AMD GPU: Difference between revisions
Remove 24.05 |
Information about iGPU usage of VRAM/GTT for large amounts of VRAM/GTT for LLM (source: based on a forum comment https://community.frame.work/t/igpu-vram-how-much-can-be-assigned/73081/6 of https://community.frame.work/u/lhl/summary ) |
||
| Line 10: | Line 10: | ||
== Special Configuration == | == Special Configuration == | ||
The following configurations are only required if you have a specific reason for needing them. They are not expected to be necessary for a typical desktop / gaming setup. | The following configurations are only required if you have a specific reason for needing them. They are not expected to be necessary for a typical desktop / gaming setup. | ||
=== AMD iGPU with high amount of RAM (usecase: large language models) === | |||
The iGPU uses system RAM and has no dedicated VRAM. It can use up to the full available system RAM for example for large LLM models. On many systems its possible to set the amount of VRAM in BIOS: „Auto“ or the lowest amount is enough. The driver knows, to expand with GTT. | |||
Documentation: | |||
* [https://docs.kernel.org/gpu/amdgpu/module-parameters.html amdgpu gttsize] | |||
* [https://www.kernel.org/doc/html/v4.14/gpu/drm-mm.html#the-translation-table-manager-ttm ttm pages_limit and ttm pages_pool] | |||
Example for 128GB system RAM, in this example the LLM can use 120 GB „VRAM/GTT“: | |||
<syntaxhighlight lang="nix"> | |||
boot.kernelParams = [ | |||
# The kernel module parameter gttsize is a is deprecated and will be removed in the future. | |||
options amdgpu gttsize=120000 | |||
# specified as 4KiB pages: 120 GB GTT | |||
options ttm pages_limit=31457280 | |||
# specified as 4KiB pages: 60 GB pre-allocated | |||
options ttm page_pool_size=15728640 | |||
];</syntaxhighlight> | |||
=== Enable Southern Islands (SI) and Sea Islands (CIK) support (eg. HD 7000/8000) === | === Enable Southern Islands (SI) and Sea Islands (CIK) support (eg. HD 7000/8000) === | ||