Official NixOS Wiki

Ollama: Difference between revisions

← Older editNewer edit →
VisualWikitext
Readf0x (talk | contribs)
2 edits
m Changed description of AMD GPU support to better reflect actual state of ROCm support.
Readf0x (talk | contribs)
2 edits
m Undo revision 19826 by Readf0x (talk)
Tag: Undo
Line 13: Line 13:
Its possible to use following values for acceleration:
Its possible to use following values for acceleration:
* false: disable GPU, only use CPU
* false: disable GPU, only use CPU
* "rocm": supported by select AMD GPUs (See [https://rocm.docs.amd.com/projects/install-on-linux/en/latest/reference/system-requirements.html ROCm support matrix])
* "rocm": supported by most modern AMD GPUs
* "cuda": supported by most modern NVIDIA GPUs
* "cuda": supported by most modern NVIDIA GPUs


Retrieved from "https://wiki.nixos.org/wiki/Ollama"