Ollama: Difference between revisions

Usage via web API: Add hint for Open-WebUI
Readf0x (talk | contribs)
m Changed description of AMD GPU support to better reflect actual state of ROCm support.
Line 13: Line 13:
Its possible to use following values for acceleration:
Its possible to use following values for acceleration:
* false: disable GPU, only use CPU
* false: disable GPU, only use CPU
* "rocm": supported by most modern AMD GPUs
* "rocm": supported by select AMD GPUs (See [https://rocm.docs.amd.com/projects/install-on-linux/en/latest/reference/system-requirements.html ROCm support matrix])
* "cuda": supported by most modern NVIDIA GPUs
* "cuda": supported by most modern NVIDIA GPUs