Ollama: Difference between revisions
Mathtician (talk | contribs) Updated syntax for systemd service config (acceleration -> package); have not tested standalone package config |
Added a useful Hint/Warning Text after the list of available ollama packages, informing users that it may be advised to add the CUDA Substitute, so as to not compile CUDA from source. |
||
| Line 24: | Line 24: | ||
* ollama-cuda: supported by most modern NVIDIA GPUs | * ollama-cuda: supported by most modern NVIDIA GPUs | ||
* ollama-vulkan: supported by most modern GPUs on Linux | * ollama-vulkan: supported by most modern GPUs on Linux | ||
'''Note:''' When using the ollama-cuda package, you may want to add the CUDA Substitute Binary Cache, since most household Computers will not be able to compile CUDA from source. (See the [https://nixos.wiki/wiki/CUDA CUDA] Wiki Entry for more Information) | |||