Ollama: Difference between revisions

Revision as of 22:15, 18 July 2026 view source Librepup (talk \| contribs) 6 edits Added a useful Hint/Warning Text after the list of available ollama packages, informing users that it may be advised to add the CUDA Substitute, so as to not compile CUDA from source. Tag: Visual edit ← Older edit		Revision as of 22:21, 18 July 2026 view source Librepup (talk \| contribs) 6 edits Re-phrased CUDA notice and added external Link to CUDA Cache Site Tag: Visual edit Newer edit →
Line 25:		Line 25:
	* ollama-vulkan: supported by most modern GPUs on Linux		* ollama-vulkan: supported by most modern GPUs on Linux

	'''Note:''' When using the ollama-cuda package, you may want to add the CUDA Substitute Binary Cache, since ~~most household Computers will not be able to compile~~ CUDA from source. (See the [https://nixos.wiki/wiki/CUDA CUDA] Wiki Entry for more Information)		'''Note:''' When using the ollama-cuda package, you may want to add the [https://cache.nixos-cuda.org/ CUDA Substitute Binary Cache], since compiling CUDA from source may take a long time. (See the [https://nixos.wiki/wiki/CUDA CUDA] Wiki Entry for more Information)