Jump to content

Talk:Ollama: Difference between revisions

From Official NixOS Wiki
Cymno (talk | contribs)
Cymno (talk | contribs)
mNo edit summary
 
Line 3: Line 3:
It seems the syntax to specify acceleration type has changed. On a recent nixos rebuild I got the following error:
It seems the syntax to specify acceleration type has changed. On a recent nixos rebuild I got the following error:


The option definition `services.ollama.acceleration' no longer has any effect; please remove it. Set `services.ollama.package` to one of `pkgs.ollama[,-vulkan,-rocm,-cuda,-cpu]` instead.
''The option definition `services.ollama.acceleration' no longer has any effect; please remove it. Set `services.ollama.package` to one of `pkgs.ollama[,-vulkan,-rocm,-cuda,-cpu]` instead.''


This compiles, but I haven't tested yet whether acceleration works correctly:
This compiles, but I haven't tested yet whether acceleration works correctly:


<code>services.ollama = {     
    services.ollama = {     
    enable = true;
        enable = true;
    package = pkgs.ollama-rocm;
        package = pkgs.ollama-rocm;
};</code>
    };

Latest revision as of 21:36, 10 December 2025

slight syntax change

It seems the syntax to specify acceleration type has changed. On a recent nixos rebuild I got the following error:

The option definition `services.ollama.acceleration' no longer has any effect; please remove it. Set `services.ollama.package` to one of `pkgs.ollama[,-vulkan,-rocm,-cuda,-cpu]` instead.

This compiles, but I haven't tested yet whether acceleration works correctly:

   services.ollama = {    
       enable = true;
       package = pkgs.ollama-rocm;
   };