Talk:Ollama: Difference between revisions

Cymno (talk | contribs)
Cymno (talk | contribs)
mNo edit summary
 
Line 3: Line 3:
It seems the syntax to specify acceleration type has changed. On a recent nixos rebuild I got the following error:
It seems the syntax to specify acceleration type has changed. On a recent nixos rebuild I got the following error:


The option definition `services.ollama.acceleration' no longer has any effect; please remove it. Set `services.ollama.package` to one of `pkgs.ollama[,-vulkan,-rocm,-cuda,-cpu]` instead.
''The option definition `services.ollama.acceleration' no longer has any effect; please remove it. Set `services.ollama.package` to one of `pkgs.ollama[,-vulkan,-rocm,-cuda,-cpu]` instead.''


This compiles, but I haven't tested yet whether acceleration works correctly:
This compiles, but I haven't tested yet whether acceleration works correctly:


<code>services.ollama = {     
    services.ollama = {     
    enable = true;
        enable = true;
    package = pkgs.ollama-rocm;
        package = pkgs.ollama-rocm;
};</code>
    };
Return to "Ollama" page.