Talk:Llama-cpp

Review the AMD ROCm section

I wrote from memory, and I'm not entirely sure my knowledge is accurate. When changing the env variable, I've noticed performance changes in llama-cpp. But again, I'm not sure. Could someone verify what I wrote?

I also wonder if one should compile llama-cpp on their own machine with rocmGpuTargets ??

Thanks Woile (talk) 12:36, 19 May 2026 (UTC)