#Use AMD GPU with ollama

3 messages · Page 1 of 1 (latest)

hushed obsidian
#

Computer has an AMD GPU with the amdgpu driver installed and running.

Installed ollama and tied to run it -- it was successful, but is using only the CPU.
While installing ollama, the script returned success after it installed ROCm.

What is needed to get the GPU working when running an ollama instance?

torpid pivot
#

Try running with DRI_PRIME=1.

hushed obsidian
#

Thanks! ...tried "DRI_PRIME=1 ollama run llama3.3" and it ran but the video card still appeared to not be used. What to check next?