#Yo guys, open interpreter is working on cpu, but i want it to work on gpu.

6 messages · Page 1 of 1 (latest)

steep iris
#

I have Amd Radeon RX 6500M, there are no instructions on Gitthub page for Amd cards.
Any help would be helpful :)
I am on linux (arch linux)

lavish valve
#

how did you install it originally

steep iris
lavish valve
#

go to the llama-cpp-python page on installing it with gpu support

#

ROCM in your case, I dont know about it myself but I did see it is supported

#

but yeah you need the make env commands preceding it