Install AI local | Mistral AI | Page 1

split pilot Jan 25, 2024, 10:10 PM

#

Hello, I understood that it was possible to install ai to run it on my pc, I would like to know if my pc is able to run it, and if so do you have a tuto to install it?

abstract mesa Jan 25, 2024, 10:11 PM

#

the 4070 has 8g vram ?

split pilot Jan 25, 2024, 10:15 PM

#

abstract mesa the 4070 has 8g vram ?

12G if I'm not mistaken

abstract mesa Jan 25, 2024, 10:21 PM

#

thats good enough to run a 7b model in 4-5 bit quants yes

#

you wont be able to run the 8x7b tho

#

as the minimum would be 24gb vram

#

you can run "some" models

#

but not the more powerfull ones

split pilot Jan 25, 2024, 10:38 PM

#

Ok

#

do you have tuto for install it ?

abstract mesa Jan 25, 2024, 11:02 PM

#

just google around

#

install oobabooga webui .. and thats a solid start you find it on github .. rest is on youtube

#Install AI local