missing "load model" button | Text Generation WebUI | Page 1

quasi sphinx May 30, 2023, 11:54 AM

#

#

I'm trying to load stable vicuna or another model but I dont see a load button on my version of the UI?

#

Is there a way to force it to load a model

#

I'm very new at using the UI so I'm really confused about how loading new models works

#

Do I unload the model then the unload buttons turns into a load button?

tawdry talon May 30, 2023, 1:22 PM

#

It looks like you have a 4 bit model there - try setting all the 128 group size, 4 wbit, and llama then hitting reload

#

And if you haven't you need to install 4 bit code separate

quasi sphinx May 30, 2023, 3:11 PM

#

Alright

#

My other main issue is how slow the UI is

#

I'm using it over google docs and I'm wondering if it's my wifi or something else that's the issue

tawdry talon May 30, 2023, 3:37 PM

#

I would start a new thread for that one, but I'm guessing the fact you're running it on Google docs would be the problem.

quasi sphinx May 30, 2023, 5:14 PM

#

Probably yeah

#

I'm guessing it's my wifi because with others it works

#

I'll see
It's just the UI
The AI works fine with the API

#missing "load model" button