#can't start web UI without loading a model, Bug?

1 messages · Page 1 of 1 (latest)

marsh zodiac
#

was able to start the web UI without a model loaded in earlier versions
tried reinstalling to fix this, bug?
get this:
Error: Please specify the model you'd like to download (e.g. 'python download-model.py facebook/opt-1.3b').
bin A:\oobabooga_windows\oobabooga\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cuda117.dll
2023-07-14 21:18:43 ERROR:No models are available! Please download at least one.

adding models I get this message:

bin A:\oobabooga_windows\oobabooga\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cuda117.dll
The following models are available:

  1. facebook_opt-6.7b
  2. prajjwal1_bert-tiny
  3. TheBloke_airoboros-33b-gpt4-GPTQ

Which one do you want to load? 1-3

none
Traceback (most recent call last):
File "A:\oobabooga_windows\oobabooga\text-generation-webui\server.py", line 1145, in <module>
i = int(input()) - 1
ValueError: invalid literal for int() with base 10: 'none'

Done!
Press any key to continue . . .

this is a huge problem when the Web UI keep crashing when I try to load a model, so I have to restart it, load a model I don't what to run, to get the Web UI to start, then unload that model, try some new setting for the model that crashed, try loading the model I want, then the webUI crashes again and I get to repeat until I give up.

is this intended behavior or is this a bug?

tacit salmon
#

How long has it been since you updated the one-click-installer?
We stopped including --model-menu a fair bit ago.

marsh zodiac
#

dose running the update_windows.bat not update to the latest version? should I reinstall from a different link? what do I do to fix this?

tacit salmon
#

update_windows.bat updates the webui, but not the installer itself. Edit webui.py and change CMD_FLAGS to something like this: CMD_FLAGS = '--chat --model None'