snow ocean
Fixed by downloading all model files rather than the ones that gave me errors!
Hi, I've just setup the text generation webUI and downloaded both Guanaco-33b and WizardLM-7B-Uncensored as those were recommended in the localLLAMA subreddit. After fixing a bunch of other errors I'm unable to load both models. They both throw OSError: Can't load tokenizer for 'models[ModelName]'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'models[ModelName' is the correct path to a directory containing all relevant files for a LlamaTokenizer tokenizer.
What am I missing? I've downloaded the models from https://huggingface.co/timdettmers/guanaco-33b-merged and https://huggingface.co/ehartford/WizardLM-7B-V1.0-Uncensored/tree/main respectively and haven't changed any settings in the UI. I have a 4090 and apparently a 33b models should work? Let me know if that's wrong though that seems to be a separate issue..
Edit: Wait, do I need to download all files from the model rather than the .bin files and the ones it complains about are missing?
dull reef