help-forum
Brand new setup, python errors
Lucid_Vision
My text generation webUI started crash often,what should I do?
Windows
possible to change model directory?
Windows
llama model not loading
LLaMA
Windows
does not load any models
How to fix it, i cant run my model
Windows
Cant load models
No reload button
Can't load any model
Unable to load models
How come I cant load this model?
Linux
Is it possible to use the UI with Openrouter?
Failed to create llama context
CUDA_LAUNCH_BLOCKING=1
[solved]Python and/or FlashAttention error?
EdgeGPT error 'replace_all' from 'modules.chat'
Llama.cpp models always giving same response since latest update
API parameters seem to not work
Llama-3.2-11B-Vision keeps writing 'assistant' at the end of each response with default character.
Linux
Prompts & Characters
The sentence_transformers module has not been found
Stuck in a neverending loop
ERROR: Wheel 'rouge-score-0.1.2-py3-none-any.whl' invalid
Setup
Windows
Cant get mradermacher/llama-3-70B-instruct-uncensored-GGUF to load
Is it possible to run the new "relfection - llama 3.1" model? (solved)
Gradio
LLaMA
Update and old release are broken. (Dev/1.14/1.13) (Solved)
Cannot use combined vram and ram if model exceeds ram only?
Fail to load model on older version.
Setup
LLaMA
Windows
torch.cuda.OutOfMemoryError: CUDA out of memory
i can't run start_windows.bat
launching server.py --model "model_name" --api not consistent
Windows
How can i run a multi-modal model lile InternVL2 in Web ui?
Ok to create a folder in /Models for GGUF files?
Failed to load xapp-gtk3-module
Linux
Loading gguf Failed
Windows
How to use text-generator-webui to generate texts? and / or finetune models?
Model loading issues.
Windows
I can't get L3-70B-Euryale-v2.1 to run
Linux
Setup
AMD
Pls help
Linux
Setup
Question
Gradio
Windows
new user, don't have access to nsfw channel
Cannot use FlashAttention2
Windows
LLM is speaking for me under a different name.
Prompts & Characters
Error when running start_linux.sh during oobabooga installation on Linux
Linux
Setup
how to go about installing loaders or fixes for it?
Setup
Windows
Notebook truncates incorrectly
Windows
Llama.cpp crashing Text Generation WebUI - Core Dumped
Linux
How do you load tokenizer?
RMS_NORM error on Arch Linux w/ AMD 6600
Linux
Setup
LLaMA
Slower inference speed at longer context specifically with Textgen WebUI
Gradio
Windows