help-forum
How do I get Docker MCP Tools working in Text Gen???
Downloading folders from huggingface?
Windows
Help
Model generating incoherent replies after char reaches 4096 context size
How does the file attachment mechanic work?
Need help installing - tried everything, even ChatGPT for help
Windows
What's up with max_new_tokens; Or what is stopping me from exceeding 4096 Tokens in Text-Gen Webu UI
Setup
Windows
Error when loading gguf through Llamma
LLaMA
Windows
Speaking out of turn
Prompts & Characters
How tf do I keep facing the same error when I am loading model???
Any expert here can help me with the performance issue?
Portable oobabooga doesn't apply/restart when checking extensions help
Couldn't out of context be solved by deleting old messages?
Prompts & Characters
Client doesn't show Listen Port when listening in selected and session is restarted
Windows
Unable to interact with Web UI
Linux
Setup
Classifier Free Guidance via Intel SYCL?
Linux
Dual GPU support for LLM inferencing? (Locally)
Linux
LLaMA
Hardware
Windows
Upgraded GPU from 3080 to 5080 - now model responses are borked
im trying to load some models to do some light testing but i keep getting a warning message:
modulenotfounderror: no module named "yaml"
Did anyone manage to run a Qwen3 safetensor version on Windows?
Setup
Windows
Are there anyway to change from cpu only to NVIDIA acceleration?
Windows
Error when running start.bat after updating.
Windows
Weird model settings load error
Error using ad_discordbot extention
No module named 'llama_cpp_binaries' - windows 11
LLaMA
Windows
[solved] i have installation issue. help, please
Windows
Won't detect models after running an update
Windows
[SOLVED] Where llamacpp_HF?
Linux
Setup
Failed to load model
Improving times and can't load AWQ model
Windows
refuses to generate an output
Windows
I keep getting an error when loading models
Windows
character creation
No web ui after install
Linux
Setup
AMD
Does Ooba no longer download what's needed to run models? Issues loading both AWQ & GPTQ models
Setup
Windows
Help Model Fails to Generate Output on Linux
Linux
Setup
AMD
Prompts & Characters
Seeking for Gradio update methods
Windows
can't run web-ui on a RTX5080
Hardware
Windows
failed to build the chat prompt. The input is too long for the available context length.
Hardware
Windows
Fail to load the model
ERROR: Could not find a version that satisfies the requirement
Fail with openAI API for embedding
Upgrade RAM or VRAM: Slow text generation
Windows
Privacy concerns with Gradio
Gradio
Windows
Looking for some knowledge about the languages which model uses.
Prompts & Characters
Windows
Tokenizer errors while trying to run merged Transformers model
Gradio
Model not Loading-Qwen32B
Setup
Windows
My model is very slow because my chat log is very,very long.
How to send context to Vram?
Windows