help-forum
RWKV from ui?
[docker setup] GPU works but its not used
serialized input error after fresh install
Oogabooga Arguments
Gradio
Setup
Windows
Pyg7b - Can't determine model type from model name.
Gradio
LLaMA
Hardware
Windows
StableLM Guide?
StableVicuna-13B Guide?
"IndexError: index 32 is out of range" and "RuntimeError: Error(s) in loading state_dict for Llama"
Gradio
Windows
Some Cuda; Bitsandbytes and PyTorch errors when installing the webui.
Windows
Text-generation-webui with ROCM
Linux
Hardware
AMD
Can't start with monkey_patch enabled
Setup
Windows
Gradio leaves Port in Use on Restart or Terminate
I have 8 A100 GPUs...is there a guide to training a non lora model and inferencing with lora after?
how to setup GPTQ-for-LLaMa one click installer?
Setup
LLaMA
Windows
FileNotFoundError: [Errno 2] No such file or directory, with MetaIX_GPT4-X-Alpaca-30B-4bit
Linux
LLaMA
Problem with TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g
This extension for Discord bot is not working for me
Massive slowdown with longer conversations well past token limit.
Windows
can someone help me train a model?
Ooobabooga refusing to run on3060
new gptq-for-llama update is slow?
Setup
LLaMA
Windows
https://github.com/haotian-liu/LLaVA
training pythia 410M
Windows
problem with the output
Prompts & Characters
LLaMA
Windows
critical libmamba error
Setup
Windows
llama to vicuna install, what could possibly go wrong?
Linux
Setup
LLaMA
Loading the Example.yaml doesn't work
Prompts & Characters
Windows
Trying to get 30b 4bit running on 4090
Linux
Trouble getting Text Generation WebUI to work for the first time
Cuda model no longer working
Setup
Windows
Ways to increase token/second?
Windows
[SOLVED] Could not find the quantized model in .pt or .safetensors format, exiting...
Linux
llama-7b-4bit quickly turns to programming discussion
Prompts & Characters
LLaMA
Windows
CPU Allocator: Not Enough Memory
LLaMA
Some models generating gibberish
How do I get Vicuna to work on this?
GPT4 x Alpaca: torch.cuda.OutOfMemoryError: CUDA out of memory.
Windows
declare-lab/flan-alpaca
Text only generates at full speed when in a different tab
Gradio
LLaMA
Windows
anon8231489123_gpt4-x-alpaca-13b-native-4bit-128g
Telsa K80 help
OSError: models/pygmalion-6b_sharded is not a local folder
Setup
Windows
TavernAI: (ForbiddenError: invalid csrf token)
Windows
adding extensions / augmenting character context
Gradio
Prompts & Characters
Training your own LoRa
How would one use the training tab?
How to run gpt-4chan? TypeError: expected str, bytes or os.PathLike object, not NoneType
settings.json
How does the API work?
Error in screenshot. (Solved.)
Setup
LLaMA
Windows