help-forum
"/v1/models" API Endpoint no longer returning all models after update
Traceback Error when loading model
Setup
Windows
Out of memory when loading model
Windows
Min-p preset broke down after the the update
Windows
Lora Training and Datasets
Linux
Using API (SillyTavern) with identical settings to OobaBooga webUI creates identical gens in API
Linux
LLaMA
Can not install oobabooga on ubuntu 22.04
Linux
Setup
why latest webui (checkpoint 28 - 1 - 2024) have slower t/s compare to the previous from october??
Web interface not rendering properly.
How can I train a model using a hosted GPU?
Linux
Setup
How can i send a prompt via api to change character persona?
Prompts & Characters
I got this error when I try to run exllamav2 loader.
Perfomance lost in multiGPU CUDA
Hardware
Help with the API extension
Setup
I installed the latest snapshot from scratch, but my chat quality is garbage.
Setup
Prompts & Characters
Windows
how could chatml template be broken for one model but not another?
How to regenerate or continue generation with API
Prompts & Characters
Windows
Memory sliders are ignored when loading Mistral-Instruct-0.2-AWQ
Sillytavern works, but doesn't stream
CPU models only download a few kilobytes
Weird context length issue
Windows
What is the quickest way to determine version/revision that is currently installed on my linux box?
API Issue
Silly tavern Api issue
Linux
ngrok slow generation
q_weight and gptq_qzeros have incompatible shapes
AMD/CPU/NVIDIA - Trying to Run 1 but not the other
Setup
Windows
Cannot Load Any Large Model
Can't load any model, due to Exceptions
Setup
Windows
Loading model on multiple GPUs
Network Error While Loading Large Model
help
Model loading error.
Setup
Windows
Api URL not working anymore
Setup
Windows
Localhost Error
Setup
Error load_model_wrapper, load_model and llamacpp_loader, index out of range
TextGenUi not using GPU
Hardware
Windows
Setting up OpenAI compatible API with mistral model
Starting only the Openai Server without having to go through the UI process.
Performance deteriorates with longer chat
Stop AI from writing actions and dialogue for the user
Windows
long term memory
Loading saved instruction templates works but causes UI error
Mixtral LLMs
How to make model directory compatible with LM Studio?
Setup
Windows
RuntimeError: No HIP GPUs are available
Linux
Setup
AMD
My WebUI is supper slow and takes forever to respond, Please Help D:
ROCm LoRA Training
Linux
LLaMA
AMD
Noob looking for help on Ooba/RunPod
Setup
elevenlabs extension
Windows