help-forum
Issues with the new update
LLaMA
Windows
I need helpI don't know a solution to a problem
cant load a model
Windows
Ooobabooga & Twinny
STT under textgens API?
How the hell am I getting CUDA_OUT_OF_MEMORY 'ed when I'm running a 70B (Senku-70B) on an A100?
Linux
Setup
Could not create share link. Missing file: frpc_linux_amd64_v0.2
Gradio
Im new to OoogaBooga and LLM's please bare with me: How do i run GGUF models?
Linux
Help finding a file from ooba
Windows
Installed the WebUi and it is not working . RuntimeError: CUDA error: no kernel image is available
Trying to run Dolphin 2.7 through Oogabooga on Windows, cannot get past "current device_map" error
Windows
Long_term_memory extension giving me long term brain dmg
Windows
Import error
"only one usage of each socket address is normally permitted"
Gradio
Windows
Best way to stop it talk so much garbage back?
Can't load any EXL2 models after latest update
Windows
Can't load AWQ model after latest update
Git hub Error
how to fix this? i just beginner i do this for a while but the chat still error
Could consuming a lot of vram cause repetition and poor understanding of the situation with exl2?
API -----Parameters: greeting
noob question, ran out of tokens. What do I do? How do you get more tokens or how do you avoid that?
Total sequence length exceeds cache size in model
LLaMA
Windows
Which loaders can use a combination of ram and vram? Is it only GGUF?
SillyTavern with notstoic/pygmalion-13b-4bit-128g with OogaBooga
Effective easy way to installing extension requirements?
Setup
Windows
Issue installing Coqui_TTS Extention
Windows
Need help Delploying ooba
Gradio
Setup
Hardware
Windows
Cuda error: no kernel image available
Setup
Windows
I can't connect to ST (Models endpoint is offline)
Gradio
Setup
Windows
LLM file types and performance
Linux
Prompts & Characters
Hardware
AMD
How does max_tokens affect the AI response through the API ?
Linux
Prompts & Characters
3060+4060 = add the VRAM?
Linux
Hardware
Subbing ooba api for OpenAI api in langchain quickstart returns 404
oobabooga wont load the model
Error while trying to chat
Prompts & Characters
Windows
Downloading multiple GGUF files in repo in .zip format to get around 50 gb limit, not working.
Windows
LLM Bypass Legal Blockers
Windows
Where is repeat_penalty_range?
RuntimeError: probability tensor contains either `inf`, `nan` or element < 0
Connection errors out with no log output whenever I compute text.
Linux
AMD
Ordered list or numbered list issue - formatting
Requesting Default Chat template & Instruction Template
I need help
Hardware
Setup
Windows
How to make madlad work?
Prompts & Characters
PDF/doc summarization and best extension for it
do Mixtral GGUF's run out of the box?
Illegal seek issue
Linux
Novie question
ExLLaMa
LLaMA
Windows