[SOLVED] Where llamacpp_HF? | Text Generation WebUI | Page 1

torn wadi Apr 25, 2025, 4:14 PM

#

Hi all 👋
Long time Windows user here. Just switched to Linux. My windows version had the HuggingFace version of llama.cpp in the loader list, but my Linux version doesn't.

I git clone'd oobabooga/text-generation-webui main branch onto an external drive and ran ./start_linux.sh and set the install for NVIDIA w/ cuda.

Where is the HF version of llama.cpp?

plush flint Apr 25, 2025, 5:06 PM

#

oobabooga replaced old llama-cpp-python loader with llama.cpp server app.
new implementation doesn't have _hf loader anymore

#

You can read it here:
https://github.com/oobabooga/text-generation-webui/releases/tag/v2.8

GitHub

Release v2.8 · oobabooga/text-generation-webui

✨ Changes

New llama.cpp loader (#6846). A brand new, lightweight llama.cpp loader based on llama-server has been added, replacing llama-cpp-python. With that:

New sampling parameters are now avai...

torn wadi Apr 25, 2025, 6:05 PM

#

[SOLVED] Where llamacpp_HF?

#[SOLVED] Where llamacpp_HF?