slow token
A chat interface based on llama.cpp for running Alpaca models. Entirely self-hosted, no API keys needed.
Repo link: https://github.com/nsarrazin/serge
Template link: https://runpod.io/gsc?template=6if3vnhf02&ref=vfker49t
Note: This template logs might be bugged though if you CPU is 1% and up it should start fine.
Supported models:
floral patrol
will there be support for adding models manually via jupyter?
slow token
It's not mine project 🙂
floral patrol
alright but how did you get alpaca on it as shown in the screenshots