#Hi all

1 messages · Page 1 of 1 (latest)

torn vortex
#

Might be best to support the Wyoming protocol, then it should integrate and show up automatically.

graceful verge
#

I was just about to ask a similar question since I finally had some more free time. Were you able to make any progress on a custom llm integration?

My thoughts were to use oobabooga running in a docker container to handle LLMs. Then use the oobabooga API similar to the OpenAI integration to get it all working together. The Wyoming protocol mentioned would also be a great addition.

#

Oh yeah, I guess I'm a little late to reply too 😅