Llamafile Rag in Javascript | AI @ Mozilla | Page 1

thorn rapids Jul 20, 2024, 4:47 AM

#

Hi, Is there any example to implement Rag using llamafile and mongodb vector store in node js ?

inner bloom Jul 20, 2024, 7:19 AM

#

I just wrote documentation for a new embedding server I've been working on, that's 10x faster than the old one. Check out https://github.com/Mozilla-Ocho/llamafile/blob/main/llamafile/server/README.md

GitHub

Distribute and run LLMs with a single file. Contribute to Mozilla-Ocho/llamafile development by creating an account on GitHub.

#

You could easily write some Python code that takes the embeddings from this server, and puts them into MongoDB.

thorn rapids Jul 20, 2024, 4:11 PM

#

Thank you so much, just wanted to check if there is any example for Node js implementation?

#

node JS implementation to invoke llamafile and pass mongodb vector store embeddings and get the text generation response?

#Llamafile Rag in Javascript