#Use RAG with Claude?

1 messages · Page 1 of 1 (latest)

final canopy
#

Hey all. first time user to this container but very familiar with docker and such.

I am using basically an unmodified docker compose file as well as .env file except for adding my api key for Claude which is all I pay for.

I would like to be able to upload PDF, docx, and other text docs and have claude give me a summary. is this possible without an openai api key? if so what variable do i have to set in the .env file.

i went over the docs and it looks like with only claude this is not possible, so i wanted to double check.

magic lotus
# final canopy Hey all. first time user to this container but very familiar with docker and suc...

You can’t use Claude for embedding but if you don’t want to pay OpenAI you can either use HuggingFace (free, remote) or Ollama (free, local)

See: https://www.librechat.ai/docs/configuration/rag_api

RAG API

Configure Retrieval-Augmented Generation (RAG) API for document indexing and retrieval using Langchain and FastAPI. This API integrates with LibreChat to provide context-aware responses based on user-uploaded files.

final canopy
#

awesome. i can use huggingface

#

in step 1 of the docs, can i add those variables anywhere in the .env?

image.png
magic lotus
final canopy
#

and specific permissions the token needs?

#

i added the section to the env and changed the image for rag and get this:

2025-06-26 20:35:46 error: [getUserPluginAuthValue] No plugin auth OCR_BASEURL found for user 685d824cd26df54ec67a5d57
2025-06-26 20:35:46 error: [getUserPluginAuthValue] No plugin auth OCR_API_KEY found for user 685d824cd26df54ec67a5d57
2025-06-26 20:35:46 error: Error uploading document to Mistral OCR API: An error occurred while setting up the request: No plugin auth OCR_API_KEY found for user 685d824cd26df54ec67a5d57
2025-06-26 20:35:46 error: [/files] Error processing file: Error uploading document to Mistral OCR API: An error occurred while setting up the request: No plugin auth OCR_API_KEY found for user 685d824cd26df54ec67a5d57
image.png
#

its def hitting huggingface

image.png
final canopy
#

@magic lotus any ideas?

magic lotus
final canopy
#

also, Upload for file search worked!

#

question about that (since i use this for data security) - is hugging face doing the anaylsis of the file or is it claude? i want to make sure my data stays in as few hands as possible....

magic lotus
#

For OCR mistral ain’t free but it’s very cheap

HF handles the vectorization of the files, the results are stored in your RAG vectordb

final canopy
#

So the vectorization (analysis?) is hugging face?

#

Is there a limit?

magic lotus