#help with local documents

6 messages · Page 1 of 1 (latest)

finite vale
#

How to make the model answer only from data available in local documents ? I loaded my csv files as local collection but model keep getting wired answers from his trained data #localdocs #1207791894516605000

silver zealotBOT
#

Hi @finite vale. I'm kapa.ai, your friendly support bot. I will try to answer your question by searching through the knowledge base. :wave:

#

To make your model answer from data available in local documents, you need to use the LocalDocs feature of GPT4All. Here's how you can enable LocalDocs:

  1. Install the latest version of GPT4All Chat from GPT4All Website (https://gpt4all.io).
  2. Go to Settings > LocalDocs tab.
  3. Download the SBert model.
  4. Configure a collection (folder) on your computer that contains the files your LLM should have access to. You can alter the contents of the folder/directory at any time. As you add more files to your collection, your LLM will dynamically be able to access them.
  5. Spin up a chat session with any LLM (including external ones like ChatGPT but warning data will leave your machine!)
  6. At the top right, click the database icon and select which collection you want your LLM to know about during your chat session.
  7. You can begin searching with your localdocs even before the collection has completed indexing, but note the search will not include those parts of the collection yet to be indexed. source (https://docs.gpt4all.io/gpt4all_chat.html#plugins)

However, please note that LocalDocs currently supports plain text files (.txt, .md, and .rst) and PDF files (.pdf). source (https://docs.gpt4all.io/gpt4all_chat.html#how-localdocs-works) It seems that CSV files are not supported at the moment.

Also, it's important to understand that LocalDocs can query your documents based upon your prompt/question and provide context for an answer. However, it cannot answer general metadata queries or summarize a single document. source (https://docs.gpt4all.io/gpt4all_chat.html#localdocs-capabilities)

#

If you're experiencing issues with the API not using LocalDocs, it seems to be a known issue as per this Github issue (https://github.com/nomic-ai/gpt4all/issues/1200). You might want to follow that issue for updates or potential solutions.

Note: you can ask me a follow up question by @ mentioning me again :speech_balloon:

#

@finite vale kapa.ai is still learning and improving, please let us know how it did by reacting below

steel rose
#

How can i restrict the LLM to only using local documents?