#in my conversation ai the rag is call every message, it is normal or i can setup it to call the rag
1 messages · Page 1 of 1 (latest)
It is possible to configure your conversational AI to call the RAG (Retrieval-Augmented Generation) tool only during critical queries instead of every message. This setup can help optimize performance and reduce unnecessary tool calls.
To achieve this, you can adjust the system prompt to specify when the RAG tool should be used. For example, you can instruct the agent to call the RAG tool only when it encounters specific types of queries or when additional information is required. Here's an example of a revised system prompt:
"For every conversation, use the ConceptLM tool to retrieve relevant user-specific data from the library only when the query requires additional information or context that is not readily available. Always call the ‘retrieve_info’ action with the Library_id: [Your Library ID], and use the retrieved information to guide your response."
This approach ensures the RAG tool is triggered only when necessary, improving efficiency and maintaining a smoother conversational flow.
Let me know if you need further assistance with adjusting the system prompt or testing this setup!
even if i add this i have the same problem
I don’t have enough information to address your specific issue. Could you clarify what you mean by "rag" and provide more details about your setup or the feature you're using? For example, are you referring to a specific API, tool, or functionality?
even if i add thisFor every conversation, use the ConceptLM tool to retrieve relevant user-specific data from the library only when the query requires additional information or context that is not readily available. Always call the ‘retrieve_info’ action with the Library_id: [Your Library ID], and use the retrieved information to guide your response. i have the same problem