I am trying to add functionality to my OpenAI drive voice assistant. I am not seeing a great deal of information available on both ends of the spectrum between HA integration and LLM wrapping. I did run this by o3 itself and it had suggested to use the extended OpenAI conversation agent and adding both a function for google search api and the instructions to call to that function but i am struggling to enact that and the methods its describing is..... a little counter intuitive to how the integration functions. Is there a known more straight forward method to add search to the conversation agent, in such a way that the LLM itself understands the context?
#Web Search capability
last bolt
north socket
last bolt
oh this looks like its exactly what i would need
rancid shoal
Are there any updates on this and progress? It looks like it's very limiting because the assistant loses functionality to control Home Assistant.
Perhaps I should have looked at this first.
rancid shoal
Nah, I can't get there tbh. I could use help if anyone has figured this out - feel free to ping me
Perhaps the best bet is finding a remote MCP server
lethal sphinx
I have a self written google script. And html2txt parser that allows my google ai assist to use websearch with out loosing local commands.
I will add it to https://github.com/Bram-diederik/home-assistant-LLM-scripts
