#Internet search with LLM

1 messages · Page 1 of 1 (latest)

native summit
#

I have tried both OpenAI and Google as LLMs for my voice assistant but neither of them is able to include recent internet searches in their response. That an LLM per se is not designed for that is clear to me but I thought that the newer models can consider this in their response - but I might be wrong?

And another one which might be related - queries for people are always answered with "nobody". So for example "who is Elton John" or whatever person you like, the answer is always nobody. I already tried to set all the profanity settings to "no blocking" but it doesn't make a difference.

placid island
#

newer models can consider this in their response
older and newer models alike need to be able to be given the tools to reach the internet in order to achieve what you want. That's not supported

So for example "who is Elton John" or whatever person you like, the answer is always nobody
yeah, that's a known bug due to allowing local control and clashing with these sentences. however, i can't find any actually open issue, so please add one. until it gets fixed, you can ask "who was Elton John" (yes, i am aware he's still around) or "what can you tell me about Elton John"

toxic mica
#

Also, even with that question, the LLM isn't searching the internet (at least I don't think the API ones like gpt-4o-mini do that, I think only the actual chatGPT or Gemeni apps do it, because there's sort of RAG going on and some tools they add on top). If you want that to work in home assistant I think you need to leverage something like MCP. https://www.home-assistant.io/integrations/mcp/

Home Assistant

Instructions on how to use the Model Context Protocol with Home Assistant.