#Issue with "prefer handling commands locally" option

1 messages · Page 1 of 1 (latest)

near orbit
#

This is strange. I thought it might be an issue with my LLM setup with Music Assistant but, a simple question that the LLM should handle highlights the problem.

Summary:

  • My OpenAI LLM is working fine. I can play music in MA, turn lights on etc.
  • If I enable the option "prefer handling commands locally" I expect lights to be handled by HA and music to be played by the LLM (if I have no sentences to handle them in HA).

Issue:
With handle locally DISABLED my LLM correctly reports who Barack Obama is (see attachment).
If I ENABLE handle locally and ask the same question, it seems like HA doesn't defer to OpenAI and responds with "Not any"

Anyone know what is happening??

image.png image.png
trim citrus
#

There is an intent for the Who keyword

#

If you go to dev tools, assist tab, and type in the Who is Barack Obama question, it will show you the intent it is matching

round birch
#

basically, Barack Obama becomes a zone which doesn't exist, so nobody (="not any") is in the Barack Obama zone 😅

#

and no, there's no easy fix for that until we can target multiple entities in a single sentence

near orbit
#

ok - thanks guys for the explanation. I guess I'll just have to use the LLM for now - unless I can selectively disable some in-built intents?

tall tangle
#

Hmm. Seems like an issue with the fall through. If the query doesn't match a zone, I would expect it to fall through to the LLM like it does if there are no found entities or the like.

trim citrus
#

Yeah seems like the slot domain is wrong in the intent? it's set to person but would think it should be zone or area?

round birch
#

That slot is not an entity name/alias slot, which is why it does not fail per se during recognition. That is the issue

tall tangle
#

So Zone is basically just a wildcard?

round birch
tall tangle
#

Ah. Well, that explains it. Hah. So if it was turned into a slot and passed in from Home Assistant to Hassil, like we do for Entities and Areas, this should work as expected.

round birch
#

Right. But those intents are for the person domain. As things are, you can't target multiple entities (let alone multiple domains) in a single sentence, except as a group (e.g. "turn off the kitchen lights")

A while ago I've proposed a fix involving re-architecturing the intent recognition using filter based lists, but it's never been done. We're going off topic, though 😅

proven tinsel
#

OpenAI is garbage IMHO, DeepSeek is faster, smaller and better.

round birch
#

Yeah, absolute garbage as a whole. They'll be bankrupt in 2 days tops. Also, congrats on the very on-topic post!

lime plume