#How can I allow voice assitants to use integration actions?

1 messages · Page 1 of 1 (latest)

topaz axle
#

From all the assitants (Google, OpenAI, Anthropic), I get something to the effect of "I am sorry, I cannot fulfill this request. The music_assistant integration is unavailable."

vague finch
#

On Music Assistant repo you may fing bunch of scripts, that will allow playback.

topaz axle
#

oh like I need to create intermediary scripts to call the music_assistant.search action etc?

#

there's no way to just expose the action itself?

grave dirge
#

Llm can only know how to perform actions with tools(scripts with descriptions on what they do and how to use them) and context (exposed entities, scripts, etc). Kinda like how you have to add apps for Google Assistant or Alexa for them to do certain things 🙂

topaz axle
#

but it seems to be able to use the built-in ones just fine (light.turn_on etc) -- is there some internal tooling to provide that?

grave dirge
#

Yeah because behind the scenes home Assistant is adding tools for those into the llm context 😉

topaz axle
#

got it thanks for the clarification!

grave dirge
#

Also depending on setup some of those commands run through the intent parser instead of llm

#

For command handling