Custom sentence for playback on sonos speaker | Home Assistant | Page 1

ashen flint Feb 14, 2024, 8:03 PM

#

Yes, please, share some code

granite root Feb 15, 2024, 1:10 PM

#

Sorry missed your message, can i upload here more than 15 lines or do i use pastebin?

distant muralBOT Feb 15, 2024, 1:11 PM

#

Please use a code share site to share code or logs, for example:

https://dpaste.org/ (select YAML for the language, and consider picking a longer expiry)
http://pastie.org/ (select YAML for the language)
https://paste.debian.net/ (you guessed it, select YAML as the language)

Please don't use Pastebin, since it can randomly add spaces to the main view. Please also don't share text as images since it makes it harder for people to help you. Remember that others may have colour blindness, impaired vision, etc.

granite root Feb 15, 2024, 1:13 PM

#

intent_script: https://paste.ubuntu.com/p/n4Hj4HcYZt/

#

custom_sentence: https://paste.ubuntu.com/p/Wp2j3wpVRC/

#

Like i said, the problem is that it takes a few seconds before the source is showing as media_title attr.

#

Ow just see that message 'Please don't use Pastebin" 😄

#

Anyway i know the code is working.

ashen flint Feb 15, 2024, 1:19 PM

#

so source is going into state_attr(media_player, 'media_title') and it takes a while, right?

granite root Feb 15, 2024, 1:19 PM

#

Yes correct

ashen flint Feb 15, 2024, 1:19 PM

#

ok. are you aware you could use {{ slots.source }} in the response? if so, is there any reason you avoid it?

#

it would be populated with exactly what you said in the triggering sentence

granite root Feb 15, 2024, 1:20 PM

#

Well...

#

I read allot about slots.source (i mean using slots...) but i have no idea what it is

#

I'm not a code engineer so 🙂

ashen flint Feb 15, 2024, 1:22 PM

#

a "slot" is a placeholder that was used to trigger the Assist pipeline. it could either be explicitly used in a sentence (e.g. turn on {name} where name is the slot automatically provided by HA or source in your example, where source is a text value slot)

#

you can access slots in reponses with the slots dictionary, which contains all slots. in your case, you should output slots.source

#

however, i think i recall there was a bug or missing feature with the response being provided in the intent_script. if that produces an error, then let me know and i can give you an alternative solution that works

granite root Feb 15, 2024, 1:24 PM

#

Give me a second i going to test it right away.

ashen flint Feb 15, 2024, 1:24 PM

#

also, if you use slots.source in the reponse, you no longer need the delay, as the value is available immediately

granite root Feb 15, 2024, 1:24 PM

#

Yes going to remove the wait trigger and change the state_attr(media_player, 'media_title') with {{ slots.source }}.

ashen flint Feb 15, 2024, 1:26 PM

#

that's a delay action, not a "wait trigger". a "wait trigger" actually exists and is something else

granite root Feb 15, 2024, 1:26 PM

#

Yeah sorry that's what i mean 🙂

#

I have a little knowledge after using home assistant for a few years but it's just hard time making all the code, automations etc without any coding knowledge...

#

It outputs sorry something went wrong

#

But assist is still working and plays the source

#

      text: |-
        "OK, {{ slots.source }} wordt afgespeeld in {{ state_attr(media_player, 'friendly_name') }}"```

#

I think this is OK?

ashen flint Feb 15, 2024, 1:31 PM

#

if it said something went wrong, there should be an error in the HA core logs. What is it?

#

the response seems ok, yes

granite root Feb 15, 2024, 1:32 PM

#

Logger: homeassistant.helpers.template
Source: helpers/template.py:2345
First occurred: 14:27:49 (2 occurrences)
Last logged: 14:29:06

Template variable error: 'slots' is undefined when rendering '"OK, {{ slots.source }} wordt afgespeeld in {{ state_attr(media_player, 'friendly_name') }}"'

ashen flint Feb 15, 2024, 1:32 PM

#

but like i said, i can't remember if you can use slots in the intent_script response

#

oh, there it is

granite root Feb 15, 2024, 1:33 PM

#

slots is undefined, no idea why 🙂

ashen flint Feb 15, 2024, 1:33 PM

#

in that case, remove everything under the speech part in the intent script and add this to your custom sentence file, just above lists::

#

wait

#

replace {{ slots.source }} with {{ source }} and try again please

granite root Feb 15, 2024, 1:35 PM

#

Without the brackets?

ashen flint Feb 15, 2024, 1:35 PM

#

with them, i've edited the reply

granite root Feb 15, 2024, 1:35 PM

#

Oh okay just a second.

ashen flint Feb 15, 2024, 1:36 PM

#

don't forget to reload intent_script from dev tools https://my.home-assistant.io/redirect/server_controls/

granite root Feb 15, 2024, 1:36 PM

#

yep done that and it works, but...

#

Now it says "OK, FV:2/61 wordt afgespeeld in Badkamer"

#

They removed the source_list from the sonos entities and replaced it with a sensor that holds the sources

#

and now it outputs that 🙂

ashen flint Feb 15, 2024, 1:38 PM

#

right. that makes sense, though. that's what the intent_script gets, the value, not the spoken text

#

what you've defined in the out: part of your list

#

i'm guessing that's not acceptable, right?

granite root Feb 15, 2024, 1:39 PM

#

Yeah it don't make sense to me because i don't know all these codes for every radiostation 🙂

ashen flint Feb 15, 2024, 1:39 PM

#

remove everything under the speech: part in the intent_script and add this to your custom sentence file, just above lists::

responses:
  intents:
    HassGetState:
      default: "OK, {{ slots.source }} wordt afgespeeld in {{ state_attr(slots.media_player, 'friendly_name') }}"

#

then reload intent_script and conversation from dev tools

granite root Feb 15, 2024, 1:40 PM

#

do i keep the speech: part itself?

ashen flint Feb 15, 2024, 1:40 PM

#

nope

granite root Feb 15, 2024, 1:40 PM

#

OK wait i going to show you if it is correct what i do

ashen flint Feb 15, 2024, 1:40 PM

#

ashen flint remove everything under the `speech:` part in the `intent_script` and add this t...

that probably won't work because you won't get the value for media_player. 🤔

granite root Feb 15, 2024, 1:41 PM

#

I can try? 🙂

#

so like this?

#

responses:
  intents:
    HassGetState:
      default: "OK, {{ slots.source }} wordt afgespeeld in {{ state_attr(slots.media_player, 'friendly_name') }}"
intents:
  SonosSource:
    data:
      - sentences:
          - "(zet|wijzig|speel) [radio|sonos] [op] {source} [af|op|naar] [in] [de] {media_player}"
          - "(zet|wijzig|speel) [radio|sonos] {media_player} op {source}"

ashen flint Feb 15, 2024, 1:44 PM

#

you can try, but i don't think it will work. replace {{ state_attr(slots.media_player, 'friendly_name') }} with {{ slots.media_player }} and it will work, although it will not do what you want

#

i'm looking for a solution in the meantime

granite root Feb 15, 2024, 1:45 PM

#

Going to test, but the place i added it is OK?

ashen flint Feb 15, 2024, 1:45 PM

#

yeah, it's fine

granite root Feb 15, 2024, 1:45 PM

#

ok

ashen flint Feb 15, 2024, 1:45 PM

#

spacing was the most important, as it always is in YAML

granite root Feb 15, 2024, 1:47 PM

#

Now it just stays on the 3 dots response

ashen flint Feb 15, 2024, 1:49 PM

#

yeah, you can't get both the media_player entity ID (the out of a text list value) and the spoken source (the in of a text list value) in the same response, unfortunately

ashen flint Feb 15, 2024, 1:49 PM

#

granite root Now it just stays on the 3 dots response

i don't know why or where. are you testing via text?

granite root Feb 15, 2024, 1:49 PM

#

yes

#

Just true the Assist icon

ashen flint Feb 15, 2024, 1:49 PM

#

ok. have you reloaded conversation?

granite root Feb 15, 2024, 1:50 PM

#

I always reload all yaml config?

ashen flint Feb 15, 2024, 1:51 PM

#

ok, that's good

#

can you also test your sentence here? https://my.home-assistant.io/redirect/developer_assist/

#

and paste the output

granite root Feb 15, 2024, 1:54 PM

#

This is what i get with my original code with the delay action

#

  name: SonosSource
slots:
  source: joe
  media_player: badkamer
details:
  source:
    name: source
    value: FV:2/61
    text: joe
  media_player:
    name: media_player
    value: media_player.badkamer
    text: badkamer
targets: {}
match: true
sentence_template: >-
  (zet|wijzig|speel) [radio|sonos] [op] {source} [af|op|naar] [in] [de]
  {media_player}
unmatched_slots: {}
source: custom
file: nl/sonos_source.yaml```

ashen flint Feb 15, 2024, 1:56 PM

#

you haven't updated the sentence or list, so that's still relevant

#

but why have you switched back?

granite root Feb 15, 2024, 1:57 PM

#

I was just checking what it outputs

#

just a second i'm to test it with your solution 🙂

ashen flint Feb 15, 2024, 1:59 PM

#

it should be the exact same

granite root Feb 15, 2024, 2:00 PM

#

I think i made a mistake with the code you provided 🙂

#

going to test it again

#

This is with your code

#

  name: SonosSource
slots:
  source: joe
  media_player: badkamer
details:
  source:
    name: source
    value: FV:2/61
    text: joe
  media_player:
    name: media_player
    value: media_player.badkamer
    text: badkamer
targets: {}
match: true
sentence_template: >-
  (zet|wijzig|speel) [radio|sonos] [op] {source} [af|op|naar] [in] [de]
  {media_player}
unmatched_slots: {}
source: custom
file: nl/sonos_source.yaml```

ashen flint Feb 15, 2024, 2:02 PM

#

the same, as expected

#

only it works and doesn't time out

granite root Feb 15, 2024, 2:02 PM

#

it still outputs the 3 dots

#

in the normal assist...

ashen flint Feb 15, 2024, 2:03 PM

#

one last test: https://my.home-assistant.io/redirect/voice_assistants/ > {your pipeline} > dotsvertical > Debug

#

then paste the RAW output (full) here

granite root Feb 15, 2024, 2:04 PM

#

run:
  pipeline: 01gzjghmyggfh2sbs0mzqkp3wg
  language: nl
  runner_data:
    stt_binary_handler_id: null
    timeout: 300
events:
  - type: run-start
    data:
      pipeline: 01gzjghmyggfh2sbs0mzqkp3wg
      language: nl
      runner_data:
        stt_binary_handler_id: null
        timeout: 300
    timestamp: "2024-02-15T14:00:35.324153+00:00"
  - type: intent-start
    data:
      engine: homeassistant
      language: nl
      intent_input: zet joe op in badkamer
      conversation_id: null
      device_id: null
    timestamp: "2024-02-15T14:00:35.324380+00:00"
  - type: intent-end
    data:
      intent_output:
        response:
          speech: {}
          card: {}
          language: nl
          response_type: action_done
          data:
            targets: []
            success: []
            failed: []
        conversation_id: null
    timestamp: "2024-02-15T14:00:42.800591+00:00"
  - type: run-end
    data: null
    timestamp: "2024-02-15T14:00:42.800732+00:00"
intent:
  engine: homeassistant
  language: nl
  intent_input: zet joe op in badkamer
  conversation_id: null
  device_id: null
  done: true
  intent_output:
    response:
      speech: {}
      card: {}
      language: nl
      response_type: action_done
      data:
        targets: []
        success: []
        failed: []
    conversation_id: null```

ashen flint Feb 15, 2024, 2:06 PM

#

ah! or course...

#

the sentence(s) you defined do not specify what response to offer. add the following line after everything here #1207346883073413120 message
the spacing is important

        response: default

granite root Feb 15, 2024, 2:09 PM

#

So like this?

#

responses:
  intents:
    HassGetState:
      default: "OK, {{ slots.source }} wordt afgespeeld in {{ state_attr(slots.media_player, 'friendly_name') }}"
intents:
  SonosSource:
    data:
      - sentences:
          - "(zet|wijzig|speel) [radio|sonos] [op] {source} [af|op|naar] [in] [de] {media_player}"
          - "(zet|wijzig|speel) [radio|sonos] {media_player} op {source}"
response: default```

ashen flint Feb 15, 2024, 2:11 PM

#

no, with the spaces, so that response is at the same level as sentences

granite root Feb 15, 2024, 2:11 PM

#

Ah ok

#

responses:
  intents:
    HassGetState:
      default: "OK, {{ slots.source }} wordt afgespeeld in {{ slots.media_player }}"
intents:
  SonosSource:
    data:
      - sentences:
          - "(zet|wijzig|speel) [radio|sonos] [op] {source} [af|op|naar] [in] [de] {media_player}"
          - "(zet|wijzig|speel) [radio|sonos] {media_player} op {source}"
        response: default```

#

Still got no response and only the 3 dots?

#

The intent_script looks like this

#

  SonosSource:
    action:
      - service: "media_player.play_media"
        target:
          entity_id: "{{ media_player }}"
        data:
          media_content_type: "favorite_item_id"
          media_content_id: "{{ source }}"```

ashen flint Feb 15, 2024, 2:55 PM

#

granite root Still got no response and only the 3 dots?

in the debug tool?

granite root Feb 15, 2024, 3:01 PM

#

No it the normal Assist window

ashen flint Feb 15, 2024, 3:03 PM

#

anything appearing in the HA logs as a consequence?

granite root Feb 15, 2024, 3:07 PM

#

No strange thing is that it dont outputs a warning?

ashen flint Feb 15, 2024, 3:11 PM

#

🤷‍♂️ i'm out of ideas. have you tried turning it off and on again? 😅

granite root Feb 15, 2024, 3:12 PM

#

🤣

#

Anyway thanks allot for your time and support, learned some things i can maybe use in other cases. 🙂

#

Anyway the code i shared seems OK to you?

#

I mean the two latest blocks i shared.

ashen flint Feb 15, 2024, 3:15 PM

#

yes

granite root Feb 15, 2024, 5:45 PM

#

You still there? 🙂

#

This one works perfect for my Apple TV sources?

#

    action:
      - service: "media_player.select_source"
        target:
          entity_id: "{{ media_player }}"
        data:
          source: "{{ source }}"
    speech:
      text: |-
        "OK, {{ source }} wordt afgespeeld op {{ state_attr(media_player, 'friendly_name') }}"```

#

so is it possible to do something like {{ source.out }}?

granite root Feb 15, 2024, 6:31 PM

#

Tested allot of different things but nothing seems to work

#

Ok think I found a solution to use {{ source }}. 🙂

ashen flint Feb 15, 2024, 6:51 PM

#

granite root so is it possible to do something like {{ source.out }}?

The out value is available by default in intent scripts

#

Check out what your issue was initially

ashen flint Feb 15, 2024, 6:52 PM

#

granite root Now it says "OK, FV:2/61 wordt afgespeeld in Badkamer"

This is what i mean

granite root Feb 15, 2024, 7:00 PM

#

Ok fixed it

#

For some weird reason the sensor.favorites also can be used with service: media_player.select_source

#

So i changed the action and now it works fine with {{ source }}.

#

I tested changing {{ state_attr(media_player, 'friendly_name') }} with {{ slots.name) }} or {{ slots.media_player) }} but name returns the entity and media_player returns nothing

#

So it seems i have to keep {{ state_attr(media_player, 'friendly_name') }}

ashen flint Feb 15, 2024, 7:19 PM

#

That works for intent script responses with speech, yes

granite root Feb 15, 2024, 7:26 PM

#

So I can’t replace it with slots.name?

#

Not that it’s a big deal but it makes the code a bit cleaner.

ashen flint Feb 15, 2024, 7:56 PM

#

It's not yet supported. I want it to be, if you are asking my opinion 😋

granite root Feb 15, 2024, 8:39 PM

#

Well seems very reasonable for me also to add this. 😉

#

One last question. Don’t know if you familiar with Siri Shortcuts? Is there any change to output the speech to a shortcut. Will be good to also have the response wen I’m using the Voice Assist Siri Shortcut.

#Custom sentence for playback on sonos speaker