making a game time over automation | Home Assistant | Page 1

bronze scroll Apr 7, 2025, 1:38 PM

#

I made this automation to tell my kids when there game time is up for the next school day. i want to have openai create random funny messages for them. i made a test scenario and it failed?

`alias: Test automation
description: ""
triggers:

trigger: state
entity_id:
- input_boolean.test
  from: "off"
  to: "on"
  conditions: []
  actions:
data:
agent_id: conversation.kids_ai
text: >-
Craft a fun message for the kids, reminding them that game time is over
and they have 10 minutes to save their progress before shutdown.
Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
Sonic.
language: en
response_variable: kids_message
action: conversation.process
delay:
seconds: 2
data:
message: "{{ kids_message.speech.plain.speech }}"
action: script.game_time_actions
mode: single`

tacit shard Apr 7, 2025, 1:41 PM

#

bronze scroll I made this automation to tell my kids when there game time is up for the next s...

what is the format of kids_message?

bronze scroll Apr 7, 2025, 1:44 PM

#

tacit shard what is the format of `kids_message`?

you mean the script its sending it too?

#

📎 message.txt

tacit shard Apr 7, 2025, 1:53 PM

#

bronze scroll you mean the script its sending it too?

no, you are using conversation.process and storing its responce in kids_message then looking for .speech.plain.speech inside that and its complaining that .speech doesnt exist so you need to look at the format of kids_message to find out what it actually needs

#

look at the part of the trace that handles the conversation.process

#

probably this one:

bronze scroll Apr 7, 2025, 2:04 PM

#

tacit shard no, you are using conversation.process and storing its responce in `kids_message...

tacit shard Apr 7, 2025, 2:08 PM

#

change this
message: "{{ kids_message.speech.plain.speech }}"
to
message: "{{ kids_message.text }}"
when calling your script

bronze scroll Apr 7, 2025, 2:14 PM

#

for both the automation and script i got: Error: Error rendering data template: UndefinedError: 'kids_message' is undefined

#

when i changed to message: "{{ kids_message.text }}"

#

`alias: Test automation
description: ""
triggers:

trigger: state
entity_id:
- input_boolean.test
  from: "off"
  to: "on"
  conditions: []
  actions:
data:
agent_id: conversation.kids_ai
text: >-
Craft a fun message for the kids, reminding them that game time is over
and they have 10 minutes to save their progress before shutdown.
Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
Sonic.
language: en
response_variable: kids_message
action: conversation.process
delay:
seconds: 2
data:
message: "{{ kids_message.text }}"
action: script.game_time_actions
mode: single`

tacit shard Apr 7, 2025, 2:17 PM

#

try kids_message.data.text

bronze scroll Apr 7, 2025, 3:21 PM

#

do i update also in my script too to match

tacit shard Apr 7, 2025, 3:24 PM

#

did you copy this from somewhere to begin with?

#

sorry you probably actually want the automation to return the entire dict
so change it to
"{{ kids_message }}"
then we can try and deal with it in the script

#

then inside the script you want to output

{{ message.text }}
becasue the data you send to the script is stored in the field message and then the variable of the dict is text

#

i have absolute no idea where .speech.plain.speech came from? copied or hallucinated i guess

bronze scroll Apr 7, 2025, 3:41 PM

#

is this correct. the original automation was created by chatgpt

tacit shard Apr 7, 2025, 3:45 PM

#

that looks right, does it work? if not where is it erroring?

#

also in future don't start with "i made this automation" if its AI generated. tell people thats its AI generated. as thats probably why it doesnt work and needs to be looked at differently

bronze scroll Apr 7, 2025, 3:59 PM

#

ok it got to the script and produce this error on the script

tacit shard Apr 7, 2025, 4:04 PM

#

data section should be:

  entities: scene.game_time_before```

bronze scroll Apr 7, 2025, 4:39 PM

#

tacit shard data section should be: ```data: entities: scene.game_time_before```

same issue

tacit shard Apr 7, 2025, 4:44 PM

#

oh wait i think it should be entity id but the action is wrong

#

target:
  entity_id: scene.game_time_before```

bronze scroll Apr 7, 2025, 4:46 PM

#

alias: Restore TV Volume and Surround Sound
action: scene.turn_on
target:
entity_id: scene.game_time_before

tacit shard Apr 7, 2025, 4:46 PM

#

yeah

bronze scroll Apr 7, 2025, 4:49 PM

#

ok it ran all the way through this tim but no announcment was made on any of my speakers?

#

📎 message.txt

tacit shard Apr 7, 2025, 4:50 PM

#

what does the trace show for the make announcement section

bronze scroll Apr 7, 2025, 4:51 PM

#

#

📎 trace_script.game_time_actions_2_2025-04-07T16_49_01.61594800_00.json

tacit shard Apr 7, 2025, 4:51 PM

#

on the step details

bronze scroll Apr 7, 2025, 4:53 PM

#

#

no announcementwas made

tacit shard Apr 7, 2025, 4:54 PM

#

yeah because the variable its trying to use is not returning anything

bronze scroll Apr 7, 2025, 4:56 PM

#

oh damnit lol

tacit shard Apr 7, 2025, 4:58 PM

#

i am starting to think it might be easier to start from scratch. this AI generated chaos is just painful to try and adapt

bronze scroll Apr 7, 2025, 5:00 PM

#

ok i will do that. just wanted to make it fun for my kids and make them laugh

tacit shard Apr 7, 2025, 5:01 PM

#

yeah i see what your trying to achive. but the AI is hulicinating stuff that does not exist

bronze scroll Apr 7, 2025, 5:03 PM

#

yeah lol how should i start?

tacit shard Apr 7, 2025, 5:09 PM

#

ok so this is a stripped down automation that should just get the responce and announce it

#

description: ""
triggers:
  - trigger: state
    entity_id:
      - input_boolean.test
    from: "off"
    to: "on"
conditions: []
actions:
  - action: conversation.process
    metadata: {}
    data:
      text: >-
        Craft a fun message for the kids, reminding them that game time is over
        and they have 10 minutes to save their progress before shutdown.
        Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
        Sonic.
    response_variable: kids_message
  - alias: Make Announcement
    action: notify.alexa_media
    data:
      message: "{{ kids_message.text }}"
      target:
        - media_player.echo_show
        - media_player.jamar_echo
        - media_player.echo_king
        - media_player.paris_echo
mode: single

#

try that and see if it works on its own without all the other adjustments

bronze scroll Apr 7, 2025, 5:20 PM

#

just asking restart or single mode?

tacit shard Apr 7, 2025, 5:21 PM

#

it probably doesnt matter but leave on single

bronze scroll Apr 7, 2025, 5:22 PM

#

nothing was announced?

tacit shard Apr 7, 2025, 5:24 PM

#

look at the conversation process section

bronze scroll Apr 7, 2025, 5:25 PM

#

#

tacit shard Apr 7, 2025, 5:28 PM

#

description: ""
triggers:
  - trigger: state
    entity_id:
      - input_boolean.test
    from: "off"
    to: "on"
conditions: []
actions:
  - action: conversation.process
    metadata: {}
    data:
      text: >-
        Craft a fun message for the kids, reminding them that game time is over
        and they have 10 minutes to save their progress before shutdown.
        Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
        Sonic.
      agent_id: conversation.kids_ai
    response_variable: kids_message
  - alias: Make Announcement
    action: notify.alexa_media
    data:
      message: "{{ kids_message.text }}"
      target:
        - media_player.echo_show
        - media_player.jamar_echo
        - media_player.echo_king
        - media_player.paris_echo
mode: single

#

i missed the agent id for your ai integration

bronze scroll Apr 7, 2025, 5:48 PM

#

#

dangit now another issue.

#

is that the open ai tokens i have to replenish?

tacit shard Apr 7, 2025, 5:50 PM

#

i dont know your openai status but we can maybe get this working to the point it at least announces the error

#

then you can sort out your openai account

#

at least now i know where paramaters from earlier came from

#

can try

#

description: ""
triggers:
  - trigger: state
    entity_id:
      - input_boolean.test
    from: "off"
    to: "on"
conditions: []
actions:
  - action: conversation.process
    metadata: {}
    data:
      text: >-
        Craft a fun message for the kids, reminding them that game time is over
        and they have 10 minutes to save their progress before shutdown.
        Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
        Sonic.
      agent_id: conversation.kids_ai
    response_variable: kids_message
  - alias: Make Announcement
    action: notify.alexa_media
    data:
      message: "{{ kids_message.speech.plain.speech }}"
      target:
        - media_player.echo_show
        - media_player.jamar_echo
        - media_player.echo_king
        - media_player.paris_echo
mode: single```

#

if we get it doing stuff and announcing the error then when you sort out openai subscription stuff it should start working

bronze scroll Apr 7, 2025, 6:02 PM

#

do i need to add a delay to give it time to process the conversation

tacit shard Apr 7, 2025, 6:03 PM

#

no its a blocking step

#

it doesnt continue until its done

bronze scroll Apr 7, 2025, 6:04 PM

#

tacit shard Apr 7, 2025, 6:06 PM

#

try adding responce in there

#

description: ""
triggers:
  - trigger: state
    entity_id:
      - input_boolean.test
    from: "off"
    to: "on"
conditions: []
actions:
  - action: conversation.process
    metadata: {}
    data:
      text: >-
        Craft a fun message for the kids, reminding them that game time is over
        and they have 10 minutes to save their progress before shutdown.
        Randomly include quotes from Invader Zim, Gumball, Teen Titans Go, and
        Sonic.
      agent_id: conversation.kids_ai
    response_variable: kids_message
  - alias: Make Announcement
    action: notify.alexa_media
    data:
      message: "{{ kids_message.response.speech.plain.speech }}"
      target:
        - media_player.echo_show
        - media_player.jamar_echo
        - media_player.echo_king
        - media_player.paris_echo
mode: single```

bronze scroll Apr 7, 2025, 6:14 PM

#

Finaly got a response. max output token my alex just said

tacit shard Apr 7, 2025, 6:15 PM

#

ok so we have that part, now we just need to add the adjustment stuff back in

bronze scroll Apr 7, 2025, 6:20 PM

#

📎 message.txt

tacit shard Apr 7, 2025, 6:21 PM

#

you totally delete everything you had before

#

i added the adjustment stuff you said was working before to the automation

#

oh whoops

#

try this one now

📎 message.txt

#

sorry had the old not working responce var in there

#

hopefully should all be combined now

#

i am not sure its entirily right but can at least test it and go from there

bronze scroll Apr 7, 2025, 6:34 PM

#

going to implement it in my current automation.

#

i have diffrent times for it to run for the reminders

tacit shard Apr 7, 2025, 6:36 PM

#

ok, well at lease you now have the 2 blocks you need to get the variable and to play the variable.
you can mess with stuff around that

bronze scroll Apr 7, 2025, 6:37 PM

#

📎 message.txt

#

change them all to this {{ kids_message.response.speech.plain.speech }}

tacit shard Apr 7, 2025, 6:39 PM

#

you need to use both the section that generates the responce and the notify section

#

on the stripped down automation. there were 2 blocks.
add your other stuff around them

bronze scroll Apr 7, 2025, 6:43 PM

#

ok once i complete the full automation ill post it here if you dont mind reviewing

tacit shard Apr 7, 2025, 6:44 PM

#

ill have a quick look if its not working, but hopefully you should be able to put the pieces together now

#

treat this as a learning exercise

bronze scroll Apr 7, 2025, 6:50 PM

#

thank you sir, really appreciate it. so all i have to do now is get some openapi tokens and rewrite my automation

#

just asking do you know exactly where i can replinsh my openapi tokens

tacit shard Apr 7, 2025, 6:56 PM

#

i have no idea, i havent ever used it. but i assume you log in and set up payment terms. its usually pay as you use i think?

bronze scroll Apr 7, 2025, 7:18 PM

#

i go it

bronze scroll Apr 7, 2025, 7:42 PM

#

@tacit shard

📎 message.txt

#

Message malformed: extra keys not allowed @ data['actions'][0]['choose'][0]['sequence'][0]['lias']

tacit shard Apr 7, 2025, 7:47 PM

#

lias: Save Current TV States

should be

alias: Save Current TV States

#making a game time over automation