Ensure OpenAI performs actions from intent_script

[wind sleet]

I created an intent_script to allow my kids to call me using an old phone connected to a Grandstream. I use the ha-sip add-on to make these calls. However, to connect the Grandstream to my phone, they need to hang up first. So I instructed the LLM using the description field to give these instructions.
The instructions work fine, and the LLM does inform me that I need to hang up the phone and wait until it rings, however 9 out of 10 times it doesn't perform the script. That's also why I added the last line However, sometimes it does work (and sometimes it doesn't actually give the instructions in that case).

Is there any thing I can do to ensure it does give the instructions AND actually call the script?

Here's the intent_script I used

  CallDad:
    description: |
      Call dad on his phone
      Important: respond that they need to hang up the phone so the call can be made
      Important: respond that the phone will ring after they did this and after that dad will be called as well
      After explaining that then perform the actions from this script
    action:
      - alias: "Call script"
        action: script.turn_on
        target:
          entity_id: script.make_call_assist
        data:
          variables:
            to_call: !secret sip_dad
            number_calling: "sip:**622@192.168.2.100"

Also tried Google AI. It actually performs the actions, but doesn't give the instructions.

it just responds with OK

[desert rose]

Maybe it can not perform several actions (speech, script) at once?

[wind sleet]

It does work sometimes (both the response and the action). But it's not reliable

[desert rose]

That's the thing with LLM...

[bronze stag]

You might want to add a speech component to your intent, so that the LLM sees the speech reply and may utilize it:
speech: text: "{{ action_response }}"

Can replace the action response variable I have here with literal text if you don't have any data from an action to display

For instance, here's how I use it on my calendar intent, which the LLM uses to give me my upcoming calendar events:

[wind sleet]

Thanks, tried that, but with no result. Google AI still only responds with OK, and Open AI gives the right response, but doesn't perform the actions 99% of the times