torpid hatch
Hello, all. I'm running Extended OpenAI Conversation, and I'm trying to figure out how to pass which voice preview speaker the user is speaking through.
Ideally, I'd want something that I can put in the jinja2 system prompt that outputs Current Speaker: Living Room Voice Preview Speaker, but I can't figure it out after pouring over documentation. Thanks for any assistance.
hoary laurel
Hello, all. I'm running Extended OpenAI Conversation, and I'm trying to figure o...
What is your context? where do you want it? I mean, you want to get it in the script, that is called by that assistant? Or you basically want some single sensor in the system, that will show currently active speaker?
torpid hatch
What is your context? where do you want it? I mean, you want to get it in the sc...
I'd like to be able to inform the LLM which speaker the user is talking to it through. That way I can say "Okay Nabu, what's temperature in this room?" (or any other contextual example) and the LLM knows from which room the user is speaking to it.
hoary laurel
AFAIK it should be in the context that HA is sending to the model. At least for default integration it's there. Pipeline knows what is the device, and which area it's in.
I'm aware that Extended integration has hand-written prompt. So it's matter of this integration to provide the device area for prompt.
torpid hatch
AFAIK it should be in the context that HA is sending to the model. At least for ...
Thanks! I ended up rooting around in the addon's source code, and the device can be determined from current_device_id!
hoary laurel
Nice! So it's there, just wasn't included into the prompt!
torpid hatch
{%- for entity_id in device_entities(current_device_id) if entity_id.startswith('assist_satellite.') %}
The request is being made through speaker: {{entity_id}} located in the {{area_name(area_id(entity_id))}}.
{%- endfor %}
Which outputs: The request is being made through speaker: assist_satellite.computer_room_voice_preview_assist_satellite located in the Computer Room.
Well, the device_id is some long string of letters/numbers, but can be looked up as entities, which is what the spaghetti code above does.