#Is streaming audio to the HAVPE supported?

1 messages · Page 1 of 1 (latest)

sweet imp
#

I am doing a standalone version of the components/esphome/assist_satellite.py component in order to learn how the HAVPE works.

I have managed to get a complete pipeline to work (wakeword -> tts) with the default mode of passing a audio url to the VOICE_ASSISTANT_TTS_START event and the HAVPE plays the sound correctly.

However, when I try to stream audio instead (i.e. VOICE_ASSISTANT_TTS_STREAM_START) I can't get it to work. I added some extra debugging to voice_assistant.cpp and noticed that it doesnt enter the "if (this->speaker_ != nullptr)" if clause, meaning the speaker doesnt seem to be available.

Is this intended, i.e. is streaming not supported yet?

timid chasm
#

you can stream audio to them, but it is through the media_player component

#

unless you are referring specifically to tts, not sure if that goes through a separate avenue

past hound
#

afaik, the assist_satellite is only used for... well... Assist stuff. streaming media does not fit the bill
obviously, it all depends on your code, but you should use media_player.play_media for that purpose

sweet imp
#

what i mean is to stream tts audio instead of providing a url to a wav file, the purpose would be to reduce latency until you hear sound, since e.g. elevenlabs support streaming.

the reason i thought it would work was because there is a function in the esphome/assist_satellite.py file.

past hound
#

ah, now i understand, but i lack the know-how to help. sorry