How much does the HA hardware affect the time between when you stop speaking a voice command and the automation firing.
I'm currently running HA on a Raspberry pi 4 and using HA voice preview. The delay is around 3-5 seconds.
It would be nice to get that down to 1 sec or less. Is that possible and if so what hardware would achieve it? (edited)
#HA Hardware and its effect on voice prompt reaction speed. (Time to Automation)
knotty bear
strong sun
How much does the HA hardware affect the time between when you stop speaking a v...
what does your voice pipeline look like? and what is taking the time?
strong sun
yeah thats the pipeline
also on the VA page if you click on the dots next to your pipeline you can bring up the debug trace
that will show how long each step takes
with HA cloud it should be pretty quick but would be good to see
knotty bear
trying to find this now. standby
knotty bear
yeah, i found the debug thing, but its empty
i asked it a question but nothing populated
strong sun
is the device your asking on definetly set to use the pipeline your looking at?
on the VPE device page
knotty bear
everything in there seems to be pretty fast
hm.. maybe its waiting ages to see if i've finished speaking before doing anything.
strong sun
you should be able to tell what stage its in by the led patterns
knotty bear
i'll do some more testing with it, now that i know about the debug trace thing
sometimes it takes quite a white, but its usually not too bad
strong sun
if "listening" it is "slow clockwise"
then it turns into 2 lights flashing for processing i think it is
then slow counter clockwise for responce
knotty bear
yeah, next time it takes a while i will note down what the lights are doing
strong sun
if you are having issues with it detecting end of speech then you can mess with the "finished speaking detection" to make it more aggressive
if you have background noise such as a tv on then it can cause issues
with it set to use online services there is also going to be the occasional slowdown for latency and whatever
knotty bear
is there any setting to require silence for a while before allowing the mic to be active. So if for example the TV is on with constant noise it just wont respond at all to anything until there is silence for 10 seconds or something. kind of an auto mic mute
strong sun
no, but if your tv is integrated you could have an automation that when the sattelite entity switches to "listening" you could mute/reduce volumee until it completes then bring it back up
i have seen people do that to great effect
knotty bear
i could automate it, just need a mic in the media room
i have my projector start/end automations auto mute/umute the HA voice just so it never triggers accidently from the movie speaking, its pretty good but still triggers maybe once or twice a week otherwise
but would be nice if it would auto unmute if projector is on but there's no sound, like im just browsing forums on the projector
strong sun
you can adjust the wake word sensitivity but yes the occasional false positive does happen
what device is outputting to the projector?
knotty bear
win10 pc
strong sun
I image there is some way of creating a sensor based upon output of audio on windows and report it that way
work something out with hass agent maybe
knotty bear
i already have a DIY esp32 doing IR transmitting from esphome, So can probaby just throw ambient noise sensor on another input of that
strong sun
yeah i am sure you could do that, but that wont tell the difference between that just people talking in the room for example
knotty bear
unmute is easy, remute if movie starts again is more tricky. Probably need to tie it into media player classic playing, then it would work perfectly
should be easy to write something to run in background and query media player classic state and forward that to HA as an event
anyway, thanks for your help.
strong sun
i think there was a MPC integration at some point but it broke and was abandoned
there is a VLC one if you were to use that
knotty bear
im sure i can wip up something quickly in delphi to get the MPC state, but will need to do some research to figure out how to send events to HA from delphi
strong sun
MQTT
knotty bear
yeah, that is probably the easiest way
strong sun
theres an MQTT library for everything
knotty bear
i just created a MQTT service last month when i got the Daiken AC automation modules.
so its already running
strong sun
there is an auto discovery thing you can add to custom devices so they pop up automagically
strong sun
you could also just make a switch helper that is "shit is playing" then switch it on/off with an api call
knotty bear
yes, mpc state is what i was thinking, playing/paused/idle
i think i can grab that from just an WinAPI message to the MPC window's status bar text
strong sun
this is one of those things, theres a millions solutions. you just gotta work out which one is best
knotty bear
yeah
strong sun
hopefully i gave you some ideas anyway
knotty bear
yes, you did. Thanks.