#Jetson AGX Orin 64GB + Custom Wake Word

1 messages · Page 1 of 1 (latest)

north gorge
#

I have been using Home Assistant, Assist Microphone, Open Wake Word, Piper, Whisper, and Ollama on my NVIDIA Jetson AGX Orin device.

It works fine if I use the default "Alexa" wake word.

However, if I use any custom wake word, it works fine the first few times. After a few sequences of questions (or a complex question), the system emits a strange sound and it stops in the conversation part. Looking at the debug inside the HomeAssistant page, it's just stuck in getting a reply from Ollama.

I thought Ollama was possibly consuming memory, so I tried the OpenAI API. After a couple of chats or queries, it's the same issue; it's stuck.

After it stucks, I can reactivate the system by restarting the container wyoming-assist-microphone.

Please note that I use dustynv containers for all, but Ollama was using integration on Home Assistant. I did the same for OpenAI.

The combination where this error happens is:
dustynv/wyoming-whisper:2.3.0-r36.4.0
dustynv/wyoming-piper:master-r36.2.0
dustynv/wyoming-openwakeword:latest-r36.2.0
dustynv/wyoming-assist-microphone:latest-r36.2.0
dustynv/homeassistant-core:2024.12.4-r36.4.0

north pollen
north gorge
#

@north pollen, I have used these containers because their native support to NVIDIA Jetson. Do you know an updated version compatible with Jetson (linux/arm64/v8)?

north pollen
#

specific whisper version that supports I can understand, i cant imagine the other stuff really needs to be special. although maybe there are some advantages. in any case changing the HA imagine itself is a place to start
should use ghcr.io/home-assistant/home-assistant:stable

north gorge
north gorge
#

@north pollen, I could update most of the containers for the ones available on rhasspy's repository:
ghcr.io/home-assistant/home-assistant:stable
rhasspy/wyoming-whisper:latest
rhasspy/wyoming-piper:latest
rhasspy/wyoming-openwakeword:latest

However, I couldn't find the update project for dustynv/wyoming-assist-microphone:latest-r36.2.0.

Should I replace this one by rhasspy/wyoming-satellite?

north pollen
#

also that whisper version may or may not support using the integrated gpu acelleration. but i am not sure

#

i would just have done 1 part at a time tbh