Hi,
The end goal is voice assistant that works when using Swedish as a language.
I've set up a voice assistant as per the instructions and when I am communicating with the voice assistant by text but when I am using faster-whisper it seems it is not as accurate and rare succeed to accutately capture the actually words.
Are anyone else seeing this issue with language that are not English? What's the best way to resolved it?
I have also tried the nabu casa voice STT service but are having the same issues. Note: I have a ollama installation for conversation agent.
#STT for Swedish
1 messages · Page 1 of 1 (latest)
Have you tried playing the recorded audio on speakers?
The issue might arise from bad microphone audio.
Otherwise, more information is probably required to be able to help..
I have not had issues, but I use custom sentences, which I found minimizing the risk of failed intents when first setting up the VA.
I have the problem, when I try to use Swedish say "slå på fönsterlampa sovrum" it rarely works, and when I look what the STT tought I said it's way way off.
But if I type in assist, it works fine.
If I use Home Assistant cloud, it works fine.
I don't know why it is like that
That's because when you don't use Cloud, you use Whisper, I guess?
What is the model you use, and where you're running Whisper at?
Yes I use whisper, and I use auto as model.
I want to be using my Assist localy and not use cloud.
Is there a beter way than whisper if I want to use it local?
Well, there are other local STT out there, but recommended one is Whisper. You need to set model for your language with decent beams. It will require good hardware to run quick. But it'll recognize speech better.
I am running my whisper as docker on a nuc. The nuc doesnt have a high load as iy is mainly used for frigate and have a coral connected to it so all video nl stuff is offloaded.
Even so I find it slow when using larger models. What hardware would be recommended for larger models? I suppose i should go for a gpu setup? Today i have 64gb ram and a i7 cpu.
Yes, you can't go really fast without GPU...
I think swedisch sst is not as far as englisch same is for dutch,
Ive ordered a jetson orin nano that hopefully will be able to run bigger models and hence be more accurate