#High failure rates for πŸ‡―πŸ‡΅πŸ‡¨πŸ‡³πŸ‡©πŸ‡ͺ

1 messages Β· Page 1 of 1 (latest)

steep imp
#

Well,
@elevenlabsio
is not reliable for many languages just yet, when using the multilingual v2 model.

Test

  • Test 10 phrases in 6 languages
  • Feed text in #XILabs API for genAI audio output
  • Transcribe audio output via OpenAI's #Whisper
  • Assert equality between input phrase and output phrase (they must be equal)

Here are my success rates :

πŸ‡ΊπŸ‡Έ 100%
πŸ‡ͺπŸ‡Έ 100%
πŸ‡©πŸ‡ͺ 70%
πŸ‡«πŸ‡· 80%
πŸ‡―πŸ‡΅ 10%
πŸ‡¨πŸ‡³ 10%

Thus, seriously mulling on limiting my chatbot service to πŸ‡ΊπŸ‡ΈπŸ‡ͺπŸ‡Έ.

steep imp
#

High failure rates for πŸ‡―πŸ‡΅πŸ‡¨πŸ‡³πŸ‡©πŸ‡ͺ