#my conversion is completely changing voices halfway through

1 messages · Page 1 of 1 (latest)

kind pantherBOT
#
AI-generated Answer for rynok827105

I'm sorry, but based on the information provided, I can't determine the cause of your issue. Could you please provide more details or context? This could include the platform or software you're using, the specific circumstances under which the issue occurs, and any error messages you might be seeing. This will help me better understand the situation

References

Title: Streaming - ElevenLabs
Path: https://elevenlabs.io/docs/api-reference/speech-to-speech-streaming

Title: Get Voices - ElevenLabs
Path: https://elevenlabs.io/docs/api-reference/get-voices

Title: Prompting - ElevenLabs
Path: https://elevenlabs.io/docs/speech-synthesis/prompting

wanton peak
#

why does my cloned voice change completely in conversion?

kind pantherBOT
#
AI-generated Answer for rynok827105

When the voice changes drastically during a conversion, it could be due to a stability issue or a problem with the voice itself. The prevalence of this issue can depend on the voice used, the dynamic range of the voice, the presence of any low rumble, and the quality of the original samples used for cloning.

If you're encountering these types of issues with longer texts, it's recommended to use the Projects feature. This feature is less prone to these issues and allows you to regenerate specific paragraphs you're unhappy with, instead of the whole text.

Remember, the AI will attempt to mimic everything it hears in the audio, including the speed of the person talking, inflections, accent and tonality, breathing pattern and strength, as well as noise and mouth clicks. If there's too much variance in these factors, it might confuse the AI, leading to more varied output between generations.

For a better clone, ensure that the voice maintains a consistent tone throughout, with a consistent performance. Also, make sure that the audio quality of the voice remains consistent across all the samples. Even if you only use a single sample, ensure that it remains consistent throughout the full sample. Feeding the AI audio that is very dynamic, meaning wide fluctuations in pitch and volume, will yield less predictable results.

If you're still facing issues, you can refer to the guide to troubleshooting and the guidelines for voice cloning provided

References

Title: Voice Cloning – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/sections/23821115950481-Voice-Cloning

Title: Why is my voice monotonous / too chaotic / doesn't sound similar etc? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416017389329-Why-is-my-voice-monotonous-too-chaotic-doesn-t-sound-similar-etc

Title: Why does my voice or accent not sound correct after cloning? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13434263477137-Why-does-my-voice-or-accent-not-sound-correct-after-cloning

Title: Why does my voice start whispering, change accent, change tone, or break? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416095176977-Why-does-my-voice-start-whispering-change-accent-change-tone-or-break

Title: Instant Voice Cloning - ElevenLabs
Path: https://elevenlabs.io/docs/voices/voice-lab/instant-voice-cloning

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

Title: Speech-to-Speech - ElevenLabs
Path: https://elevenlabs.io/docs/speech-synthesis/speech-to-speech

wanton peak
#

I converted a 13 minute clip that is nearly perfect and the second one i tried kept messing up. it changed between my cloned voice and a british voice

kind pantherBOT
#
AI-generated Answer for rynok827105

The issue you're experiencing, where the AI switches accents or even languages during a single generation, is known to occur, especially in longer conversions. This is similar to the mispronunciation issue and is something that is being worked on for future iterations.

Currently, the best way to mitigate this issue is to use a properly cloned voice with the Projects feature. If you're using a pre-made or generated voice, they are all in English and might have an English accent in other languages. This means that they may not have the proper pronunciation and might be more prone to switching languages and accent.

The best approach would be to clone a voice speaking the language you want the AI to speak with the accent you want. This will provide the most context for the AI to understand how to perform a passage and should minimize language switching.

Another important point to note is that the AI usually begins with one accent and can gradually shift over longer segments of text, which generally means text longer than a few hundred characters. Using the “Projects” feature is highly recommended to avoid many of these issues

References

Title: Voice Cloning – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/sections/23821115950481-Voice-Cloning

Title: Why does my voice or accent not sound correct after cloning? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13434263477137-Why-does-my-voice-or-accent-not-sound-correct-after-cloning

Title: Why does my voice start whispering, change accent, change tone, or break? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416095176977-Why-does-my-voice-start-whispering-change-accent-change-tone-or-break

Title: Studio - ElevenLabs
Path: https://elevenlabs.io/docs/dubbing/studio

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

wanton peak
#

im just worried if im having that problem, if i convert an entire book at once and its wrong. I have wasted so much money.

kind pantherBOT
#
AI-generated Answer for rynok827105

I understand your concern about the potential for error when converting an entire book. However, without specific details about the problem you're encountering, it's difficult for me to provide a precise solution. Could you please provide more information about the issue? This could include the format you're converting from and to, the software you're using, or any error messages you're seeing. This will help me assist you

References

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

wanton peak
#

Well i cloned a voice and got a good hour of material out of it with my first chapter but the same voice clone with the second chapter kept skipping back between a completely different voice and the clone voice i made.

kind pantherBOT
#
AI-generated Answer for rynok827105

I understand your concern. Voice inconsistencies can occur due to various factors. The quality of the voice clone can be highly dependent on the original samples used for cloning. If the samples are suboptimal, which often means not following the guidelines, you might encounter a lot of variability.

For instance, if you're using Instant Voice Cloning, you should use around 1 to 2 minutes of audio. This audio should be very consistent across all aspects such as tonality, performance, accent, quality, and so on, if you want the output to be consistent. Using more audio than that can make the AI too variable, which can cause inconsistency between generations.

For Professional Voice Cloning, we recommend at the very least 30 minutes of audio and suggest between 2 to 3 hours of audio for the best results. The audio needs to be consistent throughout for the best result.

If you're experiencing inconsistency, you might want to try cloning the voice again with different samples. Also, using the Projects feature is recommended for anything longer than a few hundred characters. It will be less prone to these issues and will also allow you to regenerate specific paragraphs you are unhappy with, not the whole text.

Remember, good consistent input equals good consistent output. So, ensure that you use high-quality samples that are very consistent to maintain consistency

References

Title: Why does my voice start whispering, change accent, change tone, or break? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416095176977-Why-does-my-voice-start-whispering-change-accent-change-tone-or-break

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

Title: Voice Cloning – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/sections/23821115950481-Voice-Cloning

Title: Overview - ElevenLabs
Path: https://elevenlabs.io/docs/troubleshooting/overview

Title: Are there any tips to get good-quality cloned voices? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416206830097-Are-there-any-tips-to-get-good-quality-cloned-voices

Title: Why is my voice monotonous / too chaotic / doesn't sound similar etc? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13416017389329-Why-is-my-voice-monotonous-too-chaotic-doesn-t-sound-similar-etc

Title: Why does my voice or accent not sound correct after cloning? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/13434263477137-Why-does-my-voice-or-accent-not-sound-correct-after-cloning

Title: My professional voice clone failed or is delayed, what can I do? – ElevenLabs
Path: https://help.elevenlabs.io/hc/en-us/articles/23821472957713-My-professional-voice-clone-failed-or-is-delayed-what-can-I-do

wanton peak
#

So i need to put more than 5 minutes in? i need like 2 hours? also, why did it work so well on my first conversion and so horribly on my second one?