#Every sample/character i train in the end the outcome is always the same

1 messages · Page 1 of 1 (latest)

summer loom
#

So when i train ANYTHING it can be any voice in the end it always sounds the same no matter what , i'm using The Mangio-RVC-Fork 💻 to train my voices and it always turn out to sound like this audio right here regardless of what voice i use am i doing anything wrong?

vocal dagger
#

are you putting the dataset in the right spot?

#

it has to be the path of the folder where the dataset is

summer loom
rugged violetBOT
#

Ayo? @summer loom level 1 !!! lfg

summer loom
#

but it always gives me the same results

vocal dagger
#

I dont recommend doing that. Try putting the models you wanna make seperate from the Mangio folder

#

also what is the file types that you are using for your dataset

#

ive had a similar issue and try to not put anything i work on inside the folder

summer loom
summer loom
summer loom
#

tried to use different paths , everywhere but still no success , it only let me train if i have my samples inside of mangio

#

full message of the error

vocal dagger
#

I see the problem

#

The last file at the end of the path is a log

#

Don’t use logs

#

That’s used for the index which you have none yet

summer loom
vocal dagger
#

The logs and weights folder should only have something in it after you’ve trained a model

#

You should copy the path of the folder with your dataset in it

summer loom
rugged violetBOT
#

Ayo? @summer loom level 2 !!! lfg

vocal dagger
#

Are you able to join a vc so I can show you

summer loom
#

i can but i cant listen or talk

vocal dagger
#

Are you able to stream your screen

summer loom
#

yes

vocal dagger
#

Good

#

I’ll guide you through the chat

summer loom
#

alr

#

i'l join a vc

#

i cant hear you , i dont have headphones rn

vocal dagger
#

thats ok

summer loom
#

better if you can talk in here

#

so i will explain you where my file and everything is

vocal dagger
#

open up your mangio rvc folder

summer loom
#

ok

vocal dagger
#

ok

summer loom
#

what now

vocal dagger
#

remove everything from the logs folder

#

except mute

#

now

#

start the program

summer loom
#

you saw nothing

vocal dagger
#

show me the folder of your dataset

#

now copy the path of the folder

#

put it on v2

#

paste the path in the the enter the path of the training folder

#

process data

summer loom
#

wtf

#

so all i needed

#

wads to restart???

vocal dagger
#

i guess so

#

once it says end process you can go to the next step

#

feature extraction

summer loom
#

now i press feature extraction right

vocal dagger
#

yes

#

wait for it to load

#

while that loads, open up task manager

#

performance

#

gpu 0

#

scroll down a bit

#

ok

#

you are going to train on a batchsize of 4

#

save frequency of 20 or 25

#

your choice

summer loom
#

i normally do 50 epoch because my sample is over 30 seconds

vocal dagger
#

train it on 400

#

now train feature index

#

now train model and wait

summer loom
#

it will take alot with 400 epochs

vocal dagger
#

well

#

since it is only 30 seconds it shouldnt take that much time

summer loom
#

my graphic card not the best

vocal dagger
#

itll take a bout 15 - 20 minutes

#

once it is done, you can always check the different evolutions of it

summer loom
#

well ty for the help atleast i fixed that error

#

but idk if you wanna wait here

#

it will take some time

vocal dagger
#

if it sounds bad at 400, you can listen to it on model inference with 300 and so on

summer loom
#

i thought that if the sample was short i should use low amount?

#

because there isn't much to train

vocal dagger
#

the main things that determine a good model is epochs, quality of the dataset, and how much you have

summer loom
#

yup but if i use to much epoch it can sound robotic too yea?

vocal dagger
#

sometimes

#

but that isnt always the case

summer loom
#

it dint even pass from epoch 1

#

damn

vocal dagger
#

best to go for a long time and see the best out of the many epochs you trained on

#

the first is always the longest

summer loom
#

i see

#

i appreciate you taking your time to help me

vocal dagger
#

ofc

#

im here to help

summer loom
#

the reason i'm not using headphones is because i was heading to sleep xD

vocal dagger
#

i understand

summer loom
#

kinda weird how its taking longer now

vocal dagger
#

its gonna take a bit

summer loom
#

before i would do it and it would start training immediatly

#

maybe because something was wrong

vocal dagger
#

maybe

summer loom
#

now all i gotta do is pray that the voice doesn't sound the same

vocal dagger
#

fr

summer loom
#

like the audio i sent before

vocal dagger
#

is the audio you used cleaned up and without noise

summer loom
#

there is some minor noise/echo

rugged violetBOT
#

Ayo? @summer loom level 3 !!! lfg

vocal dagger
summer loom
#

yea , i was just testing

#

to see if it really worked

#

and if it did then i would redo it again but cleaner

vocal dagger
#

the thing is if the model turns out nothing like the voice you want it to, then it is probably the pytorch version you have

rugged violetBOT
#

Ayo? @vocal dagger level 32 !!! lfg

summer loom
#

what's that

#

pytorch

vocal dagger
#

it's a processing thing for python

summer loom
#

hmm i see

vocal dagger
#

the link it sent out in the command prompt

#

pull it up

#

the prompt

summer loom
#

rtc disconnected

#

uh

#

ok back

vocal dagger
#

just keep that prompt open

summer loom
#

alr

vocal dagger
#

any errors you see will be in there

summer loom
#

its only on the third epoch

#

damn

#

this gonna take a while xD

vocal dagger
#

training takes time

summer loom
#

well i gotta go sleep

#

this will take alot of time

#

and i dont wanna make y ou wait

#

and i also wanna sleep xD

vocal dagger
#

i understand

#

just keep it running

summer loom
#

when i wake up and if it finished i will ping you , if you dont mind

vocal dagger
#

plz do

summer loom
#

and then i'l also test if the voice sounds the same

vocal dagger
#

sounds good

summer loom
#

alr man thanks alot for the help

vocal dagger
#

ofc

summer loom
#

i'l be heading to bed rn

vocal dagger
#

gn

summer loom
#

Gm for you and Gn for me xD

summer loom
#

@vocal dagger ok it finished

#

i tried out the voice model

#

it turned out the same voice

#

its the same voice as the previous audio i sent

#

idk what to do on how to fix it now

summer loom
#

@vocal dagger

vocal dagger
#

well damn

#

try redownloading it

#

and then run FIXES

summer loom
vocal dagger
#

when you open fixes, double click on LOCAL_CREPE_FIX.bat

#

see if that gives you any errors

summer loom
#

@vocal dagger

#

it also downloaded a bunch of stuff the first time i opened

#

or updated

#

i cant do what it tells me to do for some reason

vocal dagger
#

do you have python downloaded

#

if not, download the latest version

#

this is a new problem so i am trying to see what can be the problem

summer loom
vocal dagger
#

ok

#

what version

summer loom
#

3.10

summer loom
vocal dagger
#

get the latest version

#

3.12.1

summer loom
#

alr

vocal dagger
#

then put this in your console

#

all of it

summer loom
vocal dagger
#

yes

#

add python.exe to PATH

summer loom
rugged violetBOT
#

Ayo? @summer loom level 4 !!! lfg

summer loom
#

or can i keep it

vocal dagger
#

disable it

summer loom
#

alr

#

ok now i'm gonna open my cmd

vocal dagger
#

ok

#

run fixes again

summer loom
#

oh wait apparently its downloading some other stuff

#

idk if its done

summer loom
vocal dagger
#

itll stop

#

when it's done it should close

summer loom
#

yea it dint do anything now

vocal dagger
summer loom
#

still the same

#

do i close it manually?

vocal dagger
#

for the pip one, wait for it to get to the root command

summer loom
#

oh it started doing some stuff

vocal dagger
#

should be the name of your drive

#

give it a few

summer loom
#

i think its done

#

right

vocal dagger
#

ok

#

now you can close it and run fixes

summer loom
#

alr

#

ok it only shows me to do this

#

i did like it said but dint go so well again

#

@vocal dagger

vocal dagger
#

do the whole line

summer loom
#

ah alr

vocal dagger
#

C:\RVC\Mangio-RVC-v23.7.0

#

that whole line

summer loom
#

alr

summer loom
vocal dagger
#

womp

#

this is nuts

summer loom
#

yea this is pretty annoying

vocal dagger
#

run the command in a fresh command prompts instead of fixes

summer loom
#

alr

sharp pelican
#

tbh mangio rvc is pretty old, try the newest ver

summer loom
#

it worked

sharp pelican
#

good

summer loom
sharp pelican
#

newest is 1008 for mainline

#

or 1228 patch

#

or applio 3.0.5

summer loom
vocal dagger
summer loom
#

there's other versions of mangio rvc?

sharp pelican
vocal dagger
summer loom
vocal dagger
#

I still use it

sharp pelican
#

good

vocal dagger
#

i make my models with it

sharp pelican
#

then no need to update

summer loom
#

alr

#

what do i do now?

sharp pelican
#

mb bro i only use mainline💀

vocal dagger
#

now that is downloaded

#

run fixes again

summer loom
vocal dagger
sharp pelican
#

like the main rvc released on github

summer loom
#

is it normal for these 2 messages showing up everytime i did the fix , yes it showed before too

summer loom
vocal dagger
#

yeah it's normal

summer loom
#

i think...

vocal dagger
#

anything in red bad

sharp pelican
summer loom
summer loom
vocal dagger
#

let it close out then

summer loom
#

should i try opening and do the voice then?

vocal dagger
#

it should do so automatically

summer loom
#

yup it did

vocal dagger
#

i mean yeah

#

lets hope it work

summer loom
#

i will do it at 50 epoch , may sound kinda eh but i just wanna see if the voice will change and stop giving me the same voice

vocal dagger
#

sounds good

#

what kind of graphics card do you have

summer loom
#

Gtx 1650

vocal dagger
#

aight

sharp pelican
summer loom
sharp pelican
#

coz only 4gb vram

vocal dagger
#

yeah

summer loom
rugged violetBOT
#

Ayo? @summer loom level 5 !!! lfg

vocal dagger
#

keep it at 4

summer loom
#

alr

summer loom
#

@vocal dagger it dint work 😭

#

the voice is the same

#

broooooooo

#

what the hell is this curse

#

it keeps giving me that damn voice its always the same

vocal dagger
#

I might have to get some more minds on this problem

summer loom
#

like it doesn't matter what sample i use its always this voice

#

i can use audio samples of vtubers like gura , or youtubers , girls , everything

#

it will ALWAYS sound like that voice

#

it doesn't let me do other voice

vocal dagger
#

whack

summer loom
#

this is very weird , before i used the google one where i could train , i think it was google lab or something , it worked just fine but then they couldn't keep that up so it got discontinued i think so i changed to this one and now it gives me this problem

vocal dagger
#

cuz it is run on your computer

summer loom
#

yea makes sence

#

but i did everything right

#

this is not supposed to be happening

#

this is so weird

ocean stump
#

this is all based off of the pretrains

ocean stump
vocal dagger
ocean stump
#

show me ur settings on the last step

#

@vocal dagger they seem to have ghosted me

vocal dagger
#

theyll be back

ocean stump
#

when

vocal dagger
#

idk

#

they usually reply

ocean stump
#

its a little late for me

grizzled drift
#

I know nothing on helping that you can do

#

Why are you advising them to install 3.12, when everything should be 3.11 which most these projects call for

#

And on top of that, the zip already has python and torch in it

#

Ignoring how you also told them to install torch, globally, instead of in a containerized environment

#

Like bruh

#

All they gotta do is unzip and run

#

If that doesn’t work, it’s either on a different drive from the C drive

#

In a one drive folder, or the extraction failed

vocal dagger
#

always a pleasure getting help from you felt

#

we've tried all that

grizzled drift
#

Let me go to pc and ill reread

vocal dagger
#

i even looked through the files that he had

grizzled drift
summer loom
ocean stump
grizzled drift
summer loom
grizzled drift
#

ok so heres whats gonna happen, ill walk you through step by step

summer loom
#

first i put the name of the voice and out this settings

#

then i precess the data with the right path

#

just press feature extraction

grizzled drift
#

so, can you show me this logs folder

summer loom
#

alr

grizzled drift
summer loom
vocal dagger
#

could be processing the same thing because it has the same name

grizzled drift
#

what is in 0_gt_wavs

summer loom
grizzled drift
#

alright, so preprocess is working

#

so, when you are inferring

#

are you selecting the voice?

summer loom
#

yes

grizzled drift
#

for curiosity, what audio format is the dataset in

summer loom
#

i even have a separate application that is solely to use ai voices and its still the same voice on it

grizzled drift
#

ok

#

can you send the model and part of the dataset?

#

and some example of like, what it should sound like

summer loom
#

the one in weights?

grizzled drift
#

like a 5 second clip

#

yeah

#

you can upload it somewhere and link me it in dms if you dont want to share it

summer loom
#

you want me to send it?

#

alr

#

sending it

#

i will give you the sample

#

how its supposed to sound like

grizzled drift
#

ok 1s

summer loom
#

and its not only with this sample

#

i also tried other samples but it turns out the same voice

grizzled drift
#

and im going to assume that is correct

summer loom
#

nope that is the same voice but higher pitch

grizzled drift
summer loom
#

by dataset you mean sample right

#

or audio

grizzled drift
#

yeah

summer loom
#

of what i want to train

#

ok

#

yes that's what i used

grizzled drift
#

so, my main recommendation is, i would try to get a little more audio, and try to keep it consistent

#

cause there are parts in that where i can hear like the beeping, where he is close to the mic, far from the mic

#

inconsistencies with rvc typically cause it to like, do the stupid "make a model sound like robotic hiss" issue

summer loom
#

yea ik what you mean but i tried with other samples and it turned how the same

grizzled drift
#

is this a youtuber or

summer loom
#

its my friend

grizzled drift
#

if you want to make a model of ur friend i recommend just like, having them record their mic directly in audacity

summer loom
#

If its ok by you , what if you try to use that sample and train it on your pc? just to see if it turns out the same for you , if you dont mind

grizzled drift
#

1s

summer loom
#

alr

grizzled drift
#

what batch did you use

#

inside the logs folder is the train.log

summer loom
#

like

grizzled drift
#

at the top you can find it

summer loom
#

batch size per Gpu?

grizzled drift
#

it will say like -bs #

#

yeah

summer loom
#

i used 4

grizzled drift
#

ok

summer loom
#

50 epoch

#

i also used 400 epoch before

#

but the one i sent you is 50

#

so better do it with 50

grizzled drift
#

yeah its not gon be long

summer loom
#

damn your gpu is way better than mine then

grizzled drift
#

not really

summer loom
#

how is it that fast xD

grizzled drift
#

like, its better, but, its not a god tier one

summer loom
#

for me 50 epoch take like maybe 30min or something

grizzled drift
#

because training speed is dependent on dataset and the gpu speed

#

so like

#

1 epoch of 60 minutes of data, should be roughly the same speed as like, 60 epochs of 1 minute

summer loom
#

oh damn

#

asking because i'm curious

#

i can also train in an pc without gpu?

#

i forgot if you can or cannot

grizzled drift
#

can but will be slow

summer loom
#

i see

grizzled drift
#

gpus are used because its a bunch of tiny calculations

summer loom
#

because i can just try do it on my second pc

#

nut would take some tim , my second pc isn't that good

#

if that works for you i will shocked lol

grizzled drift
#

1650's may not seem super fast, and are not really

#

so, how long was the dataset for yours that you trained

summer loom
#

31 seconds

#

the one i sent you

grizzled drift
#

that was the whole dataset?

summer loom
#

yes

grizzled drift
#

weird cause i did it and it sounds diff from the model u gave me, like

#

it sounds like i made a 50 epoch, and you made higher

#

ill run it for a bit longer and see if same

summer loom
#

is it the same voice as mine

grizzled drift
#

like inferring with

summer loom
#

i used from the mangio that i used to train

grizzled drift
summer loom
#

but i also tried with other application i have solely to use ai vocals

rugged violetBOT
#

Ayo? @summer loom level 6 !!! lfg

grizzled drift
#

this is what i get

grizzled drift
summer loom
#

it worked

#

pretty sure

#

yea pretty sure that one is right

grizzled drift
#

i think primarily that it is working, but there seems to be an issue with how you are inferring with it i think

summer loom
#

i dont see how it is working i used other samples not from the same voice to see if it would lead to the same result and it did end up being the same result

summer loom
grizzled drift
#

yeah that is the most up to date simple one

grizzled drift
#

the UI is ugly, but, that is old reliable

#

mangio hasn't been updated since like, august of last year

summer loom
#

i see

#

also

#

could you possible ssend me the pth file of the voice you made just now using the sample i gave you?

#

i wanna mess around with it

#

because i think it worked

summer loom
grizzled drift
#

you download the zip if you have nvidia or amd/intel (tells you which one)

#

you unzip it, onto your c drive

#

then you just run the go-web.bat

summer loom
#

like this?

grizzled drift
#

dont move it out of the folder, you can create a shortcut, then move the shortcut

#

but go-web has to be in the folder

summer loom
#

alr

grizzled drift
summer loom
#

😭

#

i extracted it to my C drive and then press go web

#

and it gave me this message

grizzled drift
#

because the zip you download, should be like 5 GB

summer loom
#

yes

#

not only that , also audios

grizzled drift
#

and you unzip the entire thing, and run

summer loom
#

tensorboard

grizzled drift
summer loom
grizzled drift
#

no i mean, you unzip the entire folder

#

then run go-web.bat

summer loom
#

yup

grizzled drift
#

so what does the folder look like

summer loom
#

wait

#

MB

#

MB

#

when i downloaded

#

i press to download source code

grizzled drift
#

i linked you to releases

summer loom
#

dint download the one from my graphics card

grizzled drift
#

yeah source code is just, only the source code

#

it does not come with all the dependencies in it

summer loom
#

yea i was dumb

grizzled drift
#

like python, pytorch

#

dw

summer loom
#

i see

#

was this the one you used to make the voice?

#

or did you use the mangio fork

grizzled drift
#

i just use the one i linked you

summer loom
#

oh i see

#

well as long it fixes my problem i will be happy 😭

#

i'm extracting it

#

65%

grizzled drift
#

and make sure the voice is consistent

summer loom
summer loom
#

but why is wrong to have pauses in the sample?

grizzled drift
#

pauses aint bad, what im saying is the voice isn't consistent

#

theres parts where he talks close, then far like across the room

#

theres the beep in the background in the beginning

#

stuff like that is what causes it to mess up

summer loom
#

ah yes i see

grizzled drift
#

and did you run it through UVR

summer loom
#

the reason for that is because we were playing lethal company XD

grizzled drift
#

ye

summer loom
grizzled drift
#

if ur gonna do that, id recommend just, find something to record one audio program

#

and record only discord

#

and i could tell because you dont got denoise on in uvr

summer loom
#

actually no , because we were talking inside of the game xD

grizzled drift
#

if you open a spectrogram of the sample, you will see there is a big streak in the high frequencies, and that is typical /w UVR

grizzled drift
#

u want to sound like him, but in game

#

if u make a regular model, and talk in game, its gonna add that sound

summer loom
#

oh i see

grizzled drift
#

if you make a model of him in lethal company, right, its gonna be impossible to make it consistently the same

#

because if he turns, or you turn

#

the audio its distorted by the positional audio

summer loom
#

i'm a beginner when it comes to this stuff xD

grizzled drift
#

under the adv settings in UVR

#

ik it exists in one of the menus, i just dont really use UVR that much

summer loom
#

may this be the one?

#

i can press to press data ? @grizzled drift

#

i just wanna make sure

grizzled drift
#

i would click v1, then v2 again

#

and it will give you a 32k option for sample rate

#

i recommend using 32k for most people unless your source audio strictly has frequencies higher than 16 kHz

#

consistently at least

summer loom
#

i see

#

but its fine if i dont?

#

what's this?

grizzled drift
#

its buggy af iirc

#

idk if they ever fixed it

#

its better to just, do each step, make sure it doesnt error out, then let it train

#

vs hope one click does all the steps in order and doesnt mess up, but, last time i used it, it worked like, 20% of the time

summer loom
#

i'm training it rn and then i will ping you when its done if you dont mind

#

also could you send me the pth file of the voice you made?

#

from the sample i gave you

grizzled drift
#

i alr deleted it, sorry g

summer loom
#

because yours worked 😭

#

no its fine

#

just in case this doesn't work too

grizzled drift
#

ik its ur bud, i just deleted it all cause, me no need archival of some persons friend lol

summer loom
#

lol nw

#

thanks for doing that

summer loom
#

@grizzled drift IT WORKED

#

IT FRICKING WORKJED

#

FINALLY

#

THANK YOU

#

Thank you for everyone's help

summer loom
#

You have no idea how frustrated i was

#

that this wasn't working

#

tysm

ocean stump
#

But hey good stuff

grizzled drift
#

ik i got super offensive and emotional, but

#

i hate when people say "go install python"

#

and even moreso when they say "go install pytorch globally"

ocean stump
#

I'm just saying

#

U did a good job explaining and resolving

summer loom
#

Yup i was looking to fix the problem but if installing other program is the solution i'm also happy with that i had no idea there was other way of doing ai voices so thank you for that ! 🙂

rugged violetBOT
#

Ayo? @summer loom level 7 !!! lfg