#RVC Disconnected Alternative

1 messages · Page 1 of 1 (latest)

stuck kraken
#

Last night I tried to set up my Dataset for training only for the entire thing to backfire on me, thanks to me not knowing that I needed to save the Training around the 100th epoch mark
When I tried to start over again from scratch it says i've reached GPU limit and now have to wait a whole 24 hours to try again

Does anyone know an alternative?

sharp reef
#

use a local fork if you have decent Nvidia GPU

#

idk about the paperspace alternative but give it a try

stuck kraken
#

about that my specs are
AMD Ryzen 3 2200G with Radeon Vega Graphics 3.50 GHz
and RX 570 8gb graphics card

idk if that translates well to Nvidia

sharp reef
stuck kraken
#

so it wont work on my pc?

thorny hull
#

Be sure to not put high epochs for the save frequency

stuck kraken
#

just keep it around 500

but if i saved it around say the 100th epoch and left for a while to do stuff
and if i try to resume by loading it, and it wont work what next?

thorny hull
stuck kraken
#

alright i'll give it a try... After 24 hours

stuck kraken
#

error again ans again

thorny hull
#

it seems like u didnt run the training variables cell

stuck kraken
#

i did it first as the instruction said

thorny hull
thorny hull
stuck kraken
thorny hull
#

you could just try to disconnect and delete runtime and re run everything from the start

sharp reef
#

free T4 gpu is only available for a session daily, so if you get disconnected or do "disconnect runtime", the next runtime won't use T4 until tomorrow

#

though doing restart runtime still keeps T4

thorny hull
#

it depends from how much you abuse it

#

technically on their site they say 12 hours daily, which depends on the usage so in reality its 4 hours for things like this

#

but depends cus if u use ot every single day every single month they give less time, so yea, but its not like if u connect 1 min and accidentally disconnect they dont have the free daily gpu till tmr

stuck kraken
#

Anyways I'll try it again tomorrow since I'm vacationing with my family

I just hope someone will be here and responds before I begin

sharp reef
stuck kraken
#

update it finally finished
but it says i need to download the file thats closest to before the over training point?

#

so far i downloaded 4 files

  1. e500 s4500
  2. e80 s720 (2nd lowest the lowest being e60 s540)
  3. e100 s900

I set training as

save_frequency 20

total epoch 500

batch size 8

#

which one of the 4 i downloaded should i use?