Been redoing my Mio model for a bit on Ov2. Have like 40 mins for a dataset which I know is crazy high but it is what it is. I've got it to like 450 epoch/45K steps before overtraining but idk, it sounds a bit off. Like the esses and breaths sound choppier than the model I did on the OG pretrains. Some weird humming and chopping artifacts too.
Does Ov2 encourage smaller datasets than that or is this just something dodgy in my dataset? Or perhaps a mix of both. Thanks!