#Jittery Mouth Rigging

5 messages · Page 1 of 1 (latest)

frail wren
#

Hello! So I have a bit of an issue with my mouth rigging, and I can't figure out how to fix it. I've already finished the entire model, but as you can see in the provided example video I took of me reading out something, the rigging itself is very jittery and inaccurate, and doesn't hold mouth shapes well without shivering kind of? I'm using the mediapipe webcam tracking through vbridger, and my mouthshapes are rigged in a 3x3 grid using another vbridger mouth rigging as an example. I'm really not sure whether my rigging is the issue, or if I just can't for the life of me set up the model correctly, so any help at all would be GREATLY appreciated!

kindred aspen
#

if it looks smooth in live2d but jitters on vtube studio could be a few things, first mediapipe, while better then basic isn't the best so if you can i recommend trying it with Nvidia tracking or even better an iPhone.
But other then that here are the two other main reasons your getting this effect. (and a bit of an explanation so if you ever deal with it again with a client you can explain to them what's up and why)

Assuming its not just media pipe, its then its one of two things.

  1. Camera angle: Try adjusting your camera to a more straight on view for better tracking.
  • The further from a straight on 90 degree viewing angle you place your camera the worse tracking will be and steep angles can cause issues with the programing trying to tell where your lips eyes etc. are causing it to jump around.
  1. lighting: it could be the lights you have aren't bright enough so add more light or might be one of your lights is causing the effect. try turning off the lights your using one by one and see if the effect keeps happing.
  • regarding why some lights cause issues with tracking, depending on your camera and the types of lighting in the area if they are both the same hertz you'll end up getting an effect that when viewed on screen live looks like lines of slightly lighter or darker video moving up or down. basically the camera is taking pictures to form a video at roughly the same speed your LED light is flashing causes a darker picture every so many frames which messes with the tracking causing it to be jittery..

If all else fails i have heard issues that some graphics cards struggle with vtube studio for some reason so as a last resort have a friend try it on there set up or you on your mobile device?

You can also always increase smoothing which will help reduce this jitter but also make the mouth less responsive.
Good luck! hope you can work it out!

frail wren
half lantern
#

you can also try to increase the range of mouth open/mouth smile parameters past the max like from -1.5 to 1.5 to make it less likely to reach the "extremes" in vts

viscid kraken
#

Yeah look at the dots and how they move when you move your mouth