#lipsync setup help?

20 messages · Page 1 of 1 (latest)

small atlas
#

hello, could i get some help with a rig i'm working on? there's a part i'm a bit stuck on

basically, i'm rigging a mouth that can use the usual "mouth form" and "mouth open" parameters, i've
already rigged those.

but now i want to also rig separate "AIUEO" parameters for VTube Studio's lipsync feature, that can be triggered on and off. or used together with camera tracking. that's where i need help.

from what I know about this, you need a "silence" parameter, where at "1", the "mouth form" and "mouth open" parameters work like usual
but at "0" they don't move at all, and only the "AIUEO" parameters move.

so... how do i properly set this up?? so that at 0 silence the mouth form and mouth open keyforms stop moving?? this is the part i'm stuck on 😭

thank you for any help!

trim tundra
#

are you following any reference or tutorial for this?

trim tundra
small atlas
trim tundra
#

what about the example file they provided there?

#

its a file and a video

small atlas
#

ahh i didn't realize there was a video

trim tundra
#

For the picture it would say they dont move because the silence parameter was done first so the permutation is like that
but tbh i would need to watch the video

#

btw, how much experience do you have rigging?

small atlas
#

i've rigged about 3 models to completion before!

#

i've just never done this specific lipsync feature before

#

i'll watch the video now, and return if i'm still confused afterard ^^

trim tundra
#

ok i asked just to know if you would know what a permutation is

small atlas
#

i don't think i do?

trim tundra
#

ok...

#

a permutation is basicaly all the possible combinations of keyforms in an object
Example
when you rig eye open to be
open: +1
close: 0
thats 2 permutations
when you then add eye smile
now you have 4 permutations [2x2]
open + smile
close + smile
open + normal
close + normal

#

this logic can be used with the silence
by adding the 2 keyforms on silence BEFORE doing mouth smile and Open, you make sure that the moment silence moves to "active" it will make the lips close

small atlas
#

ohhh ok i see, so i sort of made parameters in the wrong order for this

#

i've skimmed through the example video and they're setting up the lipsync on an already rigged model!

it looks like they copy and paste each mouth keyform onto
silence +1