#Issue with mouth recognition on VTS w/ iPhone

1 messages · Page 1 of 1 (latest)

lean skiff
#

Maybe someone has an idea I didn't try yet.

So this doesn't happen at every time of day, but more often than not: While my mask cam view on the iPhone software seems to do perfectly fine, my model within Vtube studio is just opening their mouth despite my actual mouth being completely shut. Checking within Vtube Studio, my "closed" value seems to randomly rise up to 0.2ish, when moving my face around (or when simply looking at the camera dead pan).

I do not know why this happens, and why it doesn't always happen. Might be lighting, but I do have a pretty substantial LED keylight over my screen. Might be the camera distance, but usually my phone rests comfortably on a phone stand an arm length away, directly in front of my mug. Might be the beard (?), which is a theory underlined by my mouth also opening a lot when i do, like, "kissing" movements with it in lack of a better term.

I only bought this phone back then because I was annoyed with the webcam not working great with my glasses, but while the phone also doesn't like them, this is now an additional issue. I noticed this in the evening more than over the day, so "lighting" is my best bet, but I have no idea how to fix it.

If anyone has any clue or managed to fix the same issue, I'm happy for any input. Thanks!

valid blaze
#

Oh my God, I've been experiencing this too and have been feeling like I've been going insane over it. The only difference is that I've been having this problem when Vbridger is activated, and my jaw open instead thinks that 0.2 is 0 when I'm smiling with my teeth together. When I rotate my head around, it jumps by 0.2-ish to max 0.4. I even got a new phone and it's also got the problem, though it has a base of 0.15 and jumps to nearly 0.3 as I turn my head around. I've done setting resets, face ID calibrations, different computers, a factory reset, a whole different apple account, and even had apple IT look at it both remote and in person (their diagnostic software found nothing wrong). All I know is that in September, my mouth/jaw tracking was working perfectly and now everything's busted. The people on the Vbridger discord have been working with me for I kid you not weeks to try to help me figure out what the actual fuck is going on.

#

But since this is with different tracking, are you using any volume parameters with your mouth open? If you do, it could be picking up ambient noise. I'f you're just using the standard mouth open input though, we might be having the same problem.

lean skiff
#

YES, same here, it worked perfectly fine forever and only acts up recently. I do use volume parameters, but I already tried disabling both the parameter and my mic itself, and it doesn't do anything. So I'm pretty sure it's the same issue here.

valid blaze
#

Is this also with Vbridger mouth rigging? With a separate jaw open and mouth open? For me, the effect is very minor with my standard rigged model with the standard mouth open that combines the lips and jaw tracking, but is very pronounced with Vbridger tracking that separates the two. I've identified that it even affects internal iphone things that use ARKit tracking like memoji, so I feel that it's likely something going on with our devices. Hopefully a problem with software that will get fixed in a future patch, but given that you're the first person I've seen mention this problem it either isn't being noticed by most people or is very minor for most people.