#Hand tracking not working on example model?

12 messages · Page 1 of 1 (latest)

hollow tendon
#

I'm using a "hand tracking model sample" from the Steam workshop here: https://steamcommunity.com/sharedfiles/filedetails/?id=2795528219
On there, there's also a demo video showing the expected result, hands tracking and getting mapped to the model.
(example video mirror on Twitter: https://twitter.com/subetega_nikui/status/1497576028226478085)

Trying to do this for myself, I've gone to the camera settings, set the mode to "Level 5" with "Face and hand tracking" with a Logitech webcam - the hands work fine during calibration.

When going to the model settings, I can see all the rigs for various hand tracking things, like HandLeftFinger etc. The input and output values here are also moving when you move your hands. However, the actual model does absolutely nothing when you try using your hands. I've also tried with another model that seems to be rigged for using hands, with the same results. Any ideas what the problem could be?

Example video of what I am trying here: https://www.youtube.com/watch?v=uu4Zg74W3tQ

uneven bane
#

@hollow tendon I don't know how exactly this model works. Perhaps it has a hotkey toggle to turn the hands on?

#

That would be my first guess.

hollow tendon
#

I'm not hellbent on trying with this model, can you recommend a different one where you know the tracking works, for testing purposes? I'll see if it has any hotkeys in a minute

uneven bane
#

Hmm, I don't have any. But the tracking definitely works and moves the Live2D parameters.

#

So everything is working as intended. The model is just doing nothing.

hollow tendon
#

You were correct, you actually need to trigger something before the model goes into a mode where the inputs are actually shown. For reference, if we go here:

#

There's actions for handL and handR. I've mapped a key to those and if you press that once, the hand inputs actually work:

uneven bane
#

Makes sense.

hollow tendon
#

Thanks for the hint! I'm closing this 🥳