#"Collab mode" for Neuro's model

1 messages · Page 1 of 1 (latest)

barren trout
#

As of right now, Neuro mostly looks forward, like on chill streams (pic 1). However, on collabs Neuro should look at the partner (pic 2). It might help with immersion, because it won't look like Neuro is ignoring her partner.

image.png image.png
terse star
#

do other vtubers do this

#

should be fairly simple to do perhaps if its a thing

barren trout
#

They usually do for chatting streams.

terse star
#

ah I see I see

smoky skiff
#

is it easy to use like how she eye tracks osu?

barren trout
#

As far as I understand, it is just a matter of moving her center point of the rig to the left/right.

vivid mesa
barren trout
#

But why when you can just offset the model?

vivid mesa
#

Hololive actually use the VA's face for tracking.

Unlike animations/ blendshapes which is triggered by hotkey, Neuro have to be re rigged or use a fake face in virtual camera as explained here timestamp 7:45 https://youtu.be/Q1JlgGilp9A?t=465

listen for the explanation here, timestamped 8:31: https://youtu.be/LtB0ncmw3tc?t=511, else it would have been just as easy as setting a slider value

terse star
vivid mesa
hasty spire
#

Could it be done that for collabs she had some marked points or directions to look at?

#

For example, mark where each partner is on the screen, video, photo as in the case of the fridge review stream, or any other source of information.
And make her look at each one without forcing her according to who she is addressing or listening, or what she is talking about

barren trout
#

Bump for tutel. Miyu is working with her model to address Neuro, but Neuro does not.

image.png
terse star
#

i actually mostly implemented this

#

and forgot about it

#

so thanks for bump

grizzled scarab
#

Bump for Friday collab

terse star
#

i mean i rotated her body but not her head enough

#

thats on me really

midnight fern
#

I remembered this discussion when Neuro was moved closer to Numi, but still looked straight ahead. It is a bit more noticable when they are very close together.

atomic igloo
barren trout
#

Collab mode might not work with fillian, because she is practically everywhere on a screen.

noble tulip
atomic igloo
devout turtle
#

what about the osu eye track but instead neuro tracks fillian around the screen?

barren trout
#

It adds a whole another level of complexity just for the sake of eye movement.

barren trout
#

bump for tutel sadge

noble tulip
narrow path
#

Surely he is cooking a fully dynamic system of tracking

wide raptor
#

There's some stuff in the SDK for tracking already built, but how it interacts can depend upon nuance of the model, and you could probably have a placeholder object in Unity to track the "partner", actually getting the tracking data to move that would be a pain, but you could probably manually position as a start.

#

Should in theory make the Evil v. Neuro collabs able to track each other, although they don't exactly go anywhere so idk how useful that is lol.

#

I'm assuming he's already using it to track cursor position for the eyes for osu!, just needs to do the same with angleX to turn head, idk if Teru rigged bodyX separate or if it's angleX for body turn as well. Only issue might be if some other scripts override the value and the order they apply.

wide raptor
#

Playing with it a bit and I guess the other issue is that if he is using that script for osu! he'd have to modify it and the script on the parameters to swap to a Collab mode to have the head/body not trigger with the osu! tracking or in general when not collabing. As for a dumb thought I had, he can set up a system to convert the collab partner into osu! circles and then Neuro can pretend she's playing osu! on their faces.

livid sundial
noble tulip
barren trout
#

Final bump for @terse star

terse star
#

actually im pretty sure it does work its just this is the furthest her body tilts

image.png