#Gig related to programatically rerigging .glb -> .vrm

12 messages · Page 1 of 1 (latest)

young bramble
#

Company's name: I'm independent
Company's website: https://saori.sh
Experience requirements: none
Location requirements: none

have a relatively difficult problem and idk anyone who can solve it

basically i have this meshy -> vrm converter which is successful when using the super basic mixamo fbx -> vrm retargeting code that is basically boilerplate for anyone who works w/ vrm. its all in here https://github.com/saori-eth/meshy-to-vrm/tree/main/utils (mixamo-to-vrm is the retargeter, vrm-converter re-rigs meshy rigged glb to vrm)

so in this demo it works perfectly fine, but when i bring it into hyperfy (the new open source one) i get a gigantic stretched avatar
https://github.com/hyperfy-xyz/hyperfy/blob/dev/src/core/extras/createVRMFactory.js
heres some notes on their avatar paradigm:
https://chatgpt.com/share/69615e4b-9b74-8010-be85-49ffec6a8c4a
hyperfy basically loads vrms, maps bone names, and then rips everything out of it, replaces it with three.js skeleton which runs anims on the gpu
their animations are basically, take a skinless mixamo fbx anim, add a root bone in blender, parent it to the hips, then export as glb (they do this because glbs are lighter weight i guess)

SOOO basically what im looking for is a converter, similar to whats in meshy-to-vrm/utils folder but works inside hyperfy
ideally it works everywhere that vrm works, but mostly care about hyperfy

drowsy plank
#

Can vouch for Saori, worked with him in the past, payment came as soon as the task was completed and working. 👍

low jewel
#

What is your mesh source? Meshy?

#

So they take the Meshy Rigged GLB and you convert to VRM, and in your normal VRM tests it looks ok, but when you load that VRM into Hyperfy it doesnt use a threejs-vrm loader but its own which explodes things

#

How does hyperfy treat manually authored VRMs?

young bramble
young bramble
#

my own website is the only one ive found that this vrm converter actually works in
(i think) because my skinless mixamo fbx -> vrm retargeting code was shown to me by the same ppl who built the converter

#

i wish i could explain better but its part of the reason i want to pay someone 😭

#

btw fwiw all of this will stay open source, i just want to use it for a game / experience im building