Struggling with ML-Agents

[zenith cradle]

I recently started using ML-agents for a school project, to make a humanoid character stand upright nut can't figure out what specific bones and joints or how to even give control of them to the Module. I'm using a unity wizard ragdoll for the model's body and would love to know how to train this model just to stand upright

[indigo mortar]

Start from playing with the ragdoll itself. What parameters of what components affect the character ability to stand up? And how would you know if it stand upright if you couldn't look at the character visually, but only at the various parameters? Once you have that figured out, you would know what parameters to let the model control and what parameters to monitor to provide it rewards during training.

[zenith cradle]

hmm this is solid advice but I sadly don't have the time for it 😦

[indigo mortar]

Well, this is not a project that you can do quickly and without thorough research. If you don't have the time for it, maybe choose a simpler goal.

[zenith cradle]

standing upright isn't a simple goal damn

[indigo mortar]

It's not at all. Why do you think there are millions of dollars being put into developing humanoid robots currently?

[zenith cradle]

seen a lot of projects on yt and github about it tho

[indigo mortar]

Sure, it's a lot simpler in a virtual environment, but it's still a pretty complex task.

[zenith cradle]

that's fairs

[indigo mortar]

Especially if you don't have any experience in the field

[zenith cradle]

Any documentation or anything at all I can read to at least nudge me in the right direction

[zenith cradle]

true

rn it feels like i'm beating round a huge bush

like HUGE

[indigo mortar]

As I said, research how a ragdoll works first what makes it move in certain ways and makes it stand upright. I don't think there's much documentation on ragdoll in unity docs, but it's basically just rbs with joints. So research how these joints work.

Then separately you need to research how ml agents work in unity.

Finally combine the knowledge to implement the thing.

Maybe use Google or YouTube to learn more about Ragdolls. The general concept is the same regardless of the engine used.

[zenith cradle]

I know how the unity mlagents works it's just the ragdoll I never understood

[indigo mortar]

It's all about physics. Think of a door. It can rotate around an axis when a force is applied to it. That's basically one joint in your ragdoll. The combination of many of these joints and forces/torque applied to them could make it move in certain way or stand upright.