Space Marine Too: The Electric Boogaloo (Ver.2)

[placid crystal]

Titus and the boys in all their unrigged glory!
Textures set up by some guy, I dunno
Assets ripped with Ninja Ripper 2.5 (and it's a pain in the ass)
https://drive.google.com/file/d/1GlCTMu1g5-JJHum6FpJOF_O3HGhb7KZT/view?usp=sharing
Feel free to make a rig if you'd like!
Updates will come in the next few days!
Super big thanks to @fallen valve for the shader and forbidden knowledge!
Big thanks to Sabre and GW for the goods.

[mortal goblet]

[raven basalt]

Hoh very nice! Please do tell me if/when you get the AdMech assets from the game. Luv me tech lads

[fair shale]

Or literally anymore SM2 Assets

Mad respect

[fallen valve]

Shader + Mesh Fix Time
@placid crystal

[fallen valve]

Added 1 extra option due to some parts.

For reference:

• New Shader
• Mesh Fixes ( Merge By Distance [ .01 ] + Weighted Normals [ Face & Angle ] )

Also new name to fit it most likely working with possibly weapons and static assets.

[fallen valve]

Titus fully dealt with minus head and hair.

[woeful creek]

warhammer except it isn't gatekept

[fallen valve]

..and not insanely complex..

[woeful creek]

yet this is all the baked textures. we haven't seen the customization stuff yet

[fallen valve]

Shouldn't be too hard, considering the devs have yet sounded too abmitious on things yet.

[fallen valve]

@placid crystal Enjoy.

[torn sphinx]

https://tenor.com/view/spongebob-squarepants-spongebob-toons-cartoons-animation-gif-14827471

[lapis patio]

Perfection

[placid crystal]

Teamwork!!!

Remind me to nix the double Gadman with the next update!!

[placid crystal]

It's a process, but hey, this is a start!

[fallen valve]

As we get more information from the game, I can add more to that shader or make new ones for other assets.

[placid crystal]

yupyup

I'll also keep an eye out for the highest lod parts moving forward.

[fallen valve]

The fun part will just be doing a simple pass of merge by distance ( .01 ) + weighted normals ( face & angle ) on each part.

Titus being an example of that pass done on all parts at once, even switching to face & angle by copying that to all selected.

[placid crystal]

I was worried that merging by distance would scoff up the UV's so I've tried to avoid that... but, knowledge is power.

[fallen valve]

Better than having a bunch of extra verts to worry about, and no, it won't mess up UVs.

[placid crystal]

Also, I must've missed Titus' eyeballs somethere in the rip.

[fallen valve]

His eyeballs, and the textures for his head and hair.

[placid crystal]

I just finished applying the new shader, and made mesh fixes to Chiaron and Gadriel too.

WIll have the update up in about half an hour or so.

[fallen valve]

Nice

[fallen valve]

Lemme know if their are any issues also.

[placid crystal]

So far with the weapons, turing occlusion to 1 blacks out the mesh completely

So I set those to 0

Also, update is out!

[fallen valve]

Its why I included the slider.

[placid crystal]

Nice

Space Marine Too: The Electric Boogaloo (Ver.2)

[stiff lichen]

Fucking beautiful

[fallen valve]

If their are more maps in the textures, lemme know so I can update the shader.

..or make a new one if needed.

[placid crystal]

I managed to pull bloodied textures for Titus from the title screen, will upload those in a later update.

[fallen valve]

Let me know if they need shader adjustments or a new shader for blood versions.

[proper prawn]

Bro I will send you my left liver if you also rip the Guardsmen. ❤️

I am sending the right one over right now.

[delicate pewter]

i will send you a kidney

[proper prawn]

I uhh just noticed I said liver... I mean kidneys of course...

Am I gonna correct it? No. 😄

[mellow crescent]

Is this all of the armor pieces?

[supple breach]

should make a pack like the spartan pack

[fallen valve]

I'm not the one pulling the parts, just organized them to show what I could make work shading wise, and what is left over without proper texture data.

[fallen valve]

Also for anyone's reference, the reason I don't just input metal to metal, is because of how Blender does metal vs most game engines.
\
Blender: Switch From Main BRDF To Metal BRDF
|
Most Game Engines: Mix Metal Into Specular Within The Same Large Calculation

This is why I do things a little more complex in the shader.

Its why say RE Engine Resident Evil materials for example don't quite look right in Blender when handling the metallic shading, because REE, like most game engines, is just mixing in the metal calc into the specular calc, not calculating the metal on its own entirely.

[sly lagoon]

Rigged?

[fallen marsh]

One thing we still have to figure out is making a temporary IK setup to use until some actual tools to rip the official rigging become available

[fallen valve]

Its mostly solid parts, minus the suit section, and the neck of the chest, so to weight it all shouldn't be a large issue for anyone who has weighted Halo Infinite parts in comparison.

[supple breach]

ik just had to mention it

[queen plank]

I need da bugs

[timid shale]

I just want the guardsmen and the Chaos guardsmen

[fluid sage]

not ready yet, it is specular and glossiness with some minor modifications.

[placid crystal]

Love the magic that's happening here.

[fallen valve]

You'll wanna remove the old images and add new ones if you can.

[placid crystal]

I'll see what I can do tonight 🙂

[fallen valve]

If need be I can always help you make a new post if it doesn't let you add new images to the current post.

[quick saddle]

Will we ever see the Guardsmen? I would love them

[light vine]

can someone rip the normal marine?

[placid crystal]

I have a rip ready, just gotta put it together.

[velvet atlas]

any chance the custom space marines are gonna be up soon?

[placid crystal]

Probably sometime after work or in few days, I'll see what more I can do. Working on some boltguns right now.

[velvet atlas]

oh awsome!
I kinda need to get my hands on the Bulward class.

[light vine]

is there gona be a rig?, and is the online mode ones gona be ripped?

[placid crystal]

No rig yet, Ninja RIpper only pulls model and worldspace data

Hoping someone with time and patience can rig one up though. One day.

Or, wait for tools to develop.

Either way, I was only able to pull models and textures.

[light vine]

i mean i can try bc i was testing my skiils to its best i got some done on it

[placid crystal]

It's beautiful.

Lovely little noodle marine

[light vine]

yes ill try to get it as good as can and when done post here

[light vine]

iv rigged the 1st hand

[fallen valve]

"1. Duty. Not to Death, but the Emperor."

[west roost]

LETS GOOOOO

[west roost]

is it ready?

[light vine]

try this

[light vine]

should be Vrchat ready aswell

[west roost]

https://tenor.com/view/monkey-monkey-dancing-monkey-vibing-monkey-jumping-monkey-vibe-check-gif-27025323

I assume giving our boy controls for it rig it not easy

[light vine]

uh tf

[west roost]

aaaa

I don't think that normal brother

[light vine]

it works for me

[west roost]

what version are you on

[light vine]

4.0

[west roost]

4.1 goo engine

[light vine]

?

[light vine]

huh idk what that is lol

[west roost]

it a custom version of blender focus on toon animations or renders

[light vine]

oh maybe thats why?

[west roost]

let me check

nope

[light vine]

odd

try go to the shading tab and look in there for the helmet

dose it have the textures for the helmet?

@west roost

[west roost]

hold up

[light vine]

remove the top one and replace it with this

[west roost]

it works

[light vine]

cool

[west roost]

I wonder when are we going to get the Tyranids models

[light vine]

what are they agian?

[west roost]

https://tenor.com/view/tyranid-attack-space-marine2-ultramarines-warhammer40000-attack-gif-25493766

[light vine]

oh

[west roost]

I think I miss spell their name

[light vine]

i call them bugs lol

[west roost]

fair

[delicate pewter]

and lets not forget about the guardsman, cant wait to rig them to starfield

[west roost]

I want them for blender

[light vine]

all armor in game should be able to be put on this rig with some small edits

[delicate pewter]

i salute you Rigmaster

[west roost]

I giving titus ARP

job done

[light vine]

id love to see what you do with it

[west roost]

Need more

give me more things to rig

@light vine

[light vine]

hm?

[west roost]

Me want more rigs to work with

[light vine]

i dont have any more lol thats my 1st

[west roost]

[light vine]

when more is ripped ill do more

[west roost]

YEEEESSSSSS

[light vine]

im waiting for the online ones

[west roost]

there a deathwatch one

[light vine]

i have the files i will do them all my brain is dead rn so ill do them later

[west roost]

oof

[supple breach]

knees are on a joint same as elbows and shoulders

[light vine]

?

[supple breach]

ill show one momento

[marsh anvil]

Holy shit nice

[gilded iris]

Holy guacamole

[velvet atlas]

fun fact! I did not know the kneepads of the spave marines worked like that untill the game

[obtuse hull]

Good afternoon everybody. I'm sorry for the inconvenience, but I'm trying to create a rig for the deathwatch space marine, but I'm not getting the desired result, and the following ends up happening:

With this in mind, could someone explain to me how to create a custom rig for this space marine and for the primary space marines placed in this section?
Thank you for your attention.

[supple breach]

well the rig should work fine but you would have to weight paint all the armor because it is a different uv map

its not hard since the armor dont bend

[light vine]

just wait ill do it when i get to it

[obtuse hull]

I understand. Will you also create a rig for the characters that accompany Titus?

[light vine]

ill try, need someone to put the shader on them tho

[obtuse hull]

I understand. Thank you for your attention.

[finite kite]

@light vine will there be a way in the future to select each peice of armor and choose the individual color as oppsed to the UV map, also is there ever going to be a day we might have access to the customation parts to add to the model?

[fallen valve]

This requires A: for someone to pull the customization parts, B: to pull the textures alongside them, C: for me to see how customization even works, and D: update the shader to accommodate said customization.

Its not a simple process.

Hell, I don't have the game yet to even debug anything on my own.

So I am going by what I can figure out from the textures alone, that being only baked out armor and weapons so far.

[finite kite]

got it, i will be happy to help in the proccess if your willing to teach me, as i would love to help devolp this lol

[fallen valve]

Its not a simple thing to teach, so you will simply have to wait.

..and my own time is limited.

Just bought it now, so will see what I can do with debugging the game.

[finite kite]

It's worth the wait man, cant wait to animate with this lol

[fallen valve]

Knowing I read before that it should have an offline mode, means I should be fine if I disable EAC the way I usually do.

Means I can still load the 3D assets enough to debug them.

It'll be about 15-20 ish minutes to download from the looks of it.

[fallen valve]

Oh my god, hdetm...well then, this is like their work they did for CEA and H2A.

Holy...pretty dam similar workflow.

He @jagged herald Yo Haus, do you have info for the model and texture formats back from CEA and H2A?

[light vine]

lot of that idk tbh im just doing this bc i want to make space marines for vrchat that are the SM2 models lol

[finite kite]

That's fair

Tho I would be willing to help

But I respect ur decision

[light vine]

rn im setting up the death watch to look like a normal marine

[delicate pewter]

any news when it comes to the imperial guardsman?

[light vine]

unknown im just slowly making them and waiting for models to be ripped

[fallen valve]

Huh, tried injecting into the game multiple times, nothing seems to attach.

So unfortunately, it looks like we are just going to have to pull from the files themselves.

Well the engine has certainly stuck to its roots.

I'll need to look into this more.

I just need to see if Haus can be around to help me get an understanding of these file types.

[heavy halo]

may need to find a way to shave off the gorget if you are going for mark vii

[fallen valve]

Huh...so they don't do occlusion in the blue like I thought...must be a leftover, as their texture file doesn't reference it...

[heavy halo]

the deathwatch armour is mark viii

[fallen valve]

We are missing textures however for every piece.

[jagged herald]

oh god, not the saber engine again

[fallen valve]

Yep, welcome back.

Its even more Saber this time.

Space Saber one could say.

I notice it is clean cut the Saber engine, even for what I know of CEA and H2A.

They moved away from blinn phong spec gloss though, thank god.

[fallen valve]

Ironically, the pak files are straight up openable in 7zip.

Which is funny.

[jagged herald]

at least they got rid of the stupid pkzip encryption that they tried to use in quake champions

[fallen valve]

Yep, much better now.

Anyway, I just laugh now cause I'm like..
I had this nightmare once...welcome back to it I guess.

H2A especially made me wanna mind flay someone.

[jagged herald]

i don't have the game, but i have debug symbols for the beta. when i have time i might take a look, but i don't know if i want to subject myself to re'ing games anymroe

[fallen valve]

I'd be eternally grateful if you did so for this game, cause their is so much data missing I can't simply get out injection wise, since injecting to debug the game does not work it seems.

[jagged herald]

the hlsl shader code should be in one of the paks if its anything like their other games

[fallen valve]

The problem is they used ninja ripper for these rips, meaning all the textures are messed up too, not in their correct formats.

As in it got these post-GPU, not pre-GPU, when it swapped and messed with everything.

[fallen valve]

Although if you do have info on what formats existed for the saber engine back in CEA and H2A, I could try working from there, if you don't look at the game yourself.

[jagged herald]

PICT/PCT files are the textures, and they're pretty rudimentary. It's usually a couple of fields like the height, width, dx format etc and then the raw texture bytes

[fallen valve]

The model format being the most pain point right now.

[jagged herald]

they change their format a lot. CEA is nothing like H2A, but quake is similar to H2A so they might be using that format

[fallen valve]

Cool, if you got info on all that, could help.

[jagged herald]

i barely remember working on either. that time was a fever dream in my life. the code is there on github though

[fallen valve]

libsaber, structures, geometry correct?

[jagged herald]

yea, TPL/Templates = models, PCT/PICT/Picture is textures, LG/LevelGeometry is maps

[fallen valve]

Cool cool

[fallen valve]

Thank you, would you want me to send you any files you might want to look at in the meantime?

[jagged herald]

i'm at work right now. i'll ping you if i find some free time

[fallen valve]

Awsome, thank you again Haus.

[west roost]

Who wants it

[placid crystal]

Fuckin love this.

[placid crystal]

This has become a sacred place. A House of Haus, so to speak.

Welcome.

[fallen valve]

https://tenor.com/view/venture-bros-crazy-weird-magic-gif-12402930

The Haus Sanctum one could say.

[late grotto]

would you wanna take a crack at the chaplain i cant seem to get it to work

ill try one last thing n try grabbing em from a different scene

[placid crystal]

I noticed only a couple pieces ripped properly, but no helmet or armor, just bobbins.

So I'll try again once I return to the ship

Taking the slow scenic route and ripping every little bit of weaponry I find.

[fallen valve]

Can you go back to Titus' Ultramarine helmet?
I need every texture referenced by it, if possible, cause something doesn't seem right here, given what I can read in plain text in the files.

Also occlusion isn't used, not as far as I can tell, meaning its a leftover.

   format_name = "MSCG+MRGH"
   format_descr = "MetGray(r)+Roughness(a)"

[placid crystal]

Kinda thought so, there's a neck piece that uses a different texture from the suit and torso, and helmet

I'll post them as soon as I can

[placid crystal]

How can I use that reference?

[fallen valve]

You can't was just my way of saying something seemed off, but whatever you can get for me of all of Titus' UM helmet textures.

[west roost]

Do we have bolters

[late grotto]

I got all the armor and pieces from the beginning of the second mission in the launch bay

Just no uvs

[placid crystal]

Damn

[fallen valve]

On a note, old shader on the left, new shader on the right, mostly perfecting the reflections to match Saber's very wack system.

The two shaders in comparison, left old, right new.

I also turned down the default 'light' intensity. Saber's engine fakes emission lighting, with a more advanced mode in the process which I'd have to understand at a later time.

A quick change to the texture type names as well, although we are still missing texture types.

[placid crystal]

Oh nice.

[fallen valve]

The texture types missing are: HDETM & CC, which can layer up to 4 times for the CC to create the custom marines we have in game.

HDETM is their Height / Detail Mask Texture.

[ancient siren]

though I would share a salamander I made using this!!

[west roost]

gib

is it rigged

[fallen valve]

Ah, I was looking at the wrong one.

Their is regular titus helmet and an alt titus helmet.

I wonder what _ts means in his alt textures.

[placid crystal]

If those are the black and white textures I saw while digging around, sure, I'll pull them real quick.

[fallen valve]

Title Screen

[placid crystal]

Need them for all the pieces?

[fallen valve]

I need both the HDETM and the CC of all of the titus armor pieces.

[placid crystal]

kk, I'll put them into a zip for you

[fallen valve]

Anyway, ye, he has his primary gameplay material set, and his secondary title screen material set.

[fallen valve]

When you grabbed Titus' stuff, were they the in-game textures, or the title screen textures?

[placid crystal]

in-game

have a screenshot

[fallen valve]

Makes sense.

Got one of the front of the helmet?

[fallen valve]

So it looks as if too, we will need an actual model importer, cause their appears to be material slots missing.

[placid crystal]

mhmh

*mmhmm

I noticed that when I was working on the uv setups

There were between three to five, sometimes six channels, but they were all borked to holy hell

[fallen valve]

Their usually should only be 1 needed, as was with H2A.

The material slots rather are the parts missing.

That is outside what we can do though, even me, due to the game having a pretty good defense against debugging like I was trying.

[placid crystal]

hdtems, but no visible cc yet

[fallen valve]

Must not get used for Titus.

[placid crystal]

WIll take a look at the regular space marine and see if there are any

I thought so

Has anyone else made it to the point where you unlock the armory for your MP marines?

[fallen valve]

Did you ever get his face or hair textures yet?

[placid crystal]

Thinking the CC maps might be in there

Yup, one moment

[fallen valve]

A side by side, left is old, right is new.

*Minus HDETM for the moment.

[placid crystal]

I'll keep looking for those.

Might take a few days, mind you, since I do work alot.

But I'm pretty happy with the progress thus far.

[fallen valve]

Are the HDETM textures above not all of Titus'?

[placid crystal]

Everyone's done some good work.

The face for sure, the armor pieces are trickier to pick out with what looks like blood spots as dark splotches... so I'm not too sure.

Gonna work from this frame, will let you know what I find.

[fallen valve]

So what I will need from the looks of it is his damaged textures, which is what the HDETM is for.

So for now, I won't do HDETM till we have some form of texture exporting.

[fallen valve]

Hair is missing its textures.

Also missing his eyes.

[placid crystal]

Yeah, working on that too, lol

Gonna make an update to this pack with the new hdtems and hopefully his eye meshes.

[fallen valve]

Don't worry about the HDETMs for now until I can have something for them.

[placid crystal]

The way NR rips everything is like stitching a butchered pig back together... and I have to play hide and seek with the pieces.

kk, no problem.

Funny enough, I found Gadriel's head, eyes, hair and helmet piece.

[fallen valve]

I can only assume the texture resolution is lower than it otherwise should be is graphics level.

[placid crystal]

Possibly, that appears to be an issue with the rip

The closer I can get to the object in question, the highest resolution I can find. But not all are hi-res.

Like with the Deathwatch Marines, some of their pauldrons came out lower res than the others.

So I probably have to do a second pass and get in as close as possible.

Could also have to do with my own PC graphics setup, since I can't handle ultra settings

[fallen valve]

His head at the current quality level we can pull.

Set up as close to accurate as I can set him up as.

[placid crystal]

Oh, we're missing his service studs, too

[fallen valve]

Also holy fuck Titus' ear.

[placid crystal]

Maybe he got nibbled on by a tyranid?

[fallen valve]

That is one lucky fucking Tyranid.

[placid crystal]

Found the head mesh with eyes this time.

Gonna prep it for the pack.

[fallen valve]

Want me to set up the shading for stuff first before you shove it into the pack?

[placid crystal]

Sure.

I'll send it over.

Or... Put it in it's own separate blend file since these rips are a bit fucky with fbx

[fallen valve]

Uuuh, might have found a way to debug the game...thanks you shitheads known as cheaters

[placid crystal]

oh

nice

kinda

bu still nice

[fallen valve]

Its the dumb thing I tried earlier, I just didn't do it right.

[placid crystal]

Finally found the eye textures, lmao

[fallen valve]

Welp, I got into debugging the game, wow.

So easy.

All it took was a single ini change.

So not a ton of info gleamed that I didn't already know from the files themselves, and no textures either due to how they process them, at least with Nsight, might try RenderDoc next.

[fallen valve]

RD won't even try to connect, and the game crashes out anyway, which means this will require the game files themselves to be exportable at this stage.

[placid crystal]

interesting

Well, we knew there would be some roadblocks

also,

[fallen valve]

Le send so I can handle the face and hair stuff.

[placid crystal]

yupyup

version 3 incoming

[fallen valve]

Send before ya make V3.

So I can make some updates to the shader and the materials on the SMs.

[late grotto]

still looks cool

[fallen valve]

@placid crystal
So, figured out what I could for the Face, Eyes, and Hair.

Splitting the shader down the middle four ways.

• Default
• Subsurface
• Opacity
• Eye

Meaning 4 shaders for different purposes.

Now this is in Eevee, so support for Subsurface is not the best here.

[light vine]

?

[heavy halo]

oh ok so

the deathwatch marine has a thicc neck-guard as you can see

that's mark viii armour - so if you were wanting to do mark vii you'd have to trim it down

really it don't matter tho

[light vine]

iv done that already

[heavy halo]

swag

[light vine]

bc i was bored i try to remake the in game walk

[edgy locust]

What?

[heavy halo]

swag!

[edgy locust]

What!

[jagged herald]

yep, same(ish) format as H2A

[fallen valve]

Nice nice, glad your takin a look at it.

I tried taking a look at the file formats myself but it wasn't as easy to decode your stuff on said formats.

Mostly cause a lot of the format research stuff I look into is very direct in where stuff is in a file format.

Although that makes sense for the formats I have dealt with before.

[west roost]

@fleet moon

[native blaze]

Bro that looks fire id love to grab those fire decals if youd be willing to slide em

[jagged herald]

it's kind of shocking how saber managed to make their file formats even worse. makes me want to commit die.

[fallen valve]

We thank you Brother Haus for enduring this immense pain.
Seriously though, thank you for looking into all this.

Oddly, I can't seem to find where they store their shader code.

I see a resource file for it, but not the actual data for it.

I must be missing something.

[woeful creek]

holy shit, a haus appearance. we love haus in this house

[placid crystal]

Oh god, is that supposed to be an Adeptus Mechanicus?

[fallen valve]

I think so.

The mesh vertices at least.

[light vine]

when will the online marines be out?

[fallen valve]

Either when someone can pull the pieces out while debugging the game, or if we get any form of minimal model and texture ripping going.

We will most likely need the latter due to the masking.

[placid crystal]

Funny enough, I might've stumbled across masking and cc maps in my latest dive.

But he's right. Soon. This kind of thing takes time, and I'm afraid I don't always have alot of it, with my work schedule and fatherly responsibilities and all. But soon.

Still alot of pieces to stitch together, and I'd like to be as accurate as I can.

[fallen valve]

Reason we might want to wait for more Haus stuff before we try to rebuild the customizable space marines.

[placid crystal]

Yup, and in the meantime, research!

And exploration! I haven't even reached the Chaos stuff yet!

Or played the game that much... For that matter, lol

[fallen valve]

I got as far as the hanger before the first main mission post-tutorial, where I made a bunch of screenshots for reference.

Then went to go research the shaders more, which is a problem when the actual shader code seems to not be stored in the game as of current, as far as I can tell from what is stored in the game files.

They have a reference file for them, but not anything packaged in the data files.

I can go back and use H2A as reference, but not quite entirely, just sort of for the things that haven't changed.

Oddly, the shaders get compiled somehow on initial bootup, but how, yet to figure that out.

I even found where the compiled shaders go in your OS for later reference, but not where the actual uncompiled data is in the main game files.

[placid crystal]

hm

[fallen valve]

The shader cache is what I am hoping is something information wise, but this format is a little odd at the start.

[jagged herald]

Shaders are precompiled. Your best bet is to open the .td files in a text editor

[fallen valve]

Precompiled from where though? In the shader cache files?

Cause that is what I am looking at right now.

[jagged herald]

yeah the .sdc files in that are the compiled binaries

[fallen valve]

Right, got that far, and figured out it says the whole bulk data and then some lesser amount of bulk data..but not how to read said bulky data yet.

I genuinely had to write the formatting down otherwise I lost track at some point.

Then each entry ( 18 + 2 ) has a u32 integer and then a u8 integer ( plus some null bytes ) ..
Is the bulk data compressed?

Cause it seems like their is a bulk data total, and then possibly a bulk data total uncompressed.

The whole reason for needing to figure this out is the fact that they handle the shader model workflow different now to what they did with H2A.

Its similar, but not quite the same.

[jagged herald]

bulk data?

[waxen ledge]

d

[fallen valve]

Yes, Their is the header ( u32 x 4 ) , then each entry group ( size + number of entries in group ), then each entry in that group ( unknown u32 integer + unknown u8 integer ) then after all that, is a giant lengthy amount of the 'bulk' data that seems to be all the bulk data of each entry jammed together with no spacing in between.

With no way yet from the entries themselves at the top to determine where each bit of bulk data of each entry sits.

I can split the data up by the group data size but unsure if that would be correct, as they could interleave the entry bulk data regardless of associated shader group.

Although it is probably that simple.

[jagged herald]

what file is this?

[fallen valve]

Using PC DX12 MTL Stencil as my reference sdc file.

Also figured it out more properly now.

Header is - group total, entry total, bulk data total size, sanity check ( 01 )
Group is - group bulk data size, group entry total
Entry is - unknown u32 integer ( entry hex ID ? ) , unknown u32, null 4 bytes

Then the bulk data...which I am unsure how to read.

[jagged herald]

I don't really know anything about shaders so I probably can't help there...

[fallen valve]

Does the debug stuff say anything about the SDC files or did those files come with the original FX files?

[jagged herald]

doesn't mention anything useful about them, no

probably gonna call it here for now. already spent way longer than I care to. Posted most of my research to reshax

[fallen valve]

Its zlib compressed.

The bulk data.

Thank a fellow in the ImHex server for that one.

[jagged herald]

ah nice. anything useful in them?

[fallen valve]

So basically each group's bulk data is a zlib compressed package of some sort.
Yet to actually make a script yet to uncompress them.

So knowing what is in them is yet in my grasp.

[fallen valve]

Based on the total entry byte sizes of 1 group though, the file I was looking at nearly doubles its 1st group when uncompressed, meaning either source shader code or compiled d3d bytecode is held within, which either way can be viewed or parsed then viewed.

[velvet atlas]

love the armor, hate who is in it.

[jagged herald]

@fallen valve

dxil

[fallen valve]

Oh, you figured it all out?

Was about to post my pattern for the file type:

import std.core;

struct SDCHeader {
    u32 GroupTotal;
    u32 EntryTotal;
    u32 BulkDataSize;
    u32 SanityCheck;
    };
    
struct SDCEntry {
    u32 EntryID;
    u32 EntryUncompressedSize;
    padding [4];
    };
    
struct SDCGroup {
    u32 GroupBulkDataSize;
    u32 GroupEntryTotal;
    SDCEntry Entry [GroupEntryTotal];
    };

struct SDCGroupData {
    u8 ZLibCompressedData [parent.Group[std::core::array_index()].GroupBulkDataSize];
    };

struct SDCFormat {
    SDCHeader Header;
    SDCGroup Group [Header.GroupTotal];
    SDCGroupData BulkData [Header.GroupTotal];
    };
    
SDCFormat Format @ 0x00;

The second u32 of the entry is still unknown to me though.

[jagged herald]

nah i just chopped off the header and decompressed it to see what was inside

[fallen valve]

You made sure to chop the zlib data groups apart correct?
Cause their is usually more than 1 group of bulk data in these files.

@jagged herald So it looks like the 2nd u32 of the entry is the entry's uncompressed size.

[jagged herald]

nope. i just manually extracted the other streams and they're also dxil though. there's 4 streams in that file and they all begin with 78 01

[fallen valve]

Oh so the script can just read multiple zlib streams in 1 file?

[jagged herald]

nah it probably corrupted the other streams with the file i uploaded. i just deleted the header with a hex editor and ran it through a decompressor

[fallen valve]

Cool cool, so ye, each entry references only 1 shader, in its decompressed form, using the entry uncompressed size.

Ala the total of every entry's uncompressed size in a group should match the uncompressed size of that group's bulk data.

Now to save this script for further use later.

import struct
import zlib

"""
struct SDCHeader {
    u32 GroupTotal;
    u32 EntryTotal;
    u32 BulkDataSize;
    u32 SanityCheck;
    };
    
"""
class SDCHeader:
    def __init__(self, data):
        self.GroupTotal, self.EntryTotal, self.BulkDataSize, self.SanityCheck = struct.unpack("<IIII", data)

"""
struct SDCEntry {
    u32 EntryID;
    u32 UncompressedSize;
    padding [4];
};
"""
class SDCEntry:
    def __init__(self, data):
        self.EntryID, self.UncompressedSize = struct.unpack("<II", data[:8])


"""
struct SDCGroup {
    u32 GroupBulkDataSize;
    u32 GroupEntryTotal;
    SDCEntry Entry [GroupEntryTotal];
}    
"""
class SDCGroup:
    def __init__(self, data):
        self.GroupBulkDataSize, self.GroupEntryTotal = struct.unpack("<II", data[:8])
        self.Entries = []
        entry_data = data[8:]
        for i in range(self.GroupEntryTotal):
            entry = SDCEntry(entry_data)
            self.Entries.append(entry)
            entry_data = entry_data[12:]

"""
struct SDC {
    SDCHeader Header;
    SDCGroup Group [Header.GroupTotal];
    u8 BulkData [Header.BulkDataSize];
}
"""
class SDC:
    def __init__(self, data):
        self.Header = SDCHeader(data[:16])
        self.Groups = []
        offset = 16
        for i in range(self.Header.GroupTotal):
            group = SDCGroup(data[offset:])
            self.Groups.append(group)
            offset += 8 + group.GroupEntryTotal * 12
        self.BulkData = data[offset:]

    def extract(self, filename):
        with open(filename, "wb") as f:
            f.write(self.BulkData)

    def extract_all(self):
        offset = 0
        for i, group in enumerate(self.Groups):
            zlib_data = self.BulkData[offset:offset+group.GroupBulkDataSize]
            offset += group.GroupBulkDataSize
            data = zlib.decompress(zlib_data)
            for j, entry in enumerate(group.Entries):
                with open(f"{i}_{hex(entry.EntryID)}.bin", "wb") as f:
                    f.write(data[:entry.UncompressedSize])
                data = data[entry.UncompressedSize:]


def main():
    with open("./test.scd", "rb") as f:
        data = f.read()
    scd = SDC(data)
    scd.extract_all()

if __name__ == "__main__":
    main()

Thank you Jumanji144 and WerWolv for the help.

[delicate pewter]

Shit that's a lot of work for some models, hats down to you gents and thank you.

[fallen valve]

The above is for the shader definition collection files, not the models.

Which tells the engine how to shade stuff basically.

[delicate pewter]

still, that's a lot of info to take in

[fallen valve]

I had to write things down as I figured this all out as well.

[delicate pewter]

so are we close to reach a positive result ?

[fallen valve]

Not sure on Haus' end with the models and textures, but the materials are just text files ( yml or json or something ), and then the shaders are compressed up dxbc shaders that get linked to each entry in each shader group, meaning all it would require is for Haus to make some form of data viewer for the sdc files or just an exporter for them.

@jagged herald Would you be willing to include viewing and or export support for the SDC files in Index or whatever your going to use for SM2?

[delicate pewter]

that's impressive progress, in such a short time, but again the last game i borrowed assets lol was Tomb Rider 2013

[fallen valve]

What helps is Swarm is just rebranded Saber engine, like not even kidding, a lot of it is like the H2A iteration of Saber engine minus the new file types and the changes made to the existing file types like models and textures.

Okay, yep, the text files are all just yaml.

Well that's easy to deal with.

[delicate pewter]

o well lets hope that Haus can help with the viewing and export support the rest you seem to have it well in hand

[fallen valve]

On to me poking at the textures next.

[jagged herald]

https://reshax.com/topic/1058-space-marine-2-pct_mip-pctresource-textures/?do=findComment&comment=5464&_rid=4494

[midnight compass]

can you ping me if you rig it please ?

[jagged herald]

i don't plan on rigging

[polar mist]

If anyone nabs the Chaos Marine models, lemme know :3

[fallen valve]

I assume your going to include whatever rig just comes with the model then or does it not even come with a rig?

[jagged herald]

i havent figured out the node chain setup because saber changed a bunch of stuff with their vBuffer, and I don't have the time or drive to figure that out right now

[fallen valve]

Guess its on me then.

[fallen valve]

You got your in progress info for the models somewhere?

[fallen valve]

@jagged herald Also don't know if you checked, but the per image information is inside the resource files:

__type: res_desc_pct
header:
  faceSize: 5592400
  format: 51
  mipLevel:
  - offset: 0
    size: 4194304
  - offset: 4194304
    size: 1048576
  - offset: 5242880
    size: 262144
  - offset: 5505024
    size: 65536
  - offset: 5570560
    size: 16384
  - offset: 5586944
    size: 4096
  - offset: 5591040
    size: 1024
  - offset: 5592064
    size: 256
  - offset: 5592320
    size: 64
  - offset: 5592384
    size: 16
  nFaces: 1
  nMipMap: 10
  sign: 1346978644
  size: 5592400
  sx: 2048
  sy: 2048
  sz: 1
imageOffset: 0
isCopyDst: false
isImposter: false
isLightmap: false
linkTd: res://td/ch_titus_helmet_02.td.resource
mipMaps:
- ch_titus_helmet_02_0.pct_mip
- ch_titus_helmet_02_1.pct_mip
- ch_titus_helmet_02_2.pct_mip
- ch_titus_helmet_02_3.pct_mip
- ch_titus_helmet_02_4.pct_mip
- ch_titus_helmet_02_5.pct_mip
- ch_titus_helmet_02_6.pct_mip
- ch_titus_helmet_02_7.pct_mip
- ch_titus_helmet_02_8.pct_mip
- ch_titus_helmet_02_9.pct_mip
pct: ''
source: <source>\characters\ch_titus_helmet_02.tga
texName: ch_titus_helmet_02
texType: ''
tileLayout: 0
tiles: []
useHeaderFromResource: true

Titus' Helmet for example.

[jagged herald]

yeah ,i already have that set up

[fallen valve]

cool cool, but ye, this makes it easy on me to build up the textures in python.

Is the raw image data just dds raw image data?

[jagged herald]

Index: https://github.com/Wildenhaus/IndexV2/tree/sm2
LibSaber: https://github.com/Wildenhaus/LibSaber/tree/sm2

Not providing any support or builds. very slow, very buggy. only a handful of things work. but all of the research/code is there

[fallen valve]

You my friend are bloody awsome.

This will help immensely.

[spare knot]

the codex states you shouldn't mess with armor for entertainment.

[fallen valve]

Now now..this is research..on how to beat our enemies better..and make more space marines..totally all that.

[spare knot]

https://tenor.com/view/warhammer-40k-warhammer-no-meme-gif-15084429411958404464

[fallen valve]

Shut up, Leandros.

[delicate pewter]

and hopefully some cadian guardsman

[placid crystal]

"This isn't supported by the codex astartes.... but I am looking forward to it."

[fallen valve]

The fun part of this will be reading what are effectively yaml files...

[jagged herald]

there are lots of libraries for that. i'm using one

already wrote a parser for saber's awful scripting material system. never again

[fallen valve]

I just need one to start reading stuff like the resource files..
Oh, I forgot I need to read the .cache files as well, lemme look at those before I move on any further.

[jagged herald]

Pretty sure the cache files are all just yaml files with a list of files contained in the paks

[fallen valve]

Not quite, their is some data in between, but won't be able to get a further look at them till I get back home.

[jagged herald]

Well damn, someone sent me money so I guess now I have to finish what I started

[placid crystal]

damnit

the haus always wins

I'm ready for bed

[fallen valve]

Wait what, as in donations?

[jagged herald]

Yeah someone sent me a kofi

[fallen valve]

link?

[jagged herald]

Google.com

[fallen valve]

https://tenor.com/view/fair-baron-zemo-the-falcon-and-the-winter-soldier-fair-enough-seems-fair-gif-22912772

[jagged herald]

Pls no

[fallen valve]

Have a fiver for doing some amazing work as always.

[woeful creek]

We must once again drain our bank accounts for haus

Because the Warhammer gatekeeping days are over

We have won over the gatekeepers

[fallen valve]

Let this be known, the traitors shall be vanquished.

[quick saddle]

Does this mean we will see Guardsmen soon?

[placid crystal]

eeeehhhhhh

Maybe.

Guardsmen have lots of pieces as well.... And my plate's a little full atm

But hopefully with proper tools. One day. in the 42nd Millenia maybe.

[woeful creek]

down with the gatekeepers

[placid crystal]

Never was for gatekeeping... But it also seems like there aren't very many people working on this... So, we're kinda doing the research relatively solo.

Plus, I prefer to put out assets with a little tlc rather than raw rips.

[fallen valve]

However we are going to need those proper rips once Haus does his magic.

[placid crystal]

I'll see what I can do about that.

I have about 200 new gigs to play with on GDrive

Very rudimentary color ramp, but I know we can do better.

Also, that HDTEM is tiiiiny

Gonna post this to a new blend pack and forward it to you for research. It'll be packed and scaled down to the other Space Marines I did.

Just gotta wrap up a couple missing textures.

[fallen valve]

I'll send you my current node to work with for now.

[quick saddle]

Well. Heres Hoping. Still, love the look at what you have here, looks dope.

[lapis patio]

Has anyone acquired the chaplain helmet?

[light vine]

are they out or wip?

[jagged herald]

thank you kind sir

[placid crystal]

Still wip

[lilac rover]

@swift path

[jagged herald]

@fallen valve

[placid crystal]

Hoooh?

[fallen valve]

Oh, wow, is this just the model to test I assume?

[placid crystal]

Did you manage to pull a rig with it?

[fallen valve]

Not responding That could mean good or bad....

Apparently, yep.

[placid crystal]

Interesting

[fallen valve]

I imported this in with Better FBX mind you, don't know how Haus handles building of FBX files.

[placid crystal]

The best part is all the pieces are there, and in the right spots

Well, from what I can see.

[jagged herald]

you can delete the empties

[placid crystal]

Looks like a porcupine if I wasn't thinking about the node and bones.

[jagged herald]

weights are a little screwy

[fallen valve]

Oh god, the cine models are gonna kill people's PCs.

[placid crystal]

Yup

[fallen valve]

Lots of odd bits of geo.

[placid crystal]

Hmm, how many separate objects are in that file?

[fallen valve]

@jagged herald Is this with all lods shoved into the blender of this file?

[placid crystal]

That would make sense.

[jagged herald]

lods and collision volumes were filtered out on export, which is where the empties came from

[placid crystal]

So that's what we're looking at then?

[fallen valve]

Seems like they store multiple different parts in this file then.

Noticing this with the face.

[placid crystal]

Kinda like with Reclaimer?

[fallen valve]

Yes, but with no filtering like you can select in Index proper.

[placid crystal]

Or rather how meshes appear on loading the model file?

Kk

Well, hell, progress has definitely been made today! Excellent work Haus!

[fallen valve]

Also they have Render and Sim specific meshes too in here, which is semi-useful sim meshes wise.

[jagged herald]

meshes have splits and currently theyre going to their own meshes on export

[fallen valve]

Fair I guess.
Able to pull me Titus? ( ultramarine gameplay )

He's my base for stuff right now.

Should be cc_titus as far as I understand.

[fallen valve]

Oh....wonder if another file of his has his whole fit.

Although its odd, cause the empties show that their should be more here..

[meager birch]

do you have a guide to get indexv2 working with sm2? im very lost.

[fallen valve]

Their isn't a working version yet.

We still are figuring out things.

[fallen valve]

..but ye, their should definitely be more objects here.

[meager birch]

ah i see thank you

[placid crystal]

Oh yay! The purity seals are in the right spots!

[fallen valve]

Ye, but, I am wondering if we need 1 lod down for the proper parts to show.

[placid crystal]

Possibly

[jagged herald]

here's a full rip of the cinematic titus model incl textures and lods - nothing removed https://www.mediafire.com/file/o4b6ucnsj052gsb/cine_titus.7z/file

[placid crystal]

Heh

Cinetitus

[jagged herald]

i know that there are a few extra bones specifically for lods. havent figured out how they work though

[placid crystal]

Object physics? Most of the armor pieces jiggle and move with the slightest movement.

[fallen valve]

Cool cool, I wonder if gameplay Titus has his other pieces at a lower LOD than LOD 0.

Anyway, I'll be back in a little, just heading to the store, and I'll look at cine titus then.

[light vine]

Is it possible to rip all running and walking animations?

[fallen valve]

We'll get to that once we get the basics working..

[placid crystal]

Heh, cinetitus. 🙂

[fallen valve]

When Titus is shirtless in the 2nd intro.

[light vine]

Sounds cool

[fallen valve]

@jagged herald Uh, looks like ya got a broken texture here.

[jagged herald]

apparently that texture is BC7A. Not sure how to handle that

[fallen valve]

Also, same issue as before, not sure what is causing this.

[jagged herald]

thats the cine one?

[fallen valve]

yep

[jagged herald]

try this one

[fallen valve]

That looks to have more there.

What changed?

[jagged herald]

i split the submeshes into their own meshes again

[fallen valve]

Makes sense.

Did you want the submeshes to be part of their parent mesh or?

[jagged herald]

i tried that and that was causing issues with the fbx

[fallen valve]

Fair, ye, FBX is funny that way, its why Porter evidently just built his own format and importer for his own tools.

I am not expecting you to do that or anything, its something I will keep in mind, for my own tools for SM2.

[placid crystal]

what about dae?

[fallen valve]

Not sure if that would help.

DAE is just more open a format.

Although GLTF might be the way to go because it is just more open and can store a lot of shit.

USD is the new kid on the block, but nothing quite yet stable for everything.

So if we don't use FBX, GLTF is the way to go.

[placid crystal]

Might be worth looking into then

[fallen valve]

USD would only be useful if we want everything to be set up using what Blender has available, rather than what is standard.

Later when I build up my own patterns for each format, then I can begin to create a plugin to import the native formats.

[fallen valve]

Also not sure if this will help, but here is the BC7 documentation:
https://learn.microsoft.com/en-us/windows/win32/direct3d11/bc7-format
https://learn.microsoft.com/en-us/windows/win32/direct3d11/bc7-format-mode-reference

Well, looks like I could find no direct reference to BC7A...meaning we might have to figure out the differences ourselves.

[fallen valve]

Also I assume the BC7A is coming from the debug stuff you have, ala a list of formats they are using?

[jagged herald]

yea

[fallen valve]

Ye, that must be super new, cause their is not even a dxgi documented reference of it.

Maybe directxtex has something about it.

Yep, not even a lick of reference in dxgi stuff, meaning this is either them picking a mode of BC7 and not saying mode, or this is a custom dxgi format.

They also mention DXT5A, which is also not an actual DXGI format, meaning either custom or a mode of DXT5.

[fallen valve]

  DXGI_FORMAT_BC7_TYPELESS = 97,
  DXGI_FORMAT_BC7_UNORM = 98,
  DXGI_FORMAT_BC7_UNORM_SRGB = 99,

Actually it could be typeless if not unorm or unorm srgb.
Guess your gonna have to experiment.

[jagged herald]

that's maddening

saber decided to just shove in both the old and new texture formats. wrinkle_mask uses the old one

[fallen valve]

Ah, odd.

Backwards compatible moment.

[jagged herald]

only 20/29956 texutures that use the old format

good job saber

[fallen valve]

https://tenor.com/view/clapping-leonardo-dicaprio-leo-dicaprio-good-job-gif-13100657

[jagged herald]

has 10 faces, each with their own part of the mask

[fallen valve]

Good thing I can import dds images with lattes dds importer.

So covering from the looks of, is for effect coverings, ala blood, mud, and water.

Which the hdetm mask is used for.

At least for something like titus' helmet.

[sharp wraith]

has anyone tried ripping the multiplayer textures

[fallen valve]

Not yet, especially as it requires the right shader ( I am handling all that nonsense ), and a way to rip all of the stuff for it, Haus is on that one.

[sharp wraith]

ah ok well you guys are doing great work thanks

[placid crystal]

I agree, with the amount of textures I've pulled, it is nonsense.

I don't need almost everything in a scene, damnit, just what I need.

It's eaten up a metric fuckton of my data :*I

[neon vortex]

Potentially dumb question but does anyone know what the CDT file in the TPLs are?

[meager birch]

i be Cooking, it will properly will be painful finding the textures from the ninja rip.

[fallen valve]

He @jagged herald , so looking into the files contained within an SDC shader group, it looks like some are just u32 integers, possibly markers or such, but I am unsure what the markers could be.

Wonder if you could see anything in your RE of the exe that could help.

[jagged herald]

collision data

[jagged herald]

might be crc32

[jagged herald]

@fallen valve Your SDCEntry is a bit off. the first uint32 is a CRC32 hash of the file name. The last uint32 that you have marked as padding is actually an LPString32, where a value of 0 means its empty

[fallen valve]

The first thing I figured out, second thing...uh, did not realize that.

[fallen valve]

what is lp in lpstring32 ? I do not know that off-hand.

[jagged herald]

length prefixed string. an lpstring32 is an int32 denoting the string length, followed by the text

[fallen valve]

Seems like they never use names anyway.

..or the names are stored elsewhere, ala in the bulkdata.

[jagged herald]

one of the hashed filenames is filenamespreload

[fallen valve]

Funny, also for the Vulkan shaders, they seem to use their own custom format for the vulkan shaders that I couldn't figure out off-hand.

Its different enough that using the SPIRV pattern as a template did not work.

[fallen valve]

Actually, which file is that hashed filename in?

Also I assume you know the stuff to get out the actual name instead of the hash?

[jagged herald]

you need to know potential filenames beforehand, hash them with crc32, and make a lookup table

[supple breach]

lots of titus

[fallen valve]

Ah, fair.

[fallen valve]

I assume not many are left over to use then.

[proper prawn]

Bruh I dont even know how you guys are this fast in ripping stuff from the game, its been like what? 3 weeks? Max?
You guys are awsome, the 40k dudes do be eatin' good.

[placid crystal]

It's been stop and go for me, lol

But I'm taking a little time to do it right, until tools develop and more folks can have access to properly put-together models and possible rigs.

[proper prawn]

Heeeelll yeah. I'm new to blender do being able to just hop in and use made models etc is amazing
Means less modelling which... yeeeahh

[lapis patio]

Did u by any chance aquire the textures?

[fallen valve]

Give things some time, we have yet to get things working fully yet.

[lapis patio]

Im aware im only asking incase the textures were extracted

[fallen valve]

Yep, looks like they don't use the occlusion baked out, but rather the screen-space occlusion.

[edgy locust]

Explain in Fortnite terms

[meager birch]

https://tenor.com/view/flashgitz-black-templars-black-templar-templar-dance-warhammer-40k-gif-6730809294613751178

[edgy locust]

Understandable

[fallen valve]

That would be in Unreal terms, so same terms really, as occlusion in unreal is either baked out, or screen space usually.

[gleaming nexus]

is the chaplain in this pack or not yet?

[fallen valve]

Not yet, we don't have index V2 in order yet to grab everything.

[sharp wraith]

you guys think itd ever be possible to rip the executions from the game?

[fallen valve]

Haus never actually touched animations..this would be the first.
Depends on if he is willing to look into it.

[meager birch]

After spending a day and a half trying to find the correct textures out of 3000 extracted from the ninja Rip, I believe it’s a better idea to wait for the lads to finish decrypting space marine 2 file system and get an integrated with index V2. I’ll pop up the extracted files on another thread in case anyone wants the Thunder hawk files soon. I’ve also noticed there is a number of missing meshes, Which Is either due to mesh culling/ lod switches or Vehicle being slightly different depending on when the player is at during the campaign. (Ninja rip captured very early in the game.) another question that may be answered once the lads have finished their work.

[placid crystal]

Yes, but progress is progress

I spent a few days working on these, ngl

Still have three left to do, and then get back to the weapon pack and the regular Space Marines and their armor sets

One thing NR also does is rips everything in the scene that is currently rendered... also while using up the resources in your memory or storage. Essentially, the less amount of storage space you have, the less of a complete rip you'll get. And, if you're looking to get everything, be prepared to prepare multiple rips.

It's tedious, very tedious, and very messy

But progress is definitely progress.

Also, holiday is coming and is one of the best times to invest in memory and storage! Doesn't hurt to invest in a 10TB+ external drive for future renders and projects!

[fair shale]

Yay! The leg textures!

Even if they're discolored you got em!

[placid crystal]

I'll be adding CC maps to (their own separate Chaos Astartes Pack) eventually (within the next day or so)

Right now everything shows the base textures as they appear in the files

[fair shale]

You guys do the Lord's work 💪

[meager birch]

do you see why im not a happy mike right now! It will be needed to be imported with t-pose to get rid on the skew (note changing fov dosent do much to remove the skew)

[placid crystal]

T-pose import might have to be the right way to do it... But, hold onto that one too

So you can reference it when rebuilding the model

Don't know how to fix the skewing

Also, you'll notice the model appears squished into a box shape, you can fix that by scaling the mesh in the correct direction by 2

[meager birch]

very true also about fixing the skewing..... i having an evil plan see if i can use a lattice in blender to fix it

[woeful creek]

that medieval knight one is cool af looking

[viscid river]

are these like
dead 30k marines that were in the background ?

[glossy cedar]

They're from the chaos legions, so technically yes

[viscid river]

Oh cool

Here to hope the thousand sons will be added too

[delicate pewter]

That iron warrior would look so fine in Starfield, those shapes mmmmm in 2 words heretically sexy. Nice work Mister lore.

[glass knoll]

this is very hype! are these rigged as well?

[polar mist]

Lemme know when those are all set, I’d love to grab that Black Legion boi

[placid crystal]

No rigs, unfortunately

But I'll hopefully have these set to go soon(tm)

[viscid river]

I dread the vertex groups you'll have to do for the exposed bodysuit

[placid crystal]

I think those are often just one straight color... But I could be wrong. I'll have to double check the cc files if there are any for the suits

[viscid river]

weight colors are icky to me
way outside my scope of competence

[fallen valve]

With the copy of index ( not finished yet ), you should be able to get all the parts with their weights, plus the rigs.

[glass knoll]

What’s the progress like on the index? Any etas?

[placid crystal]

Yaaaaay!!!

We test tonight! I'll shoot for getting off work early tonight!

[fallen valve]

We have the templates ( models ), textures, texture definitions ( materials ) and scenes ( blockout, no instances yet ), but none of the shaders in the SDC files, due to the SDC format being kind of insane to figure out right now.

[leaden edge]

this makes me wonder if i should wait for the index to be released or just release my cadian pack tomorrow with custom weight painting-
idk what to do because ive gotten so many dms about its ETA-
that and the anxiety thats caused because of the fear that I messed the rig up somehow, as well as proportions.

When I imported the Cadian meshes from NR (Ninjaripper), the Leg and boots were all squished so i had to guestimate whether or not the proportions were correct, as well as everything needing rigging.

[fallen valve]

I'll see what Haus has left, right now he is working on loading multiple stuff at once for multi-export.
Ironically it was Adam who donated and requested that.

[leaden edge]

Thanks, much appreciated. Id rather have good weight painting and correct proportions, so this will be a life saver.

[fallen valve]

We also have the solid collision plus the sim collision both exportable as well other than the render meshes.

[leaden edge]

Good, Good. Thanks.

[fallen valve]

Means you can set up the render meshes that are meant for sim rendering to be sim cloth or such, use the sim mesh as the collision for that cloth sim and then set up the solid collision meshes as collision so the sim stuff doesn't fly into the model.

[placid crystal]

Nice.

Excellent work!

[glass knoll]

And I assume you guys want to release with the shaders? Or will there be a release without them?

[fallen valve]

The shaders file aren't necessary to make the assets exportable, so most likely we will go without them unless I can somehow figure out the formatting of the SDC bulk data before that point.

[glass knoll]

So then SoonTM there will be a release?

[fallen valve]

Maybe, I don't know what else Haus wants to have as part of the Index V2 SM2 build.

So for now I won't say anything time frame wise.

[glass knoll]

Understandable. I’m really hyped for this, have been meaning to make a cinematic for a while but was always too lazy to make a bunch of custom models specially knowing how GW is about fan content

So SM2 assets will be a god send

[fallen valve]

Well as far as the way the Saber CEO is speaking, they don't care so much about ripping and modding, but it won't be up to them in all reality.

They will care if you cheat, but not if your just doing non-harmful modding.

[glass knoll]

Yea it’s just good ol James and his workshop who I know would take down content in a heartbeat similar to what happened with Astartes

[fallen valve]

If they take down a port I help with of titus' ass, its canon.

[glass knoll]

Lmao

[placid crystal]

So we'll reiterate again, we don't rip assets or use them for profit

And our community has a pretty good track record of using our collective powers for good... And art.

[glass knoll]

Ah sorry, what is the right term for the procurement of the assets? I also don’t plan on monetizing what I make, I really just want to make a high quality blender short cinematic to give some love to my shark boys (and guardsmen/night lords)

[placid crystal]

Ripping.

And tearing.

But mostly ripping.

So long as you remember to credit Saber for the assets and GW for their franchises (and good ol Haus and Casey with the purple/pink name for their sorcery, and the Archive for being a proper asset archive), it should be good.

[fallen valve]

Purp?

[glass knoll]

Fingers crossed 🤞 I’ll keep that in mind as well

[placid crystal]

Fixed it, sorry about that

Just got home, digging into the thingy now

[placid crystal]

I keep seeing Purp and apparantly my brain registers all purple/pink names as Purp.

Don't.... Don't get old.

Or if you do, make sure you're a Primaris.

[placid crystal]

🙂

Ready yourselves, brothers. These next few weeks are not supported by the Codex Astartes, but I am looking forward to them.

[onyx flare]

I want the Calgar model so badly- I plan on using parts of him for a vrchat project

Mostly I want his head but if I could get all of him that would be amazing

[winged bear]

bro think he:

[placid crystal]

Nah, just keeping the references going

[late grotto]

chaplain with all textures applied render ready

[delicate pewter]

Thank you very much and btw does it have a rig ?

[late grotto]

ye

[meager birch]

thank you for posting this mate its great work just an fyi their right hand is having some 'weight issues'/bone. 🙂

[late grotto]

i didnt rip or rig it i just applied the textures

problem seems to be that mostly everything is weighted to the left arm

[fallen valve]

Make sure your selecting the right bone, their might be control bones in there.

[leaden edge]

I believe I figured out the MP side of SM2 shaders.

I think.

I use NR to rip my custom
Marine, and some of the textures came out as what I interpreted to be an RGB style mask texture. Idk if it’s different with the raw files that you guys might be dealing with, but I hope I provided some insight with that.

[fallen valve]

I already know how the MP side goes, but its building it into the current WIP of my shader that will be a little later, as I just need to build in all of the non-combiner shader macros into the shader, which includes the customization and tintbymask macros.

[leaden edge]

Alr, good to hear

[fallen valve]

Just to give you an idea of all of what I have to build into the GLT shader or build as a combiner ( for the macros which are combiners, not part of the main shader calculation ).
Customization and TintByMask being what I think is used for customization ( decals I think are handled seperately ).

Open in Notepad ++

[leaden edge]

Got it

[fallen valve]

This being the default preset, their is also metal and stone as a preset file for the glt shader.

I am also still working on the SDC file format, trying anyway, and still yet to pinpoint the exact part in the files where they link the shader file to the shader cache information.

[meager birch]

Got blender itch earlier. its rig has been fix a bit and IK added. ill post a copy when im done meddling with it. 🙂

[glass knoll]

you guys are awesome

I started to build out my little cinematic environment

[west roost]

Can you send it

[jagged herald]

tool is live
https://github.com/Wildenhaus/IndexV2/releases

[leaden edge]

HELL YEAH!!

[fallen valve]

V3 of my shader is not published yet, hopefully tonight but here is the github page for when it releases.
https://github.com/GameOverloads/Space-Marine-2-Shader-Resources

V1 and V2 will be archived here also tonight.

[leaden edge]

Hallelujah

[fair shale]

https://tenor.com/view/flashgitz-black-templars-black-templar-templar-dance-warhammer-40k-gif-6730809294613751178

[fallen valve]

Soon I will have the visualizer-device delivered to the objective brothers.

[fair shale]

https://tenor.com/view/warhammer40k-emperor-of-man-emperor-gif-12094981323200160207

[fallen valve]

Much of its sub-modules are missing for now, but I can find the others with time.

[late grotto]

You rig the cloth tooz

[meager birch]

Yes, I did. I also need to fix the weight painting on the other-hand and then I’ll post the blender file without the textures.

Personal preference, but it annoys me when the legs control the cloth around it like the Chaplin or other models I’ve rigged in the past.

[late grotto]

Yeeee

[meager birch]

https://drive.google.com/file/d/1Z2xki0MuEpOEPCZNAMvlHybIFMfNlNg4/view?usp=sharing

[late grotto]

how do i fix the normal issues in blender 4.0

[meager birch]

explain the issue?

[fallen valve]

Is this is a rip from the game files or from a game running rip?

[meager birch]

its the file i sent back to them, its most likely a NR file.

[fallen valve]

Ah, then just NR wack then like I usually see.

Honestly, might just be worth rippin him directly from the game at this stage.

[meager birch]

working on it thank to Haus and the other peeps 🙂

[fallen valve]

Good thing I posted my shader now, in its current state which should be able to handle a lot of stuff, even if not fully yet.

[meager birch]

Very true I'll have to compair the index rip thunderhawk to the NR world rip see how much the world fov messed up the import.

[fallen valve]

The fun part comes with certain other shaders which I would need more reference info for.

[late grotto]

it was from adams

its only an issue i have in blender 4.0

[fallen valve]

Ah, ye, adam has a fun tendency to not have his files in good standing.

I can rip it out myself when I am home and send it to you.

[late grotto]

it looks perfectly fine in 3.4

[fallen valve]

I should just be able to rip it when I am home and then you just have to import it into 4.1, and it should look fine.

[late grotto]

you sure its an issue with the model?

it hasnt just been stuff from rips

it does this with any model i export to 4.0

i could try 4.1

[fallen valve]

Given Adam's past issues with game files ( especially when I looked at his UE stuff) it should be just fine if I just send you a direct rip with all the files included.

Ye, I'm on 4.1, but I am also using Better FBX to import in my FBXs, so that may help.

[late grotto]

cause this is whqat it looks like in 3.4

[meager birch]

ill post index rip of him on the drive soon waiting for an export to finsh

[fallen valve]

I have had no issues on my end on 4.1, but again, I'm using Better FBX cause Blender's native FBX importer/exporter is pure garbage.

Literally from a reverse engineering of the 2014 if I remember correctly for the native importer.

[late grotto]

im going to try opening it in a newer version as i recall there being smoothing issues in 4.0 iirc

[meager birch]

any ideas why im having issue with this Transparent texure ?(image is a png) blend 4.2

[fallen valve]

Connect the alpha of the diffuse to the surface input real quick.

I hadn't built in transparency ( or whatever the decals use, I would need to check their definition files ) yet since I had been just using Titus as reference for the minute.

I want to see if they store the mask for that in the alpha.

Send me a screenshot of the viewport with the alpha of the diffuse connected to the surface input is what I mean.

[fallen valve]

Okay so keep the alpha connected for now to the main shader, but just for the minute, to bypass this for now, take a mix shader and a transparency shader.

Connect the alpha to the mix factor of the mix shader, connect the main shader to the A of the mix shader, and connect the transparency shader to the B of the mix shader, and then connect the mix shader to the surface input.

Then just make sure your material settings / viewport display settings have the blend mode set to alpha clip.

I will have to look at the decals later to find out how they work.

[meager birch]

that did the job thank you.

[fallen valve]

Yes, let me go check the TD for that and see what the decals use.

[hollow raptor]

can this tool get animations?

[fallen valve]

No, not in current version.

[hollow raptor]

dam

[meager birch]

https://drive.google.com/file/d/1QjK2IOJzfn4j4vGB0pQoXA7ITN7cOlcu/view?usp=sharing

raw from index

[fallen valve]

Oh he, looks like you don't need any of that, just set the blend mode to blend it seems, let me know if that works, or if I still need to make changes to the shader.

[meager birch]

i cant find the old alpha bend in 4.2 material setting.... google wasnt helping

[fallen valve]

Oh ye, its render mode now I think.

Eevee stil has the same settings from before, Cycles has the render mode setting.

[meager birch]

ah 'render method' was already set the blended

[fallen valve]

Then that means I need to update the shader, got it, might be able to do it here remotely without too much trouble.

[placid crystal]

About to make the change to the new shader, but i'm reaaaaaly happy with the extractions!

I need to add a front light to make him stand out.

[fallen valve]

I shouldn't need a reference for doing this since I already know how this would need done.

[placid crystal]

I noticed the shader has new duds, would you mind sharing a screen with your setup?

[fallen valve]

Use the main TD file as your reference, the material name in Blender has the material variant at the start and the TD file to open.

Its just a YAML file you can open in Notepad.

[fallen valve]

https://discord.com/channels/819709630540021810/1288079313513615430
Shader with the hotfix should be in the shader post.

[meager birch]

https://tenor.com/view/thats-my-boy-curtis-payne-house-of-payne-ho-hate-s9e4-gif-25259918

[fallen valve]

Let me know if it works.

[meager birch]

dropped in without issue great work mate

[fallen valve]

Your welcome.

[fallen valve]

@placid crystal Grab the hotfix first if you hadn't already.

[delicate pewter]

Any chance for those cadian imperial guards models pretty please ?

[meager birch]

give me names (nvm boss got it :P)

[fallen valve]

I have a file of all the imperial guard stuff exported out, one moment.

[fallen valve]

https://drive.google.com/file/d/1hOqMFLzpG6Cmf8yGLNOg5nN1fFezQEFZ/view?usp=sharing
This was shared to another, but this has all the imperial guard stuff I could find.

[delicate pewter]

Thank you very much Spartan and you too Michelangelo.

[meager birch]

https://tenor.com/view/john-mulaney-nothing-i-did-nothing-gif-13526080

😛

[fallen valve]

https://tenor.com/view/fantastic-bumblebee-b-127-optimus-prime-orion-pax-gif-3687651649448763020

[placid crystal]

already got it 🙂

versus the previous with updated lighting

[fallen valve]

Ye, it should look accurate in terms of reflection functionality when properly lit.

Without a map to use as a test, for now I just use a generic warehouse HDRi.

[meager birch]

going to be evil while i go get food.

[fallen valve]

When I get around customization stuff, and finish that, I want build up my space marine, and change up the Iron Halo part a bit, a quad point Iron Halo, which can cover all sides, at the expense of increased power needs from the backpack unit.

[meager birch]

when you're import your index FBX. i'd say set your import scale to 100. My poor never dead is toy sized! XD

[remote trench]

https://tenor.com/view/heavybreathing-cat-gif-6111353

Dreadimus Chadimus my beloved

[fallen valve]

Oh I know, I was the one to figure that one out.

[glass knoll]

scene is starting to come together

[meager birch]

https://tenor.com/view/panda-animal-oh-no-oh-my-facepalm-gif-17424737

[fallen marsh]

The multiplayer armor is finally becoming possible

[leaden edge]

[fallen valve]

It'll take me some time to make the shader handle the customization side though.

[leaden edge]

i can provide a basic MP shader for those who want it.

Not nearly as good as CDR's, but it does its job.

[glass knoll]

I would appreciate it

also, Im kind of dumb when it comes to blender... how can I use these shaders?

is there a guide somewhere?

[leaden edge]

id ask someone else other than me, i aint the best at explaining anything

[fallen valve]

When I have some time, I'll begin to write some info for my shader.

Maybe the customization and tintbymask node will be a tonight build.

Probably just the customization node if it takes a fair bit to build.

[supple breach]

Is it mp sm time???

[fallen valve]

It will take me some time if I build up the two macros for multiplayer stuff tonight, maybe I'll stream it so people can see how I have things set up.

[supple breach]

I was just wondering if it's getting worked on

[fallen valve]

I have my shader in the uploads, it will either get worked on more tonight or later tomorrow.

[glass knoll]

im curious btw where I might be able to find the textures for the chaos marines? i for some reason only get the brown metal texture of the default black legion marine

[fallen valve]

Check the TD file for the material your looking at in notepad ++, which should tell you all the textures you need for the material variation / material your on.
Other than the main diffuse texture the TD is called.

[glass knoll]

I’ll have to try tomorrow when I’m on my pc again

[full vault]

Hey, not sure if this was reported yet but I've taken a notice that the majority of the bolt weapons and the combat knife seem to have messed up normals. Ripping using the index tool.

also visible in the index tool itself

And this looks to be the case for quite a few of the bolt weapons. Though the chaos stuff is all good by the looks of it, but i may be wrong

[fallen valve]

let haus know so he can sort it out.

[full vault]

Oh yea I could post it on the github

[fallen valve]

would suggest ye

dm him if you want as well

[full vault]

Roger

[placid crystal]

Hmm, I'll take a look at this tonight too

Ripped the chainsaws from the game so I was gonna have a look

[full vault]

All the 4 melee weapons except for the combat knife seem to be fine

Also the muzzle flash particle texture sheet seems to be glitchy and green? Ill throw a picture in a bit

I just remembered this so I may add it to my github post

[full vault]

The mysterious green muzzle flashes...

[placid crystal]

I removed my ninja ripper function, since I'm using index, but you could try firing your weapon, pausing it mid shot, going into photomode to get a good look and then ripping

[fallen valve]

As long as you let Haus know, we should be good.

[west roost]

send

[ornate cliff]

I saw the same issue so I've just been using LOD 1 instead cause the lods seem to not have that issue and LOD 1 is usually not bad at all

tho the lods sometimes wont be attached to the armature, but you can parent stuff as a quick fix

[ornate cliff]

cant wait till the MP stuff is setup ala the spartan pack cause these are some BEAUTIFUL assets

I wanna see everyone's custom chapters

[placid crystal]

Lost all of my shoulder icons in the last cleanup, does any aspiring individuals still hooked up to NR have access to those, including the color maps?

[delicate pewter]

now you are just teasing ...

[placid crystal]

Just doing it right, lol

As best as I can

And this is without CC maps attached. Still need a proper setup for that, but the files are indeed packed.

[delicate pewter]

That looks crazy good. Beautiful job. Love that rusty look.

[marsh anvil]

Dude same unfortunately I have to wait for it to happen

[glass knoll]

Any chance you’ve figured out how to get the right blue textures on this?

[fallen valve]

Will be working on this, this afternoon.

[placid crystal]

You madlad

[fallen valve]

Unsure if I will be finished this afternoon given the customization macro is lengthy as fuck.

[placid crystal]

I bet

My hands are little tied today as well,

[fallen valve]

I still need to package up and give all my SDC research to Surasia so he can poke at it.

[placid crystal]

Oh man, this project might just be getting alittle bigger, lol

[leaden edge]

Gonna send a shader for MP that i created for those who dont want to wait for it to be done, standby.

literally scrapped it together in like 20 minutes

[fallen valve]

If you wish to use my shader for any referencing, you are more than okay to go ahead, just credit is all I ask for.

[leaden edge]

sounds good. Also- Quick question.
I mostly use EEVEE for rendering; How do i get rid of all the noise generated from your shader, if possible..?

[fallen valve]

noise?

[placid crystal]

in the regular viewport?

[leaden edge]

both in rendered view and viewport

[placid crystal]

I too have this issue

[fallen valve]

Show me what you mean.

[placid crystal]

But use cycles for the render

[leaden edge]

alr gimme a sec

[leaden edge]

(Rendered View in EEVEE on left, Material Preview on Right)
Turning up samples reduces it, but I have to enter ridiculously high amounts. (8192+)
This is on the default 16.

(The Left pauldron and anything other than the helmet is using the shader I created.)

Samples on 16384

Cycles rendering eliminates this entirely.

[fallen valve]

Odd, I am not on 4.2 so I am unsure why that has such a problem.
On 4.1, everything seems to be fine for Eevee rendering.

[leaden edge]

odd.

ill probably go back to 4.1
only used 4.2 so i could easily remove unused weights

[fallen valve]

I have yet to move to 4.2 simply cause of addons existing in 4.1, and not existing in 4.2 .

[leaden edge]

fair enough

[fallen valve]

Hell, I only use 2048 samples in Eevee 4.1, and it works fine,

[leaden edge]

huh.

[placid crystal]

This little pack is getting bigger by the minute, so I might wind up doing separate releases.

MP Chaos Marines (once I get proper CC maps setup) and then Campaign Chaos Marines.

But the MP Bad Boys are just about done.

[fallen valve]

As I said, packs should only be gameplay variants ( sm, cc, etc ) anything with cin, cine, etc, should be individual releases.

[placid crystal]

yupyup

[hollow raptor]

my boyssss

[placid crystal]

Wrapping up the last bits for the Chaos Release, should be ready by tonight, then back to the Deathwatch

[hollow raptor]

can you change the colors?

[placid crystal]

The maps will be included, but I haven't figured out a proper way to do so.

[fallen valve]

As said before, customization not there yet.

[placid crystal]

Soon, tm

[fallen valve]

That is two entire macros worth of nodegroup making.

[hollow raptor]

i haven't been up to date on this that much

[leaden edge]

gimme a sec. sending blend file here literally rn.

it has the bare bones of it.

just need to append any of the materials and you should be fine.

the cc mask is the texture that has no other colors other than Red, Green and/or Blue.

(built off of Spartan's shader)

all i needed to really edit/add was this right here. Only a single seperate color node and then 3 mix nodes and we have a basic version of the MP Shader.

[fallen valve]

Be mindful that the customization is seperate shaded layers, rather than modifying the albedo color, since the diffuse gets modified by the albedo tint after all of what you have there.

So it will look wrong on assets which modify the albedo tint.

[leaden edge]

again, i scrapped it together in like 5 minutes because i gotta go to work soon so its not gonna be great.

[meager birch]

@fallen valve just fyi im seeing a number of hdetm files as I'm setup up material don't know if your shader has a spot for them yet.

[fallen valve]

Nope, cause that is another seperate shader layer meant for the effects like blood, mud, dirt, etc.

[meager birch]

great thank you for letting me know 🙂

[meager birch]

this is coming along nicely

[lapis patio]

Has anyone by any chance extracted the Corus Blackstar (Deathwatch dropship)?

[placid crystal]

Might be able to find it

[meager birch]

seems to be only a 2 low LOD version in the files but their is a number of destroyed part.

[placid crystal]

ah

[placid crystal]

good enough for background?

[meager birch]

https://tenor.com/view/yes-yessiree-for-sure-sure-ok-gif-8368053375224078927

[delicate pewter]

Will the Thunderhawk be available for download ?

[meager birch]

https://tenor.com/view/cat-fun-yes-yes-sir-gif-15190052806474128338

[delicate pewter]

bro all this assets will look beautiful in Starfield

[meager birch]

note i won't uploading textures. The material shader and all my work will be setup in blender but peeps will have to get them from index V2 and drop them in a texture folder. For 2 reason, space on my mega account and to keep GM off my ass.

https://tenor.com/view/tales-of-heresy-kldpro-vesp-eldar-gif-16165922775068830187

[delicate pewter]

fair enough.

[sharp wraith]

hey is there a file for the campaign space marines with rigs?

[placid crystal]

Not quite yet, but it's on my to-do list. Gotta re-do the Deathwatch and then start on Titus and the boys

[oak forge]

where do you get the textures? Some of the ones I use just- don't work

[crimson condor]

is there an extra step i'm missing, i'm taking the textures through index v2 but they don't seem to have the same quality as whats on the titus rip. do i need to extract them as dds then convert them somehow? currently i'm just exporting them as png and throwing it into unity as is with a shader that supports packed maps

the shader seemed to work for titus just fine

nevermind exported as tga and they seem to have improved

[meager birch]

They are the game file textures extracted using index v2 the link is above in this chat.

[oak forge]

Ohhh, alrighty, I'll have to wait until I get the PC version of the game. Thank you for letting me know!

[meager birch]

Are you using the shader spartan created?

[crimson condor]

is this a unity shader or a blender shader? i'm using mochie atm

[meager birch]

Blender

A lot of the data is layered on top of each other in the textures, hence spartans shader

[crimson condor]

mmmm gotcha, so the best bet atm is to just bake it in blender?

[fallen valve]

I don't have baking in the shader yet, and probably won't be able to include until I figure out a method to handle all calculations before the lighting outputs would be used. In other words, baking support will be a while.

Its why for now I have everything handled via seperate shaders combined together.

[sharp wraith]

damn

[placid crystal]

Which is funny, because Index rips the highest quality textures, compared to NR which only rips HD textures when it's in frame, zoomed in to the highest possible point, and only when you have the resources for it.

I ripped some chains words but I have yet to dig into them just yet

[remote trench]

Chainswords you say? That including the Thousand Sons versions?

[placid crystal]

Aye, I have those as well

I'll have a better look at it tomorrow

[west roost]

I want to down those models

[lapis patio]

YEESSSS

Low poly or not

I require

[placid crystal]

Weighted Normals.

Think I solved it.

I just ripped an artificier chainsword and noticed it has some wierd triangles going on by the hilt, but after applying a weighted normals modifier it cleaned it up