🆕｜sd3

[torn wharf]

oh someone else is under NDA but they're telling you and then you're telling us oh okay. its' totally legit then

[raven fern]

i am the source

[shut sable]

they are, again, not under nda; i would like them to keep their job

[torn wharf]

is the source the juggernaut model creator who bs'd a bunch of shit while drunk and then deleted all his social media?

[fleet meteor]

https://tenor.com/view/metal-gear-rising-metal-gear-rising-revengeance-senator-armstrong-revengeance-i-made-it-the-fuck-up-gif-25029602

[bitter hearth]

@torn wharf I just received confirmation, my uncle who knows someone told me that theres nothing to worry

[shut sable]

the source is someone who Actually Knows what they're talking about

[torn wharf]

i dont want your uncle to die my man. you better not tell me dangerous stuff

[mossy star]

perchance a good starter prompt? a jumping off point?

[bitter hearth]

[torn wharf]

so the man inside your butt?

[fleet meteor]

Okey this didn´t work out so well "upside down house, doing a barrel roll" 😁

[bitter hearth]

wtf lmao

[placid swallow]

i can see it

[torn wharf]

the fakest part is probably how you tell us, but then say you cant tell us

[solemn raven]

self portrait

[shut sable]

because i'd like for that person to still have a job

[raven fern]

lol

[placid swallow]

why do they pay your bills with their job?

[eternal steppe]

Dorse.

[shut sable]

no, i just think they shouldnt get fired

[gloomy wasp]

Yoink is doing the same level of trolling I used to do in the civitai discord before everyone blocked me

[eternal steppe]

That's just illogical, though.

[raven fern]

@dusky thistle have you figured out some cool/good settings for 2B?

[eternal steppe]

Of course they're going to be replaced for minor works if AI can do it for them. It's a harsh truth but it's a reality.

[placid swallow]

what if by not telling us stability loses public interest and is forced to shut down, you effectively gotten everyone fired

[dusky thistle]

yup, thanks to aimingfail i am now using this prompt: "IMG00584.JPEG"

[raven fern]

hahaha

[gloomy wasp]

That’s gonna happen anyway

[bitter hearth]

oh no, I never thought about file names in prompt xD

[gloomy wasp]

There is no timeline where stability doesn’t shutdown or get bought out in the next few months

[eternal steppe]

Has anyone made a full rundown of the differences in prompting between clip_l, clip_g and t5?

[raven fern]

DSC001.jpg

[torn wharf]

its the most cheapest form of bullshit to tell people then say you can't say your source . maybe a journalist can do this if tehy verify the source with their editor. a dude in a chatroom? naw. that's just a dude in a chatroom

[fleet meteor]

The source doesn´t matter, if he wants to share something is fine

[pallid loom]

the source is that they made it the fuck up

[eternal steppe]

That previous image you posted, was that with Medium?

[torn wharf]

two possibilitys. 1) you're bullshitting. 2) someone has REALLY been bullshtiting to you

[mossy star]

@bitter hearth pls tell me ur using the 2b version

[gloomy wasp]

SD3 is really good at everything except anatomy. Wow I’m impressed

[fleet meteor]

Yes, only medium withouth T5

[bitter hearth]

I am ||not||

[mossy star]

damn i was almost excited :/

[eternal steppe]

Without T5? Interesting.

[torn wharf]

if there's only consequences from telling people, you're not trying to protect the source by telling people. it's just so dumb of an excuse

[eternal steppe]

It's a waste of time. Block him and move on.

[shut sable]

meh, i'll probably get proven correctly one day

[shell plaza]

good morning

[placid swallow]

let us know when that day is, that is of course you're allowed to tell us

[mossy star]

ill take another look, just put me off with how it didnt immediately click for me like 0.9

[eternal steppe]

Question:

Are some of you only using one of the three clips?

[shut sable]

if sd3.1 releases, i'll post it

[fleet meteor]

Was that possible? 👀 😳 I´ll try

[raven fern]

the only small problem with posting sd3 pics here is that we always have to wonder is it from 2B or api :3

[placid swallow]

SD is like windows, every other version is good

[eternal steppe]

I have the non-included model with the three seperate clip models.
That in a comfyUI node you have three text spaces to use for prompting

[shut sable]

anyways get [redacted]

[placid swallow]

oh yoinked hacked into their slack give us more deets

[fleet meteor]

Damn I tried with one

[shut sable]

not their slack, im in the Secret Weeb Server

[placid swallow]

TELL US MORE

[raven fern]

wait how did you generate all this text with 2B? :3

[shut sable]

waifu diffusion

[bitter hearth]

ew

[shut sable]

fair enough

[eternal steppe]

It seems they conflict with eachother moreso than anything

[torn wharf]

breaking NDA releasing slack details 😮 @viral plaza that legit? was this the beta release? lol i shouldn't bother training loras i guess

[shut sable]

again, not nda lol

[raven fern]

i need your boots, your keys and your motorcycle

[solemn raven]

wow interesting

[bitter hearth]

if SAI trains this model further, would loras that we make now not be usable ?

[shut sable]

nope

[torn wharf]

i don't know why dislcosure would get anyone in trouble and fired if there wasn't an nda

[shut sable]

i was unsure if it was publicly postable, so i waited for confimation

[placid swallow]

loose lips sink already sinking ships

[torn wharf]

loras i trained on sdxl beta sucked

[raven fern]

it's a meeeeeeee

[eternal steppe]

Studio Ghibli mario lookin kinda funny

[bitter hearth]

so training it more is different from finetunes >.>

I just hit generate im dumb

[viral plaza]

loras made now will still work if we release an update

back in the day with SDv1 there were like 3 main updates released and everyone was fine transferring finetunes forward

[raven fern]

2B.1

[shut sable]

probably gonna be sd3.1

[torn wharf]

all i know is the ones i made for beta sdxl suck on refines. the one i make on 1.0 dont

[placid swallow]

2B part deux

[raven fern]

electric boogaloo

[viral plaza]

yeah it was intended as Beta, it got dropped from the name before release and in hindsight that was a mistake

[upper snow]

Realistically they'll be a bit misaligned so retraining them (or resuming them) would be better, but they should work

[torn wharf]

why was this guy sayiung beta was neutared then?

[vital crag]

Is there going to be an update 👀

[placid swallow]

alpha release soon guys

[viral plaza]

oh and similar for sdxl 0.9 vs sdxl 1.0, albeit that was a very short time period

[eternal steppe]

It is most indeed a beta. Lotta specific generational problems that need to be addressed.

[raven fern]

the update is 4B 🙂

[proven bloom]

lol why is AMD working with SD if SD3 is still so Bad and far behind

[dusky thistle]

well good to know it's beta

[viral plaza]

there could be. No promises nor time schedule

[bitter hearth]

I won't run it even more

[viral plaza]

probably gonna get the 8B released before we go back to the 2B

[raven fern]

you sad case

[viral plaza]

(again no promises)

[eternal steppe]

Like I say to any company, keep working at it.
Success comes with time.

[dusky thistle]

this true?

[shut sable]

p-pwease~

[viral plaza]

no that's just a reddit troll that endlessly spouts nonsense trying to cause drama

known idiot just block em

[bitter hearth]

lmao

[torn wharf]

He's the author of Juggernaut

[raven fern]

it's a digital dummy

[upper snow]

so? half the model finetuners I know love causing drama

[vital crag]

Fair, thanks for the reply. Do you know what the minimum requirements will be for the 8b? Will my 3090 even run it?

[torn wharf]

i'm just saying thats who he is

[upper snow]

actually more like 80% if we're being inclusive

[torn wharf]

counting merge authors?

[raven fern]

im pretty sure 24GB will run 8B

[drowsy phoenix]

this looked like a damage control tbh, but w/e

[upper snow]

eh, just broadening "causing drama"

[dusky thistle]

my real question with all this is how responsive 2b is to training. i think that's what really decides the direction of this

[placid swallow]

8B will be like running 4x2B

[torn wharf]

it's not the original claim of "my friend told me the model was lobotomized and the beta ws better"

[dusky thistle]

looks like simpletuner is ready to roll so i'll see what i can do tomorrow

[viral plaza]

a 3090 can run it. 8B is chonky but still consumer-GPU scale. It'll probably take an entire minute per gen on a 3090 or something. (Not sure haven't tested)

[raven fern]

simpletuner 😮

[shut sable]

with all tencs?

[vital crag]

Fingers crossed. I don't want to have to buy a super computer just yet 😫

[bitter hearth]

the math god

[torn wharf]

i can't get it working on windows. it wants sh scripts

[eternal steppe]

Welp, rip 16gb cards I guess.

[raven fern]

sh is linux i think

[viral plaza]

From what I've been told it's extremely quick to learn new training

[vital crag]

Amazing. Thank you

[shut sable]

run wsl for it then

[raven fern]

but there are ways to bypass linux stuff and still make it work on windows

[viral plaza]

(but of course it's public now and diffusers trainer at least is out so go try it and see)

[open zinc]

hi im new. using img2img, how do I get a filter/rotoscope?

[shut sable]

actually just run everything in wsl since wsl is faster

[torn wharf]

makes my 4080 run unstable

[shut sable]

did you install the drivers

[placid swallow]

does it start wobbling and stuff?

[torn wharf]

if wsl is even installed. gpu crashes constantly

[upper snow]

Do you also have the nonpaged pool memory leak issue?

[viral plaza]

8B has the exact same tencs as 2B medium if that's what you're asking

on a modern card the tencs are just like <=1 second to run even if you're using t5

[raven fern]

just wait for the quantized version

[torn wharf]

dont know. wsl is installed then my gpu just hard faults. the system will keepgoing but no graphics

[shut sable]

ok but can my 3060 pull through or will it die

[viral plaza]

8B probably works as far down as 8-10GiB cards

[eternal steppe]

Actually, Bitnet and mlx stuff is kinda cool

[viral plaza]

(with fp8 weights)

[stiff dust]

Can you share workflow of this image?

[viral plaza]

(but again if you have weak card probably slow to run)

[eternal steppe]

Oh, if that's the case there's little to no difference at all in perplex between those two so

Cool.

[dusky thistle]

great, yeah, that's what we need is some of that demo'd asap

[raven fern]

most people these days have like what anyway? 8GB cards?

[viral plaza]

(there's a reason we want 2B to succeed rather than just pushing 8B alone, and that's 2b runs quick on normal people GPUs lol)

[eternal steppe]

I have the Intel Arc A770 16GB LE.

[shut sable]

also pls add pi-chan to this server, it'll run perfectly (i hope)

[viral plaza]

don't use t5 but yeah it'll be able to run 8B in fp8 weights most likely

[upper snow]

Well at least that's a bit more decisive. I just have nonpaged pool inflate to take several gigabytes of memory (up to 20GB or so before the instability is too great) that is never reclaimable and get sound glitches and stuttering until I eventually cave and restart. I cannot for the life of me fix it.

[eternal steppe]

Considering you're giving info like this, I doubt it's that far away now.

[placid swallow]

is your job safe giving us all of this info like this?

[raven fern]

this info is not crazy info or something lol

[eternal steppe]

It's not. I'm being very sarcastic.

[dusky thistle]

will you be running for the state or US senate before considering a shot at the presidency?

[torn wharf]

oh geeze no i don't have that. just a random screen black out. logs showed something about wsl causing conflict with something and i removed it from windows and things run fine now

[raven fern]

lol clown

[shut sable]

btw stableAGI releases in 2 weeks (source: dude trust me)

[torn wharf]

not knowing what is causing it is a pain. i still am annoyed about it since i dont know why wsl caused it

[raven fern]

is that DSC0004.jpg ?

[fleet meteor]

The workflow is in the image, you have to open it in full screen and download it , then move it into comfyui

[placid swallow]

fridge worthy

[open zinc]

can someone tell me where i can find how to make a good filter using img2img?

[raven fern]

filter?

[bitter hearth]

soap man wtf

[open zinc]

rotoscope type thing ig

like I put an image and style changes

[shut sable]

...this server needs a prompt inspector bot thing

[bitter hearth]

soap plushy

[raven fern]

🤗

[open zinc]

make him stressed from not being able to find a bug in their code for 12 hours

[raven fern]

i like it

[raven fern]

time to make teletubbies :3

[viral plaza]

i wish more of the technically minded folk at stability would actively speak with the public, imo we could cut out a lot of the drama and confusion that way

[raven fern]

one day

[bitter hearth]

get hit with all this cuteness

[untold valley]

thank you for some of the clarification, idk why it's hard to speak up in earnest..

[dusky thistle]

yeah, at a minimum, some consistent communication with the regulars on here would be helpful

we'd be happy to keep ppl up to date and communicate any issues and help look for solutions on weird shit with the workflows/prompt flesh bombs etc

[placid swallow]

technical blog post updates or something

[solemn raven]

Love it! How about children's drawings? 😁

[frigid mango]

When something is so progressive, that banning and not showing things like very conservative people and religions is the goal...

[raven fern]

it's too much

[torn wharf]

alternatively, the religious and conservative people would be the one wanting the csam in there. history has proven this.

[raven fern]

come on that is not sd3, that is you posting what some child did :3

[torn wharf]

sd3 is a child its like 2 days old

[placid swallow]

bamboo is drawing them in real time notice the time stamps

[raven fern]

🙂

[frigid mango]

its actually ridiculous. Even thinking about prn - nobody is hurt in AI generations while the prn industry... well bad stuff happening there should be no surprise

[bitter hearth]

that sunflower is going to overtake the sun!

[mossy star]

no way

[torn wharf]

you've already got pony xl. how much more ai porn could be needed? it has peaked

[mossy star]

fuck

[raven fern]

https://tenor.com/view/nier-automata-swagger-android-walking-animation-walk-gif-16557605

[placid swallow]

the peak is just the beginning

[mossy star]

goddamnit

[bitter hearth]

turn around

[torn wharf]

plateau is still a peak

[raven fern]

haha

[bitter hearth]

@raven fern what is your picture character name

[upper snow]

pony made a lot of avoidable mistakes including not using caption dropout which screwed up CFG... there's a lot more to be done, trust me lol.

[raven fern]

it's Gojo from JJK

[torn wharf]

so pony 6.9 gimmikcy name he's giving it. he'll do it there. i'm not sure why the new architecture is so important to the porn users

[placid swallow]

people like what people like

[upper snow]

i really do not know why. but literally all of the NSFW finetuners collectively decided that caption dropout wasn't important.

[raven fern]

clown you aint foolin no one, i recognize that watermark anywhere

[bitter hearth]

@raven fern probably doesn't know him

[raven fern]

well i dont know all the anime out there :3

[fleet meteor]

What is caption dropout? using capions instead of the tag system?

[upper snow]

and then suddenly everyone wonders why their model is hard to control and then people end up with mile-long cope negative prompts because their classifier free guidance is broken because the model tuner didnt know what that is or how it works...

[dusky thistle]

The city lay under a peaceful blue sky, unaware of the impending doom. Without warning, a blinding flash of light heralded the detonation of a hydrogen bomb, a moment of pure, unrelenting brilliance that outshone the sun. In that instant, the heart of the city was consumed by an inferno, the epicenter of which reached temperatures comparable to the core of stars. Buildings and all forms of life in the immediate vicinity were instantaneously vaporized, leaving behind nothing but scorched earth.

[bitter hearth]

I meant this was your character as a prompt, sd3 probably doesn't know it lmao

[raven fern]

oh

[torn wharf]

if i understand it right, caption drop out is good for teaching the model to fill in details where a short prompt is given. so maybe don't want it to learn to fill in the blanks as much

[shut sable]

they WHAT

[raven fern]

i mean when did JJK anime release, i actually forgot, newer models should know about it

[raven fern]

and Gojo within JJK is a very popular character

[shut sable]

mfw the most popular xl model is made by a clueless person

[torn wharf]

as far as output, sdxl is all porn users need

[mossy star]

at first i thought it was doomed, then i liked it, then i thought it was over, and now im neutral; please i want to get off this ride

[placid swallow]

there is no stopping

[torn wharf]

porn has never been a very varied media

[bitter hearth]

imagine trying to make an awesome model by yourself
Clueless right

[upper snow]

It's more complicated than that. Classifier free guidance needs a robust model of the mean of the data distribution. It uses this during sampling to figure out what isn't in your image. Without caption dropout, you get a weaker model of the mean of the distribution, and train it for long enough and the model will be harder to control.

[torn wharf]

some of the most brilliant people were raised by idiot parents

[bitter hearth]

maybe I'll be a good parent

[placid swallow]

how can a model know what it doesn't know

[shut sable]

he forgot to turn on "don't make model overfit"

[torn wharf]

right! thats a quality explanation thank you

[vital crag]

its a me... mario

[placid swallow]

your kid is growing up fast

[bitter hearth]

if you squint a bit you can see a face in that explosion

[dusky thistle]

oh shit you're right lol

[bitter hearth]

I wonder if cats have more images than dogs in the training data for this model

[placid swallow]

i hope not

[placid swallow]

lol it thought it was one of those slider images to see the before and after

[placid swallow]

now that I know this is a beta i'm okay with the quality

[upper snow]

but yeah this doesn't have to come as a surprise lol, I always check what blank prompts return on a model (SD3's uncond space is 80% white/asian women). every single furry model except for like, the very first one and the latest finetunes I've done has had a fucked unconditional space. even seaart has uncond issues (it has base SDXL's uncond space mostly, but that seems to be because it's severely undercooked)

side note there's also a lot of weird high frequency noise in the uncond space? not sure what's up with that.

[mossy star]

ETA on custom scheduler mixes working?

[mossy star]

thanks

[dusky thistle]

having a lot of fun with this node

[daring shard]

im just making random random

[upper snow]

meanwhile i'm hacking torchdiffeq solvers in

[raven fern]

hackerman 😮

[dusky thistle]

shit, any chance of gettin gmy hands on that?

[mossy star]

i need to check this out

[dusky thistle]

i've made all kinds of crazy scheduling stuff recently but not that

[upper snow]

once it's cleaned up and in a state suitable for release

[mossy star]

wait is this a custom node you made yourself?

[solemn raven]

oh cool it can do tattoos

[dusky thistle]

i am totally cool with non-release ready code... been writing a ton of nodes lately myself

[upper snow]

do you like really unnecessarily precise floats?

[placid swallow]

oh so like SD3 quality release

[silk raft]

doodle white 3d model of a stickman running in a desert with water powers and the sky is purple

[mossy star]

damnit

[upper snow]

this is adaptive heun

[dusky thistle]

try using ancestral 1/f noise and sweeping the frequency over the steps... fp64 actually makes a huge difference

[raven fern]

yea clown's workflows are like an ai generated pic 🙂

[dusky thistle]

yeah, i took the RES sampler and scheduled absolutely every parameter and got a huge boost in quality, best i've ever seen from sdxl

[upper snow]

Dopri5 just really doesn't work as well as I would like it to. SD3 is a very stiff ODE.

[raven fern]

we can say that you got some very good RESults 🙂

[dusky thistle]

scheduled the noise amount, momentum, c2, noise type, noise mean, phase separated and blended the channels yada yada, custom schedule,

[mossy star]

do you guys have githubs or something so i can know when custom scheduler support is out?

[bitter hearth]

lmao the API censored my cocacola spilled on keyboard prompt xD

[dusky thistle]

what do you mean by custom scheduler exactly

[fleet meteor]

lmao

[raven fern]

that is illegal 😮

[placid swallow]

sd3 drinks pepsi confirmed

[upper snow]

https://github.com/redhottensors/ComfyUI-Prediction it'll probably end up on his github since he's the one who actually made most of it work but here's another thing you can play with in the meantime

[dusky thistle]

https://github.com/ClownsharkBatwing/RES4LYF i have everything here, just set it up recently so i haven't had a chance to get descriptions, but if you serach for "sigmas " in your comfyui

idk if you meant sigma scheduling but anyway there it is

[bitter hearth]

skyrim game graphics, it tried cx

[raven fern]

nice

[mossy star]

yeah because when i use the custom sampler with this scheduler mix, using the sigmas input, the image gets messed up - thats something i can fix though?

[upper snow]

Fehlberg2 is probably the best solver I've tested in terms of speed vs results, this only took 7 seconds and is at least decent. Low effort prompt though.

[placid swallow]

why couldn't we get the api model

[raven fern]

8B is still cooking

[dusky thistle]

yeah that's easily fixed

[placid swallow]

well it's cooking on the api just fine

[bitter hearth]

would be awesome to get an update for it

[mossy star]

this is it then? nice

[dusky thistle]

i have a bonus version of samplercustom in my node pack, it's called SharkSampler and has a bunch of noise types added

[raven fern]

shark sampler 😮

[muted dove]

It's going to be better when it's fully baked.

[upper snow]

This isn't the solvers but it's something else to play with from the same author who will likely publish the solvers node.

[dusky thistle]

use my "Sigmas Math1" node, and set max to 1 and min to 0, turn on rescale, and you can punch in any crazy formula you want

[placid swallow]

ya but why can't we just keep eating why do we get to eat once every few years

[mossy star]

you are all so helpful thank you

[dusky thistle]

np hit me up naytime with questions

[mossy star]

now all i need is sigmas input for sdultimateupscale and im rocking

[raven fern]

am i going crazy or sd3 seems to generate car pics seen from behind

[dusky thistle]

it could also really use a turn added noise off option

[placid swallow]

backside makes the cars sfw

[dusky thistle]

so you could unsample instead of just adding random noise

[muted dove]

Not noticed

[raven fern]

are you saying the car is too sexy :3

[upper snow]

holy shit it decided to do something other than block text on its own

[placid swallow]

wait til you see what they do with sd3.1 alpha-git-3234

[noble coyote]

How do you implement ClipTextEncodeSD3?

[dusky thistle]

this you can use to do iterative unsampling

[raven fern]

https://tenor.com/view/calculating-puzzled-math-confused-confused-look-gif-14677181

[muted dove]

Please explain what this actually does

[noble coyote]

What does this do? 🙂

[mossy star]

my mouth is watering and i dont even understand this

[muted dove]

What are sigmas, and how does this change the image output?

[raven fern]

dont worry, its only for people with a PhD

[noble coyote]

I asked my gf about iterative unsampling?! She said 'we can do it later!!!' 😉

[mossy star]

can make image gooder, very much gooder

[noble coyote]

A sigma is a curve - adjusts noise densities to enhance the output ...

[dusky thistle]

sigmas = measure of the amonut of noise in an image. when you're denoising, youre lowering the sigma value gradulaly in steps. karras, exponential, sgm... they just change the shape of that schedule/curve. the effect is HUGE

[noble coyote]

Just change your sigmas and see!

[placid swallow]

https://tenor.com/view/enhance-gif-10953787

[raven fern]

enhance the booba

[dusky thistle]

iterative unsampling... unsampling is a way of adding noise where the sampler basically predicts the noise that would've led to that image, so it's non-random

[muted dove]

Thanks, I've noticed how you get completely different images from different schedulers

[dusky thistle]

so you can do a tiny bit of unsampling, then denoise, unsample, denoise, unsample, denoise over an dover, and get a huge change in the appearance with very little change in the composition witohut controlnets etc

[tough oriole]

I tried that image scoring thing. I'm surprised ar how good some SD3 ones were. Feels like the stuff that it's trained on it's very good at. Visually wise.

[tough oriole]

Damn that's cool

[dusky thistle]

this is what my WFs look like now

[raven fern]

https://tenor.com/view/simpsons-homer-simpson-gif-13518564799186478937

[dusky thistle]

lol

[mossy star]

@dusky thistle import of ur node pack failed 😦

uh........ no other info in the terminal, requirements none?

[dusky thistle]

wut?

[raven fern]

time to debug 🙂

[mossy star]

(tech support srry) --

[dusky thistle]

math
matplotlib
pywavelets
functools
typing
numpy
builtins
itertools

it's in requirements.txt

[muted dove]

hmmmm, didn't work so well

[dusky thistle]

yeah it's finnicky with sd3

there's something with the schedule i need to sort out, for one you want to ensure that first step isn't at 0, and that other steps arent' the same value back to bakc

[mossy star]

pip -r install requirements.txt returns could not find version that satisfies ... (none). pls i hope its not user error im kinda dumb

[dusky thistle]

so you might start at 0.01, then 0.3, then 0.01, then the next chunk: 0.011, 0.3, 0.01... etc, last one ending at 0

[upper snow]

wow, trending on artstation prepended really does help a lot

[raven fern]

kek

[barren spindle]

lmfaooooo found this on civitai

[upper snow]

Trending on Furaffinity.... seems to work as well.

[daring shard]

casually grabbs a black whole

[dusky thistle]

yeah idk, try just doing them manually, it'll only take a min

[placid swallow]

art station makes em too cartoony for my taste

[mossy star]

fair nuff, ty

[dusky thistle]

you probably have most of them already anyway tbh

[raven fern]

lol

[placid swallow]

average pokemon the trading card game reseller

[cobalt moon]

classic political humour

[jolly swan]

There are either too many porn users or some of them are not porn users. More people use Pony than SDXL (across all derivatives, I only have data from CIvit).

It's a very popular base model (yes, despite being a finetune), so a lot of people were excited about a new base model to build on top.

[muted dove]

I can't get anything to work 😄

[noble coyote]

#🆕｜sd3 message

[dusky thistle]

try with sdxl first it's easier

[raven fern]

im personally not into pony model, but i have to applaud you for reaching this level of popularity i guess :3

[dusky thistle]

also you want to use somethin gancestral, RES is best

[cobalt moon]

and even reach to the point it is becoming a drama...

[raven fern]

haha

[cobalt moon]

tbh I think it is the fans who tried to create the drama

[bitter hearth]

nice sonic oc

[raven fern]

leaked sonic movie 😮

[torn wharf]

The people who are so mad about model licensing being required for fine tuning are another subset of pony users that are very reactive and irrational. i reckon that most end users haven't been keeping up with news and many don't know sd3m is even out

[upper snow]

You're not really finetuning if you aren't causing drama.

[fleet meteor]

goodnight!

[torn wharf]

i swaer i've heard of the idea of a crystaline sonic at some point. sd3 sure knows sonic well tho.

[raven fern]

@dusky thistle are all the pics you are posting with t5?

[cobalt moon]

I mean... I am not talking about the Pony model if I understand your sentence correctly

I am talking about the whole Lykon-AstraliteHeart rap battle

( and also fans )

[jolly swan]

I think calling passionate users "reactive and irrational" is wrong.

[placid swallow]

sd3 seems well versed on popular characters

[pseudo isle]

https://tenor.com/view/animation-cartoons-toons-my-little-pony-baseball-bat-gif-14827786

[bitter hearth]

what is your prompt thats amazing

[upper snow]

Yeah. Two finetuners. Drama. They're definitely finetuning.

[fleet meteor]

action photo motion blur, the joker falling from the stairs

[torn wharf]

i think being honest is important

[fleet meteor]

https://tenor.com/view/evil-laugh-my-little-pony-rainbow-dash-laughing-gif-4145122

[bitter hearth]

now I need to do falling + selfie xD

[raven fern]

i would be more impressed with lesser known characters :3

[bitter hearth]

well... its a general model, there can only be so many

[raven fern]

yea

[cobalt moon]

One got bashed on being critical on SD3 license over decision to make new model based of SDXL

Another one just literally say skill issue lol and getting resignation threat from peoples. Yeah it is pretty suck.

Rational person in r/StableDiffusion is like really rare

[noble coyote]

SD3 Original, then SD3 into LoRA and SDXL and Face Detailer

[upper snow]

rational person on any of the AI subs is extremely rare. you've either got coomers spreading nonsense when they don't understand jack shit or people who absolutely cannot read a room if their life depended on it

[cobalt moon]

I think neither both side don't actually wanted this lol.

And well, everyone just forgot Juggernaut's creator RunDiffusion who somehow get a thing from this too.

[dusky thistle]

yeah

[dusky thistle]

@muted dove here's a workflow (in the second image, first was the source... prompt was "ice")

[cobalt moon]

or basically "WHY THIS CANT MAKE PORN" porn guy

[placid swallow]

Hmm this is what it thinks elon musk looks like

[upper snow]

I do love being in the ideal position to talk down to coomers on the SD sub since I actually do NSFW finetunes and understand how the process works. I never get tired of telling people that SD2.1 tuned for that just as well as 1.5 despite everyone insisting it couldn't be done.

[raven fern]

@simple thistle does this just mean that now sd3 loras can be used/loaded? https://github.com/comfyanonymous/ComfyUI/commit/ac151ac1698624bc4e321addb8c126069aced4b0

[placid swallow]

i even tried elon musk as elon musk

[simple thistle]

People complain too much

[cobalt moon]

By the way anyone who wondering why RunDiffusion is involved in this because originally he also tried to get early SD3 access like AstraliteHeart did. And he get the same response as AstraliteHeart.

RunDiffusion chat to AstraliteHeart here a week before the release night, I dont remember what kind of topic they talk to

[simple thistle]

And yes that means sd3 loras trained with diffusers work in comfyui if you update

[raven fern]

nice

[cobalt moon]

... I mean girl laying on the grass issue is a real concern and one of genuine complain on SD3's anatomy knowledge. But yeah I agreed

[simple thistle]

If you want someone to blame for this it goes back to when Emad was CEO

[upper snow]

But have you considered that I have no creativity and cannot think of anything to generate other than pictures of women?

[raven fern]

i did nothing wrong

[cobalt moon]

I think he is just trying to get this drama as far as possible as he didn't have any response recently

[cobalt moon]

LLM is here for you

[upper snow]

But seriously why is the uncond space like this? Binders full of women.

[compact forge]

Karen-ified

[teal fossil]

That's a completely different image. At that point you can throw paint at a wall and load it as an early latent.

[upper snow]

And whatever's going on in that fourth image.

[daring shard]

head on collision

[viral plaza]

... huh?

[raven fern]

but i wanna see the actual moment of impact

[upper snow]

I don't understand why, but images with no prompt are 80% pictures of women. Were there just like, a shitload of pictures of women in the dataset? Because other than that the mean of the data distribution shouldn't be like that.

[viral plaza]

sd3 medium uncond (no prompt) gens are a mix of random whatever. And sometimes HD humans lol that's weird

[cobalt moon]

generate a car crash

[daring shard]

he was distracted calling his gf

[upper snow]

....Well what am I doing wrong then? I'm guessing that blank prompt is not uncond then?

[viral plaza]

well that's cursed but i got a few womanish things

[viral plaza]

i'm doing blank prompt here

[raven fern]

blank prompts sometime generate stuff of nightmares

[viral plaza]

steps 28 random seed empty prompt empty negative prompt

[noble coyote]

Eau keigh! Where should I get that paint?! 😉

[viral plaza]

cfg at 5 but that doesn't apply when prompt is empty

[noble coyote]

Errmmm ...

[raven fern]

i mean this should be in tech support :3

[upper snow]

Might be down to luck, I guess. 4.5 CFG, jury-rigged fehlberg2 ODE solver

[viral plaza]

jury-rigged fehlberg2 ODE solver hwot

[raven fern]

LOL

what in image generation

[upper snow]

a friend and I set up a comfyui node for using torchdiffeq solvers for sampling

[cobalt moon]

btw yesterday I got my 2GB VRAM laptop running

[cobalt moon]

10 minutes for 1024x1024

[fleet meteor]

Nice, do you mind sharing the prompt? 😁

[daring shard]

it diddent follow most of it XD
dashcam pov phone photo of my car in a car crash airbag diploid with another car right infrom of mine thats mid exploding

tried doing it in first person for some reason

[simple thistle]

For Sd3 the higher order samplers don't seem to really improve the image

[raven fern]

still no actual impact :3

[simple thistle]

They have a similar effect to raising the cfg

[raven fern]

haha i like this one

[teal fossil]

Now we just need a Repo that makes that possible (crossing my fingers that OT figures it out today).

[noble coyote]

???

[dusky thistle]

simpletuner is ready to go

[upper snow]

Eh, I've had better results with Heun than I get with DPM++ 2M and better results with DPM++ 2M than I get with Euler. The Fehlberg solver is adaptive and is pretty damn fast at solving.

[simple thistle]

Diffusers has a readme that explains how to train sd3 loras

[dusky thistle]

it only accepts one caption for the entire training set, apparently

[cobalt moon]

identifier training?

[upper snow]

Like 6-7 seconds per image on a 3090 fast

[dusky thistle]

i could be wrong but that's what i was told over on the HF discord

[simple thistle]

But the Loras are pretty basic, only the x attention is trained

[dusky thistle]

but regardless, apparently simpletuner has SD3 support now... i'll give it a shot tomorrow

[viral plaza]

ew

[raven fern]

time to train those sharks

[dusky thistle]

ah, so i believe OT is currently working to build their loras off the diffusers code as much as possible... would that mean they might want to look into their own implementation?

[raven fern]

im personally using OT, so il be waiting patiently

[simple thistle]

I'll have to implement the more complex loras once someone actually makes one

[dusky thistle]

yeah i laughed when i was told that...

[upper snow]

buuuuuuuuut MM-DiT doesn't have cross attention 🤓

[simple thistle]

the x attention is the one for the image stream

[cobalt moon]

Simo Ryu The Cat :

oh welp

the cat is busy training his own MM-DiT model

[muted dove]

Is negative empty too?

[upper snow]

yeah

[teal fossil]

Which are the higher order samplers?

Which parameters / samplers are you using?

[upper snow]

higher order samplers are the slower ones like Heun and DPM++ 2S a

[dusky thistle]

dpmpp 2s a being noise adding just fries the image to a crisp

[muted dove]

heunpp2 (slow) and dpm_2 seem to be best

[simple thistle]

Basically any sampler that uses output from more than 1 step ago is higher order

[teal fossil]

Too bad I can't test it atm. Definitely gotta test it later.

[upper snow]

This is what a 5th order sampler (Dopri5) does

[simple thistle]

uni_pc for example is 3 order if I remember correctly

[upper snow]

(this is actually exceptional most of the time dopri5 looks like shit somehow)

[dusky thistle]

i look forward to your sampler nodes, greatly

[upper snow]

long arm woman

[dusky thistle]

i am getting kinda obsessed with sampling

[teal fossil]

What? ... that would make it utterly useless.

Back to v1-4 days.

Please let someone proof that "Finetunes even better now!" was not BS PR talk as well...

[raven fern]

im assuming by now you have seen all the research papers on sampling 🙂

[dusky thistle]

yeah i'm not sure why anyone would releasing a training script that only offers the option of using one Caption to Rule Them All for the entire set.

[simple thistle]

I prefer Euler the simplest sampler

[cobalt moon]

that just some super basic LORA training

[raven fern]

my boi Euler

[dusky thistle]

crazy, crazy good results with RES if you carefully tune and schedule all the parameters according to the steps

(with sdxl)

[bitter hearth]

gigachad euler

[dusky thistle]

dosen't work with sd3

[upper snow]

euler's just DPM++ 2M but blurrier in my experience

[upper snow]

idk, if going for text I'd recommend Heun, I always get mangled bullshit if I try Euler

[teal fossil]

No kidding. I saw your Sigmas Workflow. 🤣

[dusky thistle]

yeah hit 541 nodes and realized i needed to finally just start writing my own nodes lol

metadata was twice the size of the image data

[raven fern]

holy nodes batman

[bitter hearth]

one generate button in a1111 > 500 nodes 👍

[simple thistle]

Just one thing with SD3, the "sigmas" go from 1.0 (100% noise) to 0 (0% noise)

[noble coyote]

How do I solve this?

[signal shuttle]

The more i use SD3 the more i love it

[simple thistle]

No weird math

[raven fern]

did you remove the file @noble coyote

[teal fossil]

That's a surprise. Is it also faster?

I always feel Euler is kinda bland.

[muted dove]

Euler

[simple thistle]

DDIM is also nice

[dusky thistle]

that is nice and clean indeed. felt a bit like the english system, remembering "1.5 sigma to 0.01 will just barely keep the composition" etc

[upper snow]

But you made that into Euler!

[noble coyote]

Either I cannot find it (I have searched?) or it is on the Git Server?

[raven fern]

i tried some ddpm and ddim stuff, gives nice results

[bitter hearth]

@signal shuttle I like your name, here is the image

[muted dove]

Tell me what you see in this random ink blot

[raven fern]

also shift of 4 gives good results too

[simple thistle]

DDIM is euler

[dusky thistle]

tbh, denoise percent drives me nuts, it deosn't translate fairly from one schedule to another, the sigmas are way different

[raven fern]

my goodness what kind of weird problems are you having...

[simple thistle]

The bad thing with previous models is that you don't get true 100% noise with the sigmas

[patent acorn]

it can do funko pops?

[muted dove]

Another "backend" of car

[noble coyote]

OK, deleted ... will try again 🙂 Thank you

[simple thistle]

SD3 math is more simple and was supposed to only be sampled with euler

[shell plaza]

yes, prompt is in the file

[teal fossil]

And shift 1 & 2 can sometimes help with anatomy (sometimes).

[simple thistle]

But I sort of made the other samplers work

[noble coyote]

SD3 makes people too tall and stringy ... ?

[raven fern]

yea what is up with that LOL

[noble coyote]

Everybody often becomes Wilt-the-Stilt!

[muted dove]

https://tenor.com/view/phone-gira-dena-varun-sahu-shock-laga-bolti-bandh-phone-dropped-gif-26984289

[raven fern]

humans are complex beings mmkay

[muted dove]

Especially for SD3 😄

[raven fern]

kek

[bitter hearth]

[raven fern]

just missing a crab 🙂

[teal fossil]

"Hands are easier than text." - not if deliberately butcher your own data.

[muted dove]

Ooooh!!!

[stiff dust]

[raven fern]

cyberpunk dlc leaked 😮

[patent acorn]

LOL n oway

[muted dove]

From the front!

[upper snow]

...But the original rectified flow paper was using Dopri5. You can use any ODE solver with rectified flow, which Euler is one of but not the only one.

[raven fern]

nice one

[bitter hearth]

Here is your crab

[upper snow]

But yeah dont even try using SDE solvers, they won't work on this at all lol

[noble coyote]

Nice!!!

[raven fern]

awww come on... it has to be on the beach... you know...the beach episode 🙂

[dusky thistle]

yeah, or anything that adds noise

[simple thistle]

I know you can use any solver that's why I made them work

[stiff dust]

What was the prompt and workflow for these?

[bitter hearth]

I don't know what beach episode is about but here crab

[raven fern]

beach episodes are for men of culture

[twilit cobalt]

Basic workflow with the prompt "Still image. What an amazing day to spend the day outside. picnic.
30 years old Female jumps up and waving hands. grass. Kindred smile. bokeh, lightroom, portrait, cinematic selfie. Instagram. Journaling. Sunny weather.
Text on sign "Don't touch grass""

[dusky thistle]

i'll admit i do miss having noise to work with as it did give me the ability to fix almost any mutation in SDXL (the noise amount/type scheduling stuff)

[simple thistle]

But if you want to experiment try sampling SD3 as a vpred model

[upper snow]

why did I try using dopri8

[muted dove]

Apple fan boy? 😄

[simple thistle]

It actually works a bit

[teal fossil]

That's the only token I'd love to see being pruned from all Datasets.

[bitter hearth]

based, anything politics is so annoying lmao

[noble coyote]

My bro once got an award from Dave Prowse - the actor who played Darth Vader!

[patent acorn]

sadly no kim jon un 😭

[teal fossil]

I can hear "Crab Rave" in my head right away.

[dusky thistle]

hunyuan DiT can make the flag of every asian country perfectly except one

[patent acorn]

is it french

[bitter hearth]

Smack my b* up!

[dusky thistle]

that's a chinese model

[raven fern]

let me guess either chinese flag or japanese

[patent acorn]

oh asian countries not any countries LOL

[twilit cobalt]

I like apple, but I thought that it would be fun to mix high tech with pastoral theme

[dusky thistle]

the country is taiwan

[patent acorn]

-100000 social credits

[raven fern]

damn it, i was close

[noble coyote]

"When is SDHunYuanDiTMobiusPonyChickenFeet coming out?!" 😄

[noble coyote]

Taiwan

[raven fern]

Pixart 3 coming soon 😮

[dusky thistle]

really?

[patent acorn]

pixart omega

[upper snow]

wow, this was not worth the 11 minutes it took to solve at all

[noble coyote]

I just love PiXart-Sigma

[muted dove]

Is it a tuned SD3? 😉

[raven fern]

[signal shuttle]

[patent acorn]

its a merge between pixart sigma and sd3

[upper snow]

There is one more solver, but it wants to take the Jacobian of the model, and, well...

[storm robin]

whaddya mean, I need more vram 😛

[dusky thistle]

use virtual memory!! and wait 5 years

[raven fern]

the word Jacobian is giving me ptsd when i was implementing the 3d physics in my game engine , nuuuuu

[storm robin]

see I hear Jacobian and think Jacobs - if it took more than one shot, you weren't using a Jacobs

[muted dove]

@simple thistle Is there going to be a way to use SDXL loras with SD3, or even merge anything SDXL with it?

[raven fern]

lol

[simple thistle]

The arches are completely different

[dusky thistle]

there would need to be xadapter for it

[simple thistle]

So no

[signal shuttle]

No SDXL uses Unet and SD3 is MMDiT

[patent acorn]

sdxl is an unet, sd3 is DiT
but apparently there IS a sdxl and sd3 merge

[muted dove]

Same image using Euler and Heunpp2, in that order

[raven fern]

xadapter the way it's implemented is not really great tbh

[upper snow]

but without vector-jacobian products we wouldn't have automatic differentiation and we'd all lose our fucking minds writing our own model backwards passes

[storm robin]

you can use the sdxl lora node to grab the clip to feed the encoder - doesn't help much 😛

[patent acorn]

a bunch of crabs dancing in the club, photorealistic 4k , 4/5 ★★★★☆

[muted dove]

Really?!

[patent acorn]

https://civitai.com/models/511463/afros-sd3-experimental-sdxl-merge?modelVersionId=568446

[storm robin]

2 identical clips, so can merge those

[raven fern]

i like the cat and fish pic there :3

[patent acorn]

it does a little effect better

[muted dove]

Oh, I've seen this rubbish 😄
I tried it myself too, but it's not worth the effort.

[simple thistle]

the only thing you can reuse from xl is the text encoders if you trained them

[patent acorn]

ouch

[storm robin]

That image will have the workflow in it

[raven fern]

ginger 😮

[simple thistle]

You could apply the CLIP part of an XL lora on the SD3 CLIP

[upper snow]

I have to wonder how IP Adapter will end up working. I guess you'd just have to shove the outputs of that into the text stream or something?

[storm robin]

workflow in pic above if you wanna try it 😛

[fossil pagoda]

Crabrave

[muted dove]

I have done this, with several different model clips, but it hardly does anything noticeable.

[bitter hearth]

[simple thistle]

There's a few ways things could be injected in the mmdit

[patent acorn]

it became the wine

[upper snow]

Probably don't really want to mess with the text encoder unless you want to train it afterwards. Only thing you'll really get is a model with a misaligned text encoder. Which can sometimes increase variety. But if you want to do that just like, skip CFG for the first 10-20% of steps.

[bitter hearth]

!

[limpid drum]

How are people filling in the T5 text? I'm taking my prompt and running it through SuperPrompter bur I'm sure there are better ways

[raven fern]

i like donuts :3

[bitter hearth]

Donuts don't like you!
Runs away

[raven fern]

[muted dove]

Doesn't it do it automatically if you connect it to the SD3 prompt encoder?

I thought that was the point of it

[limpid drum]

I had read that people are filling in the T5 text with text and then padding with commas, so I thought you can fill it yourself, like here... so you're not supposed to fill out that third text box?

[muted dove]

I feed text into clip_g and t5. I think the t5 text will be enhanced from that.

I leave clip_l empty because I've found it to make things worse most of the time.

Trying each individually, clip_l creates a nice image, but doesn't follow the prompt.

[patent acorn]

i assume mario cant do the head down pose 😭

[limpid drum]

OK cool, I was doing that before, just wasn't sure if T5 needed to have a more complex "purple prose" prompt input into it

[muted dove]

I don't know if there's a way to see what text the encoder creates, but I just hope it does what it should 🤣

[fast sierra]

he's educating himself

[patent acorn]

where is it..

[lilac latch]

sex

[bitter wadi]

When SD3 RC1 on HF ?

https://tenor.com/view/when-wen-naru-yummi-yummi-universe-gif-23030317

The joke was fun. You can upload it now. Thanks

[signal shuttle]

is 16 gigs of ram not enough for sd3?, comfyui always crashes with a OOM when trying to load the clip models

[rich sage]

SD3's portraits come out horribly.

[patent acorn]

trying --lowvram works

[remote holly]

Sd3 human generation be like :

[rich sage]

lol

[patent acorn]

stay away from those anomaly

[sullen moss]

https://packaged-media.redd.it/bte53nd5qd6d1/pb/m2-res_1080p.mp4?m=DASHPlaylist.mpd&v=1&e=1718366400&s=a94f39429ee33368eac3d547eea8c14fce80b82c#t=0

[noble coyote]

Oops! Here's some crazy!!! LOL

Tall, lean, stringy, too lanky in SD3

[noble coyote]

These two are bewitchingly beautiful (SD3 into LoRAs via low-noise SDXL)

[ruby marlin]

Amazing

[winged seal]

I am really struggling to understand how people are getting results without huge amounts of noise/static in them

[karmic terrace]

wdy mean by that? most of us sharing direct comfy ouput images, so you can download the images and load in comfy to see the settings. i never got any noise/static so far

[winged seal]

It seems as thought the static I am getting is from a lack of steps

20 vs 30 on the same image

[frigid saffron]

big difference

[karmic terrace]

im using 30 steps, but it might related with your prompt as well. are you upscaling?

[ruby marlin]

Huh that is an unusually big difference if all you are chaging is steps

[winged seal]

I am not upscaling. Does anybody have a recommended workflow for that? I found that it results in lots of issues

ohhhh

I wonder if its this

by adding 50% more steps, there is a bigger time of activity/inactivity

[karmic terrace]

yes im using the example workflow but i customized the upscaling parameters. please download one of my images and try it out

[winged seal]

will do, thanks! <3

[muted dove]

It's all "custom"

[winged seal]

yeah, so 30 steps is 100% needed on these images

[dusk silo]

anyone know what causes RuntimeError: CUDA error: invalid argument
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. in comfy? i feel like ive fixed this before but i dont know what the error is

[winged seal]

uhhh

[signal shuttle]

is that allowed?

[winged seal]

IDK, its kinda gross lol

[gusty gale]

it's not really good with multiple people

[signal shuttle]

was there ever a SD model that was good with multiple people?

[winged seal]

My SDXL detangler fix made it a lot better with crowds and such

[remote holly]

Prompt : "handsom and happy innocent man "

Sd3 :

[gusty gale]

SDXL was also bad at that stuff, but not as bad. I feel like SD3 is generally not as good with humans

it's really good with text and landscapes though

[agile hornet]

Eldritch Horror lol

[winged seal]

My SD3 detangler should monumentally improve that, assuming it works on SD3 like it did for SD1 and SDXL

Just need a trainer that can make LoRA's for SD3 and I should be able to catapult the quality of SD3 leaps and bounds ahead. Again, assuming it will be as receptive as SDXL

With my 50 image detangler, base SDXL went from ass to competitive with finetunes like Juggernaut X

and examplke of the before and after of my detangler for SDXL

and a couple more

and this was using only 50 images to de-tangle too

I have a new 6k detangle dataset I am hopeful for with SD3

[green shoal]

is it a LoRA? can't find it

[winged seal]

Its not released. I have companies interested in buying it as a service I provide

if it ends up working on SD3 half as good as SDXL, I will release a new base model for SD3 that should be monumentally more stable

[prime trench]

so it is good for training?

[winged seal]

I am hoping I can prove just how powerful it is for SD3. That should get companies to fully bite/commit

[prisma zenith]

Isn’t sd3 multimodal?

[hot talon]

Simpletuner can make SD3 lora

[winged seal]

It makes it way easier to train things yeah. It de-tangles all of the overlapping concepts. For SDXL it make the coherence monumentally better, the res flexibility (native 256x-1200x) way more consistent. It got rid of duplicates at extreme aspect ratios, and improved overall concept separation and prompt adherence

[muted dove]

Publicly?

[winged seal]

Yes

[winged seal]

I have my own personal reasons for not using simple tuner that I am not willing to budge on at this moment

[muted dove]

Political, or problems with it?

[winged seal]

Personal problems, with the dev of it

[muted dove]

oh

[hot talon]

Is it enough of a problem that you'd suggest others avoid it as well?

[winged seal]

He and I were once close friends. That time is no more unfortunately. I don't wish to trash talk him, so I'll leave it at that

[gusty gale]

haha, it is better at making aliens than humans

[muted dove]

Can the time restriction on posts in here be lifted now?

[signal shuttle]

well i am just hoping that SD3 could somehow massively improve Text to 3d generation through multi view generation

[winged seal]

They are much better now. Earlier it was 60 second slowmode 😅

[hot talon]

Is there a paper on the concept behind this or anything? I'm just curious.

[muted dove]

Anyone got a UV light? 😄

[winged seal]

For my own personal reasons, no there is not. Its a very close guarded secret of mine that few know 😅

I have had a job in this field before, and I lost it due to a horrible action taken by Civit AI deciding to screw over the company I worked with. I have been out of a job for about half a year now, so I need to hold onto things that can get me hired again at other locations

Of course, if I have a steady job, my willingness to share information will increase considerably

[hot talon]

Well good luck with the job hunt because I'm curious with what the hell you're talking about

[teal fossil]

I might test that today. I always train the Tenc for XL LoRA's.

[fossil pagoda]

I... uhm

[jolly abyss]

So you are just flexing

[winged seal]

Like I said, if it proves to be a big help to SD3, I will post it for the community as a base

[muted dove]

https://tenor.com/view/aeons-aeonsroleplay-aeons-of-sand-robin-kaecilius-gif-26034715

[winged seal]

CFG-eez nuts

[noble coyote]

Mine seem to be noise-free ...

[winged seal]

Mine was too few steps

Seems like dark scenes need them a lot more

[noble coyote]

Good to know ... !

[winged seal]

10 vs 20 vs 30 vs 40 vs 50

I am using 40 for the dark scenes now

[noble coyote]

SD3 into SDXL (low-noise) +LoRAs

[gusty gale]

I'm using 40 for everything, then pass to a second ksampler with 10-20

[noble coyote]

OpenJourney the old SD2 checkpoint used to do great foggy photos adjusting iterations and cfg

[winged seal]

SD3's consistency with things like fences is honestly stupidly impressive

If the community can figure out how to fix the funkiness of SD3's compositions, I think SD3 will truly leave SD3 and SDXL in the dust

[hot talon]

damn looks like we need noise offset for sd3

[winged seal]

like, I have never seen an SD1.5 or SDXL model that could come close to this level of consistency

[noble coyote]

Try and get the mesh of a Shure Microphone right in SD3? 🙂

[bitter wadi]

[winged seal]

I can give it a shot, sure

[cobalt moon]

Hilary Clinton?

[signal shuttle]

I am having this weird problem with SD3, where if i use the SD3 medium and then load the clips afterwards my ram crashes, however if i use the SD3 version which has all clips in it, it doesn't crash!?

[compact forge]

at 20yo was the prompt 1920 photo

[noble coyote]

Once upon a time I worked at the US Embassy; and I (nearly) got to play Croquet with Chelsea Clinton! 😄

She was 15 years old, teeth braces and white bobby sox

[compact forge]

20yo anne frank

[noble coyote]

Sad story. She gave hope to so many people 😦

[sacred jewel]

Yup

[winged seal]

As somebody who has spent the last year trying to train good realism into SDXL... I really do have to applaud how phenomenal the photo realism of SD3 can be. When it does scenes right, I can find hardly anything wrong with them. They seem to have monumentally better dynamic range, tonal contrast, and fine detail rendering than even ideogram and MJV6, and I say that as somebody who is still highly skeptical of SD3

[noble coyote]

SD3 has great visual acuity alright!

[gusty trail]

Yeah, I also suffered from the gradient checkpointing

[winged seal]

No really though. It can achive a level of fine detail consistency and realism that I fought so damn hard to get out of SDXL, but it just flat out never could

[noble coyote]

I agree

[winged seal]

I am just worried people will tune it back into dreamshaper vaseline skin and orange peel lips 😭

[noble coyote]

Anatomical catastrophes aside, SD3 has a great future!

[winged seal]

yeah, I am really starting to feel that the more I use it

[compact forge]

lets hope for a 3.1 😄

[winged seal]

I have trained hundreds of LoRA's for SDXL. The easiest thing to fix was hands down always its composition. But you could never make the fine details better

[winged seal]

Well... Thats a take lmao

[prisma zenith]

And licensing issues 😅

[winged seal]

Great spelling! lmao

[cobalt moon]

the license are fine though.

[noble coyote]

90%

[compact forge]

right. also ive only seen 1-2 checkpoints where you cant make out its ai. and thats with boring reality lora etc. SD3 hands down passes the realism test in many cases

[sacred jewel]

SD3 renders a nearly perfect prompt: "BMW X5M Competition" 😱

[cobalt moon]

I mean not for those who wanted to sell AI art sure, and the Civitai

[noble coyote]

SD3 can make people overtall - lanky and slim - like Wilt the Stilt!

[compact forge]

elvis

[noble coyote]

SD3 + SDXL + LoRA

[winged seal]

Yeah, I have seen a few things from SD3 with photographic realism where I have actually been floored. And I am probably one of the single most brutal and picky scrutinizers of how bad image gen models are at realistic world depictions

[noble coyote]

SD3 +SDXL + LoRA

[pseudo isle]

Good job, Stability.

[noble coyote]

My two issues with SD3 are: overtall, lanky people; and oversaturation (like the old SDXL 0.9)

[winged seal]

Hands are something easy to fix. I can do it in no time when I have access to proper LoRA training tools

[compact forge]

adolf hitler (not an endorsement 😆 )

[noble coyote]

...-ish!

[cobalt moon]

the hairstyle is different

[noble coyote]

And so are the murdering eyes!

[winged seal]

When I first saw SD3, I was super disappointed. While I do think it has some huge fundemental issues, I am confident that the community can easily fix them (I am looking to do my part)

[compact forge]

ill remove the 25yo and see how close it gets

[odd basalt]

SD3 vs Dall3

[noble coyote]

SD3@ClipDrop is superlative!

[compact forge]

there he is 🔥

[winged seal]

@compact forgeMay I ask what your prompt looks like for these images?

[compact forge]

good quality photo from the 1920s of...

[winged seal]

HOLY WORKFLOW

[compact forge]

no negative prompt

[winged seal]

[compact forge]

it has comfy metadata if you want my upscaling setup

[winged seal]

I just loaded it, and I am overwhelmed

this reminds me of my furry art workflow lmao

[compact forge]

some of it is just leftover experimentation

[winged seal]

A lot of red

[winged seal]

lottaaa red

[noble coyote]

You know he worked for the Austrian Post-Office?!

Hitler, Einstein - are we having an Austrian day-out?

[winged seal]

woah woah woah

it got a little closer for me 😅

[compact forge]

you cant fault his fashion

[winged seal]

lmfaoooo

[compact forge]

i think you can bypass most of of these nodes

[winged seal]

I am reinstalling node manager to see if it can download what is needed

[noble coyote]

Standing couples - the one on the right consistently loses her right leg!!!

[sacred jewel]

They need to be muted for ComfyUI not to complain 🤷‍♂️

[winged seal]

If I knew what they were specifically, it would be a lot easier

[gusty gale]

I feel dirty

[winged seal]

wow, top right one

[noble coyote]

Yes, second one is a dead-ringer

4th one he looks too benign to be a genocider

[gusty gale]

my workflow isn't as complex, but it seems to do it as well

[compact forge]

inspire pack and BSZ, and maybe one more

[winged seal]

I have to install 9

also, BSZ is one of my close friends haha. Dude makes some very useful nodes

[compact forge]

why dont you have TonemapNoiseWithRescaleCFG? thats a default node in the experimentation menu 😆

[quartz mulch]

So..it sucks for everyone? Don't care about selling, but used as a base for trained models and stuff for civitai, is what got SD where it is.

I do care about portraits. That means I'm to stick with gimped, borderline unusable base sd3 as it is, or pay up for the api, since people can't fix and upload to civitai, no?

[storm saffron]

You mean you don't share a leg with people?

[winged seal]

I borked my whole install. I don't even have the experimental nodes installed

[noble coyote]

It's the consistency that is worrying?! What has SD3 against right legs at all?! 🥳

[winged seal]

what is this one?

I have them all but this one now

[compact forge]

text box xD

[storm saffron]

The right leg is the sexy leg.

[quartz mulch]

That's not argumentative for the sake of it. If I'm understanding something wrong, please enlighten me.

[storm saffron]

A woman in hysterics

[noble coyote]

Oh yeah! Puritanical SD3 already!!! LOL

[winged seal]

Can I just replace it with a string primitive?

[compact forge]

ill make you one with all the unused nodes removed

[noble coyote]

Gone to Trinity Buoy Wharf ... ! L8ers

[winged seal]

awww, thank you <3

I appreciate it a ton

[teal fossil]

For now you could post the better SDXL base - which would be very appreciated as well.

[storm saffron]

A woman in hysterics, she is sat in a dark living room facing away from the camera, behind her on the LCD widescreen TV is a documentary about cats.

[winged seal]

Its not in a stable state as of now, and its no better than the other finetunes people can use right now. It makes no sense to restart over from scratch. Its the main reason I stopped wasting energu fully training it and instead prepared for SD3. Its very promising, but just that, a promise, not a deliverace. Maybe when I have some more flexibility and reason to dump the compute into that, I will

Its a great foundation, but only if you wanna have to train in all your own aesthetics and concepts. Its literally just base SDXL, but not messy

My time is much better spent preparing for SD3 training, cause that is something I do have plans to share ASAP

[compact forge]

here you go 🙂

[winged seal]

thank you!!!

My SDXL de-tangler is very very impressive on its own, but its past its point where it would have been game changing. If I can replicate that lightning in a bottle, I could seriously change the course of SD3. I just need to be properly prepared and in the right headspace

[oblique iron]

#🆕｜sd3 Close-up of roses

[winged seal]

but after seeing how much fundamental promise SD3 has, I do want to dedicate myself to trying to pick up the shattered coherence so that the incredible details and aesthetics can shine through more

[hot talon]

really wish you could, at least very abstractly, give some definition of what de-tangler means

[winged seal]

My de-tangler specifically targets bad composition and element coherence, and not details, which is where SD3 needs the most help

[storm saffron]

It's like a hair comb for a diffusion architecture

[craggy ridge]

This prompt will be sd3 trademark 😄

[hot talon]

is that something you're doing through training data, or something your doing by directly modifying the way training data is applied to the model?

[winged seal]

In a sense, I created a dataset using lots of tricks in order to show a modified training scripts exactly what I do and don't want. Think of it as a poor mans adversarial training. I got it to discriminate on its own faults to target fixing them very very finely

I call it a de-tangler cause of what @storm saffron said. It takes all the scrambled and frizzy strands and concepts, and combs through them, making them less likely to step on each others toes

[storm saffron]

Anyone want a 'jailbreak' for nudity? LCD widescreen TV showing a documentary about an all female nudist colony LOL I had to try

[winged seal]

and it results in monumental coherence improvements like this in SDXL base

[gusty gale]

not really, I tried this prompt a while ago with the workflow SAI made and it made weird monstrosities, I just kept improving my thingy

[winged seal]

and no, that is not cherry picked. I actually have a grid of 3x3 somewhere if I can find it

another example of how it fixes ultra wide generations

[compact forge]

is there some sort of pre-prompt for this stuff like there is for LLMs?

[storm saffron]

No, that was my prompt. 😄

[winged seal]

its by no means perfect, but it does MASSIVELY help the models glue everything together and separate concepts that interfere

left 4 are before, right 4 are after

and this all was only from 50 images of training. I have a new 6,000 image dataset waiting to bitchslap SD3 lol

[hot talon]

that's good though. Yoga poses are important.

[gusty gale]

yeah, that does work, idk if I can upload it here

[winged seal]

And also, by de-tangling concepts, it greatly reduced prompt bleed as well

[compact forge]

i was moreso wondering how this stuff is implemented

[winged seal]

"A portrait photograph that has a black man on the left and a white woman on the right standing in front of city ruins, smiling"

[storm saffron]

I found similar things with pixart, it didn't take long for it to understand the few pictures I gave it, and it kinda fixed itself, even the first epoch was good.

[winged seal]

the greenish tint you guys see is one of the faults. I am not sure if its dataset related or training settings related. It happened across all of the images. But, thats a price to pay for the de-tangling. The goal is to make a fantastic and organized base to train on top of. Fixing those aesthetics should be very easy

[storm saffron]

Took about 100 pics of basic people poses and some interesting captions and it went pop, here you are, good people.

[cunning lintel]

Posted rumours Not true according to staff

[storm saffron]

I just need to figure out how to train SD3 on 16Gb... 😐

[hot talon]

I've literally been investigating that for the last day. SAI brought in a 3rd party for DPO modification on the model (3rd hand anonymous internal sources), and the theories are either 0 loss training to overwrite concepts or erasure (https://erasing.baulab.info/)

[winged seal]

I am a strong believer in that as well

[cunning lintel]

They really actively destroyed their model if true, it's bizarre. If true it would mean they totally went nuclear on safety

[hot talon]

or yeah what aliquip said

[storm saffron]

It's fairly obvious when suddenly you get bikinis or swimsuits appearing that shouldn't be there, but they didn't get everything, some things in context seem to get through. IDK

[gusty gale]

SD3 forgets the city ruins for some reason it seems

[severe phoenix]

wait what is this? is it a tool you made for sdxl. are you using it in sd3 here?

[viral plaza]

That redditor is a known troll, you can safely ignore them

[winged seal]

Its a type of training I stumbled upon on accident that I wanna try and apply to SD3. It has capacity to seriously improve the biggest weaknesses with SD3

[hot talon]

Also regarding erasure if they did kill concepts by training bad data into NSFW space running erasure on the key value pairs before fine-tuning concepts might work a lot better than just trying to train

[compact forge]

can you explain how it works then?

[winged seal]

A message wa sjust deleted. Not sure which one

[severe phoenix]

this training you stumbled upon, you used it here too? i guessing grid on the right is after using this tool correct?

[compact forge]

the reddit link was removed ( think it was edited by the poster, not the mod)