#🆕|sd3

1 messages · Page 36 of 1

faint breach
#

but where the kitt scanner?

craggy crest
torn wharf
#

lol you got a hot looking pontiac for sure. i love that it does another one so perfect on yours. and mine is quintessentially the 1982 model

#

but i also can't get the kitt to show up

craggy crest
faint breach
#

I'm running a bunch of gens and it seems like its 3-4 seconds faster on average

sage burrow
#

Should I dig out bluestacks? :>
What can a macro help with that a randomizer prompt and multi queue don't take care of?

simple thistle
#

so it's look like it's faster on the 4000 series but maybe not on the 3000 series and earlier

simple thistle
#

--force-channels-last with SD3

craggy crest
#

i'm gonna have to set up a new tab on my spreadsheet and go through all the modfiers again

faint breach
#

So they're making a new Knight Rider series or movie i heard. With a new KITT.

Val Kilmer was one of the only good parts of that last Knight Rider reboot. They should use the AI version of his voice for the new KITT

sage burrow
craggy crest
#

strangely whimsical surreal winter by photographer "ansel adams"

faint breach
#

awww sick. i called it a red chaser light bar than queued a dozen. one came out looking so good

craggy crest
mortal mica
craggy crest
torn wharf
silent ginkgo
#

SD3 medium, sgm_uniform, euler, 30 steps, 1024x1024, batch_size 4 repeated 4 times - RTX 4080 without:

Prompt executed in 29.50 seconds
Prompt executed in 29.33 seconds
Prompt executed in 30.09 seconds
Prompt executed in 29.95 seconds

and with --force-channels-last:

Prompt executed in 28.39 seconds
Prompt executed in 28.22 seconds
Prompt executed in 28.33 seconds
Prompt executed in 28.56 seconds
craggy crest
#

strangely whimsical surreal winter moose by photographer "ansel adams"

simple thistle
#

so a small but noticeable difference

upper snow
#

comfy, where's the easiest place to inject a profiler that would cover the main inference loop?

simple thistle
#

do you want to only cover the diffusion model?

upper snow
#

yeah, pretty much

simple thistle
#

or the whole sampling loop?

torn wharf
#

i'm using the ode sampler too. it has really erratic sampling times between images

simple thistle
#

diffusion model is called here

upper snow
simple thistle
#

that call I linked is the same for all models supported by the base

simple tundra
#

I wonder has anyone successfully trained SD3 with dreambooth lora? I have tried the example in diffusers but the results is not satisfactory

simple thistle
#

I have seen a few loras

#

most are not very good but people are probably going to figure out how to get good results soon

simple tundra
#

how many images should I prepare to train a lora?

faint breach
#

for a while with sdxl, a guy was posting an empty lora over and over, but ever example image gallery was a different artist that sdxl knew. so every gallery looked like a vastly different style. but the file was nadda. he was one of civit's most published users

#

it was like 100s if i remember it right. i'm just thinking, same thing gonna happen to sd3 scene sooner than later lol.

digital thorn
weary snow
simple tundra
digital thorn
faint breach
simple tundra
#

I see, thanks a lot

viral plaza
#

retroactive damage control. that wasn't even posted publicly, it was in a private group with community members but they wanted to share and i okay'd them to. The removal of the "beta" label was just a mistake we made in hindsight. All the theorizing is wild, people needa chill.

But maybe put some pressure in the decision makers because… lol trust me dude everyone at stability who interacts with the community is going back to internal chats to push the public opinion into the heads of the decision makers as best we can.

have someone make an official announcement with a realistic roadmap man i wish lol

faint breach
dusky thistle
faint breach
#

love this glitch

upper snow
#

@simple thistle yeah, you got a few blocking calls lol

dusky thistle
craggy crest
simple thistle
craggy crest
#

Sir Broccoli

upper snow
# simple thistle if you disable the latent preview where are the other ones?

there's two somewhere outside of the forward pass, I also see a bunch of them in the get_area_and_mult method in samplers.py line 12. there's also one that I know is part of k-diffusion, if you patch the to_d function to have division by a scalar and we assume that you'll never have two batch items sampling on a different sigma value then you can avoid that one by placing sigmas on CPU fron then on.

craggy crest
#

@viral plaza congrats on fixing the fitting issue with Afremov!

patent acorn
#

fitting issue?

craggy crest
#

kahlo is still a serious issue, however

simple thistle
#

yeah it doesn't actually make sense for the sigmas to be a tensor

craggy crest
# patent acorn fitting issue?

yeah. use Afremov in a prompt anywhere close to the front and all you get is his painting. that's not the case with SD 3, thankfully. i can get his influance but not his painting now. Kahlo, though, is way overfit

upper snow
craggy crest
patent acorn
#

no wonder lying on grass are more consistent now

upper snow
#

the issue is actually not with to_d itself btw, it's all the control flow operations in the sampler loops in k diffusion. actually I know for a fact that this is what those item calls are

craggy crest
#

lots of data on him and - it's all the exact same thing

hallow lion
#

sdxl to sd3 seems nice

upper snow
#

the only things sigmas are used for in k diffusion are scalar pointwise ops, except for the to_d method, which expands the tensor for no fucking reason

hallow lion
#

sd3 is good at giving it a gloss. sd3 right now needs sdxl as a starter lol

simple thistle
#

let me try removing something

hallow lion
#

so to preserve to promt adherence thing we can use pixart sigm with sdxl and the give it some vibes with sd3

craggy crest
hallow lion
#

uni pc sgm_uniform and a higher CFG than sdxl seems good

#

sgm_uniform is the new karras guys

craggy crest
#

but set your cfg to 2 not 4.5 - and set ModelSamplingSD3 to .3 and see what happens

digital thorn
upper snow
#

this is also a blocking call, it would be more appropriate to pin the cond tensor and change that to .to(device, non_blocking=True) (which should be completely safe from CPU to GPU). also you should consider using torch.Tensor.expand() since that creates a view instead of X copies of the tensor. more memory efficient that way

#

There's nothing nearly as bad as was in A1111 here though. A1111 had gradient checkpointing running this whole time since SD1.5 came out lol

dusky thistle
upper gust
#

tried some seamless texture

simple thistle
late walrus
#

agail

upper snow
#

yeah to really benefit from it you have to get rid of all of the blocking calls. which is absolutely possible, because I did it to A1111's codebase. the problem is right here, at the left side of GPU 0 SM efficiency:

#

gpu is basically idle at the start of the step, because it's waiting for the last step to complete before it can ask what the value of sigma is in a sampler for control flow purposes, then you're making blocking transfers to the GPU, and only once all that is done can it start working on the next forward pass.

#

If you remove all of the blocking calls, it'll queue up a bunch of steps ahead of time and the GPU will never be idle until it's done.

#

oh, almost missed that one. same issue was in the LDM code base. you need to create that tensor on device.

rain palm
#

Stable Diffusion 3 is released! Here are the amazing images it can generate. #stablediffusion #sd3 #aiart #aiartwork #imagegeneration #ainews #ai #agi #singularity

Thanks to our sponsor Wondershare Virbo.
Try Virbo for free: https://bit.ly/3xckK14
Download Virbo mobile app: https://app.adjust.com/1dd5k2bc_1dvobpnn
Subscribe @WondershareVirbo
...

▶ Play video
dusky thistle
rain palm
#

people are comparing SD3 with ||SD2|| which means SD3 will be just as dead.

#

why are they doing this? literal self-termination...

mortal mica
#

i really like sd3. ii hope people can figure out how to finetune it and itll be really really good

bitter hearth
#

people are stupid
AND want attention

viral plaza
patent acorn
viral plaza
mortal mica
#

colors are vibrant, it can go full white full black. prompting is fun and gets all the details. it gives me exactly what i want. just wish the bodys and stuff wernt deformed . if that gets fixed then im super happy

rain palm
upper snow
simple thistle
#

I should have copied that from the ldm implementation

graceful osprey
simple thistle
#

oups

rose hawk
#

what's "DonutsDelivery" ?

simple thistle
#

wasn't checking my emails have too much stuff open

graceful osprey
#

BTW - embeddings for sdxl probably works with sd3

viral plaza
craggy crest
steel helm
graceful osprey
#

🤿

rose hawk
simple thistle
#

loras for SDXL should also work on the SD3 CLIP

rain palm
dusky thistle
steel helm
craggy crest
dusky thistle
rain palm
rose hawk
craggy crest
steel helm
upper snow
rain palm
shut sable
#

instead of guessing why gpu slow, see why gpu slow

rain palm
#

let see 'em, with the metadata

steel helm
craggy crest
#

SD 3 is miles better than SDXL - IF - you know what you are doing - but IF you just try to drop in a prompt and don't know how to adjust various values, no telling what you'll get

craggy crest
dusky thistle
rain palm
#

so what, i have to use braincells to use SD3?

shut sable
craggy crest
rose hawk
craggy crest
#

if you want a point and click, i hear that Runway does an okay job

shut sable
#

dont expect that just throwing in "big bobba anime uuoohh" will work perfectly, i've said this before; most of you need to learn to prompt properly (for sd3)

rain palm
#

i don't think the Stability team develops an image model specifically designed to have ppl perform braincell gymnastics.

steel helm
craggy crest
#

and SD 3 also requires a little tiny bit of common sense in other places

shut sable
craggy crest
#

Stable Diffusion is probably not for you. Bing image creator is probably a better choice.

rain palm
craggy crest
#

(getting the idea yet that we are sick and tired of people coming in here to complain about something they have no experience with?)

shut sable
dusky thistle
craggy crest
#

it doesn't even speak the same language

mossy star
rain palm
#

how difficult could it be to prompt/draw a horse with 4 legs, or a person with 2 arms?

craggy crest
astral grail
craggy crest
#

my name is SD 3 - and i am not human

mossy star
#

all hail robit

dry wave
#

but prompting behaviour can be trained. If sd3 needs good prompts to be good, then we might be able to finetune it such that it works with simple prompts, too.

rain palm
astral grail
craggy crest
dusky thistle
mossy star
#

just dont confuse the model and you're golden

craggy crest
#

prompt: a horse

upper snow
dry wave
#

yeah, but there is something strange. Like certain prompts just doesn't work and I'm very optimistic this can be fixed with training

graceful osprey
#

let's say that - it doesn't work well with tag style prompt.
especially medium

try talk with it

rain palm
craggy crest
shut sable
mossy star
#

i use a combo of tags and phrases tbh

upper snow
#

Also put live preview on a cudastream which works great as long as you don't mind an occasional preview that is just noise. So that's not merged yet. But I'm very proud of it.

graceful osprey
#

and... there is a reason for that.
probably can be fixed with further finetune, yes.

craggy crest
rain palm
astral grail
upper snow
#

few problems can't be fixed with large volumes of furry artwork

craggy crest
dusky thistle
patent acorn
rain palm
shut sable
dusky thistle
craggy crest
#

SD 3 via API - prompt: a galloping horse, mane flowing in the wind

graceful osprey
#

yep. VERY responsive so train it with care 😉
It should be easy for any kind of alignment task - but will be harder to blend in totally new concepts

rain palm
#

dudes, download the community model from CivitAI and make the same prompts
that horse will have either 3 or 15 legs.

craggy crest
#

i only see 4 legs on that horse

mossy star
#

@dusky thistle do you have a paper i can read to help me understand scheduler equations or maybe a simple example of one i can put in your node? please and thank you

craggy crest
rain palm
hallow lion
#

any loras out yet?

shut sable
dusky thistle
rain palm
muted dove
craggy crest
shut sable
rain palm
#

yes but yall are generating through the API
O_O

dusky thistle
shut sable
craggy crest
#

fact is, if it's NOT on the official stabilty.AI huggingface page, i don't want to run it on my machine. there might not be malicious code in it but that isn't where they released it.

rain palm
craggy crest
#

but hey, someone that's addicted to CivitAI and it's super sketchy stuff isn't going to listen to reason

craggy crest
dusky thistle
rain palm
#

why's it just so difficult to try the same model but without the StabilityAI API? get the model from whatever source you want, huggingface or whatever, i don't care just download the community model and run it in whatever WebUI of coise and tell me you get the same results.

craggy crest
#

talk yourself blue in the face, @rain palm we've been listening to this nonsense for24 hours now. no one cares any more

signal shuttle
rain palm
#

ok so if you've heard it for 24 hour, perhaps ppl are having a legit point?

shut sable
rose hawk
# shut sable if this is "the API version" to you then theres no fixing this case of brain dam...

btw:

GatedRepoError                            Traceback (most recent call last)
Cell In[1], line 4
      1 import torch
      2 from diffusers import StableDiffusion3Pipeline
----> 4 pipe = StableDiffusion3Pipeline.from_single_file("g:/ai/models/stable-diffusion/sd3/2b_1024/sd3_medium_incl_clips_t5xxlfp8.safetensors")
      5 # pipe = StableDiffusion3Pipeline.from_pretrained("stabilityai/stable-diffusion-3-medium-diffusers", torch_dtype=torch.float16)
      6 pipe = pipe.to("cuda")

GatedRepoError: 401 Client Error. (Request ID: Root=<guid>)

Cannot access gated repo for url https://huggingface.co/api/models/stabilityai/stable-diffusion-3-medium-diffusers/revision/main.
Access to model stabilityai/stable-diffusion-3-medium-diffusers is restricted. You must be authenticated to access it.
rain palm
craggy crest
shut sable
mossy star
rose hawk
#

I need to be authenticated to load a local file? Is this UbiSoft ?

mossy star
#

if thats right then i am a huge idiot lmfao

rain palm
rose hawk
graceful osprey
dusky thistle
craggy crest
mossy star
#

AAAAAAAA lmao we are so back

shut sable
untold valley
#

Has SD3.1 released yet with wamen laying on grass? copium

dusky thistle
#

everyone shut up and admire this beast

craggy crest
mossy star
#

thank you for the help again, i will use this newfound knowledge and return at some point with more images

rain palm
craggy crest
shut sable
dusky thistle
#

i embed all my workflows, i'm usually screwin garound with something sigma related in them

untold valley
craggy crest
shut sable
#

anyways i hope you have fun with dall3 or whatever normie model you use

rain palm
craggy crest
#

@rain palm just go play with your models and leave us alone.

untold valley
craggy crest
shut sable
craggy crest
shut sable
#

"you can bring a horse to water but cant make it drink"

craggy crest
untold valley
#

Ok y’all can be a little more helpful and ppl would be more receptive not everyone is technically minded. @rain palm the demo basically downloads the huggingface SD3 model and runs it in the cloud. It’s the same as if you download to computer and used auto1111 or comfyui. However I don’t know and don’t care to check what settings it is using. There may be some sauce. Regardless the model had it’s legs cut off. For unknown reasons

shut sable
faint breach
#

i keep coming back to the kitt prompt. 1/30ish has a proper light bar randomly. all of them are so good tho

shut sable
untold valley
#

@rain palm you can check here. Mind you this is the diffusers version but should be the same.

untold valley
rain palm
#

that's what i said, then i got the fire for saying it

craggy crest
gusty trail
#

Misinformation a lot

rose hawk
#

Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 960 column 3

untold valley
upper snow
craggy crest
untold valley
dusky thistle
upper snow
#

unfortunately there are a lot of people who use these models for bad things and having the model unable to do them natively helps keep that attention off of the makers of the model

shut sable
rain palm
untold valley
faint breach
#

no light scanner tho. what a borked unsaveable model

craggy crest
dusk silo
mortal mica
#

could almost fool me thinking this was a real image

craggy crest
#

Prompt: splashes of essence

shut sable
rain palm
craggy crest
shut sable
craggy crest
untold valley
craggy crest
craggy crest
upper snow
faint breach
#

just perturb the model its ez

shut sable
rain palm
craggy crest
faint breach
#

wrong spot for it. borrrked

shut sable
craggy crest
#

and since he was involved in that decision, he happens to know what he's talking about

dusky thistle
shut sable
dusky thistle
#

cut the employees some slack... issues usually come from the top

rain palm
#

true

faint breach
#

such a broken model. i'm really sad we have this now

craggy crest
signal shuttle
untold valley
shut sable
craggy crest
faint breach
#

how fat is it gonna make the light scanner the silly broken model. theres no fixing this.

mortal mica
shut sable
#

anyways its getting late and the tensors are getting tired, good night

rose hawk
#

just ran the example on the diffusers page and got this: "smiling cartoon dog sits at a table, coffee mug on hand, as a room goes up in flames. “This is fine,” the dog assures himself."

mortal mica
#

first try

rain palm
faint breach
#

3 dozenth try

rain palm
dusky thistle
shut sable
craggy crest
rain palm
#

shush, get Zingo out of here!

craggy crest
untold valley
craggy crest
#

could be worse. could be openAI

untold valley
#

Guh. Such a mess this was.

faint breach
#

bing is pre good at kitt . gonna have to give kitt poitns to bing here

craggy crest
rain palm
craggy crest
# rain palm ClosedAI

i hear they are hiring, they might like to have you join them. you've got the right mindset

rain palm
#

they wouldn't have me, i'm too critical.

craggy crest
rain palm
#

either i'd be lonely as a whale or i'd get fired before i even parked my car.

compact niche
untold valley
#

OpenAi got a chain on their necks tho. Microsoft hold the whip.

dusky thistle
rain palm
#

there's two sides of that story and idk which one to believe.

compact niche
craggy crest
untold valley
#

And they will get Gov 100% involved. CIA, NSA, FBI, Homeland etc all of it will be up OpenAi soon if it’s not already there

signal shuttle
#

People really need to use ClipTextEncodeSD3 node in their workflows in my experience it improves prompt following and coherency a lot

craggy crest
rain palm
dusky thistle
craggy crest
craggy crest
unkempt tusk
#

Is there any plan to make some com around sd3 ? Back in my time damage control was faster 🫡

compact niche
rain palm
untold valley
craggy crest
craggy crest
scenic shadow
craggy crest
craggy crest
rain palm
unkempt tusk
mortal mica
craggy crest
dusky thistle
viral plaza
craggy crest
dusky thistle
rain palm
craggy crest
scenic shadow
noble coyote
#

What settings in SD3-Medium will give the best text? 🙂

untold valley
craggy crest
unkempt tusk
ruby marlin
#

I don't really understand how it could still be in beta, I remember a while back they were saying it was just about finished and they just had to check if the safety features were compromising the model quality

untold valley
#

Well they did say this was done until 8B was done too so 🤷🏻‍♂️

rain palm
viral plaza
dusky thistle
untold valley
noble coyote
rain palm
craggy crest
untold valley
noble coyote
untold valley
#

I was wrong and that would indeed have been the best route

ruby marlin
#

Anyway the issues with the model are so specific that it's hard to believe it's from undertraining, it is actually a great model outside of a couple things

rain palm
#

dUo, you said the small model came first.. where is it? we just got the medium model like 3 days ago, and the large model coming...

dusky thistle
rain palm
hallow lion
#

i always tought medium shld be 4B not 2B

bitter hearth
rain palm
#

isn't there going to be an 800M model?

viral plaza
# craggy crest sorry, charlie, but that is exactly how the internet works. and it's designed th...

do note takyon is somebody i'd trust to be pretty knowledgable on that topic (he's an infosec professional). I think the relevant key here is the modern internet has end2end encryption (HTTPS) where theoretically it's impossible to decrypt the traffic in the middle unless they've snuck in a backdoor. (Which... whether or not they have done that is an open question well beyond the scope of a random discussion in the sd3 channel lol)

scenic shadow
rain palm
#

i've always heard SD3 will have 3 models.

craggy crest
bitter hearth
#

Small, medium, possibly a medium large and large
0.8, 2, 4 and 8

ruby marlin
rain palm
#

oh man X_X my RTX3060 is crying....

ruby marlin
#

Maybe I'm reading too much into the semantics lol, I guess there is an art to the safety features that takes time to refine as well

viral plaza
craggy crest
#

prompt: transmission fluid,oil,triadic alcohol ink marbling on encaustic;intricate hyperdetailed background by artist "inga moore ingrid lamberts"

untold valley
#

How to get hired as SAI spokesperson. My qualifications: can use chatgpt and can bs on discord.

viral plaza
#

there's also cloneofsimo is training a 6B supposedly so idek what name that'd get

rain palm
shell plaza
viral plaza
foggy cloak
viral plaza
craggy crest
hallow lion
#

We got the "Tiny" model 😄

viral plaza
#

whether it gets finalized/released idk, but it exists

rain palm
#

oooooh ok

untold valley
vapid radish
compact niche
rain palm
#

well if it exists what's the "finalizing" part about? can't they just throw it out there?

untold valley
#

The truth shall set you free
-FBI

rain palm
#

a 1.5 sized model with 16 channel VAE is what i want... 2GB 🙂

scenic shadow
rain palm
#

at least if it's a "small" model it has an excuse.

craggy crest
#

Princess Peach in Mario attire with SD3

a render of a short princess peach, she is standing in blue denim dungarees, with a pink long-sleeved top and white gloves, she is wearing a pink cap with the letter "P" on it in a white circle, on a simple backdrop

foggy cloak
viral plaza
#

but yeah you'd want the 800M (Small) model for SDv1 equivalent param count

#

that one is definitely better than SDv1 last I looked, but not great on any other comparison

compact niche
rain palm
#

and 16 channel VAE drools

noble coyote
craggy crest
viral plaza
rain palm
#

ofc, not comparing finetunes to basemodels

compact niche
winged seal
#

Honestly, you can do some pretty incredible things with SD3 already if you know what you are doing

mortal mica
foggy cloak
winged seal
#

I absolutely hated it when it first came out, mainly because it has issues that it never should have had, but I've used it enough and had enough amazing results from it to where I can honestly say that I think it is an okay model.

Whether it's a good model remains to be seen based off of if it's critical flaws can be trained out or not

rain palm
#

the SD3 basemodel is 4GB large, and someone on Civit put up a 15GB model of it, how does that work?

noble coyote
#

PiXart-Sigma and SD3 = PiXart-Omega at all?

steel helm
#

it had all the large clips included in fp16

compact niche
rain palm
#

X_X

craggy crest
noble coyote
#

SD3 is a wild colt that'll need wrangling to the ground! But once it's "broken-in" - we will all have become Prompt Wranglers!!! 😄

foggy cloak
craggy crest
foggy cloak
#

Local install, running in comfy

craggy crest
#

prompt: hairy eyeball macro photo

vapid radish
trim arrow
#

How big is an sd3 model?

steel helm
#

because that's obviously what people generate all the time right lol

rain palm
#

approx 4-5 GB, thus far

trim arrow
#

That ain't bad

noble coyote
steel helm
#

only if she's 5'3"

trim arrow
foggy cloak
craggy crest
rain palm
#

McMonkey, can you look away for a minute?

trim arrow
#

...oh. God I'm dumb

steel helm
#

lmao

craggy crest
vapid radish
# noble coyote Get it free @Glif; or $10/month@ClipDrop

I am using it there, that's what gets me excited, but it is not the same as running locally, too much censorship (I tried to make a picture of a wet beaver and it blocked my prompts!) . If I wanted to use a free online service I would use Bing Image creator as it is better.

craggy crest
rain palm
#

here's some sfw hentai for yall...

trim arrow
#

I wanna.mess around with sd3 but I suck at prompting lmao

steel helm
#

even the chickens have long necks in base lol

rain palm
#

that was techincally not an SD3 generation tho

trim arrow
#

I'm still prompting like 1.5 because of ponyXL so it's gonna be difficult to try and translate that to sd3

craggy crest
steel helm
#

i don't think it even does that res that clear haha

craggy crest
steel helm
#

i am loving it technically, we'll work out the rest, it's just some bit flipping in the weights i think

trim arrow
#

How long would it take to generate an image for sd3 medium? About the same as sdxl or a little faster?

rain palm
steel helm
#

yea bout sdxl, maybe a little faster

craggy crest
trim arrow
#

I should...mention. I have a 3060 gpu

steel helm
#

i ran it on a 3060 12, it was about 5 or so seconds faster stock without toys

trim arrow
#

God this cooldown is a menace. I understand why but damn 😭

trim arrow
craggy crest
steel helm
#

all the clip stuff offloads to ram, it uses like 5gb without the vae decode. it's tiny lol

trim arrow
#

I have ... 48? Gb of ram. I forget. It's a funny number.

steel helm
#

prolly faster if you change that, but why lol

craggy crest
#

prompt: claymation mountain scene with ducks

trim arrow
#

Two 16 and two 8. It's my s/o's build

idle parrot
rain palm
#

ops, thought you said 4GB lol

trim arrow
#

If I had 4gb I wasn't even gonna TRY.

rain palm
#

you can have 4 and run SDXL tho

idle parrot
trim arrow
#

I have 8 gb in my laptop and sdxl loading in models crashes out. I doubt that.

steel helm
#

yea you can run it with no vram. it's just trading speed each time you offload a chunk or something

shell plaza
trim arrow
#

The laptop has a 1660ti if that's anything.

craggy crest
rain palm
#

then something else is wrong
"Forge has very low VRAM requirements in comparison to Automatic 1111, and other interfaces, but you'll still need a minimum of 4GB of VRAM for SDXL image generation, and 2GB of VRAM for SD 1.5 image generation!"

hallow lion
#

so its really nice finishing up the detail but i def wasnt thinking sd3 will be used as a refiner model when i heard about it XD

steel helm
#

is what it is until we fix it I guess lol

shell plaza
trim arrow
rain palm
idle parrot
craggy crest
shell plaza
idle parrot
shell plaza
trim arrow
craggy crest
rain palm
# trim arrow I'll eventually try it.

wait, i lost a braincell ...
i was thinking about pruned models, the models come in various sizes, perhaps you've been getting the larger models and just hit the vram limit.

shell plaza
rain palm
#

here's something that'll trigger some of you 😛
generated with SD1.5...

craggy crest
#

prompt: Prismacolour Oil pastel Bokeh Glowing Cel shading Ghibli Cute pastels, bokeh digital painting fluffy clouds sparkles, beautiful

rain current
rain palm
craggy crest
noble coyote
#

"Copies selling fast - get yours soon!!!"

#

🥳

digital thorn
craggy crest
#

Turtles seem to be somewhat of an issue

trim arrow
#

for sd3, what do i put for oranization or affiliation if I'm just a solo person? I need to put one to access the repository on huggingface... do I just put N/A?

craggy crest
#

prompt: Food coloring ink,wet splashes, drips, drizzles, sparks

trim arrow
#

do i get the incl_clips? I don't know what that stuff means...all i know is that clip=prompt or something

craggy crest
trim arrow
#

comfyui mostly. on the 3060 12

craggy crest
# trim arrow comfyui mostly. on the 3060 12

https://youtu.be/9zfF7Jt-JnU?si=BvaFcisZiVPDw72t watch olivo's tutorial on installing SD 3

The Stable Diffusion 3 SD3 Medium Model Local Install guide. Here is the fastest way to run the new Model on your computer

Links from my Video

https://huggingface.co/stabilityai/stable-diffusion-3-medium
https://comfyanonymous.github.io/ComfyUI_examples/sd3/

Join and Support me

Buy me a Coffee: https://www.buymeacoffee.com/...

▶ Play video
craggy crest
trim arrow
#

my first go at sd3 with a default comfy workflow! Very pretty.

#

Hah, i suck at this.

noble coyote
trim arrow
#

Trying to make what I have been making has produced... undesireable results though.

#

Just flatout looks bad compared to what I've been making with pony xl.

#

this is what i've been making with ponyxl

severe forge
#

how to create a picture?

noble coyote
mystic vortex
#

why i don't see this channel in list on the left panel?

viral plaza
noble coyote
viral plaza
#

oh or that too, category

patent acorn
lean mortar
#

I bet you sd3 can't do this

mystic vortex
#

thanks guys 🙂

patent acorn
#

someone needs to try generate a capybara rn

mystic vortex
#

1.5 vs SD3 :

noble coyote
#

Cap E Barra

mystic vortex
robust kelp
#

Wow. You guys have really outdone yourselves with this one. The dog/human hybrid is nuts.

mystic vortex
patent acorn
bitter wadi
#

Wen SD3 ?

mystic vortex
warped ivy
mystic vortex
dull star
#

Biya Spigex
⭐⭐⭐

mystic vortex
#

Hitler works better than Eva Green...

shell plaza
mystic vortex
patent acorn
#

didnt know it could do hitler

bitter wadi
#

C'mon buddy. Stop this

#

Not sure what you're trying to prove. This is dumb.

chrome ingot
noble coyote
bitter wadi
#

Colors are so good, but the model is so broken. Sad

chrome ingot
noble coyote
shell plaza
compact forge
#

Lovely image

shell plaza
#

It s good to make characters honestly

bitter wadi
#

I want SD3 in Omost ! Should be awesome

shell plaza
#

Can't wait to make some lora on my 4090

bitter wadi
shell plaza
dull star
#

🤨

noble coyote
storm saffron
#

I'm still trying to figure out optimal settings for LoRA training.

dull star
#

I hope onetrainer just takes care of it all without us having to mess about with optimizing manually

#

it will probably speed up the rate at how many loras are being made for SD3 rn

gusty trail
#

It is a good take to learn how the trainer work

storm saffron
#

I don't think I'm smart enough to learn how it all works... I just bash together bits of code and hope for th best 😄

muted cargo
gusty trail
# storm saffron I don't think I'm smart enough to learn how it all works... I just bash together...

If you are interested, here is my implementation of SD3 lora training script. https://github.com/lrzjason/T2ITrainer I also reference many others, like kohya, freon, etc. The script is rough but it works.

GitHub

Practice Code for text to image trainer. Contribute to lrzjason/T2ITrainer development by creating an account on GitHub.

vapid radish
bitter wadi
cedar gale
#

SD XL --> SD3 img2img, seen better but we lost the lose limbs. 😛

patent acorn
#

do hitler in public execution

vapid radish
teal fossil
#

So loading the Clip of SDXL LoRA's actually works in Comfy (just don't load it onto the Model) and it definitely has a strong effect... but not quite sure how much it actually depicts the training it had.

patent acorn
#

SD3 cannot do capybara. -10/10

mystic vortex
#

does anyone have a workflow SDXL+LoRA>SD3>img?

steel beacon
#

Can one get SD3 to work on automatic1111?

vapid radish
noble coyote
#

Thankyou @shell plaza for the prompt idea - SD3 composite - text taken from several different creations! "Apres Moi, La Deluge!"

noble coyote
storm saffron
runic seal
vapid radish
steel beacon
patent acorn
faint shard
#

I guess..

patent acorn
#

instabook

#

LOL he got timeout

formal bramble
#

What does this image tell us? 😅

storm saffron
signal shuttle
#

the CliptextencodeSD3 node is powerful when you know how to use it

shell plaza
compact forge
#

no coconut doggy 😦

storm saffron
#

Also what order do I need to load things in the TripleClip? Does that make a difference?

compact forge
#

good quality photo of a dog riding an elefant 👏

upper gust
#

dragonfly vs ant

compact forge
faint shard
signal shuttle
storm saffron
#

My lora is getting close now, I can smell it.

bitter wadi
signal shuttle
#

here is the result of that

signal shuttle
bitter wadi
#

nb: i don't care as you don't get people using it too.

bitter wadi
quartz mulch
compact forge
ruby marlin
# compact forge

This is the type of prompt adherence we've been dreaming about for the past 2 years

bitter hearth
cinder lodge
alpine axle
bitter wadi
#

Looks good 👍

compact forge
alpine axle
#

it's only trained at 512, but kinda promising

signal shuttle
pastel latch
latent fiber
#

tiger|sd3

bitter hearth
signal shuttle
bitter hearth
upper gust
twilit cobalt
#

the "trick" for correct anatomy

pastel latch
#

Really doesnt understand whales too well

runic tusk
bitter hearth
alpine axle
calm zinc
#

That wasn’t our employee, it wasn’t KandooAi. That was an imposter I reported to the stable diffusion mods. That’s probably why all their posts were deleted.
Make sure to verify people pretending to represent other people. Especially in the world of Ai.

signal shuttle
hallow lion
#

kinda cool being there when a new tehcnology starts off but i really wish we were at the point when any image you made was just normal and usable. this feels like early nineties internet, like tis this cool new thing and aesthetic and kinda clunky and uh can i download the internet or what is that anyway... -

calm zinc
#

None of this is true.

compact forge
#

great hands, great leader

bitter hearth
lilac bridge
#

Testing SD3 for making items for dnd 😄
So far not bad. Gotta keep experimenting

runic tusk
gentle wolf
compact forge
alpine axle
hallow lion
calm zinc
#

We’re fine. In talks with SAI. We’ll train SD3 if it’s trainable. Nothing has changed. Just waiting for tooling to get to a good place. Meanwhile be prepared for a limited release for people to test Juggernaut XI. 😙

hallow lion
#

well dats good newz

compact forge
gentle wolf
bitter hearth
gentle wolf
#

huh, interessting. how?

calm zinc
#

Not true. That person was an imposter and we reported them.

hallow lion
#

seriously this was a beta only? They never mentioned that ever... Theres gonna be a 3.1? like with sdxl thjeres the 0.9 and then the 10?

gentle wolf
#

apparently

bitter hearth
calm zinc
#

This is not true. That person was not KandooAi. It was an imposter. Simple as that.

acoustic kite
#

i just want the ability to use poses without getting exploding humans

desert garnet
wind talon
bitter hearth
#

This @gentle wolf

compact forge
pastel latch
bitter hearth
gentle wolf
desert garnet
calm zinc
#

@prime perch @craggy crest @torn wharf that “employee” was an imposter pretending to be @cosmic mantle for some unknown reason. We’re fine. Chilling on the sideline waiting for tooling. We’re in talks with SAI. We’ll play by their rules. We are excited to train. All that stuff going on is a big nothing burger. 🍔

If you ever need anything verified simply @me or @cosmic mantle

compact forge
bitter hearth
pastel latch
#

uh....

severe phoenix
wind talon
calm zinc
hallow lion
gentle wolf
#

once again it shows how amazing discord is, to make things worse and spread fake news and have information lost in the wall of trolls

signal shuttle
cosmic mantle
signal shuttle
#

I am in love with CliptextencodeSD3 node, all gens have been nothing but amazing

bitter hearth
#

God himself in chat thomas

calm zinc
bitter hearth
#

Do you guys like cheese cakes thomas

compact forge
wind talon
lilac bridge
#

Oooooh SD3 is quite good at img2img

gentle wolf
#

SD3 is good in a lot of things

cobalt moon
lilac bridge
calm zinc
# pastel latch how to be a part of that?

But a little secret if you want to try Jugg XI right away. It’s available on our platform inside Fooocus right now….
DM me and I’ll get you an hour or two of server time.

gentle wolf
#

xD

pastel latch
cobalt moon
#

I mean it have flaws, of course. After all these complaints and oversights

calm zinc
signal shuttle
lilac bridge
signal shuttle
calm zinc
compact forge
pastel latch
cobalt moon
#

@calm zinc I might sound a little bit like putting oil on a fire ( you have the right to reject answering this though )

Do you have opinions on this Lykon vs AstraliteHeart rap battle?

signal shuttle
hallow lion
lilac bridge
signal shuttle
lilac bridge
signal shuttle
sacred jewel
lilac bridge
compact forge
gentle wolf
sacred jewel
cobalt moon
sacred jewel
#

Test it yourself and see. Easy to prove

lilac bridge
calm zinc
# cobalt moon <@567562473859710976> I might sound a little bit like putting oil on a fire ( yo...

None. Nothing but respect for @lavish osprey
I don’t envy him at all. He’s got a hard gig and he’s doing a great job. I’ve chatted with the Pony creator and he’s said nothing but good things about this whole thing too. Professional and tactful. People don’t realize that there’s literally nothing “there”. It’s all drama made up by the community.

Everyone is literally doing the best they can. We all need to give a little grace to each other. I think in the end everything will work itself out.
How do I know this? Because we simply want pretty pictures, and we’ll figure out a way to get that.

sacred jewel
cobalt moon
compact forge
#

its always the booba that makes men fight

twilit cobalt
#

Something is actually happening in range of 60-80 steps with DPM++ 2M (SGM Uniform) sampler, but after 80 steps convergence is just jiggling a bit

calm zinc
patent acorn
sacred jewel
pastel latch
#

beauty standards are getting out of hand these days

cosmic mantle
#

Fun is allowed right ? 😄

patent acorn
cobalt moon
#

boob is the real King of Civitai

tranquil oracle
#

How did Stability release such a pile of junk?

desert garnet
calm zinc
cobalt moon
compact forge
pastel latch
tranquil oracle
#

SD3 is not something that, under closer inspection, reveals flaws. It's complete junk.

uncut pine
#

When for automatic?

desert garnet
signal shuttle
#

I love cliptextencodesd3 node so much, single handedly changed my view of sd3

tranquil oracle
sacred jewel
#

They uploaded it to Huggingface I think that's how they did it

cobalt moon
tranquil oracle
cosmic mantle
tranquil oracle
desert garnet
signal shuttle
cobalt moon
eager wraith
patent acorn
#

it cannot do knuckles sadly i want to make a meme 😭

tranquil oracle
desert garnet
tranquil oracle
sacred jewel
cobalt moon
desert garnet
#

needs more shrimp jesus

tranquil oracle
calm zinc
#

Literally right below this comment is me saying this account is an imposter. 🤦🏼‍♂️
Just go down 200px on that screen. Haha

signal shuttle
tranquil oracle
#

Netherlandish Proverbs. SDXL on the left, SD3 on the right. All completely erased and forgotten. (And it's not just this one painting, it's pretty much all of it.)

cobalt moon
compact forge
tranquil oracle
past thicket
#

I'm liking the weirdness so far

patent acorn
#

Mona lisa in the artstyle of picasso drawing
is this even picasso??

spark quail
cobalt moon
tranquil oracle
desert garnet
gentle wolf
signal shuttle
tranquil oracle
cobalt moon
#

You want a storybook artstyle rather than Religious Art one?

twilit cobalt
tranquil oracle
cunning lintel
cobalt moon
gentle wolf
#

the side effect of purging information from a model, is the destruction of similar ones. It even says so on the github page.

spark quail
#

what is there to point out, the research paper specifically stated that it essentially had a filter with its pretrained images

hallow lion
twilit cobalt
#

I get it. Censoring of "laying on the grass images" was due to amont of people advising to touch grass online

drowsy phoenix
gentle wolf
#

For example: remove all sex positions > bad person lying on grass SFW results

tranquil oracle
#

Yes, the best word for a Picasso painting is "Picasso", not a long description.

cobalt moon
#

SD1.5 is the great example, really

compact forge
desert garnet
#

try with Pocassi

patent acorn
signal shuttle
patent acorn
tranquil oracle
gentle wolf
#

removing existing artstyles is just making it harder to replicate, it's still possible. So why make it harder for everyone, just keep them in.

tranquil oracle
#

Of course these are fictional quotes, but they're 100% true to the spirit of the original. SD3 output is just generic medieval junk.

hallow lion
#

SD3 YOGA-LORA when?

tranquil oracle
cobalt moon
#

You have to be realistic here that some artist can get very furious when their art is getting trained as a dataset.

If they rich enough, they could give SAI some traction by filing a lawyer letter to them

signal shuttle
cunning lintel
drowsy phoenix
tranquil oracle
gentle wolf
#

you can still copy style with photoshop. There's no change here. If you commercially release copyrighted stuff, you're still as liable as before AI

patent acorn
#

i figured out it can do lightnign mcqueen lol

spark quail
#

so many people misunderstand image models lol. youre not going to prompt an image that the model was trained on. its going to create something new -- thats what they do.

signal shuttle
tranquil oracle
cobalt moon
#

from what I understand the context here, is @tranquil oracle tried to replicate the old existing medieval image as close as possible or tried to replicate the artstyle for the new one

twilit cobalt
gentle wolf
#

hot take, all art is stealing from somewhere. 😉

tranquil oracle
#

It can discern between Bruegel paintings, prompt for "The Hunters in the Snow", you'll get that.

sacred jewel
spark quail
tranquil oracle
#

It's the same when I prompt for New York. I want something that really looks like New York, not something new.

signal shuttle
cobalt moon
gentle wolf
#

Sometimes you want XY in New York, then it should look like New York and not like Mars

tranquil oracle
spark quail
#

if you wanted the same pictures of new york everytime, the tool you are looking for is google images, not an image model

cunning lintel
tranquil oracle
spark quail
#

now if you wanted to create a scene specifically of new york with something in it, like godzilla or something, youre probably going to need a lora for that

twilit cobalt
#

Image models are not just blending between "compressed images", it's actually concepts learned in the process of training. But to prove that to general audiece, models should exhibit this understanding of anatomy. The thing with art, that it always has been human-centric, because it's how people communicate visually, with the art

compact forge
tranquil oracle
pastel latch
sacred jewel
patent acorn
mortal kite
compact forge
cobalt moon
#

is this what you tried to getting ( from Hugging Face )

tranquil oracle
#

SD3 is just total trash when it comes to style adherence, detail, creativity of composition, lighting, saturation, everything.

patent acorn
#

well its a base model so

tranquil oracle
#

(SDXL on the left, SD3 on the right)

bitter hearth
twilit cobalt
tranquil oracle
desert latch
#

BIG THINK: Maybe some SAI stuff are from medieval and think that train artist ] 1515 can cause copyright infringement

patent acorn
signal shuttle
bitter hearth
twilit cobalt
cobalt moon
signal shuttle
patent acorn
cunning lintel
# tranquil oracle It's seems like a deliberate defect, caused by some absurd "policy"

Only SAI can tell, i can also imagine it's in the same bin as how words weight weird, the long prompts somehow caused certain words to override all else, and maybe demand specific incantations similar to whatever cogvlm produced; too strong a reliance on one exact sentence, too little on basic captions. The model is too much tuned to very specific phrasing of inputs. At the same time other words, like artists and specific styles, were hardly learned while training. Either way the real issue his: how did this release pass quality assurance?

tranquil oracle
shell plaza
#

Anyone tried the fresh canny control net for sd3?

alpine axle
#

1024 version of the controlnet also just dropped

shell plaza
#

Insane developing speed btw

pastel latch
#

not seeing much of a difference though

sacred jewel
#

How do you know this for sure?

tranquil oracle
#

As I said: the Gen AI Taliban.

signal shuttle
sacred jewel
#

Gotcha 👀

cobalt moon
desert garnet
tranquil oracle
patent acorn
#

the fact that its possible to generate dark humor content lol

tranquil oracle
#

Bad taste model. (Again, left SDXL, right SD3)

desert garnet
cobalt moon
desert garnet
tranquil oracle
cobalt moon
signal shuttle
pastel latch
sacred jewel
signal shuttle
cobalt moon
#

Hm. I can't say things for sure in SD3, especially prompt adherence/coherency since everyone have their own standards on that.

compact forge
#

he murdered them

mortal kite
#

The Cropduster

tranquil oracle
#

Sorry for the rant. But SD3 is really infurating.

signal shuttle
cobalt moon
#

Yeah nobody give a thing on you still using SDXL if you dont like changes.

mortal kite
#

do you want to know how damn long it took to get this image? It was ridiculous

cobalt moon
#

plus for real though SDXL is just sufficient for most works.

desert garnet
cobalt moon
violet gorge
#

what happened to stable cascade 😭

compact forge
desert latch
#

BTW I remembered there were server bots on this service,

cobalt moon
cunning lintel
errant dust
#

You know, I thought the whole theory of perturbed layers to undo some later safety training to be pandering to some absurd conspiracy theory, but after trying the perturbed model I believe the theory has teeth

spark quail
#

the research paper actually found that the devs found no improvement in "better" images when using t5 (altho idk if they thoughy about the average sd user's prompting skills) so it should be fine to just not use t5. it makes a huge difference if you wanted to prompt for text in the jmage tho

pastel latch
balmy robin
#

what are cascade requirements? tried in colab and failed 😦 t4 15gb vram. maybe i should try forcing fp16?

desert garnet
#

when u dont get bananas on xmas

mortal kite
#

The prompt understanding isn't really that great IMO. It still doesn't really understand that well unless it's a basic simple thing

hallow lion
#

sd3 is like that rough cut george lucas showed his buddies before star wars was finished, eveyrone laughed only spielberg saw the potential

violet gorge
#

Does anyone know exactly what the difference is between Stable Cascade and Diffusion models?

errant dust
mortal kite
#

people still keep trying to cope

cobalt moon
#

although again there is possibility of SD3.1 but at this point they ( SAI ) will just rather fix the other 3 than another 2B

spark quail
hallow lion
#

cascade has a sausage in it, hence it works better

signal shuttle
upper gust
desert garnet
patent acorn
#

4/5 ★★★★☆, photorealistic, (Monalisa:0.9) in real life
it seems to be impossible to make photorealistic mona lisa. RIP

jolly abyss
hollow shoal
#

/generate Create a tiktok avatar in 3d cartoon of a young black boy

errant dust
#

This was an original image with the base SD3, and has a very long description since Lykron was telling everyone the issue was their competence. You'll note it does not even display the warrior the description starts with. The second image is the Perturbed version. Far from perfect, but it is unquestionably an improvement.

patent acorn
#

in new york. XD

hollow shoal
#

what are the prompts to generate images here pls?

faint shard
#

Lol

hallow lion
#

anything you like

patent acorn
desert garnet
upper gust
errant dust
faint shard
patent acorn
#

MIDjourney

desert garnet
#

sd3 mid

bitter hearth
#

steven low thomas

patent acorn
#

MIDalle

pastel latch
#

getting better

violet gorge
hexed dirge
bitter hearth
hexed dirge
solemn raven
bitter hearth
#

@desert garnet thomas

#

my random creature prompt only produces shit now

desert garnet
bitter hearth
muted dove
desert garnet
#

monalisa if she lived in San Francisco

upper gust
patent acorn
desert garnet
muted dove
fathom pelican
#

when I try to use the perturbed model I get the error Error occurred when executing CLIPTextEncode:

'NoneType' object has no attribute 'tokenize'

any idea why?

patent acorn
bitter hearth
#

@desert garnet ?!

compact forge
#

mona lisa as a slutty slutty _____

muted dove
patent acorn
compact forge
desert garnet
#

dont peek

patent acorn
livid plover
#

wow sd3 is so safe and good, it is hot like a dumpster fire!!! I love it xD

#

most advanced model out there))

desert garnet
#

exclusive footage of biden at congress

bitter hearth
livid plover
#

those pictures aren't safe for you guys, watch out!

jolly abyss
#

Solved it.

desert garnet
wind basalt
#

Is there any fine tune of sd3 yet that is actually good