🆕｜sd3

[raven fern]

huh

[bitter hearth]

got it

[dry wave]

trading card

[raven fern]

nice

[dry wave]

not perfect, though

[fleet meteor]

💀 💀 💀

[dry wave]

but you just have to give it a good prompt

[raven fern]

did you try i2i with tcg? maybe it will capture it better?

[dry wave]

you just have to set the aspect ratio correctly and describe that you want a card

no need for i2i

prompt is

"A card from the Magic the Gathering trading card game. The top of card shows a Manticore, a chimeric monster with a lion body, bat wings and a scorpion tail. The title of the card is "Manticore of the burned land". The bottom of the card show his stats and skills."

[raven fern]

can you try Pokemon and Yugioh? haha

but that is some very good result

[pseudo owl]

try describing the stats and skills, it can probably do it correctly then. It seems to even do a paragraph of text correctly if you tell it what to write.

[raven fern]

is this channel now gonna be all flux basically? lol

[mortal mesa]

they should drop 4b

[turbid grotto]

Thx but I can't find 4bit T5

[dry wave]

we can talk about sd3 when they drop a decent model 🤷‍♂️ whenever and if ever that will happen

[raven fern]

[brittle nexus]

In two weeks™ will be about 3.1.

[young blade]

Been a year since I tried my tc workflow, might have to dabble again
#✨｜sdxl message

[bitter hearth]

SD3 medium is still really good for photorealism

its just not very flexible and it breaks super easily

with SDXL you can do noise injection into cross-attention or key matrix and it won't break

[raven fern]

i mean the new joke is 2.1 weeks

[raven fern]

haha

not bad

[pseudo owl]

pretty amazing, if the text was correct, its basically impossible to tell it from a real card

[dry wave]

nah, it only got the first part of the text correct

maybe you can fix that with inpainting

but I assume its just too small

you probably need some kind of "detailer" workflow for that

[raven fern]

time to print some cards and make money from home

[dry wave]

"A boy holds a card from the Pokemon trading card game in his hand, while smiling joyful. The top of card shows a Pikachu with a santa hat. The title of the card is "Santa Pikachu". The bottom of the card show his stats and skills. High resolution, 8k, best quality. Photography."

[dry wave]

this model is just crazily good 😂

[pseudo owl]

yeah 100%, basically ideogram/dalle3 but open source

[turbid grotto]

magic happened, why my text encoding are instant now

[pseudo owl]

maybe you moved the text encoder to your gpu?

[dry wave]

oh, its prompt understanding is far away from ideogram

I would say its also not Dalle3 level

but its photorealism is really good and overall I think its a competitive model

[turbid grotto]

probably yes but it is not anymore 😦

[raven fern]

oh that looks really good tho 😮

[dry wave]

again, it's first try

I also got sometimes bad images, but in general flux produces good quality on first shot

[raven fern]

yea flux is first tries champion

[raven fern]

im happy that cctv stuff is still a thing without a lora

[raven fern]

damn, knows gta 5 nicely

[raven fern]

lol

[raven fern]

dont ask me what i generated, just take it :3

[raven fern]

good boi

[dry wave]

the loading screen of Civ VI?

[raven fern]

lol

[hazy kestrel]

Flux and Auraflow are next level! Will stability be able to compete with them?

[raven fern]

i didnt try auraflow 0.2, is it improved?

[raven fern]

they fixed the way they hold swords? 😮 finally

[hazy kestrel]

Crispy details. 🧐

[brittle nexus]

It's very good doing hand and swords

[hazy kestrel]

In only 4 steps very impressive

[raven fern]

im just generating with the online version, im not on my laptop

[hazy kestrel]

What's happening in two weeks? 😭

[raven fern]

2.1 weeks

[raven fern]

wait, make a similar image, but with the old bike that has like a passenger seat, and then put Robin as well lol

[signal shuttle]

nice, prompt?

[raven fern]

i think i just wrote: a scene from Grand Theft Auto 5

[prisma rampart]

it sort of worked, cant really see the sidecar tho

[dreamy pawn]

Compared to what? I am thinking of getting a used 3090 at some point....is it a better pick than a 16gb 4070 ti (S) or amd 7900 xtx - 24gb?

[sacred jewel]

swanks! 😉

[fleet meteor]

I´d say the used 3090 is the best option, some models like flux work better with 24gb of vram, and im sure newer models will requiere even more

[brittle nexus]

I don't know why robin is a kid tho

[dreamy pawn]

hmmm... I thought it might - I mean, I thought that might be the reply 🙂 What if I use Linux? I guess Windows is better to use, perhaps?

Nvidia in Linux - mixed reviews? 🙂

[fleet meteor]

I haven´t tried AI image generation models on linux, only LLMs on my 1060 and 3060 so Im not sure exactly how they perform 🥺 (for LLMs it worked good)

Also Nvidia is faster than AMD on AI as far as I remember

[dry wave]

windows is never better to use xD

cuda works fine on linux

[sacred jewel]

What about Grass laying on a woman?

DAMN YOU for stealing my joke first 😛

t5xxl + clip_l

t5xxxl ONLY... same results almost. Looks like Clip_l may not be doing much?

[craggy crest]

clip_l is your ambient, artsy, and background stuff, or should be used for that. clip_g is the workhorse, it drives the entire process, and should only be given the black and white, concise, description of the image. and t5xxl is your encoder with the high comprehension. give it text, and all the fancy details

[mortal mesa]

the clip L one looks better, the reflections, the little lights, even the head poses

[craggy crest]

and that's what it is for. those ambient, artsy, background details

[dry wave]

CLIP-L and T5 are used differently

only T5 is used for attention/transformer

[sacred jewel]

Flux... did not think there was a CLIP_G for Flux...

[dry wave]

CLIP-L is only used as pooled embedding as extra conditioning. It don't have as much effect as T5 has

there isn't. Only CLIP-L and T5

[craggy crest]

clip_G wasn't created for stable diffusion, they just use it for stable - you can probably make it work for flux, it's using the same architecture as sd3

[rustic acorn]

Its easy to get spoiled by Flux's consistency with hands. There is still the cherry picking, but it nails most prompts I'm using the local install.

[craggy crest]

just because you're not using it, and robin didn't impliment it, doesn't mean it can't be used with it

[dry wave]

yeah, have fun retraining flux from scratch lol

[mortal mesa]

i can type you win this time keyboard

[prisma rampart]

good try flux, other than the backwards nose, but anything upside down is model cryptonite.

[acoustic kite]

why on earth did it add a watermelon lol

[signal shuttle]

Flux

[acoustic kite]

oh well, i went all in and asked it to add watermelons after this 😂

[acoustic kite]

looks nice man, it got the hands right as well

[dull star]

lmao battery and watermelon flavours

[acoustic kite]

yeah 😂

[acoustic kite]

looks so so real

[signal shuttle]

Flux

[sacred jewel]

different schedulers

[acoustic kite]

whattt it's too good at logos

[acoustic kite]

🫠

howwww

[noble coyote]

Just d/loading Flux.dev - is it worth all the "better than MJ" hype?!

[shell plaza]

yes

[noble coyote]

Is that true text quality of Flux? Or is it added later?

[noble coyote]

Eau keigh! Is it also good at TEXT?

[shell plaza]

it's the best at text actually, better than DALLE

[noble coyote]

Cool. Cannot wait ...

[keen falcon]

True text quality

[shell plaza]

generated now

[noble coyote]

I'm impressed

[shell plaza]

local

[noble coyote]

We need an extra room for Flux discussions/imagery

[keen falcon]

agree with that

[shell plaza]

probably they have their own discord server for that

[young blade]

flux seems to nail every style and almost spot on with prompt adherence

[prisma rampart]

delicious

[shell plaza]

the only thing about flux that atm from my perspective looks a bit worrying is the requirements to finetune or to make LORAs

i've a 4090 and i'm wondering if i'll be able to make LORAs of it

[icy drift]

You need FluxDev btw all, not Schnell.

[shell plaza]

model is quite heavy

[young blade]

yeah, it hurts the GPU pretty hard

i like schnell tho too, a few wonky arms in it tho compared to dev

[inland patrol]

Orc Trump is amazing

[young blade]

using local ollama to create prompts from image inputs

[icy drift]

schnell > sdxl, but no controlnet. Not worth it imo but I like it for sure.

[bitter hearth]

I don't even use control net lol

[young blade]

cnet and lora come out...sd gonna be in trubs

[icy drift]

It's all I use. 🤣 I made an art app just for it and use that. (I'm doing art pre-ai tho.)

[young blade]

haha, controlnet is my crack

[sterile pendant]

trying out the flux dev version at 25 steps = 420 seconds per image. i cant even be mad.

[icy drift]

I haven't tried over 20 steps, and 10 was okayish.

[sterile pendant]

i just have to temper my patience like im doing blender work waiting on renders

[young blade]

yeah, it's a bit on even a 4090, feelin it

[sterile pendant]

im using it in fp8 mode, i only have 8gb vram, so shits slow as balls

[icy drift]

2 more hours till I can get home and run my massive list of all-new tests.

[sterile pendant]

i wonder if this is going to test my patience enough to do this shit downstairs on the 7900xt

[icy drift]

7 min too long to experiment imo... Not enough chances.

[young blade]

dont break anything or kick the pet, breathe

anyone find a flux discord yet? nothing on their X/website/gitpage

[sterile pendant]

yeah that's my usual stance. im only testing the dev model because cfg works with it. the schnell model doesn't use cfg(even if you try, you'll get the same image)

schnell 4 step is like 60 seconds per image, which i can cope with

[sterile pendant]

i'd never, i just like the quiet upstairs office. the kids are noisy during the summer

[frail shoal]

can we theoretically distill a 12b flux model into a smaller one like 4 or 6B. 3b even better ?

[sterile pendant]

yes, in theory

[frail shoal]

but you need tons of money that's it ?

i still don't understand why they didn't realease schnell with a lower parameter count than the teacher model

[sterile pendant]

not terrible. i'd have to throw some other hybrids at it since they are a fun way to test how well it understands things

and it's just male nipples and ken doll under the mask

[frail shoal]

flux guidance 3 ? it's like cfg ?

[hexed dirge]

dev or schnell

?

[sterile pendant]

dev

[hexed dirge]

yes but it's so slow

[sterile pendant]

im using kijai's fp8 model(the file size is massively reduced and since i'll never be able to run it above fp8, that's fine)

[frail shoal]

you could use onediff if on linux, they have already supported sd3 so maybe it works with flux as well

something like 1.7x speeds, the thing fal uses to be fast

[hexed dirge]

gpu?

[sterile pendant]

nope, wont touch linux. f'ing hate linux and i've used it plenty in the past, dozens of distros

[sterile pendant]

2080 FE

[hexed dirge]

I'm with 4070 but get 24s/it

[sterile pendant]

i get 15s/it

[hexed dirge]

ram?

[frail shoal]

if you care about speeds. The thing is i use adobe a lot and can't have linux, unless i virtualize windows lol, or dual boot

[sterile pendant]

ddr4 3200, but i have a 13600kf

[dry wave]

3090 => 1s/it

[sterile pendant]

moist

[hexed dirge]

fp8 or fp16?

[dry wave]

it's only simulating cfg. Its not real cfg

[raven fern]

aww

[dry wave]

fp8. But it seems to not make a huge difference

[hexed dirge]

will try

now

[sterile pendant]

yeah it doesn't really make a difference, the VAE will still do its shit in fp32

[sterile pendant]

we're going to see more and more models go this route and likely do away with negative prompts anyways. cfg was always a hack

[hexed dirge]

with fp8 I get 3s/it

[dry wave]

not sure about that. I think the teacher model has cfg

otherwise: why would they even have cfg at all?

[raven fern]

hahaha, sure

[hexed dirge]

Requested to load Flux
Loading 1 new model
loading in lowvram mode 9811.074999809265
100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:53<00:00, 2.65s/it]
Using pytorch attention in VAE
Using pytorch attention in VAE
Requested to load AutoencodingEngine
Loading 1 new model
Prompt executed in 97.64 seconds

[sterile pendant]

it might, but the whole goal is to make models act more like turbo/lightning/hyper models where you use cfg 1-2, at cfg 1, you have no negative prompt

[hexed dirge]

but what is the main differences between fp8 and fp16? Prompt understanding?

[sterile pendant]

and with these being LLM based, you can put negative shit into the prompt. like saying "a human that isn't wearing a jacket"

[dry wave]

I'm not sure if that is the goal. I think it just what happens during the distillation

[frail shoal]

here is a provoking thought, can we have a better flux model by merging schnell with dev?

[dry wave]

you cannot use cfg when you have low amount of steps anyways

[sterile pendant]

right

[dry wave]

I think there is no big difference. Might be just fluctuations. Like running a model with 20 steps or 30 steps. Later might look better in some cases but overall its not a huge difference

[hexed dirge]

thanks

[sterile pendant]

anyways, my point is, the goal will likely be to eventually do away with negative prompting and if you don't want certain things in your image, you'll just say that in the prompt

[hexed dirge]

now it work in less than 1 min for 20 steps

[dreamy pawn]

Thanks for the feedback/reply! bows

[hexed dirge]

I hope 5070 will get at least 24GB

[sage burrow]

I think we need a Flux channel, this poor sd3 section!

[karmic gale]

what is flux?

[sterile pendant]

it won't. it will probably be 16gb though, if not, it will be 12gb again

[vast condor]

I wasn't here for like a week, and now it's all you see

[signal shuttle]

Flux is a new opensource SOTA text to image model that is 12B parameters made by black forest labs, it beats SD3 by long shot in my experience

[vast condor]

Do we know the technical requirements to run it local?

Wondering if my 16g vram will cut it

[signal shuttle]

That should be fine for the Dev and schnell versions using fp8

[vast condor]

schnell sounds like an expletive

[rain current]

I have a 4060ti 16GB, I am using Flux Dev, upscaler, ... and it works (fp8)

[signal shuttle]

Dev is the best model and schnell is the distilled more smaller model that only uses 4 to 8 steps

[frail shoal]

why not merge them together for a better model with train difference ?

[sterile pendant]

Schnell is German for fast

[signal shuttle]

what would be the point of that?, Schnell is supposed to be the fast "turbo" model

[sterile pendant]

<==== ich spreche ein bisschen Deutsch

Well more than a bit. Like b1 level

[hexed dirge]

last "flux" question. Do you have a good workflow with upscale?

[frail shoal]

schnell is better at styles and faster while dev is better at quality and anatomy but slower, maybe we can get a middle ground model that has the best of both. There is only a matter of supporting it in some merge node and try it

[signal shuttle]

that would result in overfitting and make the images look horrible, and it isn't as simple as merging two models to get a middle ground model

[frail shoal]

there are merges of distilled sdxl models with normal ones. Are you sure this would not work ?

and i'm talking about train difference which would train the difference between schnell and dev

[signal shuttle]

Basically putting the data from the two models into one model?

[frail shoal]

yes you do model A (schnell) - (Dev(model B - Schnell (modelC).

so you train the difference of schnell and dev into schnell

[signal shuttle]

But would that work on DiT architecture?

[hexed dirge]

can you share workflow for upscaling?

[frail shoal]

it does work with other dit models like sigma, so it should work

[signal shuttle]

Tbh i am just waiting for Flux's research paper to release, so i can understand how the model works then i can make an informed opinion

[craggy crest]

dev is better at quality because they fine tuned it from schnell. if you merge them, you might make a mess

[frail shoal]

both models are derived from pro, where did you see that ?

[rain current]

very simple

[signal shuttle]

No they didn't?, they are both from Pro

[hexed dirge]

oh you use a model for upscaling?

[craggy crest]

FLUX.1 [pro] the base model, available via API
FLUX.1 [dev] guidance-distilled variant
FLUX.1 [schnell] guidance and step-distilled variant

you go right ahead and try to merge a couple of 12 billion parameter models on your machine. tell me how it works

[frail shoal]

they are both derived from pro, look closer. what you just showed it does not state what you said.

[craggy crest]

i'm so very sick and tired of you. ignored now

[frail shoal]

go to sleep

[hexed dirge]

can you share ?

[noble coyote]

Flux models kinder to your VRAM https://huggingface.co/Kijai/flux-fp8/tree/main

I have d/loaded 22Gb FluxDev.sft AND 22Gb FluxSchnell.sft

[dull star]

kinder to your disk space too

[rain current]

In the image, you can see it, but here you have...

[hexed dirge]

oh thanks

[dry wave]

dude, basically everything you write here is bullshit lol Instead of blocking people you might just read their posts properly

dev and schnell are both distilled variants from pro as Water lava but watery said

[dull star]

exactly

[craggy crest]

thanks for the insult, reported for harassment

[dry wave]

yeah, whatever. Troll

if merging works... who knows. I was surprised that merging TurboSDXL in SDXLBase works. But if it makes things better...

[dry wave]

regarding styles

[dry wave]

I made a small experiment with one of my favourite styles

old dungeon and dragons book covers xD

So I used the prompt
"illustration by Jeff Easley"

to find out if the model knows who he is

the image that came out doesn't look like images by Jeff Easley. But it looks rpg-like, so it seems to know the connection between "Jeff Easley" and "Dungeon and Dragons"

[icy drift]

I'm home and back to testing at last! 😊

[dry wave]

so I tried the same again, but this time used different prompts for CLIP-L and T5

T5 gets "an illustration by Jeff Easley"

but CLIP-L only gets "an illustration"

[icy drift]

It cannot do negation. (No other model has ever done negation, but since it shattered all my previous tests, I just had to try.)
a landscape without any color red, there is no color red anywhere at all

[dry wave]

what comes out is an arbitrary illustration that has nothing to do with RPG

this is CLIP-L and T5 both get "Jeff Easley" prompt

[icy drift]

There's a lot missing from its dataset. Also can't do TCGs. Information can be added in Loras though. Model IQ cannot.

[dry wave]

This is only T-5 gets Jeff Easley Prompt

[dry wave]

it can lol I showed it above

[icy drift]

A trading card?

[dry wave]

yes

just look it up. You only have to set aspect ratio fine and do the prompt right

[dry wave]

see

[icy drift]

Sorry, looked and didn't find it. Can you repost?

[frail shoal]

i can't seem to do vampire teeth with flux, any typical prompt ?

[icy drift]

Fangs?

[dry wave]

anyways, what I wanted to find out with my experiment was: The T5 has no idea about styles at all

maybe they did not trained on artists stuff at all

the only knowledge the model has about that comes from the CLIP-L encoder

[frail shoal]

might try that

running on 6gb vram

[icy drift]

Not as cute as Stable Cascade, but yep. Works now. Also not what I came here to do!

[dry wave]

same with "an illustration by Jinjo Ito"

Only T5

Only CLIP-L

so only CLIP-L has any knowledge about artists :/

this is not the case for "common knowledge artists" like Van Gogh

[torn wharf]

clip-l is the one from sd2 right?

i think even to this day, all the prompt meta is rooted in clip-g sd15 style prompting

[icy drift]

New, never-passed-before physics test! Can it conform a draped sheet to an arbitrary 3d form??? 😮 Yes. Yes it can. I could say it's not perfect, but in all honesty I think it might just be "not the way I would have drawn it". It understands 3d forms and fabric physics.
A draped sheet completely covering a sportscar.
A draped sheet completely covering a pineapple.
A draped sheet completely covering a pyramid.
A draped sheet completely covering a minecraft creeper.

[torn wharf]

even when i use prompt expansion models from like fooocus or all the ones that dynamic prompts accesses, they all produce clip-g style prompting

[torn wharf]

love the creeper

[low stone]

flux or sd3? I'm not getting any response out of that prompt with jinjo, in either clip-L or t5. it's just a generic illustration. running fp16 flux dev and t5 fp16

[dry wave]

Flux

using flux dev in diffusers

[torn wharf]

there's really no reason to use sd3 2b anymore imo. it needs juice

[dry wave]

(cause its always super fucking annoying to find out how to change text encoders in comfy and most time you need stupid plugins for that)

[torn wharf]

flux has stolen 2b's mojo

triple text encoder node that's in the sd3 example workflows has always worked well for me

the only confusing part is the folder name . t5 weights go in /models/clip/

[low stone]

they've actually made it real easy with this

[torn wharf]

does flux do away with clip-g?

fekin crazy

[low stone]

it would seem so

only has clip L

[icy drift]

It can do accurate fluid form conformation, but the prompt makes a huge difference.
a ghostly mist eagle made out of smoke against a black background
misty smoke in the shape of an eagle, against a black background
misty curling wisps of smoke forming the shape of an eagle, against a black background

[dry wave]

guess that's new. I don't find it in this confusing overloaded menu X_x

[icy drift]

I cannot get it to do general form destruction. 😦 Can anyone find a magic prompt for this?
an exploded view of a guitar exploding into pieces, there are pieces of the guitar flying everywhere, it is shattered and cracked and destroyed and has fallen apart

Yes, it can do a bat swinging a bat. Homonyms FTW.
An anthropomorphic bat swinging a red bat in a batting cage

[low stone]

a guitar broken into 5 pieces

[icy drift]

It was able to cut sections out of it. That makes sense. I doubt it can independently manipulate those sections as 3d forms. It doesn't understand the component structures, only the entire structure.

[torn wharf]

dev and sch use the same vae ?

[low stone]

uh oh, what have you started. 🙂

[icy drift]

LOL can you make the pieces fly? Explode? That would really amaze me. (I have this test marked as fail for now though.)

[low stone]

i get the feeling that it's applying the segmentation later in the generation. his face forms, THEN the breaking lines.

[icy drift]

My thinking exactly.

[dry wave]

yes

[low stone]

yeah and it won't "explode" them.

[torn wharf]

remember the movie "The Cell" ?

[low stone]

Nope, can't say that I do.

[torn wharf]

flux doesn't seem to

[icy drift]

The Euler sampler cannot do pie charts, but the LCM sampler can. (LCM is great at very straight lines and geometric shapes.) However, Flux doesn't understand the ratio proportions. (I had high hopes for a second on my first render, it was showing a 70/30 split.)
The pixelation here is what the model outputted.
A pie chart showing a 70% / 30% split.
A labeled pie chart. 70% (seventy percent) of the pie chart is blue. 30% (thirty percent) of the pie chart is red.

[torn wharf]

creepier than kroenenberg imo https://youtu.be/RNP4caHnknA

[icy drift]

This model will fine-tune for animation excellently. (Let's not think about how much VRAM fine-tuning needs though...)
sixteen images in a 4x4 four-by-four grid, animation frames, the animation shows a cat running

[torn wharf]

testing local flux on my 4080. dev is 100s gens and uses a little over 12gb

now i can run all the prompts. ran out of free on the pblic labs. and those are over flowing now that eveyrone knows about flux

bbl i gotta go out for a bit. got it running for when i get back at least

[icy drift]

Ummmm... I'm gonna say no. It cannot understand SVG. Probably reacting to the word "rect" a little.
<svg><rect style="fill:#FF0000; stroke:#00FF00; stroke-width:5;" width="100" height="100" x="0" y="0" ry="10"></svg>
(SVG is an image format usually used for clipart, and it is made entirely out of text that looks like XML or HTML.)

[dull star]

clip_l only, T5 only, both

salad fingers, by david firth, wasteland

[karmic gale]

oh nice going to check it ty

[frail shoal]

Does someone know why aligned scheduler works for flux but aligned your steps does not ? They are basically doing the same thing.

[icy drift]

Without knitpicking, these were done with the laziest prompting possible on one-shot. Normally you'd use controlnet. This is hands-down the most consistent anatomy I've seen out of a model. With controlnet, it would probably be perfect.
superhero doing a cartwheel
superhero doing a handstand
superhero doing a backflip
superhero doing a high-kick
superhero doing a t-pose

[dull star]

probably the same reason it doesn't work for sd3

[frail shoal]

But aligned scheduler does the same thing right ?

[dull star]

I don't even know what an aligned scheduler is

but probably not then

[frail shoal]

Well it does the same thing and you can select sigmas from sdxl, SVD and sd1. But all of these work for flux however the ays node returns a black image. I'm thinking it's black because the the aligned scheduler has the option to set force sigma min true.

[young blade]

Lmao, figured

[frail shoal]

Without it would be black as well

Btw has anyone tried the ode samplers with flux ?

[dull star]

its dog slow and I don't know if it has an improvement

[frail shoal]

Ode samplers ?

Btw does anyone know a sampler that does a good job but requires less steps ?

[icy drift]

It can do solid particle cloud fluid-like conformation. 😱 To say nothing of the profound understanding of these 3d forms necessary for it to render them transparent so intelligently. This is just a phenomenal physics test pass. Somebody get this model a trophy. 🏆 🌟 💯 ✅
a transparent glass vase in the shape of a shark, filled with toy blocks
a transparent glass vase in the shape of a sportscar, filled with toy blocks
a transparent glass vase in the shape of a microphone, filled with toy blocks

[frail shoal]

@fossil pagoda you had a favorite sampler or scheduler I can't remember that did great pics with pixart sigma but it required less steps to work. Too much it would overbake. Do you remember?

[rose skiff]

Curious what y'all are using for finetunes of SD3? Is SD3 medium small enough that dreambooth becomes more comparable to a lora in terms of training time + ease of use + performance?

[icy drift]

It can do book covers but that's no surprise. I saw people doing movie posters on a stream.
a book cover, the title says "FLUX", the cover art shows a mad scientist with wild white hair in a caricature style

Ummm... I'm pretty sure this isn't 180 degrees though. More like 120 or something. Still all the curves look very accurate. Maybe better prompting would do it. I'll probably come back to this and see if I can get something consistent that I can run through depth stereo conversion and test in my headset.
a 180VR fisheye lens photo of a mountain landscape taken from the porch of a log cabin

[icy drift]

1920x1080 landscape in 464 seconds. VAE is running on the CPU. No RAM problems. This is definitely not Stable Cascade. 😮‍💨
Also gave me a painterly style? I wonder if that's an artifact of the resolution or a problem with my prompt.
I'm switching to a prompt with HD photography tags, and starting a 4K render.

Okay. 4K is rendering. I'm going to go watch That Time I Got Reincarnated In A Conference Room. Check back in a while.

[acoustic kite]

did you add lens settings? like 50mm etc.

someone also mentioned turning down the denoising to 0.9 to get more photorealistic images

[icy drift]

I went with this. If it doesn't work, I'll go back to 1024x1024 and practice prompting for landscapes and mess with other settings. I still haven't experimented with any samplers except Euler and LCM.
raw photo, a beautiful Alaska landscape with snowy mountains in the background, with a lake in the center reflecting the mountains, surrounded by a field of wildflowers, in the sunlight, with a blue sky and white clouds, dynamic lighting and shadows, HDR, 4K, cinematic masterpiece, extremely highly detailed, white balance

[karmic gale]

just tried flux it's quite nice

far less censored than sd3

[pseudo owl]

humans are very good as well, better then sdxl base 100%

[karmic gale]

now we need the big finetuner haha

[acoustic kite]

it's not quite there yet but it's close 😆

[torn wharf]

is this nsfw or sfw?

[sage burrow]

How?! it only gave me this with a very NSFW prompt!
I also much prefer the SD3 art for SFW. I must be missing something Flux.

[sage burrow]

SFW

[torn wharf]

pretty thick lego lady so i wasn't sure

[desert tendon]

Are you using the "schnell" model or the dev model? Dev is where you want to test that

[sage burrow]

The cost of legos has gone up, that would cost thousands for a physical version these days ROFL

[sage burrow]

I downloaded Dev. Perhaps it can't do furries?

[desert tendon]

the 4 step turbo one is more censored (from what I've heard) - dev does NSFW for me

hmmm no sure on that tbh

[torn wharf]

sets are expensive but bulk bricks not so much. still higher than usual. The secret is to find garage and estate sales. "$20 for that whole bucket"

[desert tendon]

will be trained a lot coming up anyway I'm sure

[sage burrow]

Or like most models, only does nude ladies 😦 (and not futa ever either)

[desert tendon]

yea, pulled your image/wf and prompt may just be a bit TOO much.....looks like you are using dev

[sage burrow]

I always start with the most obvious when testing lololol

[desert tendon]

suuuuuuure 🙂

[sage burrow]

hahaha

that prompt tells you 100% if it does NSFW or not ROFL ROFL ROFL

[torn wharf]

i'm annoyed that it's more like a lego board texture than it is a lego construction. but yeh, it knows things

[sage burrow]

But if it only ddoes SFW, then glif is faster than my poor coputer 😄

[torn wharf]

someone's gonna report that image and a mod's gonna come look at it and shake their head. lil time bomb of laughs for them to find

stability's got bigger concerns right now

[sage burrow]

Usually unless it has || nipples || it's sfw

you should have seen all the ladies laying in grass photos that used to get posted here lol

Now I want to do lego versions of famous statues 😄

[torn wharf]

i'm not even naughty prompting. there's one word "bsuty" that's doing it pretty sure. word that's been blocked from this server. 19 foot tall toy block statue of b**sty woman. The statue is built with colorfully miss matched Lego bricks. positioned outside of a building on the sidewalk. her hair is constructed out of lego bricks as well. the brick layers are clearly defined through the entire construction of the statue

the entire prompt is about lego and all the model is putting out is THICCCK ladies

[sage burrow]

smart to use miss-matched and 19 foot tall! I wouldn't have thought of those two things

[cunning lintel]

its def more clinical in a way, i prefer sd3-8bs response to styles as well, buuut.... it's early days as dark has show nclip still has some influence, end who knows what will be developped for this model

[acoustic kite]

using the same seed and a different prompt leads to really high consistency in the style, idk who needs to hear this

atleast it's useful for making game assets

[sage burrow]

Do you mean SD3, or?

[torn wharf]

sd3 still might benefit from all the style knowledge in clip-g yet. "Greg Rutkowski" meta came from how the clip tokens would direct the unet. not the unet itself. he actually came up not often in laion dataset

[acoustic kite]

sorry i mean flux

[torn wharf]

that meta meant a lot less on refined models, but on the base model the knowledge the clip tenc is trained with is a big player

[acoustic kite]

same seed, different prompt :)

[sage burrow]

In that case, I'm guessing you mean, even morso than the other models? 🙂

[torn wharf]

t5 isn't an image pair trained model so i don't think it matters. it has self attention and works on the paralel network. but the openclip L layer, thats SD2 right? that stil lhas some trics. Ornate was a gooder

you see you see? same seed. same prmpt. i just threw ornate on the back of the first image

haven't gotten around to remembering all my old sd2 keywords yet.

[sage burrow]

When should we be expecting Flux ballz? 😄

[torn wharf]

its very ball capable already. i might try that lora when i see lora training code. or an embedding perhaps

[dry wave]

yes, unfortunately the Flux model itself has barely any style knowledge

[torn wharf]

#🆕｜sd3 message first thing i tried actually

[torn wharf]

you just need to describe styles in an sd2 vernacular and throw some lore at t5 to chew on

[dry wave]

I played around with style prompts separately on T5 and CLIP-L

"illustration by Jeff Easley" CLIP-L only

same prompt, T5 only

"Illustration by Jinjo Ito" CLIP-L only

same prompt with T5 only

so the very few style information Flux can deliver comes only from CLIP-L

at least for copyrighted artists

common artists like Vincent Van Gogh can be prompted by both

"painting by Van Gogh" CLIP-L only

same prompt T5 only

[torn wharf]

my biggest disappointment is that no matter how i approach it i can't get a flux capacitor

[dry wave]

unfortunately, CLIP-L can only shift the style in the right direction, but it cannot safe the thing. Like the image above looks nothing like "Jeff Easley".

Either Flux does not have much arts in its training data (for copyright reasons) or they used some automated captioner method that removes all style information alltogether and leaving only a content description

[torn wharf]

a warrior riding on the roof of a DMC delorean illustration by Jeff Easley

[sage burrow]

Flux can't count arms! It does great at fingers though, on all THREEE arms lol

[torn wharf]

i think its the classic distillation problem i've faced a few times. classes get compressed down to a style that overtakes the whole thing. every painting looks the same. every illustration looks the same. but if you tinker, you can evoke the depth of knowledge better. the latents are just a little bit galvanized for the time being.

less steps helps. that was 10 steps eular.

[sterile pendant]

With schnell? That kind of behavior is normal of turbo/lightning style models. You lose a lot of variety

[torn wharf]

flux pro is their money model. that's what they're intending to use to build all the public weights they release. distillations

[torn wharf]

i'm using dev. it's distilled too but i'm not sure what way. differently

[pseudo owl]

just use 6 step with schnell, its a lot better then 4 steps(it can even do nsfw to some degree then)

[sterile pendant]

Yeah probably

It's a big enough model though that it still has plenty of variety

[torn wharf]

i wanna get embeddings going on it. i wonder if sd2 embeddings would work

[dry wave]

SD 1.5 only

they should work, but probably won't help much.

CLIP-L is not part of the attention/transformer

[torn wharf]

sd3 feels like fusion in dragonball to me. like, all the parts were there ready to fuse together. but 2b became veku. Still pretty awesome and strong, but not cell killing strong you know? so blackforest tried again with more zen and formed gogeta, the true SD3

i'm not sure there's any reason to load sd3 anymore

[craggy crest]

which leaves golf balls in the corner

[torn wharf]

doesn't seem to know vegeta. it just keeps drawing him like goku. BALLS

[cunning lintel]

yay, flux can to texts on the back of a tshirst \o/

[torn wharf]

now that i've done a bunch of images and dialed in a few settings. i'm getting 20second generations on average. faster with less steps of course. but yeah. slow for you maybe.

[cunning lintel]

lol, that was just a prompt i tried with sd3 8b and was the first disappointment, this time with flux, it's better, it's much like ideogram (ideogram still a bit better)

[icy drift]

Huh. Can it just not do 4K? 3612 seconds for 3840x2160.

Gonna try hires fix 1920x1080 scaled up to 3840x2160. That might work? Hmm.

[cunning lintel]

but it's def a slow model, and there'll be a lot of room for lighter ones

[icy drift]

Uhm, NO! As someone who has never used ideogram, I can definitely say with 100% confidence that flux is way better! I don't need evidence to support my opinion! 😛

[bitter hearth]

I found ideogram okay

It feels like dalle

[dry wave]

it has best prompt understanding over all models

[bitter hearth]

The new one at least

[dry wave]

aesthetics is mediocre

[torn wharf]

guess the prompt

[pseudo owl]

Dragon

[torn wharf]

close

||Trogdor was a man. He was a Dragon Man. No wait, he was just a DRAGON. TROGDOR! BURNINATING THE COUNTRY SIDE! BURNINATING THE VILLAGE! An S shaped dragon with a human arm with huge bicep and human colored skin. Fire breathing.||

[icy drift]

Got a hires-fix workflow. This was 512x512 -> 1024x1024

Gonna try now for a 1920x1080 -> 3840x2160 and see what happens. It'll be a while.

[brittle nexus]

The encode files for flux are the same from Sd3?

[pseudo owl]

Not exactly the same but yes similar. Flux has 2 text encoders, sd3 has 3 text encoders.

[sacred jewel]

A realistic picture of Queen Sheeba of Egypt?

[brittle nexus]

I want to know if i need to download them again since they look the same files

[dry wave]

no, clipl and t5 are the same

[pseudo owl]

You don’t need to download them again

[brittle nexus]

tks

[sacred jewel]

An evil bat swinging a bat in a batting cage

[frail shoal]

vampire utopia with schnell

[torn wharf]

Nice. That's a good depiction of one

[frail shoal]

I can't believe this silence from stability. I don't even fathom what they are thinking.

[torn wharf]

https://tenor.com/view/oh-fuck-fuck-fallout-prime-fallout-4-gif-16427577073266493170

[cunning lintel]

They released a 3d thingy yesterday and showcased sd3. 1 2.xb on twitter (sadly only with basic prompts)

[cunning lintel]

The only good response is to just deliver a good model, which is still WIP, 2 weeks, and such

[torn wharf]

i like that style. don't speak. just do. that's what bf did

feels refreshing

[frail shoal]

yeah but i would have thought they would be a little more active on discord, at least when SOTA drops on their discord

[wheat stag]

guys

[frail shoal]

i'm not gonna call it flux anymore. The new name is SOTA lol

[wheat stag]

how do we get stable diffusion 3 ive been

trying to download it for four hours

I am

very dumb and desperate

[brittle nexus]

https://x.com/recatm/status/1819348949972476019?s=46&t=t04c6G-lAweXkub6PTPbKQ

XiQiao 西乔 (@recatm) on X

SD3 team has shared some generated results from the WIP training SD3.1 (not done training yet). comparing them with Robin's Flux 3.1 Pro using the same prompts. The 3.1 model is almost on par with Flux Pro in terms of quality, but it's nearly 5 times smaller, with only 2.5b

Twitter · Aug 2, 2024, 12:26 PM

[cobalt moon]

https://huggingface.co/stabilityai/stable-diffusion-3-medium/tree/main

you have three choices :

1. pure SD3 model (4GB one) with no text encoders integration. This will required you to download the text encoder separately which you can find in text encoders folder
2. SD3 with CLIP embed (6GB)
3. SD3 with CLIP and T5 embed, one is fp16 (16GB) and another one is fp8 (10GB)

[wheat stag]

THANK YOU

i'll do that rn

[cobalt moon]

well it's not hard to think that SAI is undergoing mass internal structural reform.

and that take them so long

again I suspect if Emad ( biggest shareholder for SAI ) and other shareholders will allowed any "meaningful" changes or just "eh, just do it idc"

[wheat stag]

just downloaded the third one, what should I do next?

[dry wave]

I mean, of the 17 authors of the SD 3 technical paper,. 14 authors are now working on Flux

including Robin who was I think the leading ML scientist at SAI

[wheat stag]

i dont got automatic111 or any of that stuff the only thing I've successfully downloaded is this thing

[cobalt moon]

... do you have any webui downloaded?

say ComfyUI.

[cobalt moon]

yeah seem like internal drama is cooking real hard

[wheat stag]

Nope, not a single thing. I'm new to this

Sorry

but i'm a fast learner just lmk what to do ill do it in 5s

[dry wave]

and to be honest. Flux was the nicest release for long time

[cobalt moon]

oh yeah you should have download the webui first, anyway you have two major choice, A1111 and ComfyUI.

For your case A1111 would be a suitable choice.

[dry wave]

not the typical SAI drama

[dry wave]

with stupid hypes, delays, drama

[wheat stag]

Bet! I'll download A111, so like.. uhm sorry but where is it exactly?

[cobalt moon]

I mean a lot of people praise it tons lot in r/StableDiffusion

[sacred jewel]

Will be good to go watch some youtube videos on how to install from scratch.

[dry wave]

I don't know how much Black Forest Labs are interested in continueing open source and open weights

[cobalt moon]

https://github.com/AUTOMATIC1111/stable-diffusion-webui

[wheat stag]

bet i'm gonna download it rn

[dry wave]

but as SAI seems to be not interested into open source anymore it cannot get worse

[rain current]

well, that comparison doesn't benefit SD3.1. The biggest advantage is the size, which can be used with less VRAM, but in terms of composition and quality, I think Flux is better. I would also like a real comparison with poses, people, anatomy... I've read that those who developed Flux are former SD developers?

[sacred jewel]

https://www.youtube.com/watch?v=kqXpAKVQDNU

[dry wave]

basically all people (14 of 17) who developed SD3 are now working on flux

[cobalt moon]

wait

guy

[dry wave]

including both leading researchers

[cobalt moon]

if so, wasn't the timeline messed up

I mean the resignation happened in March right?

and SD3 release in June or July

[dry wave]

and yes, the SAI twitter post is ridiculous. Even with SD 1.5 and a good finetune you can make stunning photos of dogs. That's not what anybody is interested in

[wheat stag]

just downloaded it

[cobalt moon]

put that SD3 model into {AUTOMATIC1111}/models/Stable-diffusion

[dry wave]

the "SD3" release never happened

[cobalt moon]

yeah sure whatever

fake SD3 whatever they called

[dry wave]

I guess they just start training a new model what they then delivered as SD3 medium

they even said that the model was not properly trained. So I guess it was more or less some exit-plan to keep people calm down

[wheat stag]

bet rn in my desktop i got these two ima do this

[rain current]

So now I understand why Flux is so good

[dry wave]

honestly... auto111 is not really good anymore

[brittle nexus]

A 2.5b can't compete with a 12b. It will be faster and more accessible but it's all. Maybe 8b well trained could

[torn wharf]

i get better trogdors with this approach. The shape of an S with green scales. At the top of the S shape is a dragon head with a black V between the eyes representing angry eyebrows. Attached to the top of the S curve are a pair of small wings. Attached to the bottom are two capital black L letters representing his legs. A large human arm is at the middle of the shape, attached to the S shape at the shoulder. Large human bicep arm. in the background is a country side, burning village in the distance

cant get that man arm though

[dry wave]

I would recommend InvokeAI if you want an easy UI, but that one won't support SD3. For SD3 you can use Comfy or SwarmUI

[sage burrow]

Get comfyui 😄

[cobalt moon]

oh wrong method of downloading A1111, you can watch the video sent by YouFunnyGuys above

[brittle nexus]

reforge is pretty good too

[torn wharf]

honorable mention but was a different sampler

[wheat stag]

oh ok

[cobalt moon]

the difference between A1111 and Reforge is quite small isn't it?

[brittle nexus]

No. It's huge

[cobalt moon]

after A1111 somehow pull a tons of feature update and performance fixes in 2 days

[torn wharf]

lol its really good at actual capacitors for sure

TROOGDOOORRRRR

[torn wharf]

BURNINATING THE COUNTRYSIDE

BURNINATING THE LAST SUPPER

[sage burrow]

Did everyone give up on sd3 already? lol

[torn wharf]

if something new happens for sd3 i'll move over

[cobalt moon]

Just more toys to play with

[torn wharf]

give it some space

until then, trogdor was a man.

he was a dragon-man

(really not sure how jared leto and willem dafoe ended up in this)

little bit peter stormare too

[torn wharf]

all the peter stormare prompts. is kinda like him consistently through the fashion show, but only kinda

[bitter hearth]

where are the balls at

I come here and no balls

disappointed

[torn wharf]

arnold on the catwalk. or at least what arnold prompt does. No time for balls we got a lot of latent ground to cover

[bitter hearth]

you people using flux?

[sacred jewel]

https://tenor.com/view/maybe-not-i-dont-know-maybe-we-dont-know-gif-4965071280460852343

[bitter hearth]

the new release takes a lot of resources but quality is high, and ppl are referring to this as the sd3 we should have had

[bitter hearth]

https://comfyanonymous.github.io/ComfyUI_examples/flux/

[bitter hearth]

im not sure if you are already using flux

[bitter hearth]

im patiently downloading the 23gb model file

[fleet meteor]

Nice prompts! I´ll steal them 😅

[torn wharf]

name that movie scene

[fleet meteor]

WHAT

[torn wharf]

their next goal is to release a SOTA text to video model

[bitter hearth]

who?

[torn wharf]

black forest

[bitter hearth]

black forest labs?

ahh nice nice

black forest labs kinda has a vibe of a dark symphonic metal group

[errant dust]

https://arstechnica.com/information-technology/2024/08/flux-this-new-ai-image-generator-is-eerily-good-at-creating-human-hands/

[bitter hearth]

sweets, im almost done downloading the necessary files, hope my system can handle image gen

[errant dust]

So does this already work in comfy without requiring 24 GB of vram?

[bitter hearth]

should

[torn wharf]

yup

[bitter hearth]

people are already using it on comfy

i have 12gb vram

and 32gb ram

keeping my fingers crossed

[fleet meteor]

Epic

[fleet meteor]

Same but 16gb of ram and it works (I have to use around 40-60gb of my ssd as swap )

[errant dust]

Please precede these images with the letters NSFK (not safe for keyboard). My drool seeing them is endangering my hardware

[bitter hearth]

40-60gb of your ssd? whats that?

[errant dust]

Woah

[bitter hearth]

i have 2 ssd drives, both at 512gb limit

im not hoping to mess with page files

im on windows 11 btw

[fleet meteor]

I only use it because Its too slow with 16gb of ram but you probably don´t have to do that if you have 32

[bitter hearth]

ah ok, im a bit apprehensive

[bitter hearth]

some people were saying flux locks up their system briefly when rendering with vram lower than 16gb

[errant dust]

well I have 8, so..... gues we'll see

[sacred jewel]

Scne 22, "The Great BacKon Race"

[fleet meteor]

It lags a little and maybe they ran out of ram, but with 32 you´re good

[fleet meteor]

I think you technically can run it if you have enough ram (or a big ahh swap but it will be extremely slow)

[bitter hearth]

about to test it out .. less than a min left and im done with all the file downloads

[sage burrow]

I have 8gb vram, takes 10 mins per image lol

BTW glif is useful

[fleet meteor]

4-6 minutes with 12gb vram

[bitter hearth]

this is important for optimization https://comfyanonymous.github.io/ComfyUI_examples/flux/

[torn wharf]

the majestic salmon returning home to find their mate

[bitter hearth]

some suggestions offered in that page

[torn wharf]

lol. it depicts an actual movie scene

[fleet meteor]

Im hungry now lmao, time to cook

[torn wharf]

if only fishing made it that ez

really? nobody knows the movie. bacon in a warehouse leaping around

||https://youtu.be/j8XGmZ8HDIU?t=29 || answer key

[bitter hearth]

Balls

👍

[bitter hearth]

Stalker

[fleet meteor]

I´ll try generating a more stalker version, with a swamp or more cloudy :3

[bitter hearth]

btw you'll have to update comfyui for flux type support

[sacred jewel]

Prompt?

[bitter hearth]

oh shit its slowing my pc as i try to render

[bitter hearth]

molasses guys molasses

Ball

[bitter hearth]

[bitter hearth]

i like the texture so much

no quality prompt like high res and all that ...

[prisma rampart]

retro-futuristic painting by vincent di fete (giant evil grinning balls:1.2) magazine cover by beksinski

[bitter hearth]

time to have fun

[ember coyote]

This is beautiful, good chuckle

[torn wharf]

not too soon?

[ember coyote]

Never too soon

[bitter hearth]

trying a big chunk of prompt

all fun and good but eventually i'll have to play with rendering girls

damn...

[sacred jewel]

Legend!!

[torn wharf]

remember this tv show?

[torn wharf]

it had a good run it was really popular for a bit

member?

[torn wharf]

maybe this one is easier

was a really good show

[torn wharf]

ba ba baaaa bababa baaa. babababa baba baabababa baah

ok bye gang. have fun with the tru sd3

[torn wharf]

love this ball

[bitter hearth]

you mean true flux

[torn wharf]

Sd3 is in a state of flux

[bitter hearth]

haa

funny

[young blade]

why is it so hard for all ai models to make a pickaxe, seems like a trivial tool to recreate

a dozen generations with flux and still not quite

[sage burrow]

Sd3 or flux?

[torn wharf]

friday flux hour. welcome to the twilight zone. its time to get smooth

[sage burrow]

Flux pro

[torn wharf]

late night in the flux zone

[noble coyote]

Flux.Schnell, t5xxl_fp8_e4m3fn Clip, 1024x1024, 8Gb VRAM RTX2070, 64Gb RAM, prompt = A giraffe in a red hat, reading a blue book. A green frog is on the hat, and a yellow snail is on the frog. 130 seconds to produce!

[remote holly]

Flux shnell is the distiled model ?

[torn wharf]

come enjoy the sultry styles of mrs rabbit, down at the flux lounge. late nite at the flux

[noble coyote]

I believe so. 4 steps only, and good for smaller VRAM

Flux.Schnell - prompt = Trees in the dark is a hand-painted painting by the artist Karen Kaspar in landscape format. Watercolors, ink and acrylic paints were used.
Under a dark sky stands a row of trees with dark trunks and dense dark foliage. The silhouettes of the trees are subtly illuminated from behind by the moonlight at night. The picture is painted in a mixture of blue and black hues and radiates tranquillity and a mystical atmosphere.

[remote holly]

Is it good in prompt following ?

[cursive veldt]

s generating 2 images with Ultra, using prompt a poorly photographed image of a foolish looking person drawing a really crummy attempt at a bad horse

[noble coyote]

See my giraffe picture above - nearly 100% correct!

'cept the snail was not on the frog as described

[remote holly]

Looks good , and you can combine with t5

[noble coyote]

Prompt = A cartoonish dog with intricate, colorful designs all over its body stands against a backdrop of lush green leaves. The stylized patterns on the dog include various shapes, symbols, and colors, creating a whimsical appearance.

Excellent clarity - and very good prompt coherence

Prompt = Steampunk Agostino Arrivabene Rob Gonsalves Remedios Varo Leonora Carrington Dorothea Tanning Wolfgang Lettl Hieronymous Bosch two guitars playing by a chicken and fox. So cool!!!

Text is much better than 2B SD3 - but not quite at Ideogram standard! The sign was prompted to say "Chicken & Fox Rock!"

[craggy crest]

love the fox tail on the chicken

[noble coyote]

Here is one with the text as asked for ...

... nearly!

New York City peruvian arpillera style of victo ngai, henry rousseau, vladimir kush, canaletto

[sterile pendant]

According to the CEO of Black Forest, the released versions of flux will not be fine tunable. Then again, they are already distilled models anyways

[noble coyote]

This is so cool - and waaaay better than 2B!!!

Even w/out finetuning - flux is knocking 2B out-of-the park!!!

[sterile pendant]

Just throwing it out there for the degenerates expecting some pony version of it

[craggy crest]

2B is a small model. flux is a 12 billion parameter model. of course it's going to work better

[noble coyote]

Yippee!!!

[sterile pendant]

Yeah I'm starting to develop Stockholm syndrome for the 5min dev model times lol

[sterile pendant]

Well it's even stomping 8b as well from tests I've seen people run. Hopefully stability has a contender in the oven like a 3.1 or something

[craggy crest]

i'm sure they've got stuff they're working on

[sterile pendant]

Sd3 still kicks ass

The one thing I don't like about flux is it's so aesthetic that it's really hard to get it to do ugly stuff or poor quality stuff

Like I was trying to make sketchy looking trailcam shots of cryptids with poor photo quality and it just won't do it without them looking high quality

[torn wharf]

lower steps

[noble coyote]

Start prompting "anti-aesthetic" words like grunge, distressed, dystopia, rough texture, gritty, dark etc

Werf!

[sterile pendant]

Oh I know what I'm doing with wording, just saying, they still come out too good looking. I'll pop out some examples in a bit, working on something else right now

[craggy crest]

does found footage

[sterile pendant]

Yeah it does, but that's still too high quality

I'm talking pics with terrible exposure, bad flash, etc etc

[sterile pendant]

Still too normal looking

[craggy crest]

what, exactly, are you looking for then

[noble coyote]

Un-normal

🙂

[sage burrow]

Have you tried "disposable camera" 9r "disposable camera from the 80s" in your prompt?

[craggy crest]

to me, that IS unnormal. i think i need a visual example of what you're after

[noble coyote]

There needs to be modifiers as in MJ to tone down saturation/brio/smoothness. Some of the material produced by Flux is way antiseptic and lifeless

[sage burrow]

Not sd3, but you het the idea

[torn wharf]

sd3 do bad security footage better so far

[sterile pendant]

reminds me of junji for some reason

[sage burrow]

Junji and Dali lol

[sterile pendant]

the spirals and the trypophobia stuff

ahh damn, knew it lol

oh duh, says it in the image

[sage burrow]

We just need a SD3/Flex comfy workflow now 😄

[fossil pagoda]

I have my workflow on civitai, just dont really wanna plug it. You can search for my username, same as my actual discord tag

[noble coyote]

This is way cool!

[noble coyote]

Good with limbs and fingers ...

[hallow lion]

Careful, he'll report you.

[tough viper]

What’s the point of flux having a non commercial license?

What are being gonna do with it then?

[hallow lion]

shnella is comercial u can do whatever the f u want with it 😄

apacheeeeee

train it

Fluxpony

[icy drift]

I recommend training Dev if you're not planning on running a business though. It's clearly superior, and its output can be used commercially (including for training other models). You just can't host it for image gen services.

I'm getting this weird banding effect at 4K. There are vertical stripes with a canvas-like texture on the mountains. 😦

Maybe it's the settings I'm using. 😮‍💨

[hallow lion]

i only seen similar with upscaling

[hallow lion]

im never sure if the images posted here are flux or kolors or any other better model at this moment

XD

[bitter hearth]

well these are flux

[hallow lion]

It's amazing isn't it...

Without controlnets, lora, refining, and ipadapters and even negative prompts it beats the competition.

All ym fancy workflows trying to make sdxl and sd15 great feel obsolete

[bitter hearth]

for a base model it's definitely very good, but having controlnet integration will make it more powerful

[hallow lion]

of course, cant wait

i hope it gets on civit

[bitter hearth]

yeah... flux is a surprise

i had no idea this project was in the works

[hallow lion]

its better to come out of nowhere and surprise everyone rather than create hype and then not live up to it

[bitter hearth]

lol

sure

an user already uploaded a pruned version of the model .. narrowing a 23gb file to 11gb

and people are already planning on fine tuning it

[hallow lion]

yeah the community moves fast when there is no licensing issues hindering

[icy drift]

There's nothing comparable to flux right now as far as I know.

[icy drift]

Flux Dev is already on Civitai, and no ban hammer dropped yet. 😊
https://civitai.com/models/618692/flux

[hallow lion]

ah yes it was onyl a matter of time 🙂

[icy drift]

Has anyone experimented with samplers / schedulers yet? I'm wondering how they affect detail / text / anatomy / realism / lineart / architecture.

Euler has never been great at details. Looking for an efficient way to experiment now.

[signal shuttle]

Fine tuning Flux is very impractical since it will require a ton of GPUs to train it which would cost a lot of money so there is a possibility that this models ends up not having any finetunes

[sullen moss]

Ohh https://blackforestlabs.ai/up-next/

[icy drift]

So, if I finetune it you're saying I'll be the only one? An absolute legend? 🤔

[signal shuttle]

if you got a tens of h100s then go right ahead

[hallow lion]

definietly video is next

but first: consistency please

We cant tell stories without consistency

[sullen moss]

I don't see a problem with renting servers. I think there will be quite a few people who have both the money and the means.

[icy drift]

I don't have to own them, right? How much is it to rent one, $5/hr? What did you mean by "tens"? Twenty? Fifty? Where did you get that number? How much VRAM does an H100 have?

[signal shuttle]

80GB Vram total

[icy drift]

80GB VRAM and $3/hr. The model is 12*4 GB, so 48GB. You need the weights and the error accumulation in memory, so 96GB, and you need the latents and VAE and CLIP, I think you need at least 2 H100s, but let's say 3 to be conservative. That's $9/hr.

If it takes a week to finetune (I have no idea), that's 24hr x 7 days x $9, or $1500.

Hmm.

It's not like I couldn't just splurge if no one else is going too. It's not ridiculously expensive. But I don't know how.

[signal shuttle]

See thats the issue who would spend over 1K for a finetune then release it for free?

[hallow lion]

Some billionaires maybe lol

[icy drift]

I'd probably end up spending $1500 and get some kind of error when the week was over. 😕

[hallow lion]

In spite of almost everyone beign broke there is always some ultra loaded folks

[signal shuttle]

Unless we manage the optimize the model training for flux its simply too expensive for the normal person

[hallow lion]

Call Musk.

[icy drift]

If someone knows how to run the training code and has a really good dataset, I'm willing to donate... let's say a few hundred dollars? Well, I guess the amount depends on this person's track record and what exactly is in the dataset.

[halcyon vessel]

Image/prompt:photo realistic style anamorphosis 3d, by Charles Renee Mackintosh, Ernst Haeckel, Art Nouveau book illustration, black colour glossy woman from ballet lake, dancing with handsome man
walking a huge man in a loincloth, hue dog
by Jean-Baptiste Monge, Caravaggio, Michelangelo, Beeple, Beksinski with beautiful woman in soft lush curly warm brown long hair,
perfect symmetric eyes, dim smile, wearing decorated aesthetic
rich colored patterns of huge deformed scarecrow hat and

[hallow lion]

Pony man? anyone who made the big names, realvis, juggernaut, epicphotogasm

[signal shuttle]

The creator of pony said in his discord that he is looking into auraflow rather then flux

[craggy crest]

It doesnt need fine tunes

[craggy crest]

DucHaiten

[signal shuttle]

I am not saying it needs finetunes i am simply stating that if someone wants to finetune it, it would be impractical

[craggy crest]

It would be. They'll do it though, because those will sell, because everyone is so used to assuming they need them. When in reality, the only base model that needs them is sd1.5

[icy drift]

Hmm. I wonder if it really doesn't need finetuning. Have to seriously think about this.

I think in general I just like the idea that there are many people helping make open source models better, not just one team.

If NVidia would just relead a 128GB card this wouldn't be a problem.

[signal shuttle]

According to the license of flux dev, selling derivatives of Flux[Dev] is not allowed, which only leaves schnell

[icy drift]

But kickstarter or patreon funding followed by free release should be totally doable. You just need someone with the proven skills and enough people spreading the word.

[craggy crest]

Don't play lawyer please

[icy drift]

But, more importantly!

You need a reason to finetune. Does it need it?

[hallow lion]

Well

yes

a tiny bit

but more importantly it needs controlnets and ip adapters

its wodnerful but we dont even have negative promts options now

veyr little control

[craggy crest]

No you don't. There's no reason for the 10,000 anime girls with overly large chest fine tunes. People don't need a reason, just a want

[signal shuttle]

"Restrictions. You will not, and will not permit, assist or cause any third party to

use, modify, copy, reproduce, create Derivatives of, or Distribute the FLUX.1 [dev] Model (or any Derivative thereof, or any data produced by the FLUX.1 [dev] Model), in whole or in part, for (i) any commercial or production purposes" straight from the license on hugging face

[hallow lion]

yeah we cna only play with shnell

[craggy crest]

You are 1. NOT a lawyer and 2. NOT black forest labs. Drop it

[icy drift]

Therefore, assisting someone to release it for non-commercial purposes is 100% allowed, which is exactly what I said. But seriously, don't worry about lawyer stuff. Lawyers are just money vampires. Truth justice and common sense have nothing to do with lawsuits.

[craggy crest]

You have no way of knowing what contract someone making fine tunes has with BFL

[signal shuttle]

"FLUX.1 [dev] Non-Commercial License

Black Forest Labs, Inc. (“we” or “our” or “Company”) is pleased to make available the weights, parameters and inference code for the FLUX.1 [dev] Model (as defined below) freely available for your non-commercial and non-production use as set forth in this FLUX.1 [dev] Non-Commercial License (“License”). The “FLUX.1 [dev] Model” means the FLUX.1 [dev]”)." read it, what does it say? which company the license belongs to?

[craggy crest]

Either drop it or I'll report you

[hallow lion]

So true lol

[signal shuttle]

report me for what?, i am simply telling that the license belongs to Black forest labs

[hallow lion]

dont mind him

[icy drift]

Don't threaten to report people or we'll all report you. Blackmail and intimidation have no place on a friendly discord server.

[craggy crest]

That is strictly between the creator and black forest, and no one else

[hallow lion]

ignore

he is terrible to everyone here

we just tlerate him

[signal shuttle]

yeah i can see that

[hallow lion]

block him

since the mods dont do their job

[bitter hearth]

it could use some fine tuning for aesthetic reasons also there is room for improving prompt coherence, as for cost you overlook the strength in numbers, there are people willing to chip in for donation for a good project

[hallow lion]

i reported and blocked him. We should all do the same and not let one person ruin a nice community.

[bitter hearth]

i already blocked him once, then unblocked, i see crystalwizard goes around bullying everyone

[signal shuttle]

but there's the issue of trust, what if they take the money and run?, for such thing to happen it would require a trustworthy and known person within the community to undergo such a task

[hallow lion]

Yeah he is a piece of trash

It was so nice here befor ehe showed up

everyone hates him

[bitter hearth]

you're pushing the argument on a different trajectory

[hallow lion]

That one idiot bully every group must have huh

[signal shuttle]

I understand that but it's legitimate concern isn't?

[bitter hearth]

sure it is, but that's not the point im making

im talking about feasible options for fine tuning

[icy drift]

Yeah there are lots of people who I would trust with at least some money. You're always taking a risk of course, but the amount I donate would depend on how risky / certain it seemed.

[signal shuttle]

I understand your point, and sure if enough people come together and donate money then sure, we probably could fine tune it, but you need to factor in all the risks involved in such a project

[bitter hearth]

the donation part comes from merits and community records

[hallow lion]

Well why don't we just wait for the cost to come down lol

[bitter hearth]

ok dude im not interested in pointless theoretical talks

[hallow lion]

no need to be on the bleeding edge.....

[icy drift]

Well, I'll move on after this: If any of the Civitai creators whose models I regularly use ask for funds, I will donate somewhere between $100 to $300 probably. (And, to be perfectly honest, I would be fine with paying $1500 for the GPU time if I was 100% sure I could do the code myself without failing.)

[bitter hearth]

yeah with merits to show and their records its easy to contribute to a project

and its not like every individual are going to donate a large sum, that's the thing about strength in numbers with people donating different sum and not breaking anyone's bank

[signal shuttle]

if you put that way then i guess your point make sense, say if 300 people donated 10 dollars then it would amount to 3000 dollars in donations, and it wouldn't require large donation from people

[bitter hearth]

yeah some might chip in for $10 some $20 and so on... it accumulates

im not cherry picking these images

[signal shuttle]

Bro how does flux do maps and borders so well???

[bitter hearth]

each render is pretty sweet

[acoustic kite]

consistency test

same seed, different prompt

[bitter hearth]

try that with sd3 medium you'll get botched up crap every after one render

[icy drift]

😱 Guys this is way faster!

[signal shuttle]

The only thing wrong about that map is that Kuwait is a part of Basra

[icy drift]

17 seconds.

[bitter hearth]

are you aware that its bad for it to be consistent?
more image diversity is better, not worse

this is why there are nodes like CADS which try to raise diversity

[icy drift]

Hmm. In my opinion you want both: Consistency when you want to make a small modification to the image, and diversity when you're exploring for different images.
I think a model should be consistent with a given seed, and diverse across different seeds.

[acoustic kite]

i would say using the same seed and getting the same style and your desired prompt is pretty great. if it was doing this with a different seed it would be problematic...

[bitter hearth]

oh its same seed

[signal shuttle]

The more i look into the image the more errors i see, like jordan owning Palestine and Israel and new country that exists between Syria and turkey, but even with those errors its still very impressive and better then SD3 at doing maps

[acoustic kite]

so much this. if i enter a specific seed it's usually because i don't want things to change haha

[bitter hearth]

ah if its same seed that's different yeah

[hallow lion]

Creativity in AI is wonderful but once you have something you want to reuse like a character object or scene it should be able to stay consistent with that module

[bitter hearth]

what I mean was more that
different seeds should be diverse

[icy drift]

Yeah there's still no costume consistency anywhere to be found. A shirt will have long sleeves in one image and short sleeves in the next.

[bitter hearth]

but yeah within one seed, if you make a small change its nice if it can change only a small amount

[signal shuttle]

Flux

[icy drift]

I'm getting a huge range of speeds for render times and I don't know why.

[bitter hearth]

render time varying is strange

[acoustic kite]

makes for something great like game asset sprites that stay consistent or even food photography for menus in the future if we could grab a reference image and it would correctly display the different parts of the real life dish

[bitter hearth]

I find really weird seeds sometimes

[icy drift]

This is the most detailed and rich setting I've found. (And it's the best by a pretty decent margin.)

[acoustic kite]

beta is great, i haven't used anything else ever since

[bitter hearth]

I use beta too 😄

[molten thicket]

a dog driving a bike

[icy drift]

Yes, but I tested all the samplers and the best (for intricate detail) were: Heun and DDIM. But Heun has the edge.

[signal shuttle]

Flux dev is really awsome

[icy drift]

But I haven't tested for anatomy or text or anything. Just for intricate details.

[bitter hearth]

oh you can get better detail from some very slow samplers
that require custom nodes

like RK4, implicit adams or implicit midpoint

but it takes a long time

[acoustic kite]

beta (left) vs normal (right)

or maybe it's the opposite...

hmm

wait 😂

[bitter hearth]

can't test it on this image lol

its nearly a zero detail image

blurry focus of squishies

[acoustic kite]

let me try something else haha