✨｜sdxl

[timid sonnet]

even the mountain in the back is there

[indigo carbon]

where in the settings? I deleted venv and tried again, same error.

[ionic dragon]

@floral island are you from the states?

[floral island]

from NL

[chrome furnace]

friesland?

[floral island]

nope, the other way ^^ down south

[desert copper]

OK, about webp. Firstly, it's only proprietary in the sense that google developed it (from an original On2 video codec); the license is BSD Open.

[chrome furnace]

oh thank god. 😄 just jokin mate

[floral island]

lel

[desert copper]

It also delivers better quality/filesize than jpeg, it supports alpha channels, and it supports animated frames. In other words, jpeg is shit in comparison. Just my 2 cents. 🙂

[cobalt kernel]

Ah love this diffusion from other inputs ,
Kamitani ATK had similar work around 2010 that was wild ..
— Eg. Using fmri to generate images :
[ https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1006633 ]

[ionic dragon]

oh cool

[cobalt kernel]

Its still a brute force process ..
— Plus they used DNN back then :
[ https://www.youtube.com/watch?v=jsp1KaM-avU ]

[cobalt kernel]

The later " hokusai " works like the " dragon " ..
Plus his animal paintings are staggering in technique. Made me have a renewed appreciation for his work towards the end of his life. To paint the way he did required working backwards from the base layer to the subject. So he had to visualise the entire image , composition , colours and how the paints would bleed in his head ..
— Then also have perfect execution :
[ https://www.britishmuseum.org/collection/object/A_1913-0501-0-320 ]

[peak dove]

Perhaps delete Python and redownload (3.10.6 version)

[ionic dragon]

used claude.ai and inputted few prompts and asked it to generate few prompts

[elfin cobalt]

https://brage.info/GAN/ganbot2/4cf17c20-0b0a-4846-8a6d-3069bd0fc17b.1.jpg

[spice oracle]

I dont know who from the team is working on the auto 1111 integration but thank you. I love you. The .9 model and even the previous are great and Im having a blast experimenting with it with those tools.

[timid sonnet]

@ionic dragon

[ionic dragon]

why did you tag me?

[timid sonnet]

Your image from earlier

I made one similar

[timid sonnet]

this

[livid basin]

Nice, I see quite a few papers using Stable Diffusion with brain inputs recently

[indigo carbon]

Vlad's UI didn't use SDXL properly, it didn't follow prompts. I tried using SDXL on the new A1111 branch, it gives me this error, any idea why??

[jolly creek]

I'm busy right how but maybe because you are using loras that are not supported for sdxl?

[indigo carbon]

I don't have loras on that UI

[glad epoch]

Can SDXL create multiple images of the same character

[trim orbit]

yes

[indigo carbon]

also Vlad's UI isn't as good as A1111, lower image quality for no reason that i'm aware of =\

[trim orbit]

both fail compared to comfy's ui. for whatever reason, each vlad and auto have set up their ui to use just one of the text encoders. i suspect vladmantic hooks to the clip encoder and auto1 hooks to the openclip

[fresh path]

ive seen this painting irl at the british museum

very cool

[glad epoch]

Can someone please help me with telling that

[indigo carbon]

Idk, I don't like ComfyUI because it's not as consistant, and I have to make a new workflow for every image generation. also, it's slower than A1111

[trim orbit]

i get that. but the technical implementation is the best for sdxl regardless

[bleak wyvern]

a jewelry design, jewelry collection, wood, metal, gemstones, future world style, 2030 year, dreamy, rendering by unreal engine

[indigo carbon]

yeah, but it's not optimized. I get ~5it/s where I get 20it/s on A1111, also used same optimizations

[paper phoenix]

you dont have to make a workflow for every image generations. you make a workflow and keep it. hence workflow.

[indigo carbon]

Idk. I don't like how it wants 2 positive prompts, that's weird. and Vlad's UI just isn't as good as A1111

[paper phoenix]

are you remaking a workflow every time you boot it up?

[trim orbit]

you're getting 20it/s on sdxl images? 1024x?

sometimes i think people just make things up

[trim orbit]

That's not weird. That's literally the correct way to use two text encoders

[steady chasm]

It would appear there's a lot about using ai I didn't know .. guess it's time to install confyui

[indigo carbon]

yeah, on an A1111 extension. the only problem with it is that it's not that good at following prompts

[steady chasm]

Adjust CFG scale

[trim orbit]

20it/s for 1024x seems made up

[paper phoenix]

it does require a bit of fiddling to get to grips with, but theres workflows you can download and plenty of youtube vids

[eternal fog]

On a 4090 maybe

[hearty ginkgo]

What gpu you using

[dark jasper]

just made a highres fix workflow for wdxl due to the fact its not good at 1024 generation

[trim orbit]

i haven't built any workflows in comfy. i added roop to one. i been using it to great success

[indigo carbon]

rtx4070TI

[eternal fog]

It's not really good at anything at the moment, but it was just a test.

[indigo carbon]

also my A1111 is very optimized, took me a while to master

[paper phoenix]

yeah tbh i use a1111 mostly out of familiarity. i know where all my stuff is.

[trim orbit]

my 4080 is putting images out in 10 seconds in both automatic1111 and comfyui. 1024 proper images.

[eternal fog]

20it/s for 1024x1024 on SDXL sounds like measuring it wrong

[steady chasm]

I gor a 3060 12gb (⁠^⁠～⁠^⁠;⁠)⁠ゞ I'm wondering if it'll be enough for sdxl

[trim orbit]

if you're getting 10it/s then you're not doing megapixel resolution

[eternal fog]

3080 gets about 3 it/s at 1024x1024

[trim orbit]

it sounds more like it's completely made up

[indigo carbon]

Idk then, there must be an issue with the extension

[steady chasm]

Is it fake sdxl

Like just sd2.1 with clever upscaling

[barren quartz]

Where can I get access to SDXL 0.9 API?

[steady chasm]

Yeah I want to grab it too and use it on auto or comfy

[indigo carbon]

bruh, well, if the one on HF is fake, then yeah

[steady chasm]

Idk

Never used it

Just a theory

[indigo carbon]

I got research access, I doubt it's fake

[eternal fog]

It's probably auto recording it weird

[steady chasm]

The extension might be using some tricks then that hinder the true capability of sdxl

Is the extension official

I mean someone mentioned it only used one text encoder would that do anything

[eternal fog]

It's auto1111 nothing is official

[tribal gale]

what sdxl is fake?

[steady chasm]

None

[eternal fog]

None is

[paper phoenix]

i think we've gone a bit davinci code up in here

[steady chasm]

I think the reading comprehension in ai discords tends to be minimal

[indigo carbon]

I have no idea. I removed it because I couldn't outdo my old 1.5 finetune with SDXL, so I think it's just not implemented properly

[steady chasm]

Myself included

Well I don't know much about sdxl but if you're getting that performance out of that card it's either something erroneous somewhere or a silicon valley level software efficiency miracle

[paper phoenix]

i couldnt even render a postage stamp at 20/s

[indigo carbon]

I'll wait for A1111 to actually support it in the full release. SDXL on ComfyUI can sometimes outdo 1.5 finetuned models, but requires WAY more effort to get what you want. plus, it's way slower. So I'll just be patient for it to work properly on A1111.

[trim orbit]

first 6 epochs were at 1024 and then i ran it over night some more at 768

[steady chasm]

Terran?

[trim orbit]

the model already has good understanding of terran aesthetics, but my captioning data doesn't hook any of that. i didn't want it to be labelled with canonical names so that the style would be more generalized.

[trim orbit]

from starcraft

[steady chasm]

Ohh

[hollow halo]

what card are you using that you needed to lower res and train overnight?

[trim orbit]

4080. why is there always aversion to running style training over night?

[hollow halo]

Not an aversion, it just takes me at most an hour and a half to train a concept or style with SDXL lora's, so was confused

[visual glade]

it won't be faster on a1111, it's probably going to be a bit slower until he implements all the optimizations that are in comfyui

[livid basin]

Is it just me, or does SDXL 0.9 look worse with 512x512 than 1024x1024

Like much worse

[hollow halo]

Makes sense, it was trained on 1024x1024

[steady chasm]

What's happening to the coyote ? Pantheon? (⁠•⁠ ⁠▽⁠ ⁠•⁠;⁠)

[trim orbit]

250 images on this style image set

[steady chasm]

Is she going to fight ...

[hollow halo]

Seems a bit overkill but it turned out good so you do you

[trim orbit]

why are large datasets for styles a bad thing?

[trim orbit]

heh.. 250 images called large. moderate sized

[hollow halo]

large datasets in general just introduce more chance for one of the images to ruin things. For LoRA's, the original paper used a small dataset. Finally, captioning that many images takes a lot of time and a LoRA learns well and can extrapolate even with a small number

It isn't bad, just abnormal

[fresh path]

512x is not supported

no its not

you can do it but its not recommended

[livid basin]

I mean you can make it output 512x512

[fresh path]

yeah you can do it but they dont support it

[hollow halo]

Yes it does

[fresh path]

loewst res is like 768x1168 I forget the exact resolution

[hollow halo]

no one is going to stop you, but it won't be good results

[livid basin]

4090 local machine

[fresh path]

i can crash my car into a lake, doesnt mean its supported

[livid basin]

Got to 80C yesterday

4090 runs hot

[trim orbit]

i think you misunderstood the paper. i often hit this criticism. that i'm using too many images. but i literally see better results with this larger dataset than my smaller one. i have reasons why, but you've already decided that it's a bad thing "according to the paper". And that's not a good way to approach this topic .

"You CAN'T do that" seems odd way to approach research. also, here's the paper. Nothing about dataset sizes in it. The paper was for large language models primarily. https://arxiv.org/abs/2106.09685

it's weird when people just straight up make things up, like they're chatgpt

[hollow halo]

No one said you can't bro, stop trying to argue

[livid basin]

4090?

[hollow halo]

I said it isn't normal

[livid basin]

Fair, I think 80C for 4090 is hot but not super hot

[trim orbit]

it's a lot of can't culture going on. and again, you're representing the paper to tell me it's abnormal, when you're way off base here

[livid basin]

When I used 1080Ti, I got to 88C

[trim orbit]

the paper is about large language models

[hollow halo]

talking about Kohyas paper damnit

[livid basin]

1080 Ti was old, I sold them off

[trim orbit]

lora was never meant for stable diffusion to begin with, yet here we are using it

kohya never made a lora paper

[fresh path]

engineers crying in the corner

[trim orbit]

we're just making things up i guess

[fresh path]

https://github.com/kohya-ss/sd-scripts

[hollow halo]

Github, sorry my bad for not using the proper wording for you

[upbeat summit]

don't put negative prompts in the positive prompt field 😄

[trim orbit]

https://huggingface.co/blog/lora this was the original blog about lora on diffusion tech that went popular. it uses 100s of images in it's dataset example

[hollow halo]

A paper doesn't have to be published on hf

no one was talking about that

[livid basin]

yeah this picture was quite disturbing

[trim orbit]

i run into these criticisms a lot when i talk about my lab research. larger curated training sets produce better styles. but people come along and tell me i'm doing it wrong , with no good reasoning

[hollow halo]

no one cares

[trim orbit]

you made things up and got called out on it. don't sulk

[hollow halo]

lol I didn't make things up, the kohya paper is linked, no one is backing you calm down bro

[livid basin]

Let's all lighten up a bit

Be a bit more positive in this channel

[hollow halo]

Flowwolf likes to come in to channels to cause issues, its his MO

[trim orbit]

i'm calm. can we just stop pretending that made up informaiton is accurate though?

moderately sized datasets for lora are not abnormal. They're just not what youtubers and lazy tutorial guides suggest

[hollow halo]

Lol

Yes they work, we said that, agreed with you, and you continue to argue

[timid sonnet]

Model training was made for large datasets, loras were designed for smaller datasets

[trim orbit]

wrong

[livid basin]

I'm slightly curious why you believe this?

[urban fjord]

I mostly care about small datasets as you don't always have the luxery of a ton of examples to draw from and SDXL learns quickly from a few examples.

[hollow halo]

This was my point, but the dude likes to argue

[trim orbit]

i've noticed this too. image sets as low as 6

[livid basin]

More data typically means the ability to capture the distribution better, regardless of model parameterization (LoRA, fc layers, hell even SVMs)

[trim orbit]

move on. you've descended to personal attacks. instead, just don't

[hollow halo]

lol this guy

I'm literally pointing out what you're doing, that is it. You left the discord because people kept blocking you and now you're back to argue with new faces

[livid basin]

And LoRA itself is nothing special, low rank matrices just walk a restricted path inside the full space of the matrix

[trim orbit]

i've never met you before

[livid basin]

So no reason why more data wouldn't help

[hollow halo]

You have no memory of 6 months ago then

[livid basin]

You just lose the ability to model some of the covariance, and the matrices increasingly behave like a diagonal matrix

[trim orbit]

i replied to you twice. before today. no memory of it though. used logs to look that up. /shrug

[trim orbit]

no reason to suggest loras are designed for exclusively small data either. loras were designed for LLM

[timid sonnet]

flowwolves were designed for micro datasets

[hollow halo]

Not replying directly doesn't mean we haven't interacted

[timid sonnet]

Tacos were invented by hitler

Arguing is the cure for cancer

Indiginous people are not native to their land

false information is not being spread

[steady chasm]

TF is happening in here

[uncut steeple]

Everyone calm down, were here to discuss SDXL and not to personal attack each other, spread some love

[timid sonnet]

This entire argument that won't stop between flowwolf and Damianos is literally over "false information being spread"

and it wont stop

please stop

youre both annoying

[hollow halo]

dino stfu seriously, not helping anything

[timid sonnet]

damoniano youre lightweight toxic

[uncut steeple]

Nice hair color

[timid sonnet]

and you have a false sense of entitlement

[hollow halo]

lol

[smoky patrol]

Everyone, please, let's remember to treat everyone with respect, alright?

[steady chasm]

Huh

[steady chasm]

Weird

[timid sonnet]

@rocky geode go fly a kite on the moon winner

[uncut steeple]

Thats not the best attitude to have, since that wont change a thing ever

[hollow halo]

Literally a bunch of trolls in here this morning, moving on to images

[timid sonnet]

so kite has two definitions

[smoky patrol]

Let's move onto something else. 🙂

[timid sonnet]

Little kids have kites, they fly them in the air.

Prisoners have kites and they fly them to eachother, but their version of a kite is a message written down on a small piece of paper

im not explaining it agaain

[uncut steeple]

Third eye

[uncut steeple]

Soup

[eternal fog]

THAA SOUP

[winter raptor]

This is amazing!!!

I love the art style

[hearty ginkgo]

Is this in sdxl? If so how do you get the ultrawide images

[magic dawn]

Is there any training tool for refiner yet?

[hollow halo]

Yeah it's in sdxl and I use this extension https://github.com/bash-j/mikey_nodes

[azure oxide]

i wonder what youd actually train the refiner with since it's just there for tiny minute details

[hollow halo]

People will probably start by using the same dataset as the base model, but will likely find better ways

[magic dawn]

Ehh specific subjects? How would refiner know it without training?

[azure oxide]

it gets tricky because theres two models. you could train the refiner on something with a lora but at the same time, wouldnt it also make sense to train the other model on those subjects with a lora? it gets weird since we're juggling loras on two models

[magic dawn]

It doesn't need to be trained at the same time

[trim orbit]

v1 may drop with a different structure. loras may end up working with base and refiner. interoperability was hinted at

[sudden cliff]

Has anyone figured out how to prompt a domed helmet visor where the visor is basically most of the helmet?

[azure oxide]

i havent had any experience with sdxl but from what ive been reading, the refiner isnt really there to make drastic changes to the original generated image, just to add small details

[paper phoenix]

could you show me an example photo?

[smoky patrol]

Oh, i really love how the light picks up on that. Gorgeous, really.

[trim orbit]

yeah as I understand it, it is only meant to work on the final steps of the latent image

[magic dawn]

They test with "stage 2" applied in the bots, so mostly likely will drop with the refiner, it's mainly the weight compatibility with 0.9, not architecture, just my opinion through.

[sudden cliff]

Halo example

There's a few science fictions that have these but those keywords don't help either

nothing that I've found anyways

don't care if it's shiny or not, just want the dome

[magic dawn]

Things like faces of specific persons are barely recognizable at moderate denoising level that refiner typically gets used at, you can try for yourself

[sudden cliff]

Clip interrogator is no help either

GPT-4 doesn't help

[paper phoenix]

ill have a fiddle with it too as im bored

[trim orbit]

i adjust when the refiner takes over often. it varies from subject to subject. right now i got it set to a total of 35 steps and the refiner does the last 7

[sudden cliff]

I have a work meeting to attend to so I'll be gone 😄

[azure oxide]

yeah we're thrown another knob to work with by getting the refiner: do we finetune it with whatever subject we want using the other model, do we not, do we use both, do we only use one finetuning, etc

[trim orbit]

beautiful. reminds me of ocarina of time castles

[magic dawn]

Kind of depends on the content, like if the person is a bit far away etc

[uncut steeple]

I really enjoy the abstract stuff

[paper phoenix]

looks very gilbert and george

[smoky patrol]

oh, the warping is pretty awesome

[paper phoenix]

i think the trick is to not evoke the person and negative prompt out the features and the model will try and do its best to put the helmet visor in a way that covers things up.

so yeah i think its something thats doable with a lot of negative prompting

(this is 1.5 btw, i know sdxl has different negative prompt rules)

[trim orbit]

lunk

[peak dove]

AUTOMATIC1111 SDXL - OK. COMFYUI - I N C R E D I B L E ! ! ! ! ! I'm hooked

[trim orbit]

the manpages of kohya had me scared for lora training. needing to disable the text encoder training made me think captioning was pointless. but it works so well still with unet training only

[trim orbit]

just a half week of training experimenting on xl and i'm so austounded. it really just feels like it gets a better understanding of the content at a finer grained level

trying not ot be bias with testing but things look promising

[uncut steeple]

Im looking forward to training with the full model

[trim orbit]

drip vader

[dense chasm]

does anybody have a clue how to reproduce the arcade machine game like Cadillacs and Dinosaurs character Hannah,render as a photographic sexy woman?

[sonic furnace]

Whats different about it?

[trim orbit]

train a lora

or just text describe her since she's a pixel art girl and any dark haired woman would be a candidate

[sudden cliff]

Yeah I'm thinking 'helmet' is ruining things

[paper phoenix]

evoking anything about the person's face though kind of puts any kind of visor to the back of the generations mind so to speak

[inland dragon]

https://cdn.discordapp.com/attachments/1127297005941694505/1131584160142733484/view.png
8k

https://cdn.discordapp.com/attachments/1127297005941694505/1131572155629445252/view.png

[dusk mica]

how do i change undefined to my sdxl filename?

[upbeat summit]

you need to place the model files in the models/checkpoints/ directory and if you click refresh you can click where it says undefined and you should be able to select it

[dusk mica]

ooh i see

thanks

[tame raven]

is it possible to use sdxl for 16:9 and 9:16 images?

[halcyon plank]

You will have lower quality images on average, but you definitely can get good results at these resolutions too

[tame raven]

are there any known/popular workflows for comfyui or A1111? I wasn't able to find any so far for comfyui atleast

[halcyon plank]

A1111 is pretty simple as it doesn't use the refiner, just select your resolution and run it. You might need the fixed vae though.
The workflow I use for comfy might be a pain to share due to the amount of custom nodes

[autumn forum]

https://github.com/SytanSD/Sytan-SDXL-ComfyUI

[primal vault]

My ComfyUI custom nodes and workflow were shared here before: https://github.com/SeargeDP/SeargeSDXL

[upbeat summit]

thanks for your work, Searge! great tools 🙂

[tame raven]

hah, I was just using this, maybe I'm dumb but I wasn't able to figure it out

[halcyon plank]

There was a useful custom node for aspect ratio somewhere

[primal vault]

There are install instructions in the readme, just remember to restart Comfy afterwards to get the custom nodes

[halcyon plank]

I think that was this one :
https://github.com/bash-j/mikey_nodes

[tame raven]

Yup installing is not an issue, I wasn't sure where to configure the ratios

[tame raven]

I tested this out, it seems to be working! Thank you 😄 ❤️

[ionic dragon]

@high skiff found an amazing trick to generate prompts

[sudden cliff]

guess what, I had to REMOVE all mention of helmet from my prompt AND put helmet in negative prompt...

not perfect but these are ballparkish

[paper phoenix]

i have no idea what logic makes that work

[sudden cliff]

it's just a visor, I'd love if it still had that tight look with the bottom part of the helmet

[paper phoenix]

sometimes prompt refining is like a cryptic nyt crossword

[sharp robin]

[sudden cliff]

maybe I'll put 'mask' or something

[patent badger]

any estimation to how long it'll take to have controlnet for sdxl?

[steady grove]

About 5

[urban fjord]

[eternal fog]

They said they were aiming to have them at release or very close to release.

[patent badger]

oh sh*t that's great

can't wait

[dusk mica]

6 days left

[eternal fog]

Until it's delayed again

[dusk mica]

💀

[vale eagle]

Until it's delayed again

[urban fjord]

If it gets delayed it is probably for a good reason.

[ionic dragon]

should I share it with you?

[livid cradle]

i know it's a far stretch but is there a method or way to insert "product type" as a variable (which represents the base image) i want to include in prompt to generate the surrounding form it? I'm using image to image masking but i think it could be easy if i tell SD that hey this is the image type (as we did in dreambooth) that i want to generate the background for.

Id appreciate any help on this riddle.

[random zenith]

when SDXL releases and the most advanced anime models start using it, I think the jump in quality will be so big that it will change the internet

[boreal bough]

anything that goes near or over eyes doesn't count. special rules apply.
like try making an eyepatch

[urban fjord]

I don't know what you're talking about, but if you provide the model of examples of what you're trying to do then you can train a LoRA model to make it more consistent.

[sharp robin]

Im interested

[ionic dragon]

open claude.ai

[sudden cliff]

finally, that was hard

(the helmet)

[paper phoenix]

what was the prompt then?

[random zenith]

not available outside US/UK

[sudden cliff]

key is "person wearing a full face dome visor, hardsuit" <- hardsuit helps a lot

(and helmet in negative prompt)

[paper phoenix]

ah!

[sudden cliff]

'full face dome visor, hardsuit'

without hardsuit it usually sucks

but hardsuit is what I wanted anyways

these masks exist already

so how hard could it be

[ionic dragon]

copy 400 prompts for this and make a txt file
https://huggingface.co/datasets/Gustavosta/Stable-Diffusion-Prompts

attach the file in claude.ai and ask it to generate prompts based on the data

[ionic dragon]

use a vpn

[ionic dragon]

@sharp robin here you go

[paper phoenix]

run it through clip and see what it describes it as

[sudden cliff]

Yeah I had done it, didn’t help

Even tried Bing img

[indigo carbon]

Is there an A1111 branch that supports SDXL? The one that was mentioned here yesterday didn't work

[high skiff]

@hard fractal hey Joe, I've been taking a little bit of a look at the bot today, and I will say it is recently looking considerably better than before. This is at least giving me hope that this delay was worth it, because at first it was pretty yikes haha

With that said, I could only imagine what we would be able to get out of it if we weren't as restricted as we are with the bot, so, pretty curious for that

[ionic dragon]

yeah, the bot is pretty good rn]

[sharp robin]

Thank you!

[lusty raptor]

it's tough to judge sometimes, with all the config randomization they do. The first leadup to 1.0 had craziness turned up pretty high, it was tough to vote sometimes

[eternal fog]

I wonder if they are sprinkling in some 1.5 checkpoints every so often to see what people vote

[thin nova]

this is one champ of a gpu

"how to train an sdxl lora using only 18 exabytes of vram"

[violet shale]

so wait, you need confy for xl?

[pallid path]

not necessarily

but it has the lowest vram usage and you can use/control the refiner

also its for 0.9 for now

[eternal fog]

I think comfy is the most stable and has the correct setup at the moment.

Vlad I think is using diffusers so should be decent as well.

Auto1111 has some weird setup that doesn't fully work.

[pine ether]

Does anyone know how can I achieve this kind of results? Which model and settings?

[urban fjord]

You know what, this is the best execution of this prompt that I've seen so far.

There is always a risk of cherrypicking with just one sample, but this even look better than my pre-0.9 results.

But other prompts still felt better in my pre-0.9 tests.
Like "a storefront with 'Google Research Cafe' written on it."

SDXL team: Have there been any signs of changes in bias in nationality when using generic terms like man and woman using the new refiner?

[paper phoenix]

cant see how there would be an intentional bias. do you mean different races and body types?

takes in internet photos, farts out photos based on that, so GIGO.

[urban fjord]

I wonder if there has either been an effort to make the output more diverse or it happens naturally with further refiner training.

[prisma wyvern]

Is SDXL going to be official v3.0 of Stable Diffusion platform? Also, will it be directly comparable to Midjourney v5.x?

[urban fjord]

Stability AI has said several times that Stable Diffusion 3 is something else.

[paper phoenix]

like intentially modifing its output to be more inclusive? that's a bit of a weird idea. I mean I get it and how it would be more positive but why should a bit of software do that? Is it something you feel it lacks or something you noticed personally?

[prisma wyvern]

@urban fjord So sdxl is like v2.2 or 2.5?

[eternal fog]

They said they did something to the training to something to create more diversity

Something about a bug in the way they did it before that ended up with more white people than anything else.

[eternal fog]

It's just SDXL 1.0, it's created in a different way to the other SD models

[high skiff]

Originally it was just a bigger version of 2.x, but it grew and changed a lot

I remember talking to devs about it months ago

[eternal fog]

Can probably do that with most models. I can get something sort of similar in SDXL without much effort

[urban fjord]

Not inclusive, diverse. You do not want your output to be too similar.

There is no need for you to argue against a question not directed at you.

[paper phoenix]

adding more diverse people into the mix sure, but im not sure if its going to be biased to say, have two people of random genders or ethnicities appear if you type in "couple kissing". you'd really have to cherry pick and force the model to do that by default. there has, for years been an issue of everything being based around caucasian features. I'm not sure how I feel about this or if I'm imagining something different.

[eternal fog]

What do you mean, that's what discord is for isn't it.

[eternal fog]

When I've been playing around using Man or Woman still generally generates caucasian people, but it depends on the prompt you use. It definately generates a lot more people with black skin without you having to directly prompt it.

Like if I ask for a Man and then elsewhere in the prompt talk about something in Japan, more often than not the Man will be Japanese.

[paper phoenix]

I've never really noticed that, its an even spread in terms of super genetic prompts for me. but then i use specific prompts rather than let the model do its thing.

It is odd to have to specify an <x> man rather than a white muscle dude being default i get you, but im sure thats also the majority of the trained data.

[urban fjord]

And nothing about that changes my question if the team has seen any change in diversity of output.

[prisma wyvern]

You know what is weird, when prompt say "blonde woman " and instead it generate black women with blonde hair 🙃

[eternal fog]

There's inherint biases all over the model. These are all the same prompt but with a secondary of "In America, In Japan, In Africa"

[paper phoenix]

I'm honestly baffled by this convo and don't know if im going to end up in some weird cul de sac because of it. It'd be nice if i typed in "man standing in a room" and it was any chance of any ethnicity, bodytype, disability etc. I don't think its a major issue worth a panic over as yet.

[urban fjord]

Good for you, but there is no reason to rant about it.

[paper phoenix]

are you of the mind that this is a direct line to god? its a chatroom essentially.

[eternal fog]

I get your point. It's just difficult, because they aren't going to go through an hand tag millions of images, most of them are from online sources. And if you look at how images are tagged online, generally if someone is white, it isn't mentioned. Whereas if someone is a different skin colour, espeically if it's from American Media, it always seems to get mentioned.

This is obviously a small dataset, but I just typed "A Woman Wearing Armor" and got these 4

[ionic dragon]

@eternal fog i am using your workflow, muting the preview images is making the final output worst, i dont want 4 images to be shown on my timeline, i just want the final one, how can I do it?

[eternal fog]

Just remove the Preview images nodes

[ionic dragon]

ok, will it still work if I just mute them

[eternal fog]

If it's making anything worse you've probably somehow disconnected a step

[paper phoenix]

pretty much what i get too from non finetuned models. lots of finetunes are trained on swole athletes or kpop stars so they'd be naturally biased. it might be something up for discussion though, but i certainly dont think SD has run afoul of not being inclusive so far.

[eternal fog]

They were just there so I could track what was happening

[eternal fog]

Yeah the fine tuned ones are. Most of them I think rip images from Instagram models and the like.

[paper phoenix]

if you ever want to feel self conscious run roop + your photo + a finetuned model 😄

[eternal fog]

I mean only if you have issues with self esteem, but that's another completely different discussion lol

[paper phoenix]

Its terrible, i dont have a motorbike nor am i in space. its making unrealistic versions of me. 😄

[ionic dragon]

ok, lemme try muting again

@eternal fog using claude.ai generates cool prompts

[peak dove]

Werf!

[eternal fog]

Zoom Zoom

[autumn forum]

Wow it does an impressive nsx

[eternal fog]

Surprised it didn't do the modern one tbh

It honestly does most popular cars well

[autumn forum]

Maybe more pictures in the dataset of the older. Everyone likes the older one😂

[lilac wren]

Which was not the case with 1.5.
SDXL surprised me several times with cars.

[eternal fog]

1.5 base I'm not sure, but finetunes did them fine usually

It messes up liveries a lot

[ionic dragon]

@eternal fog is this workflow all right?
or is it decreasing the quality?

[eternal fog]

I mean I can't really tell without seeing the intermidiate stages. It's been doing fine for me.

That looks more like a prompt thing tbh

[ionic dragon]

i am just talking about the workflow

the workflow is attached in the image

[eternal fog]

oh 2 seconds

shouldn't be. All you have muted are the intermediate previews

[dusk mica]

Does anybody know is 1.0 follows the prompt better?

Or is it more config stuff on the user side

[eternal fog]

I mean I've found 0.9 follows the prompt fine if you prompt it properly

Sometimes you need to turn up CFG if it's ignoring you

[ionic dragon]

so, does it effect the output?

[eternal fog]

no

You should probably put something in the stylistic prompt though

[ionic dragon]

so the workflow is perfectly alright

[eternal fog]

yes

[ionic dragon]

i am not understanding how to divide the prompt

[ionic dragon]

the output is great

[autumn forum]

It also does stance cars OK not great they look a bit off but super cambered cars it actually knows too. I typed in “clapped out civic” and it gave me a ricer civic, super cambered out😂

[eternal fog]

General style stuff seems to work if you put it in the positive, unless you want it to take over the entire image. If you aren't sure you can just copy/paste the same prompt in both

[eternal fog]

You can use the 2nd prompt to give a bit more emphasis as well. For example, I put parade float in both and it actually gave me one.

If I don't put Parade Float in both, it doesn't seem to give a shit that you've put that in

[ionic dragon]

oh ok, would it make it better?

[ionic dragon]

so like a single keyword in the 2nd prompt?

[eternal fog]

Depends what you define as "Better" play around with it, see what happens.

[shy kelp]

I'm sorry if this is abrupt, but is this Discord server for people that use Stable Diffusion on its own or is it okay to use the versions that are self hosted?

[ionic dragon]

ok

[eternal fog]

It's for anything related to Stable Diffusion. This particular channel is for talking about SDXL

[shy kelp]

Thank you.

[ionic dragon]

@eternal fog do you know how to run multiple prompts at the same time?

so it auto-queue's

[eternal fog]

Depends what you mean by that

oh

[eternal fog]

Just put in your prompt click queue prompt, put in another prompt click queue prompt

[ionic dragon]

i have this big list of prompts

[eternal fog]

I think there's a wildcard type node somewhere

[ionic dragon]

i have too many

[lilac wren]

@eternal fog do you know "Le Rallye des cevennes"?

[ionic dragon]

I generated these using claude.ai, they are great

[eternal fog]

No I don't watch a massive amount of modern Rally. Usually watch F1, WEC and GT World Challenge

[soft zealot]

you could try variations from
Linguistic Positive :
tradional house in urban japanese city in the background in the style of cowboy bebop, anime style

Supplementary Terms:
intricate details, minimal details, calm, sunny day, bright, artwork by jeremy lipkin and giuseppe dangelico pino and michael garmash and rob rey and greg manchess and huang guangjian and makoto shinkai, sharp edges, simple form, 1 0 0 mm

[lilac wren]

That's where I live, it's pretty well known in France

[eternal fog]

Ah cool. Only big rally I know of here we have is WRC in Wales

[lilac wren]

https://www.youtube.com/watch?v=U1syeUeHozY

[ionic dragon]

which one's better?

[high skiff]

trying to get my old PC working os I can test the 3090 in it

Wanna see if the GPU is the issue, or if its maybe the mobo

[eternal fog]

I prefer the 2nd 1 with the 1 person in it

[lilac wren]

what's the problem?

[ionic dragon]

thats the one with same 1st and 2nd prompt

[high skiff]

Everything is the problem honestly, it's so much to explain

In an insanely cut down version, the GPU crashes my computer whenever it's done computing something intense

[clever verge]

Just installed a 4090, it's faster than my previous 2060S 😄

[high skiff]

It's not a crash because of core clock, and it's not a crash because of VRAM

No kidding lol

[clever verge]

Let's see if I need to upgrade the CPU, hope not but you never know.

[eternal fog]

I mean if it's not the latest gen CPU you'll be leaving performance on the table

[lilac wren]

Display crash and Windows saying that the card is messing up?

[clever verge]

Yeah, gaming performance is not that important so it's the AI stuff

[high skiff]

Display crash and blue screen of death

[clever verge]

Not sure if the CPU is a bottleneck in SD or the LocalLLMs

[high skiff]

It shouldn't be honestly

For gaming and stuff it will be, but not for generations

I mean, it depends on what CPU you have

[clever verge]

9700K

[high skiff]

You'll be fine with that

It's not going to get you very good performance in gaming, but you'll be fine for SD

[clever verge]

They games I play is totaly overkill with 4090 anyway

[high skiff]

I would love to be using my new 3090, if it was functioning

[lilac wren]

Pay attention to PSU. The damage caused by a graphics card under power is terrible, it is sneaky and takes a long time to appear. In this genre, unfortunately.
Capacitors and VRM no longer do their job properly, and no software means to see that

[high skiff]

Fair enough, same here, even my 3060 TI I used to have was more than enough for any of the games I play lol

[high skiff]

It's not the power supply

[clever verge]

I hope you get it sorted soon. It's not fun not to have enough hardware to troubleshoot on.

[high skiff]

Agreed

[clever verge]

I had to replace the PSU and chassis, too little power (550 -> 1000W) and too little space.

[high skiff]

I have until August 8th to get this GP working, otherwise I have PayPal on my side to dispute the transaction already

But yes, I can confirm that it isn't a power supply related

It's not driver related, it's not temperature related, clock speed related, software related, BIOS related, VBIOS related, RAM related

I have a huge list of exactly what it's not

[clever verge]

Compability or just plain semi-broken.

[high skiff]

At this point my guess is either the core files of window on my computer are ruined, or the GPU is just flat out dead

[lilac wren]

what is your GPU?

[clever verge]

There's a possibility that it could have gone bad in the handling or shipment too.

[high skiff]

Zotac 3090 Trinity OC

[lilac wren]

Hmm, it's not a badly designed version

[high skiff]

The air I am receiving in blue screen is basically synonymous with a dying graphics card, but all of the things I have seen on the matter state that if that's the case, then it should be failing when clocking up, not clocking down

My GPU will be rock solid for hours and hours while sucking almost 400 Watts of power, and have absolutely zero issues

And then within a couple minutes of the training finishing, then it blue screens

It only ever does it when it's at idle

[clever verge]

If your older GPU works and this does not, sounds to me like it's broken.

Since you have ruled out power supply.

[high skiff]

Both of my older GPUs work, so it's very confusing

[lilac wren]

totally disagree, a BSoD can be software, it can and, and often is also caused by disks that are failing, like shitty SSDs.

[high skiff]

However I have talked to some people who have been in tech for a long time, and they have stated that there could be a problem with the motherboard, and this GPU is just more susceptible to it

[high skiff]

All of this stuff is brand new, and it all works with every other graphics card I have so, it's not going to be that

It's not software cuz it's a brand new install, and I've redone all of the drivers several times

[clever verge]

Yeah, motherboard usually one of the things that breaks first.

[high skiff]

I did buy the motherboard certified renewed from Amazon from their second life program, and it does come with a full month warranty if something does go wrong, so I'm kind of trying to see if I can get either of my other graphics cards to trip on that motherboard

All I want is to be able to use this GPU to work on SD

[clever verge]

But I don't find it plausable that it's the moderboard that's broken now.

[lilac wren]

If you manage to systematically reproduce your BSoD, you have to start with a minimal config, and try to reproduce the same bug, replacing it piece by piece.

[high skiff]

The problem is that it's very inconsistent, the only consistency is it does it when the GPU is at idle

Sometimes it does it right as my computer gets into boot, sometimes it does it hours later

Sometimes it crashes so hard my GPU falls all the way off the PCIe bus and I have to trick it to read detect it in the slot using BIOS

[clever verge]

What stop faults do you get when it BSoDs? Same every time?

[lilac wren]

Try software like OCCT and others, a big custom bench of an hour or 2.

CPU/GPU

[high skiff]

Last I counted, 63 blue screens of death, every single one of them the exact same error

I did get one different one actually, but I think that was my fault for booting the computer weird

I think it was some form of issue with the XMP profile I selected, and it defaulted back

I'm currently trying to figure out why the hell it's taking so long to make a Windows install USB

[clever verge]

It's consistent, that's good. Probably not memory related.

[high skiff]

It's been working on this bad boy for almost 30 minutes, and it's not even done

[high skiff]

Once again, the only piece of hardware that it's going to be is the motherboard if it's not the GPU, because everything else works perfectly fine with the other two GPUs

And also, the issue always states that it stemmed from the graphics card, now that could be something else like the GPU triggering that, or it could just straight up be the GPU

Sorry if it seems like I'm shutting everything down that you guys are suggesting, I've just been working on this for over 20 hours A cumulative across several different communities, and we've all ruled out a lot of these things

I have new theories to test with SDXL LoRAs but the problem is is that I can't run them until this GPU is working

My homework flow research and everything is on pause as well, I'm barely even halfway done with my documentation because of this

[clever verge]

Hard to believe it's anything other than the GPU

[high skiff]

I agree, however, once again

The error that is associated with GPU death is the one that I'm receiving, however my computer falls out of the criteria of which it's true in

Normally, it happens instantly when you try and have your GPU hit higher clocks, as the GP was dying and can't sustain those clocks

But I've gotten an almost 200mhz overclock on this GP and had it run for hours with no problems, it only happens when the GPU down clocks, which is not consistent with any body I've talked to

[clever verge]

Yeah, but I guess a GPU can fail in different ways so I would not be worried about that.

[high skiff]

Yes, but also kind of no

I mean, I personally can't think of any situation in which a GPU loses the capacity for its silicon to be low clocked, but only after being high clocked, but not having it related to power, and not benefiting from an overclock/under clock

It just seems to turn off, not related to any specific clock speed or power or anything

[clever verge]

Is this thing still under warranty?

[high skiff]

There's the idea that it could potentially be the VRAM, but the VRAM would also fail at high clock speed, not low clock speed

[high skiff]

No, there's no way to get warranty on this GPU unfortunately

Although I can likely get my money back through PayPal, as I've already submitted a claim

[clever verge]

Should get that sorted, once for all.

Is it normal that a GPU change changes the generated image? All things the same except GPU. I'm running with xformers disabled in both cases.

[upbeat summit]

does anybody know what happens with a prompt in ComfyUI if you exceed 77 tokens?

[visual glade]

the extra tokens get encoded in another block and that block gets appended

[clever verge]

Was just searching for what you said about it yesterday 🙂

[upbeat summit]

ah - gotcha. thank you, comfy!

[urban fjord]

ComfyUI uses CPU for randomness and not GPU. Auto1111 uses GPU for randomness I think so there you can get differences.

[upbeat summit]

since I only know how it works a bit in a1111 before SDXL, in ComfyUI I suppose the negative is separate from this and what about CLIP_G and CLIP_L? will they be summarized or does each CLIP has a 77 token limit?

[clever verge]

This is in ComfyUI, just replaced the GPU.

Maybe it's some setting in Comfy that changes based upon GPU resources

[visual glade]

each clip has a 77 token limit and the embeddings of each get appended so instead of 77x768 and 77x1280 it becomes 77x2048

[upbeat summit]

thank you! much appreciated

[visual glade]

which sampler?

[clever verge]

euler

scheduler normal

It's not a big deal, just curious. 🙂

[pallid path]

Got a new PC and got ComfyUI working with SDXL 0.9, so that I can test how RAW paintings look without refining or any other enhancements, and they are good.

maybe its the refining process that makes them look much softer and everything

these look as good, if not better than 2.1 paintings.

holy crap

[wintry quail]

can someone link the post about the various resolutions corresponding to different aspect ratios for 0.9?
the resolutions in the paper are different from the ones used in the bot

[upbeat summit]

if you use ComfyUI I can highly recommend Mikey Nodes by @west breach https://github.com/bash-j/mikey_nodes. it includes an Empty Latent Ratio SDXL node that has many presets build in for it

if you don't use ComfyUI here is the list of presets that should fit inside the model's 1024x1024 resolution:

1:1 [1024x1024 square]
8:5 [1216x768 landscape]
4:3 [1152x896 landscape]
3:2 [1216x832 landscape]
7:5 [1176x840 landscape]
16:9 [1344x768 landscape]
21:9 [1536x640 landscape]
19:9 [1472x704 landscape]
3:4 [896x1152 portrait]
2:3 [832x1216 portrait]
5:7 [840x1176 portrait]
9:16 [768x1344 portrait]
9:21 [640x1536 portrait]
5:8 [768x1216 portrait]
9:19 [704x1472 portrait]

[wintry quail]

thanks a bunch!

[upbeat summit]

Mikey Nodes also features an additional Custom Latent node where you can enter your own image size and aspect ratio and it will make it fit under 1024x1024.

you can also add your own ratios with Mikey Nodes by placing a user_ratios.json in your main /comfyui/ directory. these are my own custom ratios and sizes I do experiments with - all higher res and out of 1024x1024. you will get lots of non-coherent images with those, but if it converges nicely the fidelity and details of images can be really good

Masslevel Experimental Hi-Res SDXL image sizes for Mikey Nodes

[arctic bloom]

on windows?

[soft zealot]

a second hand Nvidia GTX1080ti for under £200

[plush crest]

I haven't tried yet; I just want to know if anyone else has had luck running sdxl on an 8gb amd card

I heard 16 gb were necessary, but I was hoping I was wrong

[arctic bloom]

my guess that amd card isn't best option to take step into generating images.
you can google: rocm, stable diffusion or visit r/StableDiffusion to find out how many troubles users get while trying amd card.

tho i must admit rocm 5.6 looks promising in terms of generating pictures.

my bet is that lowsest amount of vram is like 12 GiB

[quartz sequoia]

@visual glade Hi, i just got a 3090 what would u recommend i do to maximus speed / results for ur ui for SDXL?

currently getting around 3.6its

for 1024 img

[arctic bloom]

for what resolution

batch size, used sampler

[quartz sequoia]

batch size 1

ddim

6 seconds to generate an image basially

[arctic bloom]

try add to params ``--gpu-only`

[quartz sequoia]

im running the run_nvidia_gpu batch

isnt that techincally gpu only

[high skiff]

Careful, you need a 24GB GPU for that

Not sure what they have

Just popped in

[quartz sequoia]

3090 is 24gb

[high skiff]

Cool, you do have a 24GB

GPU only is way faster

The difference was more than 2x as fast as my 3080 when I went to a 3090

Just cause of GPU only

[arctic bloom]

yeah, i am chiiling in channel for a bit, so that's why i gave such advice to happy owner of fresh 3090 😄

[high skiff]

I have a fresh 3090, but it's likely dead ._.

[arctic bloom]

should look into more GiBs if you itend to use gpu more for generating images

[arctic bloom]

dead from inside, because don't want to generate cool images -- only dlss ones? 😮

[high skiff]

Dead from inside, likely

Still desperately trying some extreme measures to really determine if not, but it's very likely

[plush crest]

Dang, that sucks

[arctic bloom]

so, on serious note, it's hardware issues?

[high skiff]

Likely, but I still have a few things to rule out

[arctic bloom]

meaning need to return to manufacturer to switch (forgot thow it called)

[high skiff]

That's an RMA, and it's not RMA eligible

I'm fighting it out in PayPal claims

[arctic bloom]

meh, that sucks

sorry, don't mean to be rude, just situation is very bad

[high skiff]

Yeah, it does

The seller is working with me hand in hand to try and figure it out, obviously he doesn't want me to RMA, but he has until August 8th to figure it out

If he doesn't, PayPal is going to get my money back for me

[arctic bloom]

atm i am on 6700xt (xfx) and on linux and i can't say that i have pleasant experience with SD

[azure oxide]

That sounds like a tricky claim to handle lol, would not wanna be the guy in charge of that one. The GPU was working when you received it, hard part is how much of it was failing and how much of that the vendor was hiding

[high skiff]

Within less than 1 hour I got my first blue screen

And I have screenshots of when I originally messaged him asking if he had ever had issues with that before

And I also have 63 blue screen of death events logged in my Windows event Manager if they want to see them

[arctic bloom]

coil whine is problem for most of gpu nowdays ^_^

[azure oxide]

Ooooh you have a paper trail, that's good

[arctic bloom]

yes, i am talking about amd cards, cause i switched on them for some quite a while

absolutely, because i am making quite setup

[marble kindle]

why is it 5s/it on my 3060 12gb sdxl 0.9??

[trail bay]

re the partial diffusion, for the Comfy KSampler Advanced, is the End_at_Step inclusive? Or exclusive? like if I wanted to split 30 steps, would I do (just example): Start 0, End 25. Start 26, End 30. OR: Start 0, End 25. Start 25, end 30? or end 31?

[rich orchid]

Been searching for a while but not sure where to get help on SDXL "error loading model weights" on Vlad Automatic install on 4090 system with 128gb ram. Any suggestions?

[elfin cobalt]

https://brage.info/GAN/ganbot2/c3bbd9dc-365a-4e25-bb00-28dea45a39c1.0.jpg

In lieu of help, have snek.

There is plenty of Python in here.

[pallid path]

all these, in 30 secs, offline

thanks to a new workflow that spares a lot of steps

[sweet abyss]

Does 0.9 sdxl run (start) on rtx 4060 8gb ?

[pallid path]

I could run SDXL on 6GB

heck, some even got it on 4GB

[autumn forum]

Start:0 end:25, refiner- start:25 end:30

[trail bay]

ok thanks

[pallid path]

the 4060 does have a weaker memory bandwitdh, so that might hurt the speed, but it should hopefully run

[trail bay]

which sampler, and noise schedule are pple having the most luck with? or what is meant to be used?

[autumn forum]

DDIM, DDIM uniform for most cases is a good safe sampler

[pallid path]

I'm trying out the karras scheduler

it makes smoother results as expected, not sure if it's objectively better

[sweet abyss]

Another solution at a similar price would have been 3060 but, 4nm sounds great on 4060

[pallid path]

Karras - Right
ddim_uniform - Left

[pallid path]

4060 has a ""generational leap"", it's easier on the energy bills, but the memory suffered

like 3060 12GB both has MORE vram and STRONGER vram if I remember correctly

hmm, interesting

[visual glade]

just run it normally and yes you can use --gpu-only for slightly lower gen times

[pallid path]

I guess I'll keep on using ddim uniform

[spring fulcrum]

@visual glade where do I put command line arguements like --gpu-only?

Can you take a screenshot of an example?

also is there a way to set a specific IP instead of localhost?

[visual glade]

you put them in the .bat on the standalone

yes you can listen: --listen 127.7.7.7

[spring fulcrum]

Like this...?

[visual glade]

yes

[mild garnet]

When I want to close Stable Diffusion, can I just close my google tab or I need to do something in my command panel ?

[violet shale]

probably close the command prompt

[mental oasis]

O

[spring fulcrum]

@visual glade I'm not sure if I have this setup wrong but going from prompt to upscaled image with my RTX 4090 takes about 10 minutes... Is that normal or do you think something is setup wrong?

[violet shale]

can you load lyco on lora node?

[eternal fog]

yes

[eternal fog]

That Ultimate upscale node does lots of 1024x1024 passes in tiles over the image you've upscaled 4x. I'm guessing it's just doing load of passes, which is why it takes so long.

[visual glade]

you are upscaling to 4096x4096 so

[eternal fog]

Try increasing the tile size, then it won't have to do as many passes

[spring fulcrum]

so maybe a 64 or 128 tile size?

[visual glade]

upscaling to 4096x4096 at 50 steps is going to take a while even on a 4090

[eternal fog]

That would be even worse, make the tiles bigger so there's less of them

Or just don't use the ultimate upscale node

You could just upscale and then pass to Img2img

That's what I do and it can do around that size in a couple minutes on a 3080. So 4090 will be able to do it easy

[spring fulcrum]

This is what it goes through with just 1 image

[eternal fog]

Yeah because of the tiles

And yeah 50 steps is rarely needed

which also will make it take longer

[eternal fog]

Yeah 25 seems to be a good step spot.

With tile size be a little careful you don't go too high, as it will take longer and longer for each tile. And you can start getting artifacts or extra stuff in your images.

[spring fulcrum]

I upped the size to 2048 each just to try... I was already getting extra stuff in the images and sometimes banding.

you have to zoom way in to see the extra stuff but the band is usually right across the middle

Can you upload an image that you did with your workflow?

[eternal fog]

Yeah, or alternatively, just stick it in a KSampler and do an img2img to try clean up any edges

[eternal fog]

My workflow is a mess, but sure.

[spring fulcrum]

I just wish I could start with a 40964096 generation. and not 10241024... no upscaling necessary at that point

[hearty ginkgo]

hey

[eternal fog]

Yeah you'll get repeats and stuff then though

[hearty ginkgo]

just double upscale lol

[eternal fog]

If you generate at 1024x1024 and then img2img pass at 4096x4096 it should work fine as long as you don't go too high on the denoise. Warning though at the moment SDXL has a tendency to wash out background details when upscaling.

It will make the eyes better, but it will remove skin texture and texture on background objects

[spring fulcrum]

hmm

i wonder if sdxl 1.0 addresses some of those issues

[hearty ginkgo]

scorp you have a 4090 right?

[spring fulcrum]

ya but something just aint right. its slooooow as hell

[hearty ginkgo]

go to dm

[eternal fog]

How much System RAM do you have?

[spring fulcrum]

64gb ddr5

[eternal fog]

That's not the issue then

[spring fulcrum]

with an i9 not sure if that makes a difference

[hearty ginkgo]

same

[hearty ginkgo]

same only difference is prob out gpu

whats you upscale speed for the its when you do 1 batch size

[hearty ginkgo]

so 1/4th of speed basicaly when double the tile height and width

[spring fulcrum]

it took 10minutes 37seconds for that one

[eternal fog]

Those numbers don't add up

Are you just doing 1 ultimate sd upscale pass?

[spring fulcrum]

as far as i know just 1

[eternal fog]

Your actual iteration times are like 90 seconds

[hearty ginkgo]

one image 1024 width and hieght for upscaler and the image resolution for sdxl and 4x upscale is

[eternal fog]

So where the fuck is that extra time coming from

Is it sitting there for ages once the bars stop moving?

[hearty ginkgo]

thats 10 for the steps let me change it to 20 so i can replicate your stats

brb

[spring fulcrum]

ya it hangs sometimes

it doesnt make sense

[eternal fog]

Are you using any launch arguments?

[spring fulcrum]

yes

[eternal fog]

which ones

[true wing]

so I take it the bots are still running a bit slow?

[eternal fog]

Is it the same without --gpu-only?

[spring fulcrum]

I'll take it out and find out

[spring fulcrum]

still slow as dogshit on a cold winter morning

[hearty ginkgo]

check dm

[eternal fog]

What's your GPU usage look like when it's running

[shy kelp]

Is there a hard date yet for the 1.0 launch?

[spring fulcrum]

it doesnt seem to use it much it goes from 5% to 15% GPU usage and thats about it... Which I also don't get..... With A1111 and the first few itterations of SD 1.5 2.0 2.1 etc it used to use the whole card and I could do a ton of shit... with ComfyUI I like the results with SDXL but it is slow as shit.

[eternal fog]

Just to make sure, you have your monitors plugged into the GPU don't you and not the motherboard?

[hearty ginkgo]

this is at 20 steps

[spring fulcrum]

I have a 47 in ultrawide and yes its plugged into the graphics card... I promise

[hearty ginkgo]

no gpu usage check the

[eternal fog]

ok just making sure. I've seen people do that before.

[hearty ginkgo]

when the dedicated gpu memory maxes out it dosnt necesary increase gpu usage my memory go to around 8gb max but my gpu usage barely change

[hearty ginkgo]

and if you run one image?

what does the gpu dedicated go up to

[hearty ginkgo]

try removed all the arguments i use none of them

[hearty ginkgo]

it that one image?

[spring fulcrum]

now it seems to be cooking... yes one image

[hearty ginkgo]

dam

[eternal fog]

Is this when using GPU Only?

[spring fulcrum]

nope

thats with it removed

[eternal fog]

Your eating all your VRAM, so its going into system memory

That's why it's taking ages

[spring fulcrum]

is there a way to set specific amounts of vram

[hearty ginkgo]

i prob go into system memory also bc i only got a 8gb vram card but one image only takes around 300 secs for me

[eternal fog]

at 4096x4096?

[hearty ginkgo]

me and scorp uses the same upscale settings we basically got the same workflow

[eternal fog]

oh ok your using SD Upscale ok

I was going to say there's no way you aren't going OOM if you were running that res through img2img

[hearty ginkgo]

ye and scorp is to?

[spring fulcrum]

yep same setup

[eternal fog]

I thought you might have been trying it on it's own.

So yeah I have no idea why you are using so much VRAM

Especially without --gpu-only

[spring fulcrum]

I dont really know how to mess with the comfyui setup I just get setups from other folks I used to use A1111 that seemed to be easier to work with and not break things

[hearty ginkgo]

is there a arguement for low vram?

[eternal fog]

yeah

[hearty ginkgo]

wait were is your comfy ui stored a hdd ssd or m.2?

[spring fulcrum]

I could do vram split or medvram i think..... its on m.2

[hearty ginkgo]

try medvram

[sudden cliff]

With regards to the negative and positive aesthetic scores, what does it mean to set a low or high negative ascore?

[hearty ginkgo]

i have no idea tbh

[eternal fog]

Not a lot really that I've noticed

I think it's supposed to do something to clamp the aesthetic rating of the refinement

[hearty ginkgo]

--lowvram scorp try

[eternal fog]

The only thing I've ever used it for was when I was making an image of a zombie

I turned down the ascore on the positive and it made it look more nasty

[high skiff]

Man my eyes are pretty today

I wonder if I could use eyes of people in my family to make a LoRA for detailed eyes

Not sure how I would do that, but maybe

[sudden cliff]

but the negative ascore is especially confusing. Am I setting a lower bound? Am I saying that's the number to avoid? Am I saying 'do the opposite of the negative prompt when ascore is that number'?

[hearty ginkgo]

take ur camera and just start taking photos lol

[eternal fog]

remember when those people kept saying img2img doesn't work

[high skiff]

It's not that easy, other things need to be considered

[hearty ginkgo]

do lowvram

[hearty ginkgo]

like

[eternal fog]

I honestly have no idea. Maybe it's like anything negative would be below this score or something?

[sudden cliff]

That would be interesting, if it was like 'only apply negative prompt below this ascore'

[spring fulcrum]

With lowvram argument

[eternal fog]

I don't think that's listening to you

[spring fulcrum]

lol me neither

[hearty ginkgo]

are you using the docker or docky thingy

[spring fulcrum]

nope

[torpid halo]

Guys, do u know if it's okay to release a 0.9 SDXL LoRa?

[spring fulcrum]

It does go a lot faster now less hanging and only took 146 seconds

[hearty ginkgo]

wait

ss your upscaler settings

[spring fulcrum]

same setting with lowvram argument

[hearty ginkgo]

change tile back to 1024

[spring fulcrum]

trying it now

[sharp robin]

ur guys workflows sometimes looks so clean

mine is whole mess

[eternal fog]

So is mine lmao

[hearty ginkgo]

when i change my tile size to 2048 i do 3s a it

[high skiff]

I would need close up images of eyes, but I wouldn't want the LoRA to produce super up close images of eyes

So I would need an appropriate dataset of close, medium, and far for just eyes, encompassing different colors and shapes and stuff

My mom and I have very uncommon eyes, in 2 different shapes, so that could be cool maybe

But the biased would likely push the images to look like us

[spring fulcrum]

Okay so that was even faster:

[hearty ginkgo]

try 512

[high skiff]

My eye

My mom's eyes are a very similar color, but she has much rounder eyes

My camera makes my eyes look crusty lol

[hearty ginkgo]

maybe they are

[spring fulcrum]

I'm curious about what other people have set here:

[high skiff]

This camera way over sharpens everything up close lol

[hearty ginkgo]

one sec ill check

[eternal fog]

I mean that's for system memory which you are no where near maxing, so shouldn't be a factor

Also Windows gives you a big warning if you run out of page file space

[hearty ginkgo]

idk why i set mine so high tbh

lol

[spring fulcrum]

how much RAM do you have

[hearty ginkgo]

2x32gb sticks ddr5 running at 6400 mah

[hearty ginkgo]

whats your ram speed and ram ordering as in 4 16gb or 2 32gb or 1 64gb

[spring fulcrum]

2 x 32 DDR5 at 4000mhz

[hearty ginkgo]

what ram did you buy do you remember the amazon listing?

[spring fulcrum]

I got it from bestbuy... Im checking right now.. I thought it had an xml profile for faster speeds than what its using now

[hearty ginkgo]

it most definintlly do that why im asking you have to go into your bois and enable xmpII

[spring fulcrum]

Ya maybe it reset to factory the last time i flashed the bios

[hearty ginkgo]

prob

i use xmp for ram and use ai overcloking for the cpu

[spring fulcrum]

Time to restart and fix that profile

[hearty ginkgo]

xmp

https://www.amazon.com/CORSAIR-VENGEANCE-6400MHz-Compatible-Computer/dp/B0BTNW9XFZ/ref=sr_1_2?keywords=ddr5+ram+64gb+6400mhz&qid=1689901947&sprefix=ddr5+ram+64gb+6400%2Caps%2C86&sr=8-2

thats what i have i think

[spring fulcrum]

well when I bought ram It was like twice that price.. It was peak covid price gouging

[high skiff]

That feels really slow for DDR5, are you sure it's not DDR4?

[hearty ginkgo]

windows default ddr5 speed is 4000 i think

[spring fulcrum]

It was some of the first ddr5 that came out

[high skiff]

This is way overpriced, I got 64 gigs of RAM at almost the exact same spec for 160

[spring fulcrum]

I should probably replace it with newer ram

[hearty ginkgo]

i didnt care about price i did my motherboard and cpu and ram and coolor all same day shipping

[hearty ginkgo]

were?

[high skiff]

Amazon

Let me get the link

[hearty ginkgo]

send me a link

ok

[high skiff]

Ah, price went up

TEAMGROUP T-Create Expert... https://www.amazon.com/dp/B0BPHSL93T?ref=ppx_pop_mob_ap_share

Still less tho

[hearty ginkgo]

mines 6400mah

[spring fulcrum]

This is what I paid at the time I bought it and its way worse than I remembered it being

[hearty ginkgo]

my speed is 1200 faster

[high skiff]

1200 faster. What?

Oh, nevermind

[hearty ginkgo]

im running at 6400mzh

[high skiff]

Mine is 6000

[hearty ginkgo]

i could prob push mine more never bothered though

[high skiff]

Not usually much of a benefit on Intel honestly

[spring fulcrum]

Did you guys see that price?

[high skiff]

Not sure what's up with that, seems sletchy

That speed should be like $130 max

[spring fulcrum]

Its 159 right now for the same thing

[high skiff]

Overpriced Imo

[spring fulcrum]

I cant believe I paid over 500$ for that RAM at the time

[violet shale]

ok i got comfy how do youy actually get sdxl model

nvm found it on huggingface

[livid basin]

Have you guys had the chance to try the UniPC scheduler?

It is better than DPM++ for me

[agile quarry]

is there a DDIM_ETA setting in Comfy?

[lapis forum]

Hi can you resize the sdxl models ? i cant use them its too much for my system i only have 6 gig vram 😦

[livid basin]

You lose quality if you don't use 1024x1024

As in the pictures will come out worse in my experience

[agile quarry]

think they mean prune

[lapis forum]

i cant even run it 😦

[livid basin]

Are there 8bit variants of SDXL?

[eternal fog]

No but you can half the model to FP16

[livid basin]

I'm using the 4090, so I use 23GB ram with 1024x1024 with pytorch compiled fp16

Diffusers library btw, no attention slicing

[lapis forum]

i mean the model size is too much then my vram so my system cant use them at all .

[livid basin]

Buy a 4090

[eternal fog]

I'm pretty sure if you use comfy it should sort it out for you so it fits

[lapis forum]

i tried to do that get errors too

[eternal fog]

What GPu do you have and is it a laptop?

[lapis forum]

Error occurred when executing KSampler:

'
BaseModel' object has no attribute 'encode_adm'

File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\execution.py", line 141, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\execution.py", line 68, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\nodes.py", line 990, in sample
return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise)
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\nodes.py", line 960, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\comfy\sample.py", line 88, in sample
samples = sampler.sample(noise, positive_copy, negative_copy, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar)
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 583, in sample
positive = encode_adm(self.model, positive, noise.shape[0], self.device)
File "D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 472, in encode_adm
adm_out = model.encode_adm(device=device, **params)
File
`

`

"D:\Games\SSSSSSSSSSS\ComfyUI_windows_portable\python_embeded\lib\site-packages\torch\nn\modules\module.py", line 1614, in getattr
raise AttributeError("'{}' object has no attribute '{}'".format(
AttributeError: 'BaseModel' object has no attribute 'encode_adm'
`

[lapis forum]

gtx 1060

[eternal fog]

what are you doing to get that error, that doesn't look like a VRAM error

[lapis forum]

its not all the error its like 1/5 of it i could not put the whole error here

[livid basin]

adm, that's not SDXL is it

Isn't ADM that imagenet diffusion model

[lapis forum]

it happen when i only use sdxl models

in comfyUI

[eternal fog]

Where did you get the SDXL Model from?

[livid basin]

^

[lapis forum]

https://youtu.be/FnMHbhvWUhE

[livid basin]

If you got it by the way of pirates, that folder is like 90GB

Or like 30 GB if you just use the safetensors

[eternal fog]

Can you copy the entire error into a txt file and stick it on here?

[lapis forum]

what do you mean pirates ? dose it not free ?

[livid basin]

SDXL 0.9? Nah it is a gated model

[lapis forum]

the installation page from this video :
https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Tutorials/How-To-Use-ComfyUI-On-Your-PC-On-RunPod-On-Colab-With-SDXL.md

[livid basin]

So everyone sharing SDXL 0.9 weights is a pirate

[lapis forum]

i downloaded these 2 models
https://huggingface.co/stabilityai/stable-diffusion-xl-base-0.9 (you can download safetensors from this link - watch video to learn)
https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-0.9 (you can download safetensors from this link - watch video to learn

[agile quarry]

it leaked then after they let anyone who signs up for it at huggingface have it

[lapis forum]

so they wanted to sell the models ?

[agile quarry]

no it was just released early were still waiting on v1 . 0.9 wasnt spose to be public

[livid basin]

nah, just that SDXL 0.9 was research only

[lapis forum]

what stable diffusion make not going to be free after a time ?

i thought they are just like blender 3d

[livid basin]

SDXL 1.0 releasing for free next week

Hopefully they don't delay it again

[agile quarry]

but if they do its ok

[livid basin]

True, they owe us nothing

Just that I personally hope they release it next week

[autumn forum]

considering they are hosting an event its more of a push to actually release it? we need more votes!

[livid basin]

Speaking just for myself, I'm hoping more people vote for landscapes/objects/concepts, currently showdown & pantheon are dominated by people/people-like animals/robots/monsters

There's like so many robot mechs

[livid basin]

#1101178506530013284 message

Seeing more landscapes/designs in the bot-X channels recently

[hearty ginkgo]

anyone got it working on a amd card?

i keep getting cuda not availible on amd

[rustic surge]

Can SDXL currently support model training?

[rustic surge]

Can lora be trained on SDXL?

[trim orbit]

no. base models were never going to be charged. a beta version was released under a restrictive license

[livid basin]

I like the first one

Lots of fine detail

To be super frank, AMD support for machine learning is still really bad compared to Nvidia

For the least problems, just use Nvidia + Linux

[eternal fog]

This does horror stuff really well

I don't think I'd be allowed to post it though as it's pretty bloody

[spring fulcrum]

send image to me I love horror stuff

[autumn forum]

just put a spoiler on it and a warning?

[eternal fog]

Nah, I'll still get banned lmao

[trail bay]

hey whats the best way to share my comfyui setup right now on here

[timid sonnet]

the image

[timid sonnet]

no leg

[trail bay]

the metadata won't be srubbed?

[timid sonnet]

no

its in the image

[spring fulcrum]

If you just post the image people can drag that into their comfyui page and it will load your setup

[trail bay]

ohhhhh it is in the IMAGE itself?

[spring fulcrum]

yep

[winter raptor]

can also create a json

[trail bay]

like steganography

wow

[winter raptor]

unless you copy and paste from your browser. i do think that doesn't provide the metadata

[trail bay]

can someone look at that and tell me if that is a 'usual' way of doing SDXL

since we don't have the recommended ways yet

[trail bay]

plz

[winter raptor]

this image doesn't have the metadata attached

[trail bay]

ok

json upcoming one min

[winter raptor]

take it from your output folder, or you can send the json

image looks great though

[winter raptor]

looks good from what I see. Some people also use a second positive prompt, the l prompt, for image details, but you don't NEED to

[trail bay]

ty

l prompt? for the diff CLIP model or whatever?

[winter raptor]

something like that, I don't actually know the specifics myself ngl

[trail bay]

k

so you mean having another prompt separate for the refiner vs the base

[winter raptor]

I just know that it is used to prompt image details, etc. I'll send the image I just created with the metadata as well, you can see

[trail bay]

like a separate prompt box that connects to the clip text encode for the refiner, vs the base

[winter raptor]

ignore the custom node plugin, it's just an aspect ratio selector. The workflow is based on @high skiff workflow, with styles in a textbox from @west breach

^ @trail bay

[trail bay]

ty looking

[winter raptor]

oh, and the upscaler was put in by someone else. You can tell because I didn't change the name of the output folder lol