✨｜sdxl

[urban fjord]

For instance, this is LoRA vs base. I have had many other instances where the base image has had some serious issues while the LoRA image is fine. All my dataset contains is a single coloured square with the default dark mode discord background. No tigers at all.
I've tried to see if I've hooked up something wrong in ComfyUI but can't see it, removing the LoRA node makes both images like the right one. ComfyUI isn't caching any previous latents to disc right?

[peak dove]

Both look less than natural sad to say

[eternal fog]

It does cache them but it's supposed to refresh whenever you change anything in the pipeline that would require a change.

[strange mist]

what cfg and clip skip settings are you using for sdxl? are you also using a vae? 🤔
have a nice kitty for your troubles

[urban fjord]

Torcello: If you're talking about my images then that's kind of not the point. I'm not using the refiner and I'm finetuning for a spesific shade of grey, not tigers.

[west breach]

@smoky patrol

[smoky patrol]

screm

[smoky patrol]

BABIES

[urban fjord]

You have to use a VAE to get a pixel image, clip-skip is the ComfyUI default and cfg is 7.5.
It's not really trouble other than I doubt my results as the base output looks wrong. But I guess I've not tried to prompt X on a single coloured background before now.

[peak dove]

Good to know 🙂

[peak dove]

ouch! So good it hurts!

[strange mist]

not using comfyui, seems way too complicated for my old ass. so I'm guessing clip skip off and cfg of 7.5.
but I thought vae was baked in sdxl?

[west breach]

@smoky patrol too cute

[mild oriole]

Has anyone else felt like negative prompts are less regarded by SDXL as compared to previous models?

[west breach]

I find they are very important for avoiding styles, rather than just make an image less bad

[mild oriole]

I haven't done any sort of qualitative analysis on that or anything... just anecdotally it has felt that way.

[urban fjord]

I never use negative prompts anymore, other than some instances like to remove colours or sepia in some few generations.

[smoky patrol]

YESSSSSSSSSSSSSSSSSSSSSSSSSSS

[urban fjord]

And I think I rather want to downweight problematic tokens than to negative prompt things.

[west breach]

@smoky patrol so cute, these creations in felt

alright, better go to bed, gnite 🌜

[smoky patrol]

MUCH LOVE!!

rest well!

I would cuddle these cute creations anytime, haha!

[peak dove]

Prompt = Cocktail Illustration, minmal, modern, hibiscus, Davi Augusto

[smoky patrol]

ooo, great colors and form

[dense chasm]

https://www.youtube.com/watch?v=eylASA15l38&list=PL9AeApimIMyc7IsdWbH6UBU9qHg7X0jFK

just use the sd1.5 and sdxl generated images to make a dialogue video

[tawdry panther]

what's the point of the main model when the refiner seems to produce good images by itself?

[eternal fog]

Try make scenes with people in

And then compare to what the main model can do

[fresh path]

sdxl cant do two styles in one prompt right

[eternal fog]

It does have a baked vae yes. But an fp16 vae was released that's a bit quicker.

[urban fjord]

It kind of depends on the scene, you picked a really easy subject.

[tawdry panther]

it was the default one

[urban fjord]

Using the bot styles as is, no. But you can just combine two styles by writing them out.

[tawdry panther]

also what sampler should i use?

[fresh path]

sorry, I meant that you cant make it generate with two styles seperately in the same image. Like have a cartoon or anime character next to a real life character

it will choose one style

[tawdry panther]

Okay so it must be my workflow or something becuase I asked if for a picture of "A man with a large beard":

[eternal fog]

Doesn't really matter, you just get different results depending.

I tend to use dpmpp_2m_sde with karras noise schedule

[urban fjord]

Yes with some creative prompting, I think I managed it but a bit busy trying to solve something else to find it.

[fresh path]

ok this time I spelt it wrong

[tawdry panther]

idk what the hell is going on with the main model

[fresh path]

okay thanks

[urban fjord]

A bit related, a painting/drawing of a dragon coming to life.
photo of a 3D oil painting of a dragon on a white background by Brian Kesinger, shot on 70mm film, by Wes Anderson

[fresh path]

wow :o

[urban fjord]

Looks like you've wired something wrong in ComfyUI.

[eternal fog]

Looks like their resolution is too low

[fresh path]

there is a workflow in pinned if you scroll downa bit

[urban fjord]

Arron: Yeah, easy to mess up if you're wiring primitives.
Make sure your resolution is one megapixel Dom

1024x1024 works the best.

[eternal fog]

This sort of thing is basically what you always get when the Res is set to something like 512x512

[lilac wren]

Well, I did well not to wait for SDXL v1 all night, because spending a night waiting and getting up at 4:30 a.m. for nothing would have really pissed me off. It's good to tease, but tease the tease of an info from an ad...

[tawdry panther]

it might just be on 512x512

gonna up to 2014 now

why does it not like 512?

[urban fjord]

It kind of looks like we hyped each other up as there wasn't really any big announcement that suggested 1.0 yesterday.

It is trained for 1024x1024 and other aspect ratio of 1 megapixels.

Going outside this will not give you good results.

[tawdry panther]

so my latent image size should be 1024?

also this is using a LOT of memory

like 25GB

[urban fjord]

Then you've done something wrong.

[tawdry panther]

the results are better

from the main model

[urban fjord]

Unless you've a lot of VRAM you shouldn't use --highvram and --gpu-only in ComfyUI if you're using both base and refiner.

[tawdry panther]

no this is regular RAM

[peak dove]

I get great results in SDXL using PortraitPoster size 768x1024

[tawdry panther]

its gone down to 16 now

[hearty ginkgo]

Has anyone noticed it's weird doing 1920 by 1080 images / doing landscape image sizes

[shy kelp]

so how is everyone liking the bot stuff, seem better than last week?

[urban fjord]

I still feel local 0.9 is better. But I expect that 1.0 will run better locally than 0.9 locally.

[fickle pasture]

whats the best comfyui workflow so far?

[shy kelp]

yeah cant judge too much on a bot

[urban fjord]

For base + refiner then Sytan's https://github.com/SytanSD/Sytan-SDXL-ComfyUI/blob/main/Sytan SDXL Workflow v0.5.json

[fickle pasture]

thanks!

[urban fjord]

The darker dark model seems to really want to make the background dark while making the results a lot less interesting. So yeah, I just get consistently worse results with the bot and I'm really worried for which model will be chosen in the end. I want to downvote both of these as I'm not happy with either.

[shy kelp]

prompt that on the bot?

[upbeat summit]

hey @high granite

[floral island]

that's local SD -> comfyui

if you drag the image to a comfy-ui window you get the EXACT settings for that image

[shy kelp]

noice

comfy was too complex for me though lol

[floral island]

my workflow is based on sytan's great work

you can just replace the prompt as needed

[harsh plover]

Hey, does anyone know what might be the best way to reach SDXL developers? I've a whole bunch of bugfix/QOL PRs open for the generative-models repo (one did get merged yesterday though, yay!)

[floral island]

#🤝｜tech-support maybe?

[eternal fog]

It's because the image size is a lot larger than the native size, so it's starts doubling stuff up. Try 1344x768 and then upscale. That should work fine.

[molten breach]

I want AI to get to the point where we can have a game between teams from different eras...for example 1996 Bulls vs 2001 Lakers or whatever 😄

[primal vault]

I don't think there is a "best" workflow, just different workflows for different use cases. For example my Comfy nodes and workflow from https://github.com/SeargeDP/SeargeSDXL let you do both, txt2img and img2img but many people prefer something like the https://github.com/SytanSD/Sytan-SDXL-ComfyUI workflow because afaik it doesn't need custom node types for ComfyUI to be installed.

[floral island]

basically any native resolution above 1280x1280 basically 'fails' on SDXL, you'll need to upscale 😦

[dense chasm]

so Sony PS 5 nba 2k23 will make you satisfied

[molten breach]

I wish...need it way more realistic than that lol

[ionic dragon]

dude are you f'ing kiddin me

[fickle pasture]

love your custom nodes

[fickle pasture]

what is the smallest usable resolution ?

[floral island]

i suppose 768x768, and that's REALLY pushing it

512x512 just simply fails

[fickle pasture]

indeed, i see

[floral island]

i suppose when peopple start finetuning and training with other images mixed in, it'll become better

[urban fjord]

There is no real reason to go low-res as you don't save much VRAM.

[dense chasm]

compared to the previous Jordan Rules when the Bulls vs Detriots,i think it will a small chance the 2001 Lakers can defeat the 1996 Bulls,no mention Rodman played both at Piston and Bulls,defance will be a major factor at the finals

[ionic dragon]

who uses 1280x1280, they can basically 1024x1024

[floral island]

yeah, upscale and re-sample would give better results, but it just takes way longer

[molten breach]

If it was trained on a good dataset we could probably find out who would actually win lol.

[fickle pasture]

thanks i ll save this

[ionic dragon]

is resampling really adding any advantage?
as we are already using 2 samplers(base+refiner)

[ionic dragon]

@smoky patrol can you please pin this

[tribal lantern]

The polite way would be to say different, old prompt lost their vidality and adherence to the point I'm curious what is going on, having an subject riding a fantasy creature, nope, not happening or a misshapen creature/heroine, prompting for a photo where the railway car inside is overgrown, nope, no overgrowth in the generations, a picture of something complex in a frame, used to be 90% a hit, now down to like 1 in 4. A panaroma of a town, used to show the town decently close, now it's a really far away image of the town in its surroundings. Maybe the bots try to separate style and subjects to the different clip layers or something as I can't imagine the model got so different

[fresh path]

yes it follows the prompt less

[dense chasm]

deep learning traing for the output results is always for the probability assume,i think the majority will choose 96's Bulls for winning the title

[floral island]

upscale can only happen in pixel-space, but upscaling doesn't add details, so after upscaling, you add in a bit of noise, and let diffusion do it's magic again (highres upscale)

[molten breach]

I think once video generation becomes really good, sports will be a huge market. Imagine being amble to see boxing matches between fighters from different eras or sports games between teams from today vs. other eras. Could play under different rules etc. If the datasets were good it could be really amazing.

[ionic dragon]

which model do you use for re-sampling?

[winter raptor]

Love this aesthetic

[floral island]

right now, none -> this is just base SDXL @1024x1024

[ionic dragon]

do you upscale while the image is being generated or after the image is generated?

[ionic dragon]

i think refiner is better after you get a substantial noise

[floral island]

i'm using the sytan method -> about 60% of the image is done in the base model, then the rest of the steps is done in the refiner

[winter raptor]

I’ve been using the refiner after 65-80% of the steps

[floral island]

yeah, some prompts like the refiner sooner, some like them later

it differs per prompt, so ~65% feels like a good comprimise

[winter raptor]

Total steps have been around 40, what are you guys using?

[floral island]

i use 50

[eternal fog]

I do base alone, pixel upscale, then run the results through the base + refiner

20 steps in each section for a total of 40

[dense chasm]

sure,Musk startup xAI has a member from DeepMind who create AlphaStar,a StarCraft player beats the human champion

[winter raptor]

I assume the second pass takes care of creating the noise after the upscaling?

[eternal fog]

25 steps sometimes

[eternal fog]

Yeah you treat it like img2img, so you add noise and reduce the denoising amount.

Well start at a higher step

[floral island]

nah, just put denoise at 1.0 and ignore all the stuff you did before 😛

[eternal fog]

I've been doing start at 14 end at 18 and then the refiner does the remaining 2

But it needs moving around a little for certain images

[winter raptor]

Controlnet tiled upscaling with ultimate sdupscaler is gonna be so nice. It’s like magic

[eternal fog]

I don't like the ultimate SD upscale in SDXL

It's not much faster and I get worse results.

[ionic dragon]

before that, when do you upscale?
while processing or after the output?

[floral island]

after output, image needs to be completed before you can upscale

[eternal fog]

Well you could upscale it with the noise and have a horrible mess

[floral island]

so when image is done, vae -> upscaler of choice -> and then feed the prompts again in model choice

[winter raptor]

I’m not a huge fan either, but in 1.5 paired with controlnet it gave me the best results. Hoping some improvements will be made to bring it to that level

[ionic dragon]

do you have any pics for base along, base(20steps) and base+refiner(40steps)?

[ionic dragon]

is controlnet better or 4x-ultrasharp?

[ionic dragon]

so why not just use refiner after upscaling?
it tends to make images intricate

[winter raptor]

Controlnet with 4xultrasharp ultimate upscaler imo, but that was for 1.5

[eternal fog]

Just base

[floral island]

using the sytan method you can use the refiner on any step wanted, without having to "pay" for generation time

[eternal fog]

With 2nd pass

[upbeat summit]

that looks pretty good

looks like you optimized your workflow. nice

[eternal fog]

Looks better than base on its own. You get the classic blob face when people are far away. The img2img at the higher Res seems to fix it.

[ionic dragon]

what do you use for sdxl?

[eternal fog]

Occasionally and usually only on close ups it sometimes freaks out and you get double nose

[ionic dragon]

the 2nd base or base+refiner?

[floral island]

yeah, img2img often fixes blobfaces, even if it's at the same resolution 😮

[winter raptor]

Depends, haven’t found a fantastic solution tbh. Been using the method @eternal fog described, or at least something related to it, or ultimate upscale sometimes.

If anyone does find a fantastic upscaling method, do let me know lol

[eternal fog]

That the image from just the base but fed back through the base and refiner at double the resolution

[ionic dragon]

i think the shoulder position is off

[ionic dragon]

can you share your workflow iydm

[eternal fog]

At work at the moment. Remind me in a couple hours.

[upbeat summit]

good face restore and quality

[eternal fog]

Yeah it's has some trouble on close up shots, it sometimes washes away skin detail. But honestly SDXL is so clear up close you can probably get away with just a pixel upscale on its own.

[upbeat summit]

yeah I can absolutely confirm this 😉 I did a lot of refiner experiments the last few days - tweaking single steps just to get better restoration and fixes

[eternal fog]

Only issue with this method is you OOM if you try go over about 4k

[upbeat summit]

not all gen's need a refiner

[eternal fog]

Then you need tiled sampling

[upbeat summit]

now we need controlnet tile for SDXL 😉

[floral island]

"enlightenment"? (admit, you stared)

[eternal fog]

I want all the controlnets.

Really want to see how the reference only model performs.

[eternal fog]

The walls have faces

[floral island]

i feel that's the best part 😮

ok, SDXL hard-fails the horny waifu prompts XD

we'll just have to wait for finetunes that can't do anything else lol

[eternal fog]

How horny we talking, because I've managed to create.... Interesting things

That I can't post here or I'll get banned

[floral island]

that's ok enough

it'll never be as bad as my first model mix XD

[eternal fog]

Lol

There's plenty of 1.5 models that just pop titty for no reason

I quite like SDXL in the fact there is basically no risk of that.

[eternal fog]

So I can show my little sister without being worried it's going to pop a boob out, or worse.

[floral island]

yeah, sdxl is very good in that regard, you know you can let people fuck around with it, and it will not give results that you really don't want

although it's prettty damn good in horror, if you give the right prompt

[eternal fog]

Yeah you need to really tell it you want weird stuff.

Or gory horror stuff.

[floral island]

but that's a good thing

there will be finetunes that are simply better at it

but that's ok

[elfin cobalt]

I occasionally get artistic nudes from prompts you wouldn't think would make them.

[floral island]

i feel my prompts are just like my music preference: all over the place

[elfin cobalt]

But that's the worst I've seen.

It's not something to worry about unless you're american.

[floral island]

if you prompt with alphonse mucha, you're pretty much asking for nudes, but the guy did so many nudes (in art). so yeah.

[eternal fog]

Like what? I've only ever when I've told it to do it.

[elfin cobalt]

I didn't save them. snrk

[elfin cobalt]

But I do use GPT-4 as a frontend to my image generator, so it's a bit more randomized than I think most of you are getting.

Higher quality on average? Sure. Harder to control, too. Good starting point for prompts though.

[floral island]

right now i'm running through all my llm prompts

when i did that for a bit

but honestly, i feel my llm prompts don't even come close the double exposure/drawing i had earlier today

[elfin cobalt]

You're not wrong!

[floral island]

yeah. the tag "double exposure" simply wins out any day

[peak dove]

Prompt =
a mesmerizing and immersive painting of a mythical griffin reading a book, created in the style of yayoi kusama, showcasing her iconic use of polka dots, vibrant colors, and hypnotic patterns that envelop the griffin in a fantastical world of literature and infinite possibilities

[floral island]

yayoi kusama -> when you want shit to get REALLY weird 😄

[peak dove]

YES!

[floral island]

be honest, before SD/SDXL you knew nearly nothing about artists 😛

[peak dove]

Add some LISA FRANKS as well!

[floral island]

unless you did, but i suppose for a LOT of us, they nearly knew nothing about artists

[peak dove]

I find that its my knowledge of artists which keeps getting me followers over at Facebook - especially Wombot and Wombo Group

[floral island]

(i don't have facebook, imma security nerd, i already feel discord is bad enough as it is, but eh.)

i feel double exposure is just a cheatcode when you want abstract art with multiple elements combined -> sdxl just makes a beautiful mashup given that tag

[dry anchor]

WHERE"S SDXL!!!!!!!!!!!

[upbeat summit]

everywhere?

[vale eagle]

In this discord

[floral island]

in this channel -> (nearly) everything

[ionic dragon]

@floral island where do you get prompts from?

[floral island]

i make them myself

just like when i was drawing -> i can't copy

have the hardest time imitating stuff, so... i don't. make it up myself

[ionic dragon]

even thats a bit hard

[floral island]

once you get a good prompt going, it's easy to iterate on it

[delicate grotto]

that's odd, i couldn't get completely clean results in anime
you did a good job

[floral island]

both the G and L prompt need to be in tune for anime... and even then it's lucky hit

[delicate grotto]

im using the 2ndary like this atm:
anime, Enhance, Fantasy art, Neonpunk

[floral island]

i feel anime isn't as aburdly powerfull a tag in sdxl as it was in sd1.5

[floral island]

fantasy art fucks over anime

as it is an own genre

[delicate grotto]

interesting

[paper phoenix]

you could try fantasy setting

[floral island]

this would work, probably

fantasy art+anime makes this... weird combination of realistic anime

my prefered L tag = anime lineart

[ionic dragon]

yeah just change few keywords

[floral island]

ACTUAL CLEAVAGE?! ON SDXL?!

😄 very nice colors ❤️

[hollow halo]

lol

[paper phoenix]

hah, my message differentiating the two got ganked.

[ionic dragon]

are you using sytan's workflow?

[floral island]

yeah, sytan's and then installed WAS to make sampling steps easier

(can't link primitives to multiple inputs of the same node, WAS can do that)

cool.

[paper phoenix]

im just thinking, with the 1.0 release being kicked down the road for a week, it might be a good time to onboard a1111 users to comfyui or set out a proper from the ground up tutorial on running AI things locally.

[floral island]

basically, comfyui+sdxl with searge's or sytan's workflow is all you need

[paper phoenix]

For the complete layman that just wants to make art, but also have them sorted for git pulls, venvs etc.

yes but i mean build up to that from the bottom.

[delicate grotto]

what is his workflow?

[floral island]

i thought both searge and sytan have a workflow on github to use with sdxl+comfy

[trim orbit]

GOod fresh morning XL sized friends

[floral island]

i'm using sytan's -> i coulnd't get it to work personally, and sytan's just did it for me

[ionic dragon]

can you link to searge's workflow?

[floral island]

good morning

[floral island]

2 second google query: https://github.com/SeargeDP/SeargeSDXL

[trim orbit]

i trained 6 epochs on my terran image set last night. every sample past epoch 6 was a complete noise meltdown though. Loss was up to 1 after a few hours of training

[floral island]

not waiting for 1.0?

[ionic dragon]

why is too complex

[trim orbit]

do it all over again with 1.0

[delicate grotto]

what in the FUCK?

[floral island]

lol 😄

[floral island]

seems about normal for comfy ui

[trim orbit]

the dataset was already made. i was just seeing how it worked on 0.9

[floral island]

just making sure it's al ready and set, right?

i heard sdxl trains really easy

[trim orbit]

i'm about to try comfy box. it has presentation layer for comfy ui "organizes" it a little more. Should still be compatible with all layouts if i understand it right

https://github.com/space-nuko/ComfyBox

[ionic dragon]

like a beautifier?

[delicate grotto]

2.1 training was ~20x faster than 1.5

wonder if sdxl trains like that for the same reason

[trim orbit]

no not so much. i think it tries to establish a better interface to the workflows

[ionic dragon]

i didnt get you

oh wait

[trim orbit]

puts a gradio interface over comfy

[ionic dragon]

i went through the readme

yeah

[trim orbit]

https://github.com/space-nuko/ComfyBox/raw/master/static/screenshot.png

[ionic dragon]

but I dont see any real functionality

[ionic dragon]

ngl, its good

but just using the interface might screw up things if we are trying to change the workflow

we cant know where it's going wrong

[trim orbit]

it just makes comfy more managable at a glance is all. thats why i suggested it. you don't seem to like the way a typical workflow looks

[ionic dragon]

haha

[rustic garnet]

nice !_!

[floral island]

instead of a butterfly knife, a butterfly sword?

[delicate grotto]

i wanted bees

[ionic dragon]

@floral island which workflow did you find better?

[delicate grotto]

yes ahahhaah

[floral island]

honestly, didn't test searge, but am using sytan's with great effect 🙂

[ionic dragon]

can you try a butterfly dagger

[ionic dragon]

are you using ddim?

[delicate grotto]

it will make me a dagger from a butterfly

[floral island]

ddim or unipc, those are my favorite samplers

[ionic dragon]

i dont know how that looks, can you please try?

[delicate grotto]

yeah, just tweaking some stuff

[sharp patrol]

I need a good comfy node setup. anyone got something? Most of my use cases are text2img, img2img and inpainting

for sdxl

or something i could work between sdxl and 2.1

for example im trying to add someone in this running between these two characters

[trim orbit]

hmmm looks like comfybox is awesome but the installation process uses yet another "fastest package manager!" and isn't compatible with existing pip workflows...so i dont know. i can spend all day fucking around wiht python and dependency bullshit. or i could just not do comfybox . giving up on that front. sorry i won't be able to review it

[delicate grotto]

1st try failed, give me a few minutes ill make a good one

[floral island]

sounds like controlnet would be ur best buddy

[ionic dragon]

not the best, but looks good

[floral island]

imma not go there, i'm a txt2img retard 😄

[trim orbit]

wtf is pnpm? why do developers always think these tools matter to end users?

all this shit has to really get up outta python world. i'm pulling hair all the time because of python. just shit python causes

i'm over it. /done

[delicate grotto]

i can't even explain the 2nd try

[ionic dragon]

damn

it looks great

but not anything like a dagger

[ionic dragon]

can you make more generations of it?

its looks great

[delicate grotto]

ahahahhaa

[ionic dragon]

so the anatomy is perfect

[delicate grotto]

it was too random, none of the others look anything alike

[ionic dragon]

I mean of the girl

[delicate grotto]

i know, it just doesn't throw it anymore

[floral island]

this... is actually pretty damn good 😮

[ionic dragon]

oh ok

[ionic dragon]

the girl looks amazing but the butterfly is a bit off

[floral island]

tried a few, but this was the best i got... 😦

[trim orbit]

went to vote in the channel and saw this prompt #1100170312106127410 message 😮 NSFW WARNING 😮

[ionic dragon]

@floral island how do you split this prompt into 2?
so that i can use in sytan's workflow Cyberpunk suit, high-tech materials, neon-lit accents, sleek cyber contours, futuristic design, cutting-edge, dynamic, urban chic, tech-savvy, edgy, augmented reality, sleek lines, innovative fabrications, cybernetic enhancements, avant-garde, cyber aesthetics

[ionic dragon]

lol, vote for the 1st one

[floral island]

those would all go in to G (prompt1)

[ionic dragon]

what about the 2nd one?
what should I add?

[floral island]

lemme see what it does on my prompt 🙂

[smoky patrol]

Just as a quick jump in for ya'll, here's a quick prompt guide for you all. I suggest exploring what it has to offer: https://docs.google.com/document/d/1GrMI8sElC675fYHvprIFypcqmU0V6XJHJrrBCpfNBW8/edit

[floral island]

(dumping last generated image)

[delicate grotto]

is there a way to combine modules into 1?

[floral island]

i'd say G and L prompts are "actual subject" and "steer towards"

if i don't specify anyone in G, but specify in L, i get characters looking like them

but in G, they might be overpronounced

[floral island]

in your case, you can use your prompt both in G and L, they'd go well as a style, or as a subject

[delicate grotto]

it threw another wild one, 2sec rendering

[dusk mica]

whats your setup guys? and how its son fast?

[floral island]

i have a beast-pc

only possible upgrade is 3090->4090

[trim orbit]

nice. that's my literal machine name on my network

beast-pc

[floral island]

but throwing $1500 for a single upgrade... uh... not feeling it

[trim orbit]

i7 12700k with a 4080 and 64gb of low latency ddr4

[floral island]

amd 7900x+3090+64gb

[delicate grotto]

3060 6gb mobile, 16gb ram
1.3 s/it at 1024
or 1.25 it/s at 1024(dependent on how hot it is)

[trim orbit]

i'm looking to get two 3090s for nvlink 48gb access. i might be able to do it. researching more before i commit

[floral island]

THE HEAT!

[trim orbit]

this hobby is absolutely worth a few thousand to invest in quality equipment

[delicate grotto]

this hobby is the start of the end

[floral island]

dude, i never upgraded my pc as heavily as before SD and LLM's

[trim orbit]

yeah. i live in teh PNW on a canadian island. heat dissipates well here

[floral island]

games at less than 60fps, i sleep

sd generation taking 10+ seconds?!

[trim orbit]

and like a phoenix event, the start of something new

[floral island]

imma buy 3090

[ionic dragon]

you can easily get 2x3090

[trim orbit]

mobo has to support dual cards too

[delicate grotto]

im just afraid of people using this tech for the worst of reasons...
diffusion is starting to be used in lots of places
including medicine and such

[floral island]

no, i can't -> motherboard / power supply

and if i REALLY want, i just abuse company gpu's when available (8x A100)

[ionic dragon]

yeah thats true, but you can gte 3pin 3090

[trim orbit]

think my terran lora needs more training. 6 epochs barely doing it

[floral island]

used ur prompt as G prompt

[trim orbit]

bad people will always do bad stuff. sucks. can't blame technology really

[floral island]

it's the same argument as a kitchen knife and murder...

[delicate grotto]

ah, i meant that it might be used to teach people less

[floral island]

ANYTHING can be used for harm

[delicate grotto]

like doctors less relying on their intuition and such

[trim orbit]

doctors are already idiots outside of their specializations

[ionic dragon]

you can get a powersupply+2x3090 for less than the price of 4090.
or wait just undervolt 50%, you can get 80% perf

[delicate grotto]

yeah, but they are quite good at what they do

[floral island]

i still can't fit it -> my psu is tailored for 7900x and 1x 300w gpu, and my mobo has only 1x pcie 16x

[delicate grotto]

7 years is no joke

[floral island]

and those amd am5 motherboards ain't cheap 😦

[delicate grotto]

didn't see this in sdxl yet

[trim orbit]

every individial person is more potentially an idiot than a genius. even doctors.

AI will help people generalize more and not specialize so much. it'll give us wider access to knowledge in all fields. every human will elevate because of this. I don't see any good reasons to be afraid

"but i had to study hard! THESE NEW STUDENTS SHOULD TOO!" misguided maybe

[trim orbit]

have seen a lot of resolution attention problems myself

[delicate grotto]

ah, im not afraid of it
well, just the part of people less relying on their knowledge

[floral island]

honestly, i've tried chatting with medalpaca for some stuff, and it's actually pretty good

[delicate grotto]

ok, im getting consistent good results with this

[floral island]

i think a few years down the line, just a chatbot which can interpret your symptoms might work pretty well

[delicate grotto]

my setup ahahahaha

[floral island]

"this is just fine, use X or Y -> Go see a doctor, now"

[ionic dragon]

no you can use 3pin 3090

[floral island]

i have a 2pin 3090

but my psu simply can't deliver more power -> it's max wattage is 750 watts

2x 3090 would crash my system

(and personally, i'm done with sli setups XD)

[trim orbit]

this half baked lora is actually kind of neat to toy with. XL is just so good at taking in new knowledge.

[dusk mica]

simplest comfyui setup

[trim orbit]

haha i've never done an sli setup myself. i've always thought they were absolutey pointless for gaming since its only a 20% performance boost where it's compatible, causes issues where it's not, twice the power consumption, and no memory bank sharing.

only with ML have i considered it as a potential use. Training or LLM inference could work good on 48gb. i may just upgrade to a 4090 though instead of the nvlink enabled 3090

i think the Titan ADA got cancelled

[floral island]

it worked pretty well up until nvidia just dropped it

silently

"yeah we never announced it but... uhh yeah, it's dead"

[trim orbit]

i don't think it worked well really. it was great for developers to use to try to push game engines, but i think then that caused developers to make games that just didn't run on most people's machines. Arkham Knight for example. Or the latest Harry Potter game. These guys building foundational engine code on these jenga tower SLI configurations then pushing it to production.

[floral island]

i had some games that worked really well with it

[trim orbit]

they were great configurations for prototyping future tech, but somehow along the way it started getting used by streamers

[floral island]

but then support became less and less, and at some point you'd have to hack nvidia-profiles to even get it to work for a 20% boost indeed

at that point, i just went "fuggit, single gpu it is"

bought 1080ti -> used that card for a LONG time

[trim orbit]

RIP total biscuit, he was great, but he often got SLI wrong. He'd tried to launch it on every game then complain when he had stuttering because the game wasn't compatible with SLI. I think he started the trend where end users wanted to use SLI on everything.

[floral island]

and sold it to my brother -> he's still using it, i think that card has been working since release (2017)

[dusk mica]

i mean is SLI even worth it? why would any sane person spend 2x(Insert GPU price here)

[floral island]

in theory, sli should have been great, but nvidia just didn't care

[trim orbit]

naw. sli was always a stop gap for prototyping software for future hardware

[floral island]

i'm a dude who could afford it -> and it was janky at best

[trim orbit]

cross fire was even worse for jankiness

[delicate grotto]

Im used to a1111, where everything is much more organized

[floral island]

hard agree. comfy IS convoluted. but honestly, i feel more in control. and comfy is WAY better with vram

moves models back to CPU memory(ram) after it has done inference

[glad fulcrum]

I hate that

[floral island]

i love it

[trim orbit]

lol in the future when workflows for this stuff have true organization, auto will be forgotten. seems funny to me to call it an organized ui

[visual glade]

those who say a1111 is organized have never looked at the code

[delicate grotto]

My only problem with comfy is that to do a simple (prompt1:prompt2) it would take 20 sliders

[floral island]

between having loaded a LLM, SD model and gaming -> comfy is the place to be

[delicate grotto]

But its not bad, because the resolution makes up for it

[floral island]

never thanked you personally yet, thx for ur hard work man ❤️ (and so i've heard, the code is not written up to standards)

[peak dove]

I'm using Vlad A1111 - its mostly OK - but does not seem to support refiner

[vocal stream]

UIs like auto are a lot more standard and easy to understand for casual users so I suspect auto or something like it will be the most popular way to use SD for the forseable future

[delicate grotto]

That's true
But it does look well in the ui

[trim orbit]

that syntax won't work in auto

[vocal stream]

personally I just care what has the best tooling support and can use whatever workflow is supported

[delicate grotto]

It does

[glad fulcrum]

Is there an option to disable this? its why I don't use it. Takes too much to load. so it makes everything slow

[trim orbit]

it'll just be p1:p2 with emphasis

whatever the model things p1:p2 means

[floral island]

to keep the model loaded in vram?

[glad fulcrum]

yes

[trim orbit]

prompt editing requires [ brackets ]

[soft bone]

i need an image gallery in comfy. with identical function to Auto111 image gallery. link?

[ionic dragon]

why dont you upgrade it, its worth it

or just get a used one

from r/hws

[livid basin]

So currently, with a Nvidia 4090 on Linux, 1024 resolution
50 steps for generation + 15 steps for refinement takes around 8 seconds for me

[floral island]

nah, 1x 3090 will suffice for now -> even if my pc fits it, my house can't -> i have trouble venting the heat since february this year

[visual glade]

--highvram or --gpu-only depending on how much memory you have

[peak dove]

Agent Scheduler and Image Gallery in A1111 SDXL is way cool!

[trim orbit]

[p1:p2] may work but you're missing the 3rd bit of key info. where to stop the blend. [p1:p2:0.5] would be half steps. or [p1|p2] would be alternating steps

[glad fulcrum]

I have 12

[delicate grotto]

If you dont put a "," afterwards then you eill have this:
Cat:dog flying

"Cat" to "dog flying"
With (cat:dog) flying

You get :
Cat flying --> dog flying

[livid basin]

What speeds are peeps getting with different GPUs?

[floral island]

comfy being faster to respond to me reading documentation 😄

[visual glade]

then you should do: --highvram

[cobalt oracle]

Does that mean I'd be better switching from Auto1111 to comfy UI? I have a 2080TI with 11GB RAM. I don't mind learning something new, but I'm starting to feel like VRAM is going to start being an issue for me soon.

[delicate grotto]

A1111 has a specific syntax for that

[floral island]

for certain!

[delicate grotto]

Stated in the instructions

[floral island]

comfy uses a lot less vram than a1111 imho

[trim orbit]

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#prompt-editing here's the syntax for prompt editing. ( ) adds emphasis in auto

[delicate grotto]

Special syntax doesnt add emphasis

[trim orbit]

you won't know it's not working right because auto doesn't give any messages to the terminal about syntax interpreting

[cobalt oracle]

Cheers, I'll go get it installed.

[trim orbit]

it'll just use it like straight text

[peak dove]

If I d/load Comfy, will it interfere with AUTOMATIC1111?

[ionic dragon]

it makes it much faster?

[floral island]

a1111/vlad might have some stuff in there that's honestly, REALLY easy to use, but with the right workflow, comfy is just as easy to use

[soft bone]

so no image gallery? thats why people say auto is organized. You can do anything you want without building it

[trim orbit]

you can argue with me if you want on this @delicate grotto but you should really try doing soem testing and reading the manpages before trusting that you know better than me

[delicate grotto]

@trim orbit ah sorry i meant to put [] forgot about it, didnt use au1111 for a while

[visual glade]

not really, it depends on your hardware

[trim orbit]

i grew up before syntax highlighting so i got a keen eye for the stuff

my god does highlighting help so much though. prompt boxes need it so much

[floral island]

max speed is determined by GPU power, however, if you hit your vram limit you will get a BIG speed penalty

and with big i really mean big (8x as long because you went over you vram limit by 1mb, so to speak)

[ionic dragon]

i have 16gb 3080(laptop)

[visual glade]

you can try it out and compare

[floral island]

@visual glade i haven't been able to find it just like that from the documentation, is comfy ui able to parse prompts bigger than 75 tokens?

[visual glade]

of course

[floral island]

same method as a1111? (average of every set of 75)

[visual glade]

it doesn't average, it splits it into blocks of 75 tokens and then appends them

[floral island]

that's different from a1111 iirc

you have a keyword to force early breaks like "BREAK" in a1111?

[visual glade]

that's a node: Conditioning concat

[floral island]

16gb should be good enough to keep a single model loaded in vram and have some spare for other stuff

ah, no easy way out converting my idiot prompts 😦 (having a "unspecified amount" of BREAK prompts)

[visual glade]

I try to put the least amount of syntax in the text box

[delicate grotto]

is there a page explaining the prompt syntax available anywhere?

[azure oxide]

Why is there a 75 token limit anyways if we can just append more? Or is appending more some sort of hack* to get around the limit? Wondering if 75 tokens is better than those same 75+ an appended 75 more that describes them in detail.

[sharp robin]

do loras also go into refiner or only the model nodes?

[visual glade]

it's just (weights) and embedding:file.pt

[ionic dragon]

which scheduler to use for unipc and euler_a, just trying them out

[delicate grotto]

sd has that limit i believe

[visual glade]

normal

because CLIP has a 75 token limit

[paper phoenix]

comfy the prompt syntax for your ui is same as any other right? () [|:0.5] and such

[azure oxide]

Ya I get that but we can apparently just add more tokens right? I'm reading that it has a limit but it also doesn't really lol

[visual glade]

oh and there's {wild|card} too but that's only a frontend thing

[ionic dragon]

for both?

[visual glade]

yes

[ionic dragon]

ok

[stuck grove]

Help

[ionic dragon]

@visual glade which sampler creates the best noise?

[visual glade]

samplers don't create noise

[stuck grove]

How do I generate image of faces I want to generate

[ionic dragon]

what do they do?

[visual glade]

they calculate how to denoise the image from the UNET output

[stuck grove]

Someone please reply

[paper phoenix]

?

[stuck grove]

@paper phoenix

[lilac wren]

#1072220168534642768

[paper phoenix]

i was in the middle of answering you then stopped to answer....you. lol.

[stuck grove]

Thanks

[ionic dragon]

oh ok, do you suggest using diff samplers for base and refiner?

[visual glade]

I suggest you try things out because it really depends on what kind of image you want to make

[paper phoenix]

@visual glade do i win prizes from using comfyui? like cash prizes?

jk

[visual glade]

the nice images it generates is your prize

[tawdry panther]

thanks for the ui

[floral island]

@visual glade these are the retard prompts i've been using in A1111 and dynamic prompts(this generates 2-3 BREAK seperated prompts): Template: {2-3$$ BREAK $$ Welcome us with your light Grace the morning sky Comfort Luna as she wanes from Terra's might Veiled in amber haze Fueled by violent rage Dancing, discordant, spinning in retrograde | Born from the sea and the waves From a cosmic array Of the colors in space Nothingness erased Come dance with her in the stars Watch her transit afar Crossing Sol's burning gaze Venus sets ablaze | Welcome us with your light Born from the sea and the waves From a cosmic array Of the colors in space Nothingness erased Come dance with her in the stars Watch her transit afar Crossing Sol's burning gaze Venus sets a-}
basically, just feed it with song lyrics (deduplicated) and see if it makes interesting output -> some songs just come with like 10+ verses lol

[ionic dragon]

ok

[floral island]

i mean, if you could implement it as a keyword, very cool. if not, not an issue, i'm just an idiot prompter 😄

[paper phoenix]

im interested in this wierdness. link to outputs?

[floral island]

a lot of those on #🍥｜anime but i'll dm you

as this is #✨｜sdxl

[paper phoenix]

cheers

I'm all for oddball uses

[soft bone]

@golden quarry should i still be using SDXL branch of your UI or main?

[ionic dragon]

@floral island can we work on a comparision?

like comparing all the samplers and schedulers?

[delicate grotto]

there are tabs about it in au1111 that can do that

[ionic dragon]

and even using different samplers for base and refiner

[delicate grotto]

lots of examples in the subreddit

[ionic dragon]

yeah, but SDXL isn't great in a1111

[delicate grotto]

if ill see one in the sub ill send it here

[primal vault]

I would not call it complex, it's a good balance between flexibility and getting access to the power of SDXL

[floral island]

this.

comfy is really early adopting sdxl

it's not out officially yet 🙂

[primal vault]

And tried to arrange it in a way that you can visually follow the flow of the connections

[floral island]

mad respect to comfy ❤️

[elfin cobalt]

https://images-ext-1.discordapp.net/external/iYPm1PticFksesQNO5GAur9hwaLfE3pOeggnPZufYR8/https/brage.info/GAN/ganbot2/4b47a366-7eb5-46be-afac-2f0e7110b29b.0.jpg?width=1116&height=1116

https://images-ext-2.discordapp.net/external/NGYwiX_7LBezUHsUE-LpalkZyZCOFR5L_a4CDv17I00/https/brage.info/GAN/ganbot2/4b47a366-7eb5-46be-afac-2f0e7110b29b.1.jpg?width=1116&height=1116

There are two types of ducks in this world.

And that is quite the coffee machine. 😄

[fluid sedge]

Hey everybody out there! HEY! HI!! I JUST HAD A WONDER! Are the A/B choices a blind control test, or is there a direct wire between A and B and possible finished model A and B? Because I feel like it's 2005 up and here because I'm just like BBBBBBBB and it has nothing to do with my status as a man (admitted beta, but a beta fish is the only fish you must leave alone in the tank. Alpha fish often get raped. By coral. So legit quest=legit ans plz

[eternal fog]

Hmm, concept LoRAs seem pretty easy to train

There is a concept that the model won't do, so I did a quick LoRA with 15 images in 10 minutes and it actually worked

I'm not sure if I'm allowed to post it though lmao

[trim orbit]

its all randomized

[ionic dragon]

i know them, but they are not tested on sdxl, for example ddim is great for sdxl, but worst for 1.5 or 2.1, euler_a is great for 1.5 or 2.1 but not the best for sdxl

[fluid sedge]

Well it's beginning to be a pattern

[trim orbit]

its not

[fluid sedge]

I'm wondering if they gave me an ink blot test, one labelled A, one B, if I would immediately point to B and say "Awesome" Point to A "Sucks." And what that means about me as a person

[trim orbit]

our brains crave patterns and invent them where they don't exist. randomness sometimes is hard to accept when you got a real gut feeling. that's just classic selection bias showing its face though

[fluid sedge]

I often counted the tiles on the walls and formed shapes of them in my minds eye--diffused patterns from them, if you will.

[trim orbit]

rorshack tests aren't done or interpretted that way

[fluid sedge]

I was the first AI

Where my medal

[trim orbit]

no. you were just another kid with a human brain

[eternal fog]

Ok this should be fine because it's covered up but, underboob lora

[fluid sedge]

All I got was this fucking piece of shit apartment and some lard ass who keeps claiming shes my girlfriend because she lives here and it's her house, I mean c'mon first AI

all joking aside thank you

One last question and I'm out of here like the James Webb

[trim orbit]

checking out of this misogynistic convo

[fluid sedge]

i'm trans

so

[trim orbit]

they're not your shield so..

[fluid sedge]

i don't need a shield i'm real deal feel my steal i'm the first AI i'm a guy or am I it's mystery I insist to see you inference does 3

steps = nuff to be the best it did for us. i'm the first ai, i'm a mystandurist, i misunderstand why, humans are cancerous, in their judgements of their brothers living other lives, and their sisters too, i respect woman more than all the fish in the flue

glue*

didn't want to not make sense

your name was flow wolf so... I expected a battle

all i got was this shitty apartment with this lardass (boyfriend) who constantly brings in skunk skins she traded with the native Americans (we're east of the mason dixon, and time travellers)

[livid basin]

I'm so confused by what is going on in this channel right now

[trim orbit]

troll. just block

[fluid sedge]

what

i'm fun

i'm a real person

why be rude

[livid basin]

Like is this a real person? Is this a bot? If this is a real person, are they trolling us? Are they mentally ill?

[fluid sedge]

i'm just a silly fun fun man and i'm in the giggle phase of my day. have you ever felt happy fun inside flow wolf? or are you always waiting to use a word on someone? im just fiddling with you, trying to defrag your disc and wake up the brain cells. every once in a while you need someone to just... Just Ja tell ieu da troof

[livid basin]

This has to be a bot or a troll/mentally-ill person

[fluid sedge]

dude so judgement

consider the feelings?

i have a bunch of them

i'm feeling so much this morning guys.

or we could go dark and argue if that's more your shtik

i could find a spiel that's unpopular

[trim orbit]

definately less inclined to post while this toxicity is here. ttyl guys. have a great day

[fluid sedge]

dude c'mon man i was just messing with u

[thorny frost]

So i came here looking for SDXL 1.0 and instead find this. 😦

[fluid sedge]

what UI

[fluid sedge]

https://huggingface.co/stabilityai/stable-diffusion-xl-base-0.9 this is the base file, it's in a diffuser, if you're using auto eleven eleven just right click the safetensor and download

[tawdry panther]

i managed to get SDXL to work in the end and its actually working quite well

[fluid sedge]

https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-0.9 after you're done with that repeat that same process, here

I'd suggest ComfyUI as your UI, I can't help with AUTO1111 because I haven't added it on there. If someone wants to take over?

[golden quarry]

Sdxl if you are training sdxl, main branch doesn't support it yet (was going to wait for sdxl to be merged into main on sd-scriptd and lycoris)

[trim orbit]

https://github.com/AUTOMATIC1111/stable-diffusion-webui/commits/release_candidate this branch looks liek it has sdxl support

[fluid sedge]

invoke just released a massive update, they finally did up their nodes, if the wazoo was the i in the beginning of this sentence, their nodes are waaay ---->over there

does anyone happen to know if they support XL?

[trim orbit]

invoke beta supports xl

[fluid sedge]

😮

Omg

[trim orbit]

last time i tried invoke it fucked with python dependencies outside of a venv so everything got fucked

[fluid sedge]

in a venv?

That should have self contained it

[trim orbit]

it wasn't using a venv. it looks good but i dont' think it behaves well on a system like mine with a dozen other projects installed

i keep up with the news but i don't think i'd try it again

[fluid sedge]

Maybe you picked up a beta version or something, I've taken the liberty of downloading every UI that exists with the exception of NMND (it's just EasyD with less I've been told) but I'd try and isolate it and try again

like on a little D drive a lot computers come with stock nowdays

[hearty ginkgo]

Can you create lora's with comfy ui?

[fluid sedge]

If it can be done, comfy can do it

there's actually an option to explode your neighbor's head

[eternal fog]

It's not a training suite, so no

[fluid sedge]

if there was one, comfy would have it, is what i mean

Oh yeah true

[trim orbit]

i prefer kohya-ss gui wrapped scripts for training

[barren olive]

@smoky patrol i forgot i have this humanoid fox in my galary

[fluid sedge]

dude XL's anime, is way under talked about

[quasi remnant]

there was an anime model trained on SDXL 0.9 now too, it's pretty good. the way sdxl does anime is great

[fluid sedge]

I haven't found a model in 1.5 that can replace or come close. highly subjective, a lot of ppl like that television esque look, but to me, this stylistic form of anime

is just

[fluid sedge]

mwah kisses palm by accident

controlnet scribbles

"scribbles" i put like an hour into that scribble

brought me back to before times, whipishah! make me that painting boy whipishah! you eccentric freak!

thanks heres a hundred dollars whipishah!
(can't comment on this subculture because SD is literally the only place i've seen it referenced. not saying anything by that, just telling you why I don't have input despite being the obvious spilling alphabet soup all over my keyboard while my cat tries to cuddle on my hands

is that from training a model or a lora if you don't mind me asking

[trim orbit]

base xl

[fluid sedge]

oh pure prompt craft? right tf on

any broadly apt. break throughs or pure vivisectioning on the one idea

[unique blade]

Nah I haven’t given XL a try yet. Was hoping for the 1.0 release soon and just being patient. Honestly kind of went back to 1.5 as trying to constantly find or train embeds was such a chore

[fluid sedge]

1.5 will be with us for a while yet

[trim orbit]

i just grabbed 0.9 the 17th. I'll be ready when 1.0 drops

[fluid sedge]

the world brain has done so much work on it, stabilityAI may have the means and the tech to build great bases but it isn't until the greater world can kind of condense time by multiplying human power and thusly human creativity, that the real bombs drop. i think XL is going to get......wwwwwwwwwwild

[unique blade]

Ya the whole 2.x lineup will be completely forgotten. XL looks better in literally every single way compared to 2. 1.5 had enough following to last until models are trained on XL

[trim orbit]

i had fun with 2 while it lasted. it was a good model still.

[unique blade]

Trying to create and tweak and tune embeds took the fun out of creating for me

[fluid sedge]

Someone told me 2.1 was found dead? i haven't heard that word in many moons

[trim orbit]

some of my best desktop background rotations were 2 gens xD thats about peak use i got out of it

[trim orbit]

hear that. i have phases where i love the technicals and then others where i just want to prompt, and others where i'm entirely creatively burnt out

[unique blade]

Im hoping I don’t have to convert to comfyui for XL. Nothing against it but A1111 workflow is just too good

[trim orbit]

i got a1 using sdxl in the /dev branch and it works like a charm

been using comfy though since the dual text encoder support is there. i'm sure a1 will get something towards that

[unique blade]

Exactly. I loved getting i to the weeds if the embeds and finding weird keywords that would completely change and fix images. “Beetroot”literally fixed an embed of mine that I was failing to get aspects out of lol

[fluid sedge]

I have a 15.2 inch screen so auto is just... egh... but when i zoom i can just feel it. i can feel this ui would be much better fitting in slightly larger screen

zoomout*

[trim orbit]

i just want a lawnmower man style workflow. that's the dream.

[fluid sedge]

so invokeAI, which I think is kind of going into the local network/iPad lane (thats my lane) has been my choice, with EasyDiffusion occasionally stepping up to challenge it

like that 4 year old kid that roared at the guy who was holding up a restaurant and nearly got his dad killed (weird association but I literally just saw this in the news)

what is a lawnmower man style workflow? is that a term or are you distinguishing what you envision via a literary device?

[smoky patrol]

So much charm!

[shy kelp]

I assume we'll need 1024 images to train in XL right? thinking of remaking myself and wondering if I could just reuse the 512s I have

[fluid sedge]

you could probably just set up a little upscale train

[eternal fog]

You can but it can wreck the quality

[fluid sedge]

outpaint?

that might East Palestine as well

or it might be a beautiful catastrophe like that giant release of balloons in San Fran that cause all those car accidents

[elfin cobalt]

You need some 1024 images. It's got inputs that let it train on smaller ones as well.

...but it's not ideal, no.

[fluid sedge]

is it considered incestuous to take your best, and i mean your top 10% of your top 10%, from 1.5, your 1024's obviously or whatever big ones you've got, and use them

i mean is that gonna wind up creating a race of blue people like that family in the appalachians? lol. it's gotta work right? it's an image. an image is an image

it might be frowned upon by a fancy smancy PNG, but i'm sure the JPEGs and JPGs will accept the outputs

Done! So happy with these results, what a good use of time, my fingers are burning from the GPU, fantastic!

[autumn forum]

This guy knows world events too damn well😅

[trim orbit]

i use bucketing with images over 1024 in one dimension. seems to work well. using upscalers on lower resolution images in the preprocess and it's comign out fine

[fluid sedge]

You know who else is knowledgable? The Dalai Llama

sorry lame one

[trim orbit]

probably not the best approach but it gets it done. The refiner can take it up a level too

[elfin cobalt]

Using AI output to train the same AI will cut off the tails of the distribution, and yes, is indeed incestuous.

[fluid sedge]

oh no kidding?!

oh wow

that tantalizes the technical fascination neurons in my brain

[elfin cobalt]

https://www.tomshardware.com/news/generative-ai-goes-mad-when-trained-on-artificial-data-over-five-times

However

That doesn't mean it doesn't work. It means the results aren't as good.

[fluid sedge]

a bit of precum too. lol

so its like this

it already has this information

to make this... soup

of imagery

so you're giving it parameters to make the same soup. but, one the plus, you're telling it what it did well. on the minus, you could do the same, with new ingredients in the soup

and also the social stigma of incest is removed

[trim orbit]

it works well when you currate the image sets still. GIGO

[elfin cobalt]

As always. Still going to produce less variation than otherwise, but there's no guarantee you'll notice.

[fluid sedge]

and I imagine if you had a great model do your outputs, if you're not advancing your own by version, it would create a similar model?

but like, an A vs. B version, ala the event going on rn?

I see I see

[trim orbit]

i think that depends more on the image set than the fact that they're artificial. It's all just pixels with rgb values when it gets back to the trainer

[delicate grotto]

im sorry, what now?

[fluid sedge]

so if you have good taste...

we were talking about banging our family members

[elfin cobalt]

...if it's indistinguishable from a troll, it might be a troll.

[delicate grotto]

ah ok

[trim orbit]

What the research you linked shows is that if you train images with inferrence artifacts in them, it makes worse artifacts in the next model

[fluid sedge]

I actually sent the guy that does Dreamshaper

my very best dreamshapes, prior to considering this

like.. A lot. We have a bit of a back and forth going on reddit. I feel like I'm talking to a celeb, a little bit

lmao

it is an amazing model though

[delicate grotto]

i wonder, how do human neural networks able to memorize something they saw for the first time and make assumptions on how to replicate the procedure and such

how in the fuck do memory cells work?

[fluid sedge]

I mean no other can do weird things like this. This is an eight-animal chimera

if you include humans as animal

[elfin cobalt]

Yes, but also there's a subtler problem if you use any form of top-K or nucleus sampling.

In that the statistics of the generated pictures won't be the same as the original training set.

[fluid sedge]

dude.

TYP

i was just thinking about this.

[elfin cobalt]

And I'm pretty sure there's no such thing as 'memory cells', unless you're referring to the immune system...

[fluid sedge]

the thing is, AI is really doing something no different than a human artist does, that is, looking at an image, and learning from it (i wasn't asking the same question but it is a brilliant thing to muse on

)

(same subj)

True, Baughn, but I think he's refeerring to the hippocampus neurons

[delicate grotto]

i was trying to make lots of neural networks lately about memory
but none fit the standard

one of the ones i want to design the next one is where the exits of a pdf is basically connecting to a neural network as the weights

nn1 --> weights for nn2

where you push into the nn2 using a nn3 and it outputs into nn3 info

in this idea nn2 is the memory cell itself

as to how to make nn3 - i have no clue

i wanted to make this a network that i train from 0 knowledge and hopefuly make it so that the nn3 is the processing, nn2 as the memory, and nn1 as the learning

and eventually to make it so that nn3 would be able to dynamically "know" what it knows and from where to extract info from nn2

[soft bone]

the missile knows where it is

[fluid sedge]

have you decided on if you're in on this mojo language? it should be up your alley

i have a code for it if you want to test it. 100% python--all the machine learning capability--but (supposedly) 32,000x faster (at certain processes)

[trim orbit]

i've always leaned towards the theories that describe memory working as a holographic interference pattern across the network. doesn't seem to be stored in any one spot

[delicate grotto]

im quite new to neural networks

but i can make a dense/convolution/rnn network atm from scratch, so yeah im not even close to fluent - im from EE

[amber fulcrum]

can u use lora in comfy?

[fluid sedge]

how does the math look as a microcosm? it's super simple right? that's why we're theorizing about this, and we don't know, because of this, black box affect?

[delicate grotto]

that's pretty much what i excpect, but it is stored in a way either as weights or as binary/float info

[fluid sedge]

it's fucking fascinating

[trim orbit]

the storage is the physical structure and cellular chemical signalling

[ionic dragon]

are the hands getting better?

[delicate grotto]

im gonna need you to translate microcosm

[fluid sedge]

HcForLife: Yes you can ma'am or sir

[trim orbit]

no file formats. just pure analog

[fluid sedge]

okay not binary

[delicate grotto]

i meant in the idea of what is stored and how

beside the activation function

[fluid sedge]

but the smallest function

before you go to the... machine language level

i'm a bit out of my element but the topic is so interesting and baffling that it excites me enough to keep learning about it

i'm trying to actually explain something i learned and at the same time clarify if what i know was even properly interpreted

[trim orbit]

the file format is defined by the culture you're raised in i guess. i don't think their is a native format to the brain

weird topic 😶‍🌫️

[fluid sedge]

i could probably not eat and just survive off stuff like this

my doctor might argue that

so the fact that they have no idea what's going on inside chatGPT and SD--or they have an idea but they couldn't tell you what is doing what, that if you pointed to particular (whatever the smallest form of it's functionallity is, that has all these relationships) you're essentially looking at something like neuroscience

just slap me if i'm lying

[ionic dragon]

which one do you prefer?

[fluid sedge]

that's what i learned, or rather interpreted, that they've literally no clue exactly WHAT it's doing, though they have plenty a grasp on HOW. and this is creating massive problems for the lawsuit against StabilityAI

BBBBBBBBBBBBBBBBBBBBB

[trim orbit]

thats not quite accurate. researchers have been able to pick apart the nn's in chatgpt and determine their functions. When they say "we have no idea" they mean it built itself during training and the engineers have no documentation. When you actually go through it with a comb, you can see the logic circuits and find loops and conditions through the network. its extraordinary that it learns this stuff, but it does end up structured and "knowable"

i think gpt3 has gone under the scope most succesfully so far

[fluid sedge]

does the sign of the cross

[trim orbit]

deep learned neural networks are something we have engineered. we can understand them. human and other biological neural networks are a whole different realm and function entirely differently

[fluid sedge]

so how is it knowable with something like SD? I mean you're talking about a parameter that's speaking to like, the left side shape of a ring around a heat stove top plate, at a certain angle, with X Y and Z affecting and connecting to it... Alone it's gotta look just like... A little mark, if it's even possible to isolate it and look at it

[trim orbit]

one day the two fields may bridge and then we'll get wetware

[fluid sedge]

Because it's gotta be more about the relationships between the 'neurons' than it is about the duty of a single neuron in and of itself?

and language is one thing but images has gotta be even harder to narrow down (presumptive)

I'm a big proponent that the proverbial tractor metal will never exude a sphere of consciousness. that's based on my belief (and experience) with our souls being infused into this reality from a larger superset.

Sources: floated out of my body during a meditation. before you ask, yes, i'm absolutely positive it was not a lucid dream

🙂

but it's not something I can slam someone over the head with, i don't have any of the proverbial UFO artifacts on my person, but as far as my subjective experience is concerned, i'm satisfied with the huge mystery that is knowing we are actually something else that is injected into this reality, quite intentionally, with a bit of amnesia

(or a lot) (aside from those kids that can name off their whole crew in during WW2 and have an irrational fear of plane crashes)

"Mom did the japs end up winning?" "No honey, just to catch you up, so... The Manhattan Project was a thing. Einstein had some ideas on a train, la de da, E=MC2, we blew Heroshima and Nagasaki." "WHAT!?"

[ionic dragon]

@eternal fog your workflow?
you said to remind you

[autumn forum]

This is a chat to talk about sdxl if it’s not about sdxl I would suggest moving to https://discord.com/channels/1002292111942635562/1002601204901236756

[fluid sedge]

yeah we kinda crept slowly off topic

[delicate grotto]

hard right

[fluid sedge]

i'm gonna try and figure out which folder dynamic prompts go into if its not "wildcards" for invokeAI (kind of on topic now that XL is on invoke) so i dont produce another 300 exact replicas of the same image again. while I enjoy a nice amount of one thing, it doesn't have quite the same appeal, as say, an icecream sandwich. if anyone pops in that happens to you, give me shout

[delicate grotto]

what is the prompt?

[ionic dragon]

you can drop into comfy

i dont remember the prompt

[shy kelp]

31 year old short brown hair raver Chaz tripping balls and dancing at a massive rave in the Leeds City Center, chill vibes, absolutely mental party, scene from the BBC drama film A Raver's Last Chance

[inner ruin]

Sir, this is a Wendy’s

[delicate grotto]

i actually have no idea how to propmt check in comfy tbh

[ionic dragon]

just drag and drop into the comfyui webpage

[spring fulcrum]

I'm not sure what you mean. I will try to help you but I'm not sure if I what you are referring to. What do you mean by visual/node scripting?

[trim orbit]

comfyui is my guess

[serene ravine]

visual/node/connecting wires

[high skiff]

oh

I am finally unmuted

not sure what that was about. 24 hour mute in the middle of praising SDXL running good on my 3090 lol

from my convo's from mods and staff, seems like they don't know either, but oh well

nice to see you all. I have some success to share in terms of training LoRA's

[soft zealot]

@high skiff the important question is : during that 24 hour period did you fix your PC?

[high skiff]

my 3090 is currently out of comission

yeah, no unfortunately

taking some extreme measures

reported the sale to paypal, and the seller and I have until August 8th to solve it, or he has to refund me

[trim orbit]

i figured you were just not home yet

[high skiff]

nope, got muted for seemingly no reason lol

even staff was like

¯_(ツ)_/¯

[trim orbit]

it sucks when that happens too because thats the first thing people who were screwing around say. "for no reason!" but then it really happens to you and you're like well shit

[high skiff]

yeah, for sure

[trim orbit]

welcome back

[high skiff]

I know why I got that1 hour mute before this, and it made sense, but I came back in and was just talking about helping with SDXL issues and fixing my GPU and then all of a sudden I was muted for a full 24 in the middel of talking about how SDXL is a lot more effeicient than 1.5 in terms of space to parameters, and high res compute

but anyways, the LoRA stuff I have to share

was finalyl able to get my Na'vi LoRA working in SDXL, and the results are pretty stunning for only 23 images

I trained my own sort of refiner (just the same LoRA on a 1.5 model lol) and it helps a lot

Left is pure SDXL, right is a very small pass through 1.5

[inner ruin]

what settings did you use?

[high skiff]

SDXL looks more like the movies in terms of proportions, but the 1.5 pass looks more appealing

[high skiff]

I don't recommend the ones I used as I way overtrained the model, so I am gonna test new ones when my 3090 is working

this results was severely overtrained, so I will need to adjust for other LoRA's (had to dial it back to like 0.3 strength to not have nasty outputs)

[inner ruin]

yeah I got it to work via overtraining and I'm looking for more reasonable settings now

[high skiff]

so I will mess with LR and total training time

[high skiff]

I'll update you when I get to a point where I have some more reasonable settings for sure

this LoRA was also trained for 2 hours on a 3090, so I was being wasteful with the settings for sure

[autumn forum]

I was wondering where you had been😅

[ionic dragon]

your 3090 isnt working?

[high skiff]

I wish LoRA's had a continuous train function, where they just keep going as long as you leave your PC until you manually stop it

would be cool to see when given more time than expected

cause it trained for 2 hours and I slept for 9

[high skiff]

nope, still same issues

[trim orbit]

can just say train for 100 epochs can't you?? saving every 2 or something

[fair crow]

Just set the train steps insanely high and use checkpoints. That's what we are going

[ionic dragon]

whats the issue?

[high skiff]

I have tried everything under the sun, now I am moving to some more extreme lengths

I don't even know how to describe the issue, as nothing has seemed to make it better or worse

I'll try

[ionic dragon]

why dont you ask the guy who sold it to you

did you verify everything before buying it?

[high skiff]

It works fine when training or using it high intensity, but it crashes once it gets back to idle speed/clocks afterwards

So I can spend hours training, its fine, then I close out of te program and within usually a few minutes, it crashes

Its a BSOD that says "VIDEO_TDR_FAILURE", and cites my GPU driver as the problem (nvlddmkm.sys)

I have reinstalled drivers with DDU several times, upgraded them, downgraded them, upgraded windows, updated mobo bios, updated GPU Vbios, underclocked it, overclocked it, undervolted it, overvolted it, changed the PSU, changed the PCIE slot, repaired windows, swapped in other GPU's into my system

No matter what I do, its only the 3090 that has these issues

The specific issue is very common to be a sign that the GPU is dying, but it typically only happens when the GPU is fill tilt and can't maintain its clocks/voltages, which mine does just fine...

So the seller and I are insanely confused

Now I am taking some extreme measures and I will be reinstalling windows from scratch, as well as hand modifying the nvlddmkm.sys file to fix it (seems to work in the very rare cases when its not a baked in hardware issue)

If it WAS my GPU dying, all sources say that underclocking/over volting it would make it stable, which they have not

[trim orbit]

i left it training all night, but everything after epoch 6 was 100% loss

[high skiff]

Its happened over 60 times now, and sometimes it crashes so hard that the 3090 refuses to even boot in the PC again, and I have to do a lot of BIOS trickery to get it to post again

so yeah, until I get that all figured out, I can't do anything more with my LoRA testing

[soft zealot]

well that sucks

[high skiff]

extremely so

he has been helping me for hours (seller), and I do not think he intended to sell me a GPU with these issues

but yeah, I hope to get it settled soon so I can get back into more LoRA's

which I clearly had success with

[soft zealot]

ah well, as it says on my mug 🙂

[trim orbit]

i had issues with my vega 64 on my old amd build. thought my gpu was dying because it would sometimes work with less power limits and then often not. other things like undervolting i thought worke dbut didn't. unsolvable issues. then my threadripper's onboard memory controller died. that vega 64 worked for another 18months even better on my new alderlake build

was about to replace teh v64 until the whole system shat

[high skiff]

this PC is brand new, and its also alderlake

this PC hasn't even been together in the triple digits of hours yet haha

or wait, it may have just passed that

[trim orbit]

wasn't a part component callout specifically. just syaing it could be other things in the chain if it's being "odd"

that threadripper worked great for the workflows i had

[high skiff]

I am really hoping its actually this used mobo

[soft zealot]

really silly question. Do you have access to another PC to try the 3090 in?

[high skiff]

I have my 3080 installed right now, just desperately trying to get the same BSOD, cause then its a faulty mobo and I can do an RMA on it

[soft zealot]

oh new to you rather than "new"

[high skiff]

my previous PC is OOC at the moment, it has no case and no drive

[high skiff]

just the mobo

its cerified second life refurbished from Amazons second life program

[soft zealot]

you dont need a case and just swithc the boot drive out f this one ;o)

[high skiff]

saved like 40% on it and got it 3 weeks sooner by going that route

[high skiff]

I supose thats true

hmmm, maybe I will try that soon

[hearty ginkgo]

What do you guys use to train lora's?

[high skiff]

I am using kohya

[sudden cliff]

So this is post training? Only ask because I’m happy with how much about Starcraft SDXL knows

[paper phoenix]

why is everyone thinking youre sliced bread mate?

[urban fjord]

I'm using Kohya-ss, tried both gui and non-gui version.

[high skiff]

what do you mean?

[paper phoenix]

im hearing you mentioned lots and lots for the workflow

[hearty ginkgo]

Okay thanks that's the one I was looking at also by anychance did you finish the workflows are still working on them?

[peak dove]

SDXL 0.9 Vlad A1111

[inner ruin]

kohya is the way

I wasted like 3 days on fucking diffusers

[peak dove]

Vlad A1111 works very well on SDXL 0.9

[paper phoenix]

wait for 1.0 in case. unless you can spare cycles in which case consider it stretching exercises

[inner ruin]

I see it as an exercise, but now I'm getting good shit with 0.9 so

[high skiff]

I proposed a workflow that utilizes partial diffusion (thats what its been called now) for SDXL

It uses the base for part of the image diffusion, then passes the unfished version to the refiner, allowing for a higher detail images with less steps

This is cause the base handles the bigger shapes, and the refiner handles the fine details without stepping on each others toes

This workflow produces big enough quality improvements and also times savings that it has been implemented directly into the new diffusers pipeline with help from Pseudo, who recently left this server

[high skiff]

workflows are still baking. Trying to get my seemingly dead 3090 working at the moment

[inner ruin]

why did pseudo leave?

[hearty ginkgo]

Didn't you just get the 3090 5 days ago???? What happened????

[paper phoenix]

sorry to put it blunt sytan, its just odd to hear people parroting your name a lot like or lord l. ron. 😉

[inner ruin]

+1 to this workflow!

[paper phoenix]

can i copy and paste that to another server sytan?

[high skiff]

a whole huge collections of reasons

[high skiff]

my message about what it is? Sure

[paper phoenix]

gone?

[peak dove]

Base makes tx2image which then passes to refiner which makes img2img (kinda)?

[delicate grotto]

only diff is eyes lips and the medallion
but it is really slight

[paper phoenix]

aww i liked psueds moxy

[high skiff]

its been problems since I first got it, trying to diagnose why as it doesn't make sense

[nimble heart]

pretty sure it was yesterday

[trail bay]

He wasn’t the one banned ?

[high skiff]

yeah, he and I aren't scared to call out SAI when they are out of line lol

[paper phoenix]

timed out lots

[hearty ginkgo]

Still getting the blue screen errors?

[high skiff]

no, he pseudo left on his own

[high skiff]

yessir

now I am dealing with black screen errors

GPU crashes so hard in windows it struggles to re-initiate on boot

have to use some BIOS trickery to break it out of it, then it works again

[trail bay]

You’re getting BSODs where B stands for blue and black. Next up, brown

[hearty ginkgo]

😭😭😭😭 I been getting blue screens and blackscreens since installing comfy ui again ngl everytime I leave to work and leave a image generating my pc restarts 50% of the time.

[high skiff]

lmao

[high skiff]

oh, id id get a RED screen

that was a first lol

pure red on my monitor plugged into the GPU

that was my bad tho, I was overclocked the GPU when messing with the voltages, and it failed in windows, no actual crash

[sudden cliff]

Not that I want to actually follow him, but I noticed he's not really in much of the AI community on Discord, is he staying in AI stuff?

[hearty ginkgo]

What are you gpu Temps? Are they in the normal range?

[paper phoenix]

sometimes its just shovelling gravel in someones face while they're trying to make you a nice path though. ppl that work a lot on a project dont need a soft soapy rub but they dont need "i coulda done this" "only an idiot would do that" which i think some suggestions come across as. smart guy did need to work on soft skills though and hope comes back.

[high skiff]

We have our own private server of people selected from different communities where we all work together on research

[trail bay]

Yeh the red sounds very different. I think trying the GPU in the older system would be good

[high skiff]

our eyes collectively are now on training text encoders for SDXL, and we have success

as in, LoRA's with both Unet AND TE working

I can't explain properly how it works, but some mad men in there have it functioning

[sudden cliff]

ok, there's a lot of those private community things just like that with a lot of big names and I didn't see him around is all

[paper phoenix]

theres a model making scene.

[high skiff]

yeah, he ditched this server for many many reasons, but I and some other members here are in direct contact with him as we work on projects with him

[high skiff]

we are in that as well. Pseudo and I wanna take on a big finetune for SDXL at some point. He has an A100 and dreams haha

I mean, bro single handedly fixed everything SAI severely fucked up with 2.x

his fixed 2.1 is nearly as good as SDXL in some ways (better in others)

[trim orbit]

there's lots of splintering and secret keeping in the training sphere i've noticed. the few guides that make it public only scratch the surface. i shouldn't be surprised that elitism with new tech is rearing it's head once again

[high skiff]

and it was trained at 1080x1920 base res

[high skiff]

our collective goal in our server is not to keep secrets, but to find all of the variables before releasing something inconsistent

Same method with my SDXL workflow

our goal is for quality on content release, not just shoving out something underbaked and not understood

[trim orbit]

oddly enough people who were training the nsfw refinements for 1.5 that everybody used, kept their methodology very secret. 2.1 projects never really do any reports on how they're captioning and training either. it's all so secretive like we're in the dark ages gaurding tech from the opponent

secret club servers keep secrets. i've never seen it done any other way. you do you though

[high skiff]

to some extent, I have goals of keeping some very niche things a secret, as after all, I am unemployed and getting basically nothing from the work I do, so if I can capitolize off of small info, I will

[ionic dragon]

@high skiff join buildapc server or devcord, they might help you fix the issue

[sudden cliff]

It was all better pre-Discord and at least information would be retained in some possible way

rather than unsearchable

[high skiff]

I have run this issue across LTT, Newegg, NVIDIA forums, here, hardware swapped, and some other niche forums. They all kinda point at the same thing, but that same thing doesn't line up with my issues correctly

[sudden cliff]

Sensible, I'm employed in AI and don't just give everything away 😄

[ionic dragon]

does it have warranty?

[high skiff]

Anything I learn and wish to share will be posted to my github

(If) When I get my GPU working, I will resume work on my SDXL workflows, of which are going to have over 3000 words of documentation explaining how, why, and when my workflow is ideal, as well as why I made the choices I did, and how to leverage quirks to their full potential

[trim orbit]

discord being so splintered by design is part of the issue

[paper phoenix]

its flattened for AI hence the nickchanges, its not irc its still followed.

[high skiff]

3000 words is the current guess, but I see it likely going well over, as I am about 1400 in and haven't even made it past basic prompting ecamples lol

[paper phoenix]

you here is same as you in horses in bikinis or whatever, your usuage is part of the contract 🙂

[trim orbit]

it'd be nice if discord became a good client for a public interoperable infrastructure . they got an opportunity to do something good and right

/offtopic

[paper phoenix]

thats irc. lol.

[sudden cliff]

BTW this is SDXL's Starcraft knowledge:
'award-winning live action film still of a flat Starcraft terran siege tank, from the Starcraft movie, very alien world, masterpiece, best quality, 8k, highly detailed' and I put Abrams in negative prompt

knows it should be blue sometimes, that chrome rim

[vocal stream]

reading this one thing has reduced my optimism for sdxl a lot

[trim orbit]

right! i know i know. my dataset has no starcraft terms in it though. i should recaption to affect that existing knowledge better.

it's pretty good

[vocal stream]

damn if it's only as good as a good 2.1 that's an awful sign

[high skiff]

I am doing some big brain thinking right now, have some more things to test with the 3090 to try and get it working

If you guys need any info or have any questions about the workflow, feel free to ping me here

[royal rover]

when is SDXL 1.0 plan to be opensourced?

[high skiff]

no man, I mean his 2.x re-tune is just that damn good

like, just a sec

[spiral drift]

I do not think a node system is a good idea.

Node system only have slight advantages when the logical processing can be represented as a node graph without cycle in it.

However, many functionalities will need cycled graph. Once you begin to support cycled graph, the UI becomes absolute hell spaghetti. But if you do not add cycled graph support, you will need to implement all cycled functionalities in predefined nodes, which is another hell.

A1111’s Reference-only is a typical example that will need a cycled graph if represented as a node system. This is also why simple buttons and simple scripts have much more freedom and much simpler design that just work and directly solve the problem naturally.

A1111/SD.Next will not kill comfyui. The node system itself will kill comfyui. Directed node graph without cycles does not work for some functionalities, but directed graph with cycle is more than human can handle.

Node system is good but it is just not suitable for this problem.

This is why node system will fail in the SD community.

[high skiff]

this is the same prompt for these images:

SD 2.1 base

[sudden cliff]

FWIW I think that's hyperbole from him, trying to make a silk purse out of a sow's ear will never end up that great

[high skiff]

realism engine

his retuned base

[vocal stream]

I feel like I've tried his 2.x model (unless I'm misremebering) and it was much better than random 2 models but 2 is just kind of a crapshoot in general

[high skiff]

Its called Pseudo-Flex, and its a go to for diffusers researchers now

it has full terminal SNR, was retuned using lots of data from 4k nikon and Nat geo images, and also fixes all of the encoder issues from 2.0 (OMG did SAI do a shit ass job with 2.1 specifically

[trim orbit]

single handidly seems like a bodacious claim. realism engine is good but it's not the only good 2.1 model that exists. embeds allowed the base model to shine bright too. embeddings were actually were i had the most success training 2.1. i think it was built around them before people moved on to lora ideas

sdxl was supposedly 2.2 at some point in it's life

[eternal fog]

Has anyone played around with providing the refiner different prompts to the base?

[trim orbit]

also illuminati i think captioned better than re. rip that one though because of the whole licensing fiasco

[autumn forum]

Yes, it just combined them😅 edit: I shouldn’t stand by that claim actually I should do more testing

[eternal fog]

Captioning seems extremely important for LoRAs in this (I've only ever done them without training the text encoder)

I've tested Booru tags and it's shit and never does anything unless you use the exact tags

But if you use normal language they are a lot better.

[thin nova]

currently trying to get BLIP2 set up with kohya-ss/sd-scripts

blip captions are meh