#🏞|general-with-images
1 messages · Page 59 of 1
sounds like a strange problem to have haha
? whats that
yeah when i read that back it does sound strange 😂
wait, the new models (deep floyd for a start) are 20gb? So if we want to keep using the cutting age stuff in a few months locally we need the 24gb gpus basically?
I am allergic to cinnamon, so please ignore my indifference haha
yup
well
Photopea is basically the Photoshop ripoff alternative
basically yeah
yes and no
@digital hornet if you really want cutting edge make sure it's 64GB because DeepFloyd is currently only 1024x1024 and it's going higher
Just let me die if I couldn't eat Cinnamon.
cant you do all the layer-by-layer and whatnot tricks to get equal performance but for more time on a smaller gpu?
@dense tapir Ceylon, or Cassia?
cause SDXL and Deep floyd are gonna need 24GB VRAM, but SD 3.0 will not, as the devs have told me. They said that deepfloyd and SDXL have bloated parameters, and they will take all of teh good ones with the best data set and TE they have ever had and compress it down into SD3.0
that sounds like an EMA model, Sytan
damn, 3090 is at least reachable by hobbist to have 24gb vram, but 64gb vram sounds sad expensive
so how much will 3.0 need?
@digital hornet AMD is trying to fix that
if all goes well, the same as 1.5
Ceylon is the crap one Cassia is expensive and healthy for you.
ooo damn
that would be a hell of a lot of optimization
and im sure theres going to be tons of shit to get it lower anyway
it just takes cutting out the bad parameters and refining the good ones
yeh. I've been waiting for AMD to get good support for AI for like 6 years now, despite high vram it just isnt worth
finally
someone who agrees with me
team green for life
Stable Diffusion 3.0 vs out of beta Firefly
@digital hornet i mean the effort you're willing to put in is your call but i tested my vega card last month after a new update rolled better support out and it's finally plug and play and requires zero changes from my source code to work
anyways Sytan where the comparisons at?
For me I like 7900XTX with rocm. Oh, I am only doing 30it/s instead of 40. Yep, and half the cost.
theoretically we could have multiple SD 3.0 bases
each for different things like one for realism, one for art, one for anime, all of that
they all have 890m parameters geared towards that one thing so they are better than SDXL and deep floyd, but modular and separate
That would be insane
sure, and then a new cool technique comes out that all cutting edge models adopt and you have to waste hours to get a workaround/wait months
5.6.0 will openly support it
@digital hornet not as long as they're in PyTorch. it is a first-class citizen now. similar to Apple Silicon, but you don't even have to convert tensor formats to CoreML...
What we need is for AMD, Lisa Su, to get up off their asses and really support AI with hardware not software like FSR2/3
I think they will with their acquisition of Xilinx.
it's software that they've always been behind in, they've been better performance/$ specially with more vram which is the most important part for consumer AI because that's the thing that truly constraints you and not just make you wait longer
if TSMC didn't need to make a profit we'd all be rolling in vram
is the 3060 ti a good card for uhh ai?
those bastards
yes, its a good option for image generation
its what I have, you can do 4k and 8k gens on it, and you can do good LoRA training as well
good call singling it out to image generation
wait seriously 4k and 8k gens???
yeah, i do them all the time
using upscaler and highres fix
not pixel upscaling, generative upscaling, there is a huge difference
how much vram gets used per generation?
damn, I've been really debating with myself whether to get a 3090/4090 instead of waiting another year as my 3080 + paid Colab has been enough for everything, but if deepfloyd and other next gen techniques require 20gb, I guess I'll start trying to come up with the 2k euros to upgrade before that
get a 3090.
your probably better getting a 3090 over a 4090
deepfloyd was an nvidia plant job confirmed
all ur problems will disappear guaranteed
I would say wait for the 7950xtx
I can confirm
these guys think 4090s are melting 
no
2K? At that point just buy RTX 4090
No, if effing companies stopped with their madness of trying to go smaller and smaller and even TSMC said it is madness. They feel 2nm will be it as the costs, and time invested, will be too much. No one could afford a 500k USD wafer that rolls out about 200 dies.
Because 4090 is superior
..the 2k is for the 4090
performance per watt, but not everyone is on solar power like me
'oh yeh if you are buying a 4090 at that point buy a 4090' ??
or an even smaller 7950xtx thats faster than both of them for less money :>
i realized ill need a new PSU AND a new case to get a 4090, kind of pain
yeah buy an unreleased card
thats why i said wait lol
if I can get a 3090 TI 2nd hand for 850-900 and take the risk from 2nd hand purchases maybe that's most worth for running deepfloyd and similar
What the fuck is up with all this team green fanboi shit in here?
u wont find a ti for that price
The 7950xtx is right around the corner, and with ROCm, it could genuinely be the best AI card for consumers
trust me I tried
Pro tip: RTX Quadro 6000
for weeks
why are we even debating GPUs again i thought we all agreed to save up for a $2.5 million Cerebras CS-2 wafer
wait hold on
LOL, yep
wait nvm
no shot I'm risking wasting 100 hours of my life over the lifetime of the card on figuring out fixes for bad AMD software support
i was thinking about it and once we buy that it should probably stay with me so i can test it out first
HOLY HELL
i'd still be on AMD if they had 24GB VRAM when i bought my 4090
i was thinking of buying two 7900xtx or whatever the hell
@bold cave that's a traditional hyperscale supercomputer called Watson
No, Cerebras is the be all end all giga wafer ATM
For those with more money than brain cells there is Nvidia ...for the rest of us there is AMD.
I thought quantum computers were the end all 
Cerebras is cutting-edge stuff, they spent $600 on their platform and trained an entire large language model in like 3 hours.
theres one for 840 listed as 3090 TI on the local in-person ebay from a few days ago. Though most are 3090 without TI at that price
I said of wafers lol
quantum PC's aren't wafers :p
this is one cerebras
whoa
have you guys heard of this single cell yellow slime thing?
I know, the truth hurts there Sen. Fact is stop feeding that damn beast
very little believe it or not!
@bold cave i explained this earlier but quantum computers have a goal called quantum supremacy that demonstrates superiority over traditional CPUs and currently they only succeed at Boson Sampling but it's "a pretty big win" there, from >9000 years runtime to half a second
its designed to have a huge surface area, so its actually really easy to cool
yeah and at the same time cracking all our passwords say gg to ur bank account
they haven't demonstrated its ability to beat a simple GPU in that task yet
oh really
Yeah, cerebras is a little big lol
GPUs are really friggen good for that, now.
i am doing cat images again
i am going to compare the 16gb ultra and 2gb ultra
AAAAAAAAAAAAAAAA
you grab the shadow file or a list of salted hashes etc and just go to town locally.
THE CEREBRAS WSE
wow
broooo
i wish they hadn't nerfed Colab pro so hard that I now need to upgrade gpu so hard. 100 minutes a month? The A100 has 16gb instead of all of its ram and is like 5 times slower than my 3080? suuck
A100 is 40 or 80GB
bru who cares those are never going to be open to the public
180,000,000GB/s
ohhhh
anybody can buy one
if we're gonna drool let's drool over the a100
they switched to MSGs? EWEWWWWWWEWWEWEWEWWWWW
yeh if they are not shared between multiple users like on Colab and thus not having all their vram avialable to you
tile resample, what model do I use with that preprocessor?
A100 is 40/80GB
MIGs*
my friend has an A100
Multi-Instance GPUs. they divide an A100 into 7
makes me want to vomit
it's supported directly in the hardware via SR-IOV
have you guys heard or seen of this slime thing?
though yeah now on Colab it's saying 40gb for the A100
slime mold? yes
@dense tapir Little fun fact for you
but it';s like 5 times slower than my 3080
the Cerebras chips have a 100% yeild
I saw that happen too
in runpod
its bizarre
i think in theory slime mold could be used to improve technologies
cuz in theory it should tip thru training like a mf
depends on the current ecosystem if it's overloaded they'll cut it down. they banned SD-webui recently to fix their capacity issues ahahahahahaha
There are 2 models, thats why
that's only for free Colab, I'm on paid
there is the weaker 40GB A100, and the full fall 80GB A100
What is never going to be open to public?
@digital hornet i am too and they cut it down once you burn through compute units
cerebras, except it is
where can I buy one
well yeah, after you are out of compute units you are basically a free user till the end of the month
@smoky oak No failures? The way a GPU wafer works is there is always failures and they keep making lesser version cards from those failures until there is one that is just too far gone to make into anything.
i burnt through my compute units allocated for a whole month in like 15 hrs. in fact, if you're a Colab Pro subscriber, you can't even use the Free tier without burning credits
arent cerebras a developing technology still
Nah, never will be xD
yea google collab was a scam
They run perfected processes to make sure there is no failure
And its questionable if they will surpass Nvidia in that area
Damn
oh shit the A100 40gb uses that much? the fuck
first gen was 16nm, second was 7nm
13.08 per hour out of 100 a month, come on
in a world where we are on like 3nm
@dense tapir it costs $2.5 million US dollars for one wafer system
they are on 7nm to make sure there are no issues
and if I remember correctly, Google Collab doesnt even let you choose ur GPU
its a shit platform from a shit company
at 2.5 million for one unit you don't care how many wafers you destroy
Colab was so insanely good before it was paid, and then even better for $10/mo but since SD hype and everyone using it they've nerfed it soo much
For that meticulous measures no doubt.
I trained GPT2 in 2019 for a full month of nonstop Colab when it was all free
The nerfing really began with Deepfakes and the bans in 2018 then it calmed down and was alright then AI art/SD forget it.
yo guys, what negative prompt would you use in order to try to improve a text to image generation that includes words (fixing spelling and stuff like that)
nah, they had PLENTY of capacity before the recent rush of stuff - mainly Stable Diffusion and similar
@dense tapirThink about it this way
the A100 can do 312 teraFLOPS of AI
A first gen little brother Cerebras can do 1.2 EXA FLOPS of AI
@dense tapir he's trying to control the way you think 
What model do I use with this preprocessor tile_resample?
I guess we didn't get that
and just load up the image in there
no tile for 2.1 😦
There is Colab Pro+ too
nerdgasm over
i think im gonna delete Zovya
I gues for 2.1 we simply do not have that model so I wonder why it is in the preprocessor?
got distracted by thefastest wafer chip in the world 😅
if you wanna get scammed while you're gettin scammed
yeah i could tell
i asked you about the comparison earlier 🥹
@oak osprey post shrek
Sorry, I am foing it right now lol
@oak osprey what did you mention about the p40
You have signed away your rights to live
p40? the nvidia? 24gb? it's cuda 5.7 or so pretty old
i probably shouldnt have used high res fix for a comparison
huh
This what SD is ment for
your future is in nvidia's hands at that point
because the results will be different anyway then 🤔
now this is a weird phenomena lol
@hasty nova https://github.com/huggingface/diffusers/blob/main/scripts/convert_original_stable_diffusion_to_diffusers.py
HMMM
P100 at only 16gb is better
not sure why it put a picture of them in the forest on their hoodie in the forest
1 is the 16gb zovya
nope
and 2 is the cleaned up 2gb model
i love how his sweater has a representation of the child that lives within all of us
the cleaned up model is 5.6GB
P100 > P40 just speed wise?
speed, and I believe uses a newer cuda
Why 😄
no it cleans up to way less that that for the ultra model
I mean i dont use Colab anyway
Ahh I thought had same cuda cores
there was tons of junk for the ultra zovya model
Dunno what i would use Colab for
@boreal falcon easy to burn up through compute credits in less than a day and when you want to use Free Tier Colab with a pro+ subscription, it deducts from your credits
in other words you'd need two colab accounts to continue to use it the way you've always done without eating compute credits
Cuda 6.0
cuda six point bro
cuda60 jesuz crust
what card is that about?
That's better than not having cuda cores like amd cards 🤔
P100
4096 bit bus is more insane IMO lol
just buy AMD
200 bucks and a fan cooler
Sytan, memory bus doesn't work the same way now
why would it have changed in the last 24 hours? lol
It isn't a bad little pascal card
it was like a slow change over time. the NVIDIA 285 card had a higher bus than the 1080
I almost went for it
I am beginning to think you just have a poorly calibrated monitor, cause they are nearly perfectly exposed in a histogram
they're exposed? i don't see anything
They look perfect on my color and gama calibrated monitor
kitty cat
har har lol
Two issues stopped me. The cooling solution is horrible and deafening, and it lacks tensor cores
essence of gato
Typical Shrek response
i think i want a cat now 
you don't want tensor cores. no one cares about tensor cores. you want to run DeepFloyd. you want vram. tensor cores? pfft. it'll just take an hour longer
you do you
DeepFloyd is the future, and so, we must go backward to NVIDIA P40 24GB
I mean, you can give a slower card more time, you can't give a low VRAM GPU more VRAM
you don't understand, Marty! we have to go back to the past, to get, to the future!
SDXL is parallel to deep floyd lol
they are basically the same thing at base
oic
Did snoop just copy an image mid render
where?
those look hella dope
i dont remember copying an image mid render :-)
the ones on the right look a tad more coherent but thats it
I am obsessed with this dress lmao
i am going to redo cat image
and put high res fix on this time
i need ultimate cat
Gato^2
Nope, 2.1 didn't get that model.
the ones on the left are holding a secret they want to tell me. the ones on the right, i have met their family. we ate dinner together at their cottage in the Swiss Alps. there are no secrets, we know each other too well. it is a boring. I lust for the left side, the memories of the past. the discovery phase. the secrets.
come join 1.5 then
Nope

hey sen do you know what tile resample would do if you were to use it for a gen?
perhaps its for a reason no one bothered to create a 2.1 model :kek:
theres only 1 wym
cat! :3
i am divorced 
not not good enough 
the ultimate cat will arrive in like 30 years
These colors are gorgeous
I shant say yet
tbh we're not there yet for peak Cattiness
more tests!
women named Kat are always so hot
the same model is on the same side each time, so make sure to keep track of how many times you like the left or the right more
you can't make me
agreed, right looks a bit better
anyway my beautiful gato generation is coming along nicely
good to know, good to know
right side you can really grab a handful of, if you know what i mean
currently in the high res fix stage
left loos better
just make sure you keep notes so you know which model you visually prefer
I am gonna test a range fo subjects
right looks like jeff bezos wife after purging her reptilian skin
I can try
didn't Grimes say we can use her for AI?
thank you 🥹
you know what that means
yeah but who would want to 
how risky is it to even get a 2nd hand gpu (3090 or better 3090 ti)? finding a bit hard to quantify how much more 'expensive' it works out due to the risk
not risky
ok i laughed a bit too loud...
like 1 in 15 chance of it turning bad?
if u can inspecting it beforehand and buy from someone not shady
I have owned multiple used GPU's, never had an issue
it is much better to buy used
@boreal falcon glad someone else found it, that's what i meant when i said "you can really grab a handful from the one on the right"
I mean at minimum it's risky in the sense that a new one will have warranty and sometimes shit randomly stops working, so not being covered by warranty increases the risk
it does, but in practicality it doesnt happen
but also risk from the GPU having a not immediately obvious issue and that's why it's getting sold
GPUs just...sit there, untouched, after u install them
if there is any issue, it wont boot
so if you can test the GPU in person you should definitely put it through the fuzzy donut test
it will crash immediately during a stress test
exactly
nah, there's sometimes issues with e.g. overheating later because something isn't soldiered amazing
if it can run it for a few minutes then its 99% just fine
great benchmark to prove health
fluffy cat!
yep it'll surface coil whine, and other BS
my old GPU had hella coil whine lmao
damn maybe ill straight up message the guy who listed 3090 TI for 840e 2 days ago in case it's still available then
it's mostly a problem when you LC it
:O
Gatos
what sampler did you use?
would you believe 35 steps
the perfect breed of gatos
I almost always use 15
Chonc-kat
Gato Supreme
Id overpaint it or photoshopped
@digital hornet https://youtu.be/Cfy0cr9VorE?t=3355 you reminding me of this scene from the mel brooks film where the guy tracks these chairs down to a couple in Siberia and begs to buy them
It's the late 1920's Soviet Union. Ippolit Matveevich Vorobyaninov was an aristocrat prior to the Russian Revolution, but in addition to squandering away most of his wife's family's money at that time, lost everything during the revolution and now is a lowly government bureaucrat. He learns from his mother-in-law, on her deathbed, that during th...
bruhj
damn in 2020 I've bought a 5700xt for 370, then 2021 Ive gotten 3070 for 720 and now already I need to pay 900-2k for a 3090 or 4090, I swear just gpu expenses work out more than buying and owning a car
:O HUSKEY
great deal. buy a liquid cooling block too.
sorry its so low quality, can't zoom in or it flags for NSFW
no idea lol
stupid clyde bs
Clyde always does that
Clyde sucks ass
Clyde sucks ass
Anybody have any suggestions to compare?
@smoky oak jack black riding a bear in the swiss alps, is an oddly difficult prompt for most models. give it a whirl.
u always have to inpaint eyes
eyes getting bugged out could be the medvram options for a1111
cant wait for this training to finish just to see torch 2.0 screw it up
yo I like it
trying Jack Black ATM
it took a LOT of code changes to make the jack black prompt work. needed to disable tiling VAE, switch to MSE, use Karras, and then, and only then, did it kind of work out regularly with Stable Diffusion 2.1
its cuz jack black is most generic name ever
ugh actually fuck the 2nd hand 3090s, ill just spend the money on and time on a new case and PSU this month, install them to fit the damn 4090 and then buy it next month
LMFAOOO
i see some of the facial oddities but mostly resembles my fixed stuff, so i guess that's really as good as it can get
damn that was fast

mine would of taken 4hrs to do that
Alright, trying the blue girl now
blue gal is hawt
The provided prompt isn't exactly that good, so reserve expectations IMO
i feel like we taken nerdy basement dwellers to another level
i better not be getting lumped into that
speak for yourself, i live in an RV and i'm homeless 
all i am doing is making cats
An RV is a home :>
OK YUP
officially in the canadian census it is not
F
idk if that is worse or better
it went lewd didnt it?
👮🏽
there is a lot of boobage here

CPU bottleneck doesnt really happen as easier for SD with a 4090 as it would for gaming right? As my 5800x3d would likely bottleneck a 4090 hard in gaming
lmao
idk i have a 5800X3D with 128GB RAM and a 4090
damn
what the hell you playing that will be bottlenecked
i like the fact it looks like she doesnt have makeup on
remember to keep track of which one you like more
I will be sharing which model is which soon
do you end up using the RAM much? I only have 32 and dont want to get more ram before next year when I'll switch to the new RAM+mobo+CPus?
@smoky oak the odd way you masked those reminds me of when i tried "modest nsfw turtleneck" 
I wanna do a few more comparisons, any idea?
I can already tell which is which bc of the freckles
@digital hornet yeah but i run Vicuna, LLaMA, and quantize models like it's going out of style. it can quantize LLaMA 65B and run it in Llama.cpp without running out of memory, though for quantizing you do need about 250GB of NVMe swap space
those chickenpox freckles are zovya's watermarks
which do you think is which?
im like 90% sure its a comparison of both zovya models
it is
so you really got sytan there sen 💀
Its ultra vs pruned
with 128G RAM once I load LLaMA 65B i have about 58G RAM left 
I dont really care for running language models locally anymore but if people start making huge diffussion models andusing the same tricks...
yeh I was about to say... they both have them loooool
If I were to vote tho
I would vote right
just a tiny bit more depth
@digital hornet well DeepFloyd has a text embedder. a whole-ass language model called T5
Seems to be that most say right, interesting
but its minor
@digital hornet i can say i would have been fine with the 64G RAM i had if i never cared for language models
the ram was cheap enough i figured, that'll be really nice to have.
damn, I really dont want to buy RAM now just because I know that next CPU upgrade will require the ddr5 ram anyway so any ram bought now will be used for a year
@oak osprey how much is your setup
lost track
DDR4 is super cheap ATM
DDR5 is slow right now too
give estimate
I mean with the new CPUs you need the new motherboards and the new ram you just can't use ddr4
2800 gpu, 500 mb, about 450 mem, 500-1100 storage, prollly $5350
that's why I only upgraded to 5800x3d end of last year so i wont have to bother with new ram/mobo
i'm paying canuckistani rubles, so
ah lol
3994 USD
i already had the motherboard for a few years, and the case.
and the storage.
hm actually 32gb extra of ram to bring me to 64 is only an extra 90euro, but even then it's like 1750 for gpu + 200 for new big case to fit it + 200 for new PSU to power it, it adds up to a lot
but it has two 16tb disks in a RAID1 and 1tb of nvme
@digital hornet that's exactly the mindset i had 
lets see if you have more self control than i do
Yeah, DDR4 dropped massively in price these last couple months
because of the "i need the latest and greatest" clowns that do us these favours
Stupid ass clyde
FFS
JUST SEND IT OH MY GOD
here
There
god
have to send it in a different server and copy the link
LMFAOOOO
those boobs look a lil too big for amish i think
Alright, I am gonna do one last test, any suggestions?
They are supposed to be medieval pesants lol
try to get a "World's Best Boss" coffee mug
do spider-man
I'm going for realism, not memes lol
👀
oh yeah indonesian hotbody woman spiderman
its pretty conclusive at this point
malformed outputs galore
right keeps winning
no not indonesian spider-man
I vote right again
alright, everybody cast your picks between right and left
I am generating the last comparison for now
right
Alright, I can do that for one last comparison
Don't really know what I am supposed to do with this...
I am not well versed in what diffusers are and stuff.
right again
that is incredible lmao
You can see more depth in the shadows
yes they are all damn good
the shadows are insane on the right
that ones the Ultra model isnt it
alright, I am gonna finish off with a one to one portrait of a pretty woman
math doesnt lie 
As an AI Language Model, I do not have opinions or personal preferences. However, I can agree that these models likely have their strengths and weaknesses and are likely to compliment each other in synergistic ways, moving forward.
fuck off with that censored bs
stuff like that made chatgpt a joke
why anyone would still use it for creative outlets is beyond me
hey, chatgpt taught me to write censored python code in less than a couple weeks
it's good if you literally have no ideas and need to burst the creative block bubble, but beyond that it pisses me off when people try and write with it without editing its result, and sharing. it just writes TERRIBLY BAD.
there's a ton of creative stuff that aren't nsfw for a start, anyone daeling with those wont be particularly hindered
In case you guys are interested in dreamboothing Im also gonna post my results and determine whether or not A) Dreambooth is broken bc of Torch 2.0, B) Its broken bc of A1111 or C) It's broken bc of the model itself
Is there a general chat for video sharing?
@bold cave if you want to see the only good thing it can write, have GPT4 write you an imaginary episode of I Think You Should Leave, with Tim Robinson it's a surreal comedy show where nothing makes sense
like it's dumb how limited it is but people on discord thinking that everything that can't porn isn't 'creative' is kind of lol
people think that?
well i don't care that it is censored. i hate how repetitive it is and how "on the nose" its writing is.
like 5 lines above yeh
I asked for ideas about a haunted island last week :(
if you don't know what i mean, you tell it to write "a story where X happens" and then at some point in the story it'll blurt that out almost verbatim. at least it does for me
SEE
its not just porn
the whole thing is just brainwashed
ok but its not just porn... it censors lots of shit
it's brainwashed but you can def still use it for plenty of things
don't worry guys even when you jailbreak it, its writing is still awful
on my discord server, the bot uses Anarchy as its default persona. it sucks hard
Alright, about to finish the last comparison gen
Help me cook rice
As an AI language model, I cannot provide instructions on cooking rice. Cooking is an extremely dangerous activity, where people can get seriously hurt.
can you write a script of an episode for I Think You Should Leave where the character is trying really hard not to talk about hot dogs
this is the best writing prompt for GPT
right still
it's not dead yet though! :P
Ok that one is a tricky one
unless flower is meant to be in hand
I see more detail fo' sho on the right, however the increased depth of the shadows backfires on the eyes
which in that case left
i pick left side because she's more modest
still, I like the details on the right more
I will say, I did specify flowers in the background, not her holding them
ah ok then
alright, so right it is again?
it just has more intricate shadows although wouldnt necessarily say "better"
ye
watch him troll us
Photoreal ||pruned||
"All of you with varying backgrounds, eyesight, and mental eptitude, please, develop a universal answer for me on a subjective truth ❤️ "
💀
He trollin
hey guys can i input a 1024x1024 image on controlnet for a 512x512 generation?
With controlnet which preprocessor goes with the color model?
yes
u can, but u shouldnt
its outdated
thats how we used to upscale before CTU
oh so i should use a 512x512 then
Yo im gonna test to see if what sy says is true
cuz if it is, then that might be good news for my dreambooth training
a smaller model might be easier to train
if he's right, then maybe the added junk in the 16gb file makes it worse?
it probably does yeah
what's it based on
apparently the clip thing is also buggered on ultra
because yaeh looks pretty good
is it a sd2.1 finetune or? I missed some of the episodes of this chat
1.5 finetune
I will now say that Zovya is the best model I have ever used
the pruned version
presumably 2.1 can be better than 1.5 if as much time was spent on it by as many people but 1.5 still soaks up most of the resources
I'm kind of proof of that - my model is decent, almost kinda close to a nice 1.5 model (without nsfw stuff though, I didn't feel like training that in because I am not into it), except I barely know what I am doing and I don't have the skills a lot of good 1.5 trainers have.
2.1 is inherently flawed because it has a worse text encoder, meaning that it has a worse understanding of what your inputting, so while it may have a better data set, it's not capable of retrieving the details from that data set is effectively as 1.5
It also makes it a huge pain in the butt to train, because you need drastically different training parameters based off of what kind of things you're trying to train into it
The devs in the server themselves said that, 1.5 utilizes the open AI clip text encoder, Wallace 2.0 and 2.1 utilize an in-house text encoder
*while, not Wallace lmao
That to. Hopefully v3 if it is anywhere near combines the strengths of both 1.5 and 2.1, though I kinda doubt it because of where a lot of things seem to be headed.
As I have been talking to the devs about it, 3.0 is supposed to have a considerably better text encoder than even SDXL does
ngl I assumed you can just switch text encoders out when retraining/finetuning and at most just need to train a bit longer once
Ooo great! I'm excited. Hopefully it releases in the same ways as 1.5 and 2.1, where it's still completely free for anyone.
That would require retraining the entire base system of the model, which is the hardest part of AI. Are fine-tuning models on top of the base of stable diffusion is nothing in comparison. I believe stable diffusion 1.5 took something like 180,000 hours on it a100s to train
Sorry, voice typing is tripping me up at the moment
My bad, 1.5 was around 79,000 A100 hours
id assume they mean its bigger but not necessarily better
Yeah
It has a lot more information, but not all of that information is high quality
More than likely, the referring to the fact that the model is not just a one trick photorealism pony, but you can still get digital art and stuff out of it. Which in the grand scheme of things is not important when we have several different specialized models
I havent looked into it obviously but at least with previous techniques and models it would be the kind of thing that you can switch, freeze everytthing but the most relevant layers for the encoder so you train it to use the n ew one quicker, and then train a bit all of it and then finetune the rest, but if it's not done I guess it's not as simple here
so it shouldn't be as bad as training from scratch but I guess it can still be much worse than just finetuning the part people typically finetune anyway
👀
Very interesting, I have experienced almost 0 noise offset from kt
you can do better than that now thanks to pytorch2 and xformers and accelerate.
compiled graphs give something like a 46% speedup when training on an A100
so in theory you could hit 40k hours and get SD 1.5 now if you do everything correctly. wonder how many of those hours were spent fixing issues
Yes, but you also have to factor the compiling of billions of images
The data set changes with every major release of SD
yes and no
1.5 and 2.0 have different data sets, as well as 2.1
the previous work still contributes to the new dataset
I remember when we couldn't control poses at all lol
tbf that part matters much less when people finetune enough
I generated a hot Samoan guy, and tell me why it made the background the American Flag lmao
we are all living in america
Cause it smelled what the Rock was cooking?
i was on about the pruned model
LAION 2B (and subsets) were used for both SD 2 and SD 1.5, while LAION 5B is used for SD 2 and 2.1, which is a superset of LAION 2B: https://laion.ai/blog/laion-5b/
it was also done by a separate group than the folks who trained SD, though SD provided compute (again)
Testing something about this pruned model, hmmm...
man it costs like $12,000 just to store the data for LAION 5B with hard drives, locally, not counting electric use
Nope, nevermind, still can't do men properly
i hate how the SD devs cropped all the images in the training set when they were too large
good stuff if you want out-of-frame half-missing subjects
Yup, cropped rather than down sampled, very annoying
any way to disable vae in text to img? outputs been ass on certain models since installing
@bold cave membersense 2021, 47 items sold, 18 five star reviews 👁️
I might have to get it lol
Honestly, I can probably sell my 3060 ti for around 300
im hindustani and i find this quite funny so anyone offended just go away 🤣
I never saw this before - WARNING:fvcore.common.config:Loading config D:\stable-diffusion-webui-ux\extensions\sd-webui-controlnet\annotator\oneformer\configs/ade20k/oneformer_swin_large_IN21k_384_bs16_160k.yaml with yaml.unsafe_load. Your machine may be at risk if the file contains malicious content.
it's facts, bro
you can just set VAE to None, next to model
if you dont have the VAE option you can enable it so you see it from settings first
set vae to none?! what the hell does that do
does it stick with default vae?
the 'hard baked' option
i think that just turns vaes off
really? 🤔
as i understand it they're responsible for changing the weighted noise into the img, which is why the VAE matters so much
where in settings can I toggle the vae option
hah I was just checking if I can get a 300 for my 3070 when I get the 4090 and related crap
hmmm apparently VAE weren't in use by default before 1.4
idk they asked about disabling vae
i guess you can revisit and explore the terrible outputs from 1.3 era.
@digital hornet i tried to set mine to None and it blew pytorch up but i probably did it too naively
I think it was only 2.1 models you can do without VAE? not sure, I just use a custom one mostly
I sometimes wonder if the ai know what a "headwear" even is :P
also collars :P
The reason I think I can get 300 for my 3060 TI is because it's an FE
Which is basically like liquid gold
My only gripe about this 3080 is it's MSI
How can a face be turned into a face made out of something else? For example, a famous person's head in the clouds made of cloud
for 2.x you have to enable the upcast final layer to float32 or some shit
I looked at that, I don't think that's what I'm going for. It's more like the entirety of the face is made out of it rather than a face among it
wut
I tried shuffle and canny ControlNets but it just made a face among it and made outlines of the canny line while parts were transparent
Something like this is what I'm trying to go for, like jabba the hut made out of ice cream
(not mine)
why 300 for a fe 3060
Cause FE's are extremely hard to get
I am 99.9% decided on buying this GPU
Sytan going to do Sytan things
a 3090 for 599 is get it
@dense tapir somebody a couple miles away is selling a 3080 for $350
That's for the 3060ti :/
3080 10 or 12?
i can get a used 12gb 3060 for 300$
a new 3060 with 12 is 320
Alright he said it's a 3080 MSI 10GB for $350
Still, even just 2GB more is huge for LoRA training
I am confident I could sell my 3060ti FE for $300, so it's really a small jump
3080 12gb tears the 4070 12gb to shreds until DLSS3
for our purposes no competition
with 12gb you begin to get into the dreambooth realm
can the p40 24gb do dreambooth?
yes
the problem is none of those cards have any cooling to them
they are server rack cards
thats not a problem. have 3d printer and extra fans
the fan adapter sticks out the back with a blower fan is as loud as a damn jet
so loud you can barely talk over it
that matters on which fan you get
smh, you will soon see
it requires a shit ton of air pushed over it as it has no heat pipes.
Ever been in a server room? There is a reason they now have ear protection before you open the door.
I wonder how much faster a 3080 would be than my 3060ti in gens
A lot
how much ram would you need to run a p40 though, 16gb work
and those 2 extra GB VRAM would allow me to run vicuna 13b as well...
with just a cheap ryzen setup
thought the 3060 was 12Gb or you just have the 8gb?
I have a 3060ti
that says ti on it
ti is 8gb
that's because they have more than one GPU in that room
Don't rationalize with me. The fucking fans are hideously loud
@wispy nest basically you're going to get all of these lazy guys telling you not to do X or Y because "it'll be hawd" but it's all fine, people have done it. get a liquid block for the P40 and be happy you saved like 2 grand
Now if you stick it in a garage then that would be fine
stick it into a mineral oil bath
You and that damn mineral oil
it keeps me alive
haha
don't let him pour me the fuck out
shrek sticks theirs in the swamp water
I tried to find a water block for a P40 but it is so old I couldn't find one. I think I did finally and it was 300-500USD. Then I would need my open loop too and that isn't cheap.
There is a channel I watch that uses all those old things.
as long as you get something on the die you should just use some clamps and call it good
yeah make sure the clamp is metal, and have it properly rubbing on the contacts on the backside of teh PCB so that it holds it as tightly as it can. it's okay if you crush the PCB and the solder joints a bit
Oh, and the P40 takes a special cable for electric as the standard is for GPU not Accelerators. Cheap around 14 bucks on Amazon
yeah i saw that
my only issue i can think of is if itll fit next to my other gpy
gpu
No idea with the big bastards they are now
maybe ill just take it out and use the integrated display
P40 is slim
i have a soldering iron

and i knows how to uses it
the issue is vram, not performance, @dense tapir
if something is going to crash rather than run, any performing at all is an improvement
i like intel name for their cards, its sexy
what a deal to get a 3% performance loss from Intel
Just letting them know.
shrek literally lives in a swamp and has a better PC than 99.9% of people
See it runs 250w now let's say I got a 3090ti that is 450w. the P40 takes 5 times longer to do the same job. I will gladly pay for a 3090ti because I will feel that with as much training as I used to do.
honestly should just move my pc to spare bedroom and buy a 20ft HDMI cable to my monitor lol
3090ti is 8gb also
?
damn that is like 5x as expensive as a P40
i was looking at 3090s and decided the $800 difference to the 4090 was worthwhile
Please generate an image of a 3-year-old girl with realistic features. The girl should have white skin with freckles on her face, and her hair should be styled in two ponytails. She is wearing a white dress with red polka dots and is walking on a street with a reddish sunset in the background. Please ensure that the image quality is excellent, with sharp details and realistic colors.
Currently, there is no public bot on the server that generates images. There is an experimental bot available for early server members & Stable Society. You can obtain the Stable Society role by winning our weekly events #⭐|pow-info #1087493421209485393! However, there are plenty of other ways such as the official https://beta.dreamstudio.ai/ website or by running Stable Diffusion locally using your own hardware! Check out #1080946152318443610 for more details! You can also stop by #1025467151206854736 for any issues you experience while using DreamStudio or #🤝|tech-support for any problems you encounter while installing it locally!
why cant we just hotglue 4 1080's to get a 4320 GPU
@autumn moss yikes on trying to generate a 3 year old
💀
prob an fbi agent looking for easy targets
Estoy aprendiendo a utilizar vamos a probar
nada mas no entiende, sorry
si
@wispy nest P40 is 183 GFlops 3090ti is 40TFlops. That is about 214 times faster give or take.
i can make you a 3 year old, but they ain't gonna be human
i wish the A100 weren't so slow. its only upside is 80GB VRAM
all these people raving about how fast pytorch 2 goes on the a100 are only because it's so god awful slow
i should really just upgrade to a 4080
what it/s do you see with A100?
4090 than?
I am saving for one, yes, or the 7950XTX if I see some real world people trying it
Fuck used
Unless you know the person then cool
nope, DOA
Titan is
Seems Nvidia has scrapped the 4090ti and is concentrating on the Titan and 48gb
I am sad because a ti would have pushed the 4090 cheaper but titan will do nothing to the consumer grade cards.
i think nvidia hates its consumers
it does and
tbh, most expect it to go full on AI/ML and leave the consumer gpu market. Let Intel and AMD have that in the next 10 years
thats why you get p40 and just go sloth mode
SLoth mode, hehehehe
I hope they do it as well so I can finally kiss their ass on the way out. Here ya go Jensen.
tbh yeah why would you even need 4090 unless you generating cat pics
the hand went a bit buggered but
Games are getting stupid cause of the lack of any optimizations
Indie games are much better at it
do people actually game in 4k
games are getting bad anyway
most games recently seem to be launching as bug ridden messes
i dont see the point of 4k gaming unless its a fpv
its cuz i dont play games and just want more cat pics
some QLED
yeah 4k
i dont even own a tv tho
just bought a definitive audio surround sound system and doesnt have tv lmfao
7.2 has bluetooth
100w per channel
blacks look like shit on any LED tv
was trying to find that tv with dual screens, but almost impossible to get it
jeez i came back to all of you Boomer'ing out on me
"wah video games arent fun anymore" man we started out with god damn pong
you can go back to that. it likely still runs in a museum somewhere
😄
wonder if a cat is cheaper than a gpu
if we're using a frozen moment in time at purchase, the cat wins out. over the factor t (time) we're going to see the cat spend a lot more of your money
speaking of whom, she slept all day and will keep me up at night now
when you guys finetune* a VAE, what is your goal and how does the dataset look?
@dense tapir on my way to buy it
the WSE 2?
dont text and drive
Somebody is selling one for $350, I'm gonna buy it and sell my 3060ti for around the same



Lmfaoooo
bro i been chattin with a kid 💀
im raggin on others for talking to young kids and you're not telling me "uhm mister" 😭
ok true
Mister shrek
you are at the age where i can start to begin blaming all of my problems on your generation
Sir Shrek's alot
that's Mister Shreks-a-lot to you 

i got big jars and i cannot lie
I do have my driver's license test in 3 weeks tho
guys if the Dreamworks or Pixar guys come in here, THAT IS NOT SHREK. ok? it's just some green ogre ok no it's not even that, it's just a fantasy character
Well. For my permit
did you guys hear they're adding Shrek to the next Final Fantasy?
Same
i cant wait to be 69 years old
I'm old enough to hate the next generation also
I'd rather live in the woods with green ogre than deal with them
that's MAH swamp
I bring gallons of peanut butter and waffles
Let me know your it/s after you get it installed.
Will do
Just raise chickens

So am I
So you were rendering this fast just on a 3060?
3060ti
That's still fast
I get about 11.5its/ on my 3060ti
The slowest part of the comparisons was the model loading
this is my 3080 as a comparison for benchmarking
Drive speed is a lot of it as it takes me 2-3m the first time around due to 100% HDD activity.
I was having to load that 17.4 GB ultra model, so it was taking like 30 seconds a Gen just for that
once in my ram it is 2-3s
yeah
I had to go to CL16 from CL14 when I added 32GB more. I was at 18 but managed to tweak it. Man, at 3200 CL18 vs 3200 CL14 I felt that
Model loaded in 2.3s (create model: 0.1s, apply weights to model: 0.6s, apply channels_last: 0.3s, apply half(): 0.5s, move model to device: 0.8s)
I am not going to mess with NVME as M2_2 takes all my slots away from me so I will raid 0 a few SSDs.
I have it in my UEFI
even windows10 does software raid
a tad slower but not by much
I tried raid ssd for a while . its slower for speed, you just get more storage
Well, that is what I am going to do since I will be damned if I do another nvme and lose all my slots
What
I meant more storage on 1 drive, like C: drive
I saw a crystal benchmark 5 seagate HDD in raid zero. The same one I use (2tb) and he had 10tb and was as fast as my gen 3.
NVME M.2
i use RAID-1 on ZFS
I use m.2 for all software and boot, and hdd for storage
haha yes they are...
2x 16tb mirror for /archive and 1tb nvme for /
i would know since im using a hdd as my os drive
I also used RAM drive for a while. then NVME came out and its basically the same speed
yes it does suck
hdd as OS drive is okay if you have enough RAM to store your "working set" of data in the cache.
and never reboot 
it takes years to bloody load my computer
it'd be way faster if you ran Linux.
and im stuck on it until i can get an ssd to replace my old ssd
5 2tb seagate in raid 0 sata HDD is about 3.3-3.5GB/s. That is my nvme m.2 gen 3 speed.
M.2 and ssd are same speed unless you on different bus ports 🤔
who cares, make backups
welp im going to disappear now

