#🏞|general-with-images

1 messages · Page 60 of 1

hearty karma
#

bye bye

dense tapir
#

personally I am retiring my HDD

wispy nest
#

Intel use to support the faster memory but idk if that's true anymore

wispy nest
dense tapir
#

With two evo 970 sata ssd I will get about 1GB/s so should be fine for this. If not I get another for about 1500MB/s

wispy nest
#

Speed is key 🔐

#

Jk I have no clue what I am talking about

#

P40 or 3060 someone make the decision for me so I can order it

#

Raid 0 is where the speed is, and also where none of the backup security also is ;P

dense tapir
#

yep

wispy nest
#

I boot from dropbox

static tusk
#

personally I wont buy anything other than nvme now

dense tapir
#

I wish I could run another NVME M.2 gen 3 but B450

#

and riser cards for that are stupid expensive

#

Still lose my second slot

static tusk
#

what other cards do you have installed?

dense tapir
#

none but a 4090 will zap so many slots.

crimson dawn
#

controlnet tile is pretty useful for training images i've noticed. throw them through realistic vision to get a consistent image with refined details

dense tapir
#

Can't use it any way as I have no x4 slots on the two long ones and 4 x1

wispy nest
#

is 28s/it good

dense tapir
#

fantastic if 2.1 768x768

#

joking

#

no, that is pure rubbish

#

almost half a minute per iteration

hasty nova
azure hill
#

to add on that beautiful gen:

fleet olive
#

@sterile temple Do you have recommendations about how to create a 3D style picture from 2D picture?

smoky oak
#

WOOO@dense tapir

#

ITS GORGEOUS

hasty nova
dense tapir
#

@static tuskI just moved a safetensor to my sata SSD and almost instantly it loaded it. Same file on my HDD takes forever.

#

Pop it in and test it

smoky oak
hasty nova
smoky oak
#

I ran a benchmark with it at his house, and it performed perfectly

hasty nova
#

But nice, 10G

static tusk
#

I cant imagine the slowness of HDD loading checkpoints

smoky oak
#

I have several AI commissions right now, so this will speed things up nicely

dense tapir
hasty nova
smoky oak
#

My friend is actually using stable diffusion with a hard drive, and it's not nearly as bad as you would think, because it's continuous read and write, so most hard drives can still get well over 200 megabytes per second when loading a model

static tusk
#

I even notice sata ssd to nvme. big difference there

acoustic moth
#

with dreambooth training, how do you fully take advantage of prompt naming, most guides just say to use "photo of ohwx woman", is that enough or am i not taking full advantage of its capacity

smoky oak
#

My whole PC is now NVMe m.2, and I could never go back to having hard drive storage, as all the things that I do are extremely read and write random intense

hasty nova
#

I only got a 3070, but it's been mostly enough so far to do what I need, I can train most things on it and generate quite large images.

dense tapir
#

It takes me up to 3 minutes on my Barracuda 2tb but on my sata SSD <10s

oak osprey
#

well LLaMA is 221GB just for 65B

hasty nova
#

I can load models in like 5 seconds

oak osprey
#

have fun putting that on nvme 😄

dense tapir
#

I can't wait to see the it/s on a 3080 vs your 3060ti

oak osprey
#

i'm back now. i can probably run it for you

static tusk
hasty nova
dense tapir
hasty nova
#

But my main model is only 2.4G, I don't need to increase speed too much

static tusk
#

initial load of DD
Model loaded in 3.9s (create model: 0.1s, apply weights to model: 2.0s, apply channels_last: 0.3s, apply half(): 0.5s, move model to device: 0.8s).
then after its cached
Model loaded in 2.1s (create model: 0.1s, apply weights to model: 0.5s, apply channels_last: 0.3s, apply half(): 0.5s, move model to device: 0.7s)

dense tapir
#

Makes me so mad that newegg is back to playing games with my case. MIR offer ended May 1 then came back yesterday. I no longer do MIR since my bank is virtual.

#

thing is the mir brings it back to what it was pre mir

#

Oh, and my sata ssd on a load of the model barely made a blip but on the HDD it pegs it 100%

oak osprey
#

@hasty nova ti's working 🙂

dense tapir
#

3090ti is 2 grand, sheesh

#

more than a 4090

oak osprey
#

didnt realise it was this ez

#

to just convert a model to huggingface style

acoustic moth
#

"no executable batch size found, reached zero"

#

anyone else get this in dreambooth

hasty nova
oak osprey
#

it created the proper config file and a safetensors file with idk, whatever it needed to add to it

#
  adding: DigitalDiffusion/unet/ (stored 0%)
  adding: DigitalDiffusion/unet/config.json (deflated 65%)
  adding: DigitalDiffusion/unet/diffusion_pytorch_model.bin
#

to a zip file

hasty nova
#

But why do you need it in a special format, I mean.

hasty nova
acoustic moth
#

12gb vram

smoky oak
#

@dense tapirAlright, installing drivers right now

oak osprey
hasty nova
hasty nova
oak osprey
#

it breaks the .safetensors file out into the vae, tokenizer, text_encoder, and unet

#

@hasty nova to run it on my discord bot network

hasty nova
#

Ohhh

#

What's your bot?

oak osprey
#

trying to get people to use 2.1

#

it's called PseudoAI. i do not believe it is listed in any directories

acoustic moth
oak osprey
smoky oak
#

8bit adamw always makes me read it as

8 bit Ada Machine Wearning lmao

oak osprey
#

it's 2.83GB:

  adding: DigitalDiffusion/vae/ (stored 0%)
  adding: DigitalDiffusion/vae/diffusion_pytorch_model.bin (deflated 42%)
  adding: DigitalDiffusion/vae/config.json (deflated 58%)
  adding: DigitalDiffusion/tokenizer/ (stored 0%)
  adding: DigitalDiffusion/tokenizer/special_tokens_map.json (deflated 72%)
  adding: DigitalDiffusion/tokenizer/merges.txt (deflated 60%)
  adding: DigitalDiffusion/tokenizer/vocab.json (deflated 71%)
  adding: DigitalDiffusion/tokenizer/tokenizer_config.json (deflated 69%)
  adding: DigitalDiffusion/text_encoder/ (stored 0%)
  adding: DigitalDiffusion/text_encoder/pytorch_model.bin (deflated 41%)
  adding: DigitalDiffusion/text_encoder/config.json (deflated 45%)
  adding: DigitalDiffusion/scheduler/ (stored 0%)
  adding: DigitalDiffusion/scheduler/scheduler_config.json (deflated 46%)
#

so you can see how it violated your model file

#

😄

#

compressing that sucked ass

hasty nova
oak osprey
#

btw, how the heck did you manage to train 2.1?

hasty nova
smoky oak
#

@dense tapir I am a wee bit concerned

oak osprey
#

there's no training tools released by StabilityAI, is there?

#

and yes yes

hasty nova
oak osprey
smoky oak
#

I am only getting 11 it/s

#

💀

#

ummm

oak osprey
#

@smoky oak you need torch.compile sauce

smoky oak
#

how do I do that?

oak osprey
#

use Graph Mode if there's an option for it

hasty nova
#

@oak osprey Sytan only got a 3080, isn't the torch.compile thing better for 40-series cards?

smoky oak
#

I am at 12it/s with my OC on

#

I should be well over 16

oak osprey
#

it works for the 3xxx but the speedup is pronounced on the Ampere and Ada series

acoustic moth
#

yea dont have unfreeze checked, i tried the --xformers command and in the loading terminal it would say its loading with xformers but in the ui the option was never available

smoky oak
#

I am just trying to get my new 3080 to perform as it should

acoustic moth
#

I heard nvdia had an update that was better than xformers, torch or something along those lines, not sure about the legitimacy of that claim

oak osprey
#

i did torch.compile on a 3070 8gb

hasty nova
smoky oak
#

oh wait what the heck, task manager isn't showing CUDA on this GPU

static tusk
smoky oak
#

👁️

oak osprey
#

@smoky oak well if you struggle with that you're not the only one but it's possible you have too many offload options enabled / not the right ones

smoky oak
acoustic moth
oak osprey
#

i wish i knew more about the stupid way they've named options inside there so i could help you

hasty nova
smoky oak
#

nevermind, my dumbass was clicked on my iGPU lmao

oak osprey
#

-_-

smoky oak
#

hmmm...

#

I am still concerned

wispy nest
#

Have you tried turning it off and back on again

smoky oak
#

its showing 100% GPU usage, and only 12it/s

smoky oak
#

new GPU and new drivers

#

brb

wispy nest
dense tapir
#

hmmm

smoky oak
#

alright, restarted

#

lets see

dense tapir
#

Well :/

static tusk
#

when changing gpu the minimum is wipe drivers with DDU and reinstall fresh

smoky oak
#

nope, still slow

#

god, please don''t tell me I need to redo the hell that is A1111

dense tapir
#

maybe

smoky oak
#

FFS mannnn

#

I DO NOT want torch 2

static tusk
#

you want to be on torch 2.0 and use the latest cudnn

hasty nova
#

almost there... I am trying this new fangled controlnet tile upscale

dense tapir
#

something tells me 12-14 is what you will get

smoky oak
#

3080 should be way faster than that tho

hasty nova
#

making a big image, hopefully it works, it's been like 20 minutes or something

smoky oak
#

ok, I am redoing my venv, and it seems to still be using torch 1.13, perfect

#

I just do not want torch 2 man

static tusk
#

I dont have an issue with torch 2

oak osprey
#

ew

smoky oak
#

Every time I have used torch 2, it has been slower

oak osprey
#

do you run that on win95

smoky oak
#

in Vlad, A1111, Comfy, and Ana

oak osprey
#

486 GX2

smoky oak
#

always been slower every time

hasty nova
#

@oak osprey I have just extracted the zip you sent me, and just dragged all the files in to the upload section on hugging face. It should be up soon, I guess I should also make a model card or something.

oak osprey
#

i'm stoked for you and your new GPU, Sytan

smoky oak
#

Thank you, I should be able to work on my comissions much faster

oak osprey
#

you can fix the shrek lora now

smoky oak
#

As long as this GPU starts running at its proper speed

wispy nest
#

Is it Satan or sytan

smoky oak
#

Sytan

#

But it is based off Satan

wispy nest
#

Is that mean Satan

#

Oh

static tusk
#

make sure you have this turned off too

smoky oak
#

Its my producer name, its based off Satan, but only in name

oak osprey
#

Saitan is a food thing

smoky oak
#

Yeah

wispy nest
#

You have the upside down star thing going on also

smoky oak
#

and Seitan is a Shakespeare character lol

dense tapir
oak osprey
#

lmao getting a real "Richard Ramirez" vibe all a sudden

hasty nova
#

Well gosh darnit, the controlnet thing smoothed the image a bit too much. My guess is that my tile size was way too small.

smoky oak
oak osprey
#

hes edgy

smoky oak
#

I am not edgy >:C

oak osprey
#

im sorry sad

smoky oak
#

I am round and rotund :>

hasty nova
smoky oak
#

few edges here

wispy nest
#

Why is the new generation like this agony

smoky oak
oak osprey
smoky oak
hasty nova
smoky oak
#

I have been twarted lol

hasty nova
#

@oak osprey

smoky oak
oak osprey
#

omgomgomg

smoky oak
#

ah damn it, middleware error @dense tapir

wispy nest
#

I changed my eye color with a prompt and now look like Oscar Isaac

oak osprey
#

trips and falls down the stairs running to test

smoky oak
#

Back to our pinned messages lol

smoky oak
wispy nest
#

@smoky oak do you use Twitter to promote your work or something

oak osprey
hasty nova
smoky oak
smoky oak
#

What upscaler did you use?

hasty nova
#

It's in the screenshot, though I think vlads has an issue where it defaults to one set in the settings, so I think it was SwinIR

dense tapir
smoky oak
#

oh right, that one you used has a propensity to smooth and blur things

#

I recommend ESRGAN 4X

#

its much sharper, but it adds artifacts

#

I am using a new one now

#

don't remember where I got it from

hasty nova
#

What about R-ESRGAN 4x+

dense tapir
#

btw, I went looking and a 4090 pytorch 1.x 8s for 512x512 eulera 50steps. Pytorch2 using vlads was <1s. Yep, made for the damn 4090 and higher cards.

oak osprey
#

omg its working 🥺

hasty nova
smoky oak
oak osprey
#

this model is so slow lmao

smoky oak
#

slowo

#

sorry

#

had to

hasty nova
#

If you want some other testing with the bot I could try adding it to my server, it's very small and has like 3 active people, though technically 160 people are in there

oak osprey
#

now who spawn campin

wispy nest
#

Swampy slow

solar pebble
hasty nova
smoky oak
#

its not any faster brooooo

smoky oak
#

why is this new GPU giving me speed problemssss

hasty nova
#

Im also gonna try a higher tile size, just to hopefully make it faster

smoky oak
#

this is the same speed as my old GPU

oak osprey
#

i wonder if i need to make a fp16 version

smoky oak
#

@dense tapir Any guesses as to why its the same speed as my old GPU?

hasty nova
hasty nova
oak osprey
#

oh 😄

hasty nova
#

only 2.4 gigs

smoky oak
#

I am so frustrated >:C

oak osprey
#

oh my bad i did 100 steps for no reason at 2160p

#

im an idiot

oak osprey
#

i dont think your model is particularly slow

wispy nest
solar pebble
smoky oak
#

I should be getting 16it/s minimum right now

hasty nova
acoustic moth
#

whys installing xformers so complicated, why couldnt adding --xformers in bat file be enough lol

#

damn

oak osprey
smoky oak
#

thats how it worked for me lol

sterile temple
oak osprey
#

love that high quality SD 2.1

hasty nova
acoustic moth
# hasty nova that's usually all it takes

i have --xformers --reinstall-xformers in my cmd args but i get this error: Launching Web UI with arguments: --xformers --reinstall-xformers
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
PyTorch 2.0.0+cu118 with CUDA 1108 (you have 1.13.1+cu117)
Python 3.10.10 (you have 3.10.6)
Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
Memory-efficient attention, SwiGLU, sparse and more won't be available.
Set XFORMERS_MORE_DETAILS=1 for more details

GitHub

Hackable and optimized Transformers building blocks, supporting a composable construction. - GitHub - facebookresearch/xformers: Hackable and optimized Transformers building blocks, supporting a co...

solar pebble
oak osprey
#

who in here loves data and charts? i had SD generate a chart of its performance

#

dude i love how everything in the legend is the same colour

solar pebble
#

Looks good

hasty nova
oak osprey
#

well i literally prompted it 'SD2.1 Testing' to create the thread

acoustic moth
hasty nova
acoustic moth
hasty nova
oak osprey
hasty nova
oak osprey
#

well i hadn't heard of the model before today

hasty nova
#

Oh 😆

oak osprey
#

went to try it, couldn't 😄

hasty nova
#

Yeah it's not a very popular model

oak osprey
#

i was like who's this goofball not on HF

#

well it's possible it'll pick up if you tag it correctly on hf as being a 2.1 model

hasty nova
oak osprey
#

they have a Space thing that does it 😄

hasty nova
#

oh cool, I found it

oak osprey
#

niice

#

you're a wizard now

hasty nova
#

Just like the main image for the model

#

this guy

oak osprey
#

your spirit animal is a mage?

hasty nova
#

dunno

acoustic moth
#

dumbeldore

smoky oak
#

Great, now you all have me in a chaotic mood

oak osprey
#

dumblebadass

smoky oak
#

dumbledussy

oak osprey
#

👁️ 👄 👁️

smoky oak
#

why is this new GPU NOT FAST

#

ejkf;eiolajgiop'wGJ;wiosgh

oak osprey
#

it hav mor ram tho rite

smoky oak
#

yeah, but like

#

its also using 50% more power lmao

#

to be the same speed

oak osprey
#

well that's weird

smoky oak
#

I do not understand why

oak osprey
#

are you runnin.. oh you wouldnt be in wsl2 right?

acoustic moth
#

@hasty nova thank you so much, finally got xformers

oak osprey
#

what was it?

smoky oak
static tusk
#

delete venv, delete repositories.
change your ARGs to --opt-sdp-attention --opt-channelslast
git pull the latest A1111, dont install xformers

smoky oak
#

uhgggg, I have to use pytorch 2.0

oak osprey
#

pytorch2 is where the party at

smoky oak
#

--xformers --listen --enable-insecure-extension-access

#

and then I also ran it with

#

--opt-split-attention --opt-channelslast

#

at the end

oak osprey
#

wait what are those

dense tapir
oak osprey
#

Cross attention layer optimization significantly reducing memory use for almost no cost (some report improved performance with it). Black magic.

#

ewww

smoky oak
#

but I SWEAR I remember 3080s being like 16it/s

oak osprey
#

pls try without this

smoky oak
#

already did, no benefit

dense tapir
smoky oak
#

same exact speed

smoky oak
oak osprey
#

--disable-opt-split-attention?

dense tapir
#

but it isn't the same card

static tusk
#

when using SDP you cant have xformers installed as it screws with it

smoky oak
#

pure fire is telling me that I need to redo my whole new A1111 install

static tusk
#

yes

dense tapir
#

I would too. save the old install though

smoky oak
#

that is literally the last thing in the world I wanna deal with

oak osprey
#

listen to them they seem to know. or not, idk do wat you like lmao

smoky oak
wispy nest
#

Are you not using enviroments

smoky oak
#

I am

#

but I need to redo everything

wispy nest
#

Just create new environment than

smoky oak
#

I can't, cause it uses the old repository

static tusk
#

not everything, you keep all your settings

wispy nest
oak osprey
#

you on dsl or wat

smoky oak
#

@static tuskAlright, I'll try it

dense tapir
#

good luck

smoky oak
#

so install a whole new A1111 from git?

acoustic moth
#

damn estimated 10min training w xformers

#

pretty quick

dense tapir
#

vlad's fuck people so hard we all had to start clean over as just erasing venv was not enough

oak osprey
#

training whaaaat

dense tapir
#

hopefully Autos hasn't morphed into that

oak osprey
#

LOL

#

reinstall OS

acoustic moth
oak osprey
#

did you check therms

#

maybe is hot

dense tapir
#

yep, could be throttling

oak osprey
#

could need a repaste by now

dense tapir
#

I bet so

#

and a blow job

smoky oak
#

it ran MSI kombustor at like 74C

oak osprey
#

tbf i think its unlikely to throttle so quick

dense tapir
#

74c? OUCH

#

is that normal?

smoky oak
#

Thats nothing for kombustor lmao

oak osprey
#

the fuck is cumbuster

dense tapir
#

2 nuts and a long night

smoky oak
#

most GPU's hit like 90, its as intense as it gets

oak osprey
#

speak ENGLISH, doc

dense tapir
#

90c for me is shutdown

wispy nest
#

Can I just put my GPU ina freezer and run it

hasty nova
#

Yeah this is better!

smoky oak
#

Furmark Kombustor on a 4090 peaks over 500 watts and like 90C

oak osprey
#

oh i just had deja vu so keep in mind we're all stuck in a time loop repeating this moment forever, that kinda sucks ass

smoky oak
#

lmao

wispy nest
#

How much faster is a 4090 vs 3090

dense tapir
#

10s vs 7s

hasty nova
#

about 1000

wispy nest
#

Like 1.5x or we talking 2

smoky oak
#

way faster depending on the use case

oak osprey
#

likw 58x speedup over 3090 in ML tasks

smoky oak
#

soemtimes like 30% faster, sometimes like 100% faster

dense tapir
#

actually not so much in BS5

oak osprey
#

BS5? what is this. i'm old

wispy nest
#

Because the cuda cores are different?

dense tapir
#

hardware is 56% faster but software has not caught up yet so 35% in the real world

wispy nest
#

What about v100 vs 4090

oak osprey
#

pytorch using eager mode loses a lot of potential on this hardware. you have to compile the models to get the full FLOPS output of the 3090/4090

dense tapir
#

cuda cores on the 4090 is 16384

hasty nova
#

@oak osprey Have you read the prompting guide on the civit page for DD? There are some tokens you can use to improve generations.

oak osprey
#

oh i was just messing around with that for the moment just making sure it works

dense tapir
#

yeah, it is insane

static tusk
#

generating a batch of 6

smoky oak
#

@static tuskOh1 you have a 3080?

#

What kinds of it/s do you get in DDIM?

wispy nest
#

So 4090 is just like an insane overbuilt consumer gpu

dense tapir
#

there we go 60c

static tusk
#

of course

dense tapir
#

yes

#

the heatsink on the FE is over engineered due to it being made for the 4090 we did not get

wispy nest
#

Than technically what gpu fits sb the best as what is build for a program like it

#

Accelerator*

static tusk
smoky oak
smoky oak
oak osprey
#

omg i love Jim Bean

smoky oak
#

DAMN IT

#

uhhgggg

hasty nova
#

I like this one

#

Well I might just like this prompt

smoky oak
#

new install is installing 1.5 pruned

#

I hate that it defaults to doing that

oak osprey
#

someone's complaining about nice things again

dense tapir
#

I would kill to get a 4090 FE but not happening since Nvidia stopped making them and only solde in the brick and mortar Best Buys

smoky oak
#

it auto installs 1.5 BASE what is nice about that? lmao

hasty nova
#

Yeah every image with this prompt is pretty much a banger

smoky oak
#

4GB to immediately delete lol

#

At least I have fast internet to download this model in so I can turn around and delete it lol

static tusk
dense tapir
#

yeah auto is written very poorly for boot up

smoky oak
#

ok!

hasty nova
#

Switched over to doing some mountains with the same prompt

smoky oak
#

it worked @static tusk !

hasty nova
#

Anyway I got to go to bed

#

Gn everyone

smoky oak
#

13.2it/s with no optimizations and live preview

smoky oak
dense tapir
oak osprey
#

@hasty nova

static tusk
#

lol

hasty nova
dense tapir
smoky oak
oak osprey
dense tapir
oak osprey
#

that's Digital Diffusion ^^

dense tapir
#

Yep

oak osprey
#

mine i meant

dense tapir
#

Oh.

smoky oak
#

@dense tapirHOLY SHIT

#

18it/s LMFAOOO

#

WOOOOOOOOOOO

oak osprey
#

yeah there's the pytorch 2 boost

dense tapir
#

Sytan you on PT2 now?

smoky oak
smoky oak
#

yeah

oak osprey
#

aye that'll do it 🙂

smoky oak
#

2.0.0+cu118

dense tapir
#

yep, 3080, 3090 and 4090 with 4090 REALLY seeing the bene

static tusk
#

and you doubted my advice @smoky oak lol

smoky oak
#

annndddd

crystal deltaBOT
oak osprey
#

pwned

dense tapir
#

6.5 it/s faster

smoky oak
#

Um...

#

I just had a catastrophic error

oak osprey
#

does it make only black squares now

#

it made a cat picture ?

#

what

smoky oak
#

Fatal cuda air unspecified launch failure

#

*error

#

My whole computer froze, my audio drivers reset, and my monitors went black

#

I have no idea what just happened

oak osprey
#

probably a nightly package you need to update to

smoky oak
#

I was about to say that it went back down to 10it/s for whatever reason

#

Right before it did that

#

Let me make sure I'm monitoring GPU temps

oak osprey
smoky oak
#

That was scary

oak osprey
#

not laughing at you, just that you're not monitoring temps on a new card

wispy nest
#

Unlock thermal throttling activated

dense tapir
#

I can buy a renewed 3090 for 900-1k but I dunno

oak osprey
#

but i have this all the time on the side here

static tusk
#

use hwinfo to check gpu temp and also vram hot spot temp, thats the problematic one

smoky oak
#

wow, my A1111 is dead now

#

just error every time I try to launch

#

restarting

oak osprey
#

CUDA kernel stuckies

wispy nest
#

Does anything smell like it is burning

oak osprey
#

i smell burnt toast but i'm not sure who you're asking

smoky oak
#

oh wait

#

I wonder

#

if my PSU wasn't able to supply enough power

oak osprey
#

does it have dual BIOS?

#

ohhhh NOOOOO classic upgrade move

smoky oak
#

It does not, or at least I didn't see it on the board

static tusk
oak osprey
#

well since you're upgrading PSU now you may as well get that WSE 2

smoky oak
#

650, which is below recommended for a 3080, and I am OC'd 😅

dense tapir
#

Too low tbh.

oak osprey
#

underclock your 3080, broseppi

static tusk
#

you want 750W ideally for 3080

oak osprey
#

you will save power and gain efficienci 💪🏽

dense tapir
#

yep pure

static tusk
#

I have 1000W for upgrade headroom

wispy nest
#

Why is a 3090 24gb more than 4090 24gb

dense tapir
#

if you hit one of those spikes the 3k series are notrious for the system will shutdown.

oak osprey
#

i had to go to 1600W KEKL

#

fuckin 4090

dense tapir
oak osprey
smoky oak
#

uhhhh

#

ok so

#

350 watts....

#

GPU hit 64

#

hot spot hit 74

oak osprey
#

its not about the avg its about the transient spikes that lead to crazy V-drop

static tusk
#

3090 can do SLI, maybe thats something business want

oak osprey
#

they occur under the 350Hz sample rate of the VRMs

#

350KHz*

smoky oak
#

also, that gen was the slowest yet

#

9.9it/s

#

I am so confused

#

it hit 18 in that one test

dense tapir
#

If I were you I would buy a 1kw and be done. Get a good brand though with a good capacitor in it for those spikes that just happen. Gamer's Nexus had an episode about it. Luckily Lovelace doesn't have that issue now.

oak osprey
#

yeah i wouldn't do a whole lot of throughput testing til you have solid power

#

bad PSUs can kill gear

smoky oak
#

oh my god

#

that 350 watts wasn't OC'd

dense tapir
#

Yep, I lost a mobo years ago due to that

static tusk
#

use afterburner and lower power down to 80% for now

smoky oak
#

jesus christ this card really uses that much power?

dense tapir
#

What I do on mine just for heat

smoky oak
#

350 watts stock

dense tapir
#

sure does

smoky oak
#

whatttt

oak osprey
#

^ Sytan waking up from his coma

#

realizing GPUs use power

dense tapir
#

Hahahahaha

static tusk
#

mine runs at 280W with v curve and power optimisation

smoky oak
#

alright, lowered down to 80%

smoky oak
oak osprey
#

remember these cards are tuned for gaming and likely are blowing out an O-ring where they don't need to

#

💨

smoky oak
#

well alright then

dense tapir
#

4090, for instance, is 450w

oak osprey
#

it's definitely worth investigating how reducing the core clock vs mem clock goes

smoky oak
#

now to find out why its now slower than my last card

oak osprey
#

you can try reducing the voltage of the uhm, what the fuck's they called.

dense tapir
#

Nvidia loves the power

smoky oak
#

@static tusk Any idea?

oak osprey
#

the states tables

smoky oak
#

I know how to OC and UC lol

static tusk
smoky oak
#

I hit 18it/s one time, then boom, now its 9

dense tapir
#

until you get the power sorted out, possibly

oak osprey
#

states tables at least on AMD hw are configured so you have the voltage vs mhz set up correctly

static tusk
#

no, but the power spike earlier may have ruffled some things

smoky oak
#

alrighhttttt

oak osprey
#

yeah reboot and keep it at the speed limit, hoss

#

this answers the question of whether you can stuff both GPUs in your case tho

dense tapir
#

lol

oak osprey
#

i know you were wondering

smoky oak
#

I might not keep this 3080, IDK

dense tapir
#

Oh, he can stuff it just don't turn the power on

smoky oak
#

I might resell it if this is what I have to expect

#

Well over 2x power for slower lol

oak osprey
#

well i say go through a tuning process first and see what other people might have done

#

the vega had a pretty dedicated community of nerds

#

gotta assume the 3080 has something

dense tapir
#

your problem is 650w in 2023 is amazing it booted

oak osprey
#

when voltages drop, current does go higher. but wattage stays the same. it just means wires get hotter and shit starts frying

dense tapir
#

I still see 450w PSU being sold and SMH

smoky oak
oak osprey
#

its gonna blow your mind but my Celeron box uses 3 watts of power, @dense tapir

oak osprey
#

yeah but it's got 6x 2.5gbit ports. ALL the hardware offloading. it's a badass router

dense tapir
#

I can sorta see a workstation only needing 450w, or even less, with integrated graphics

oak osprey
#

the low-power Xeon stuff uses like 45 watts

#

i have one i'm getting ready to throw away

dense tapir
#

yeah, it is funny the mobo stuff is using less power/voltage while the gpu is more

oak osprey
#

it's hard because it's a DDR3 board and it has like 144GB RAM but also it's a low power xeon and that ram is useless

smoky oak
#

restarted. 10.2it/s @static tusk

#

it is officially slower than my 3060ti lol

crystal sonnet
#

Like a leader

smoky oak
#

:/

static tusk
#

is that with 100% power or 80?

oak osprey
#

are you no longer using SDP or something

smoky oak
#

80%, but its the same speed

dense tapir
#

did you O/C the UV?

smoky oak
#

no, I just lowered power to 80%

oak osprey
#

seems like you're shartlenecked somewhere else

smoky oak
#

I hit 18it/s for one gen, then boom, back down to 10, doesn't make any sense

oak osprey
#

oh, that happened again?

#

or just once

smoky oak
#

just once

oak osprey
#

well damn it man don't keep saying it like it's reproducible 😄

static tusk
#

in any case you will want a new PSU with that 3080, maybe switch back to your old card till you get one

oak osprey
#

have you the spirit to try and reproduce the speed drop again?

dense tapir
#

card is like old used cars that had straw and axel grease to keep the rattling down long enough to get you off the lot.

smoky oak
oak osprey
#

like if you can do that reliably that's actually pretty great

smoky oak
#

it wasn't the crash that lead to the lower in speed

#

I did 18it/s for one gen

#

did the next at 10it/s THEN it crashed

oak osprey
#

and then you rebooted?

smoky oak
#

yup

#

well no

oak osprey
#

the fuck

smoky oak
#

I did a few more, then rebooted

oak osprey
smoky oak
#

on fresh boot now, its now even slower at 10.2it/s

oak osprey
#

can you check the versions of stuff you are using again

smoky oak
#

Like it just changed in the middle of a gen? lol

#

2.0.0 cu118

oak osprey
#

you rebooted

smoky oak
#

same thing

oak osprey
#

and still slow after reboot

smoky oak
#

yup

#

slower, actually

#

from 11 to 10.2

oak osprey
#

well there's more than just pytorch here, did you update xformers / diffusers too?

smoky oak
#

I am not using xformers, as you can't with SDP

#

where do I update diffusers again?

static tusk
#

torch 2 and sdp doesnt require xformers

oak osprey
#

ohhhhh shit

#

i should remove that then eh

dense tapir
#

on vlad's you can't even click both

smoky oak
#

something is wrong here

#

When I click start, it hits 18it/s, then falls to 10

oak osprey
#

is that why i have to catch and squash all these stupid fucking errors from stable diffusion that are like "that function doesn't exist"?

smoky oak
#

possibly

static tusk
#

have you checked how much power the card is using while generating?

smoky oak
#

250 watts

oak osprey
#

80085 watts

smoky oak
#

sorry, 280

oak osprey
#

what resolution are you generating

static tusk
#

thats OK for 80%

smoky oak
#

ARE YOU KIDDING ME

#

AAAAAAAAAAAAAAAA
ITY WAS MY RES

#

AAAAAAAAAAAAAAA

oak osprey
smoky oak
#

eproigjWLSKJG KASNGHAEDRH

oak osprey
#

you did what i did

smoky oak
#

AAAAAAAAAAAAAAA

oak osprey
#

YOU DID WHAT I DID

static tusk
#

what res?

smoky oak
#

I am getting 16it/s now lmfao

oak osprey
#

i did 2160p for no reason

smoky oak
#

I was at 512x768, not 512x512 lmfaooo

oak osprey
#

at 100 steps

static tusk
#

LOL

oak osprey
#

i thought jungerally's model was slow

smoky oak
#

UHGGGG

oak osprey
#

fucking hilarious

smoky oak
#

I HATE MYSELF

#

AAAAAAAAAAA

static tusk
#

so youre good

oak osprey
#

"i might not keep this GPU"

smoky oak
#

yes lmao

oak osprey
smoky oak
#

16.2 it/s lmao

oak osprey
#

me rn

#

whoa

static tusk
#

just make sure not to go over 80% or you will over draw from the PSU

oak osprey
#

so you shaved off like 2/sec and saved 50w?

smoky oak
#

AaAaAaAaA

oak osprey
#

that's not bad

#

what if you limit it further like to your 3070 ti's power use

smoky oak
oak osprey
#

oh 3060

#

well yeah what if you limit it further

smoky oak
#

I checked back, i was wrong about my 3060ti

#

it was 210 watts, 11.5it/s

oak osprey
#

my 3070 is 150w so that sounds right

#

it's a laptop tho

#

well good thing you figured that out and now i know i should probably uninstall xformers

static tusk
#

crisis averted 😆

oak osprey
#

wonder how much shit that's breaking

smoky oak
#

i can't believe that lmao

oak osprey
#

how exciting

smoky oak
#

thank you so much for telling me to check res lmfao

oak osprey
#

i was like i bet he's doing 8k

smoky oak
#

@dense tapir Crisis averted lmao

#

I was at the wrong res

#

🤡

oak osprey
#

well now how high can your native res go

#

with your 24G and your Automatic1111 thing

smoky oak
#

24G?

oak osprey
#

or is it.. im uh

#

👴🏽

smoky oak
#

its 10 GB bro lmao

#

my 3060ti could do native 2560x1080 reliably

#

so probably 3kx1.5k

#

I am in disbelief lmao

oak osprey
#

oo yea those will look terrible too, do it up

#

i wanna see some mutants

smoky oak
#

I can't even go that far in this new install lol

#

the sliders stop at 2048 cause they are not extended lol

oak osprey
#

you can't even go so far as to do to be more like? oh

#

you have to go in and break the thingy

#

i know what i'm talking about

smoky oak
#

doing 2048x2048

oak osprey
#

that's big

smoky oak
#

4.1s/it

oak osprey
#

seconds per it? LOL

smoky oak
#

yes, its a HUGE image lmao

oak osprey
#

that's gotta be slicing and dicing layers like Gordon Ramsay

smoky oak
#

64x the size of 512x512 lmao

#

so yeah, 16/64 is

#

DAMN IT

#

end processing ran out of VRAM IckyCat

oak osprey
#

i said it's big

smoky oak
#

tried to allocate 8GB ontop of 7GB used lmao

oak osprey
#

i know my 4090 can struggle with 2048x2048 if i don't clear the CUDA cache between two different models

smoky oak
#

ok, 1256x1256 was way faster

#

1.5it/s

#

I MEAN

oak osprey
#

that's not divisible by 64 NPCDryadSmug

smoky oak
#

NOT THAT BAD

oak osprey
#

make it divisible

static tusk
#

I do 1024sq with 2.1 all the time

smoky oak
#

blah blah blah, you old boomer, with your MATH

smoky oak
#

it did native 1024x1024 without artifacts

oak osprey
#

cleft lip

#

but it's ok

#

it makes it like "that couldn't possibly be AI. he has a birth defect. AI art isn't bornt. as an AI language model, you can trust me that this is the accurate representation of reality."

wispy ether
smoky oak
#

alright so

wispy ether
#

1024 is so slow on my gpu

smoky oak
#

this seems to do 768^2 x8 just fine

#

also, I am gonna test something that I shouldn't

#

or rather @static tusk

wispy ether
#

Do 2000x2000

#

Hires fix

smoky oak
#

What happens if I install xformers here?

#

cause I notice that SDP is definitely using a lot more VRAM

oak osprey
#

the fuck is 768^2, you're doing 589824 x 589824 images now?

#

why

smoky oak
#

bro, do the math

oak osprey
#

to flex

smoky oak
#

its 768x768 lmao

oak osprey
crisp light
#

Ja

oak osprey
#

that cant be .. oh

smoky oak
#

:>

oak osprey
#

PEPE HAS AN IDENTITY CRISIS, OK

smoky oak
#

I MEANT YOU

oak osprey
#

oh

#

well don't speak poorly about pepe either

smoky oak
#

ok, I am gonna test my luck with non SDP

oak osprey
#

it's squodwid 😄

#

why because you like to watch shit burn?

smoky oak
#

no, cause I am not vibing with how much VRAM these gens are using

#

6GB used for a single 512x512

#

I was using like 3.4GB on my 3060ti with Xformers

oak osprey
#

well that's not offloading the layers sequentially

smoky oak
#

sorry

#

3080 is 5GB not 6

#

man, I keep hitting the wrong numbers

oak osprey
#

one layer at a time goes to the GPU with xformers, it's a lot slower but it reduces memory use

#

it's pretty much the only way to run the x4 upscaler on consumer kit tho

smoky oak
#

....

#

SOOOO

#

my old SD install is plenty fast

oak osprey
#

wonder how that goes now with your PyTorch 2 stuff

smoky oak
#

I WAS ALSO USING 512X768

#

AAAAAAAAAAAAA

#

well ok, its 1it/s slower

smoky oak
#

but its using the same VRAM

#

interesting

#

I know for a FACT that 512x512 on my 3060ti took 3.5GB

oak osprey
#

cuz it's there to use

#

literally that is why

#

that's how it's a lot faster, because it keeps it all in the GPU space

smoky oak
#

You know, I COULD have both GPU's in

#

just use them one at a time

oak osprey
#

no you CAN'T your PSU will piss itself

#

LMAO

#

what's the point of that

dense tapir
#

lol

smoky oak
#

oh wait, I don't have enough power cabels

smoky oak
dense tapir
#

I smell smoke

smoky oak
#

meh, oh well

oak osprey
#

oh probably a reference you won't get LUL

smoky oak
#

Marty McFly -3-

oak osprey
#

lmao that's the dad

#

George

smoky oak
#

mick phlie

oak osprey
#

OOOH YESSSSSS MARTY MCBROWN TEST

smoky oak
oak osprey
#

marty mcbrown back to the future 1950s technicolor normal rockwall cinematic movie art

#

you'll see

dense tapir
oak osprey
#

i forgot to ask for this earlier

#

when you were doing your tests

#

a lot of models have a very opinionated view of who Marty McBrown is and you can often get him to appear in a number of situations

wispy ether
smoky oak
#

yes

wispy ether
smoky oak
#

What I really wanna see is my training speeds

#

also, I was able to limit power to 80% and still OC

wispy ether
#

For some reason

smoky oak
#

I am running 50+/800+

wispy ether
#

On normal generating its 7

oak osprey
#

here's a raw output of that prompt on my first test, the middle one is definitely a strong Marty McBrown like i saw from BlueWillow

smoky oak
wispy ether
#

3060

#

Read message below

smoky oak
#

when you train is it BS 1?

wispy ether
#

Bs?

smoky oak
#

batch size

wispy ether
#

Yea

#

Or 8

smoky oak
#

makes sense

wispy ether
#

Sometimes 1 sometimes 8

smoky oak
#

BS 1 2it/s sounds right

#

my 3060ti got 2it/s BS 2

wispy ether
#

Lol

smoky oak
#

I bet this GPU gets 2it/s BS 3

wispy ether
#

Ill upgrade to 4070 soon

smoky oak
#

might even be able to do BS4

smoky oak
#

It is NOT an upgrade

#

it is not a good card for AI at all

wispy ether
#

It is

#

This is why i upgrade

#

Idc about mainly au

#

Ai

#

I also play gamed

#

Games

oak osprey
#

fucking lul

#

i'll take this one as my fault, ya know, but it's just, it hurts to laugh that hard

#

christ i really need to remember to check my tile prompts

wispy ether
#

Almost double fps

oak osprey
#

i want to make an entire movie with SD 2.1 and make people throw up in their seats

wispy ether
#

@smoky oak

oak osprey
#

from like, motion sickness, and the deformed outputs

wispy ether
#

I only have 144hz anyways

#

Va panelagony

#

1ms reaction time and 4ms pixel response

oak osprey
#

high fps just consumes more power hehe

wispy ether
oak osprey
#

but if i play rocket league with 250fps i get to hear the coil whine

smoky oak
wispy ether
smoky oak
#

alright then I guess

wispy ether
#

But tho 4070 is 12it/s and 3060 7

smoky oak
#

I would still just go used 3080 for less money and get better gaming perf

wispy ether
#

It consumes more power

smoky oak
#

oh right, I remember that being a concern now

oak osprey
#

aren't you guys using like 5 steps for your images

#

why do you even care

wispy ether
#

I have a 750w psu

smoky oak
#

I use 15, and my gens look damn good, thank you very much

wispy ether
#

Even if 850 is reccomendef

#

750 also works

oak osprey
oak osprey
#

you can parallel two power supplies too

oak osprey
#

is that a bird?

wispy ether
wispy ether
smoky oak
#

Its a WASP

oak osprey
#

its too big for that. where is the banana for scale

crimson dawn
#

i'd squint with a 4080 in a 750w supply , but less than that should be fine

wispy ether
#

Even 4070ti bottlenecks lol

#

4070 doesnt

smoky oak
#

jesus, at batch size 16, my GPU can do one in less than a second 💀

oak osprey
#

@crimson dawn just pair the 4080 with a celeron and it'll be so fucking bottlenecked it won't use that much power

#

it's the perfect crime

smoky oak
oak osprey
#

ugh that hurt my eyees

wispy ether
#

Cpu bottleneck

smoky oak
#

@oak osprey4090 and intel atom

oak osprey
#

im cave dweller dogerime

wispy ether
#

C pu bottleneck

oak osprey
#

Sytan, i prefer systems that don't RIP themselves

#

so i avoid AMD 7800X3D trollface

wispy ether
smoky oak
#

A100 and texas instruments graphing calculator

#

:D

wispy ether
#

Raytracing calculator

oak osprey
#

@wispy ether we're all already working toward a 2.5 million dollar WSE2

#

how come you all keep forgetting this

#

what the fuck

smoky oak
#

cerebras wafer powered off a button cell battery

wispy ether
#

Vgpu moment

oak osprey
#

@smoky oak do i need to FAQ you on how to image gen becuz that prompt goes int the prompt box

#

oh

#

well you edited it since then

smoky oak
#

get clowned, crusty

wispy ether
#

Rent a600 for 1€/hour

smoky oak
#

IDK, but you keep putting me in a chaotic mood lmao

oak osprey
#

can you make me a LoRA that turns women's faces into Cerebras wafers

#

waferu diffuser

wispy ether
#

Ask a rich friend to buy you a gpu farm

oak osprey
wispy ether
oak osprey
#

im so high

#

thats an amazing idea

smoky oak
wispy ether
#

Down syndrome

oak osprey
#

@smoky oak oh do it on cute dudes that'll be better

wispy ether
oak osprey
#

beefcake wafer bois

smoky oak
#

There we go, Nep's daily dose of making a distasteful joke towards some form of minority

wispy ether
#

No

oak osprey
#

@wispy ether a monk's work is never done

wispy ether
#

❤️

oak osprey
#

oh i just realised that's a double meaning because monks self-immolate

smoky oak
#

I am gonna do something irresponsiblleeeeeee

#

somebody get the fire extinguisher

wispy ether
smoky oak
#

Thats been known for decades

#

@oak ospreyplease, have the fire department on speed dial, I am about to do something very irresponsible

oak osprey
#

im inpainting expert now

smoky oak
#

if I die, it is now your fault, since I warned you

dense tapir
wispy ether
#

@dense tapir negative prompt bad text accuracy

smoky oak
#

Wow, I didn't even get to the irresponsible part before it crashed...

wispy ether
#

@smoky oak can you do img to img skribble

smoky oak
#

Welp

wispy ether
#

🤓

smoky oak
#

My PC is frozen lol

wispy ether
#

L

smoky oak
#

That would be my bad lol

wispy ether
#

Stop overclockint

#

G

smoky oak
#

I need to be overclockn't

#

Cause overclockING is breaking stuff lol

dense tapir
#

@wispy ether didn't help

smoky oak
#

I'm back

#

I am not gonna do that again lol

oak osprey
#

fuck yeah

smoky oak
#

I am rethinking my stance on the death penalty cause of you

oak osprey
#

is it that bad

#

i almost couldnt even finish it was laughing so hard

#

imagine if i hadn't. you all would have missed out

smoky oak
#

I should not be listening to a song that has glitch sound effects that sound like a blue screen when adjusting clocks

#

3 separate times it got me lol

oak osprey
#

oh crap im fucking dying i did it in the wrong aspect

#

@wispy ether i bet he overclocked it again 🤣

smoky oak
#

I AM HERE OK

#

I did OC it, but without power increase

oak osprey
smoky oak
#

seems to be running fine at 100/1000 at 85% power

oak osprey
#

CTU can't seem to like, fix that image in any meaningful way

dense tapir
oak osprey
#

i thought AI was supposed to be good

#

scam

#

do i just need to like, feed this thing back in again? and again? and again? KEKL

#

50 iterations off the central finite curve lives a shrek that knows more about diffusion than he knows about farming

#

so i can see it again for the first time

smoky oak
#

feel free to just not lmao

oak osprey
#

that's kind of like the last hallmark card i got tho

#

just sayin'

#

i'll delete it for you though

#

it's already in your head

#

no need to leave it there

#

so one takeaway is that thing undid some of the editing i did in Gimp, pretty much explicitly undid the blending i tried to do

#

but it also blurred the lines between the mogwai and Ernie's hair

#

what happened with the hair overall is just really unfortunate and i have no idea how it happened