#πο½general-with-images
1 messages Β· Page 85 of 1
lmao
π
Still can't use more than 75 tokens when using TensorRT 
I think it's because of this. No idea. 
Anyone here who has a link to cudnn 8.9? 
googl
nvidia website
I don't have an nvidia acc
make one
*dev acc
make one

you can't use more. it's a compiled model
the way it works to use more is to hijack those functions but you can't if they're compiled so they run only on the gpu
Okay, but why are we able to set more than 75 tokens when converting from onnx? That's a bit weird. π
different starting model config
Oh I get it now, thanks.
i hate tensorrt, removed it from my systems in the last cpl days because it was making bitsandbytes stop working, which means i couldn't train a model
for me it made it slower
I would love it, if it would allow more tokens :S
left hand open, right hand closed, thumb, fingers, palm, knuckles, hand, nice hands, perfect hands, 1girl, angel, wings, jewellery <lyco:GoodHands-beta2:1.0>
masking the hands
spamming inpaint
ok, got the extention working
so, i convert safetensor or somthing to onnx, then the onnx to tensorrt?
Yes
and what do i do with minimum height and maximum height and all that?
it 512 on everything by default
512 minimum and 768 max
@wispy ether just inpaint on ur image
you can upscale things even with just inpaint
by adapting your prompt
Not for GPU usage?
im getting AssertionError: onnx model not found
You have to write the full path
+filename
And wait if it seems like it is doing nothing
it says:FileNotFoundError: [WinError 3] The system cannot find the path specified: ''
if you're downloading a model, uploading one, or a dataset, you pay $0.1/GB or so
leave the second line blank and try again
trying 2x A6000s instead of an A100-80G this time
Which GPU?
Beautiful
Even a100
... yes...
literally EVERY machine there bills for network
and when the instance isn't running you pay for storage
#ai #shorts #viral #videogames
famous video games as humans AI generated (part-4) #aigenerated #shorts
so you have to delete and re-download everything if you don't want that
no
what is average it/s on 4070
HP
theres no 4070
no
cpu bottleneck if 4070ti
what a weird scythe
anyone got a lora for a scythe
-.-
just jammin
gotta make one
not even the base model knows what that object it
lol
i casnt make one
its cursed for me
no matter what i do i get exit code 0
even if i do everything right
@smoky oak as well as a few others were/are perplexed at those numbers wondering where Tom grabbed them from as most feel it had to come from his ass.
i made them up

A scythe is a tool used for cutting grass or harvesting crops. It has a long, thin, curved blade that is attached to a long wooden handle. The blade has a sharp, inward-facing edge that is used to slice through vegetation. The handle is typically made of wood and is curved to allow for a comfortable grip while using the tool. The blade is typically made of metal and has a skinny, long shape that tapers to a point at the end. The entire scythe is usually quite tall and is designed to be used while standing.
You didn't make those numbers in the graph you posted up but Tom sure in the hell did.
Oh, boy yeah
i forgot hires fix
"Reliable sources" is a great one
where can i see all arg commands
SD has never done weapons well or at all. Scythe was one of the first ones, if not the first one, I attempted in 1.4 then 1.5 then 2.0 to 2.1. You really want it you need to train them in.
yea...I spent alot of time trying to do sword
what we need is a model that can learn on the fly like gpt
yeah, it has a hard time with a damn butter knife
i'm sad that we are stuck with 1.5 here
I left 1.5 the day 2.0 hit and each time I try it I am frustrated by it. By it I mean with 1.5
i tried 2.1 and didnt like it
like most people also did ;P
for realism I much prefer 2.1
That was one of the best sword gens...
Didn't bother to inpaint
for all the Anime waifu freakazoids they stayed with 1.5
idk what it is but i feel like 2.1 is less responsive
I do everything on 1.5 
SDXL is by FAR the absolute masterpiece, and it's not even released
2.1 can have better details, but can doesn't mean will :P
doesn't SDXL take ungodly amounts of vram
Clip is why because you have to relearn it all. Now one thing I so dearly miss with 1.5 is all the photography stuff it knows as they trained that into it.
SDXL 12gb+
I've never seen a image from it so I can't answer that :P
i wish we had 1TB Vram gpus 
yea...like half of the community won't even be able to use it SDXL lol
just superglue a m2 to the gpu
more parameters doesn't instantly mean higher requirements
the devs said in time they will make smaller models so my 6gb can run it. I doubt that or if it does at what quality? Potato?
That came from one of the devs directly.
Total progress: 94%|βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | 282/300 [09:58<01:15, 4.20s/it]

i'm disappointed in the hardware market in general rn
Same
huge sizes, inefficient, overpriced, low Vram
700-1k mobos? wtf?
well, from my experience, on llms for example, more parameters just means that it takes more time to load, but shouldn't effect speed, or at least that is how it is with llms
I am just telling you the dev came in on the channel and flat out said that at first 12gb, maybe 10, is needed but in time they will reduce it so less vram will be needed. NO, at first my 1060 will not be able to run it.
gawd
I suspect ASIC tbh
i just realized i used 150steps
weird
well, i guess only time will tell.
Right now they are about 50-54% done
this hardware is such a massive bottleneck for the technology its insane
I am laying odds on an October release.
they were ~50% a month ago, id say atleast 60
I've learned long ago that words are cheap to make :P
it isn't linear and there are setbacks as devs said.
it's doing the same kind of training that MJ did
hand-picked dataset
Well, that's cool but so far all the stuff I have seen I really do not care for SDXL. If it remains as it is now it will be a lot of hype then all the people will run back to 1.5.
The biggest deal killer for it is can it easily train Pornhub and Anime waifu shit. If it can good but if it is like 2.x forget it
hey guys, which version of CUDA and torch should I use now?
haven't used SD for a while, still on torch 1.x, but I heard SD wants torch 2.x now
that's because they fucked up 2.1, they won't make a mistake like that again, i hope
I firmly believe they have.
i use 11.8, and cudnn 8.6
The fuck up they made is in the TE for training and that has not been changed it is the same 2.x CLIP.
I think it's mostly about how good is it at understanding propmt and training.
If it's good at both - people will train nsfw, waifu shit and whatever else they want
idk, the generation resaults seem promising..
so the latest CUDA 12.1 isn't supported (yet?) π€
Thanks for the affirmation.
it is, but slightly slower for some reason
cool, thanks π
We shall see. If it is like 2.1 only prettier it will be a dismal failure so I hope with them sticking to the newer CLIP they actually get up off their hind parts and release, at the same time, the training tools made for it not expect us to use the same tools we did with 1.5 as they are not good with 2.x and will not be good with XL either.
That TE actually fights you while training and why we don't have Controlnet from the original people for 2.x. Loved their open letter about this as it was 100% spot on.
Textual Encoder it is the actual CLIP
Never
controlnet is an attempt at that
Sort of and the devs, basically, told SAI off and said eff you.
what
Was an open letter to SAI and just how they fucked up with 2.x and the clip they used
We still lack models in 2.x I wish I had but at least we have something thanks to someone who trained the very few we do have.
let's be optimistic and hope the next model SAI makes will fix all the mistakes, we all make mistakes sometimes
controlnet is the best input extension that exists for SD
we need more control over the model
I agree
the ability to input edges, poses, reference images, its amazing
When dealing with SAI, and emad, I lost all optimism ages ago so now I just sit back, shrug, and whatever happens happens., I am not jumping on hype trains again. Sit back, try it, and decide then.
emad?
Have we yet received any specific tools from SAI, or even an API, etc... from SAI for 2.x? I have not seen any YET emad did say, last year they were coming. Should have been here by now.
they did, it's very handy!
i wish it would support all the extensions
can be combined with a1111 to support all features
it does
if set up correctly, that is
Emad is a former hedge fund manager who wants to build SD into a "$100 billion" business (revenues? market cap?). He is the CEO of StabilityAI.
sound like a humble guy
LOL
shouldn't the focus be to make a good product
what is it
i see the same mistake in new streamers who just want more viewers but they dont actually make content
This is just a side gig for them.
i mean the way to do it is to just hire a bunch of data scientists and artists
hire people who make good extensions
most of all people with good ideas
yeah, that was the goal of this community at first
but ?
ask them what the fuck happened
i dont know, i never used the service
i think services are the wrong way to go about it anyways
the service? SD is open source
i mean the webservice
the way they make money?
i made like 20 images, then ran out, they only take credit card with no other payment methods
basically useless for me
there wasn't supposed to be a webservice in the first place, it was supposed to be full open source, no capitalism
the better way would be to offer things like fine-tuning, lora services, 3D model like marketplaces where people can sell loras and request loras for money
offering a platform
like gumroad for AI models
then funnel the returns into development 
bro. there would be SO many leaks, it would be like what happened with NAI all over again
but that's a beautiful dream, i agree on that
i mean do they want money, or do they want to change the way we make art ?
i'd like to think they want to revolutionize art
and money is just a sidequest
good question
seems its the opposite
same shit with adobe and all the other corps, everyone just trying to make as much money as possible
in the future there will be AI designing architectures for models aswell as hardware and these corps will be reduced to hardware hosts
and fabs
the sooner we get there the better for everyone
Nvidia, without them ai would be basically impossible
amd pretty much gave up, ROCm has a date of death, CUDA and cudnn is still evolving.
i think amd will use their access to fabs and devs to make dedicated tensor accelerators
and as usual, enter the market to provide good $/ops
well, currently Nvidia is destroying them, so idk.. i guess only time will tell
but we will have china entering the market with photonic chips and resonance based hardware that will 100% turn shit upside down as soon as their fabs are finished this year, and mass producers step in with manufacturing requests
so, when its using the gpu its around $0.3/hr and when gpu isnt in use its $0.1/hr for every GB?
and china allegedly finishes their first fabs at the end of this year, with mass manufacturing starting in less than half a year after that
what are they manufacturing?
pretty much a TPU?
similar, i think they have something more generalized in mind
wings out the ass
the
e
e
MAN
ok no
its the
the bottom part of the coccyx
or what its called
the cross
from what i read the issue with the hardware right now is accuracy in programmability and memory
i don't know what the storage cost. the .1/gb is network bandwidth. i'm confused at which part of this is a struggle
its easy to just send shit through a photonics setup, but the memory takes ages compared to the computation
for example there are papers about CNN with ~600 picosecond computing times for image recognition
which is insanely fast
but there is no memory that operates at 600 picoseconds 
will a photonic chip be able to run SD?
so when running its 0.3+0.1?
quantum pc
i dont think so, because it is iteratively and requires loading and unloading from memory
unless we find a way of looping back iterations inside a photonic chip and then we just read out the resulting image
it varies
So, cuda is here to stay when it comes to ai, huh?
i mean, we need dedicated AI memory and not vram
as in, vector memory that works in the picosecond range
ofc they will expand on cuda
I mean gpu cost + 0.1(bandwith)?
it will be a gradual change from silicon hardware to fully neuromorphic hardware
as in, memory + computation in one chips, no external memory needed like in vram
Nature Communications - Development of deep neural networks benefits from new approaches and perspectives. Stelzer et al. propose to fold a deep neural network of arbitrary size into a single...
Can someone remember me the command for beginners? Its for my friend
screw CUDA, ai needs some new dedicated hardware
5th Anniversary International Conference of University of Latvia NSP FOTONIKA-LV "Quantum sciences, Space sciences and Technologies - PHOTONICS RIGA 2023" on 20β21 April 2023.
they are working on it
hi i am new to stable diffusion
i am using stable diffusion with the AOM3 model
my negative tags are lowres, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality, normal quality, jpeg artifacts,signature, watermark, username, blurry, artist name
and my positive are masterpiece, best quality
it is very hard to make it generate anything other than cp whatever i tell it to make in the positive tag
does anyone know how to fix this
this reminds me of that crazy moon from the old zelda game
@wispy nest
what model and prompt are you using
the fuc
it looks really nice
yeah gpu cost + storage + bw
better what ? 
it's expensive
better this coc
unfortunately for me whatever i try i cannot generate anything which does not risk getting the fbi on my doorstep, what prompt, negative or model can fix it
jk
i really want to make cool art
but my gen is broken
use negative prompts and exclude what you dont want
ok so maybe i could add "nsfw" to negative prompt
did i have a stroke
whats bw?
bandwidth
now i will go delete the images i generated earlier before my ms acc gets termed
he just asked for your name, not your life's story! ;P
bandwith is $0.1?
what about storage?
i have no idea what you're talking about, i just knew the acronym.
holy shit man
NVIDIA founder and CEO Jensen Huang outlines the role of accelerated computing and #AI in an address to semiconductor industry leaders at #ITFWorld2023.
Learn more on our blog: https://nvda.ws/3IfDbnY
this is frustrating, you keep asking the same questions, are you trolling?
no, so its 0.1 for bandwith and 0.1 for storage?
i don't. know.
i'm just telling you that they charge for everrryyything
and it's not cheap
ok gotcha
how long does your computer take to generate images and what gpu
my rtx3050ti laptop model takes like 10-15 sec
surprisingly fasts
from how the ships move, it won't be a pretty sight if they don't turn :P
(it was a joke about two ships colliding and then the one at the helm will be fired from their job, and maybe from one of the ship's cannons as well from what they did :P )
Hello everyone, can somebody help me fix those feet?
I tried every inpainting method, but nothing seems to work...
My room temperature thanks to stable diffusion
3060 3 seconds 512x512 20 steps

5*
yeah ive heard laptop gpu is 30% worse than desktop gpu of same name
3050 is weakest in general
What
i have 3050 ti, is that weak
50 series is the weakest of all of them
i am laptop 3050 ti
hi laptop 3050ti my name is nep
@acoustic oraclehttps://www.youtube.com/watch?v=A7wwtPekY7g
Please Give A Like To This Video...And Don't Forget To Subscribe For More Related Videos..
Thanks In Advanced
Wanna watch more videos !
RTX 3050 vs 3050 Ti Laptop - Test in 10 Games https://youtu.be/7fXaXPlQcCE
Core i5 11600K vs Ryzen 5 5600X https://www.youtube.com/watch?v=oDX7GF138KM
Core i5 11600K | RTX 3060 Ti https://www.youtu...
hi nep i can keep very cool during any advanced ai image generation and kinda cool during minecraft
but i would rather be lit on fire than run osu, it makes me overheat for some reason
tf is that
@smoky oak so the terminal snr fixes have now been expanded to all samplers supported by diffusers https://github.com/huggingface/diffusers/pull/3664
ye i really thought a 3050 ti would be like right between 3050 and 3060
no...
that looks like a driver issue
oh laptops are stupid
it isn't?
if that's a laptop then im not confused
dwarf
Yes
find problems
chain is fucked, chair faces through bike, other than that it's fine
chair?
yeah the chain is a weird one lmao
there's no deraileur hanger that i can see
cook the jesse and win a price
weird how much it resolves to apply that fix, man
made this with aom3
i like it, i will outpaint to make it bigger
Aye
instead of cooking a bunch of m*th why don't we cook some models
I just don't remember how to do 1.5 prompting these days
I would if I had the card to do it. Man, so many I want to train and even when I had colab it was more issues than pleasure.
yeah man, i bet when a good new base model releases people will start fine tuning again
possibly SDXL
If we can as it seems to be going more and more in the MJ direction which sucks
LOL
im not sure if that would be a good thing or a bad thing, this community already has some models that somewhat beat MJ
this is my outpainted image, 60 steps and its still not good
VERY bad thing as that is the cloud based, pay as you go, and no community models/training allowed.
i used poor mans outpainting script from sd webui
does anyone know how to outpaint better
i thought you were talking about the capabilities of the models this community has produced..
like does anyone have a script
That is completely the opposite to the MJ way
no, like i thought you ment that eventually people would start to over-cook models like MJ did, i wasn't talking about closed source or open source, i was talking about the sheer quality of the outputs of the diffusion models
I don't see this staying fully open is what I am getting at
that would be very sad
The $$$$$$$$$$ incentive is too great to continue open source
we are all just tools to them to beta test for them.
the goal of this community in the first place is the opposite of that
I bet a fork happens eventually
yep, community fork based on a prior version of SD
SAI goes one way the community goes the other
if stability will go closed source, then someone will take their place, open-source is inavitable.
That is precisely what I said
HF will defiantly stay i the same position, they are all about OS
the someone will be the community and paying to train new models but that shit is not cheap
yes, I like HF
Every single time I see, or type, HF I say Harbor Freight. :/
well, but so far SAI never did a closed sourced project as far as im aware of
They really don't have to tbh. Just make the model so damn hard to train you don't. They stand back and grab the popcorn while "staying true" to OSS.
i always think of hv (high voltage) from gregtech
2.1 is almost there
this is why I see SDXL and see MJ wannabe. Good for prompting but how will it train? We shall see.
Yeah, and MJ is Michael Jackson and I have to step back and realize MidJourney.
dude, MJ is really michael jackson
got an oom time to close some apps
both are horrible people
is there a way to use shared gpu memory
my gpu has 4gb vram but has access to up to 14gb shared memory from my ram
getting a realism model to work, is hard
if its free you are the product
famous quote
what model
what model is this one too
same model i use all the time
which is that
ArtiusV21
i just merged a bunch of models, if i recall correctly i already uploaded it somewhere on this server with Gdrive
have a smoke of some Old Toby

@smoky oak that's the cleanest people face ive made through SD 2.1, ever, i think?
i have heard 1.5 was better than 2 as the nsfw filter caused worse performance, is that true
it says 2.1 is better than 2 but not above 1.5
also 2.1
that's a myth
some people won't let it die
but i can see on those images in the test that 1.5 looks better than 2 in all aspects
2.1 is better with skin than 1.5 but worse on other aspects
I would say to just look at the result you like, and not the number where it's made :D
but that's from December
also that article is about SD 2.0
2.1 was released a few months later and it's markedly improved. anyway, just use models. stop thinking too much about what party has the better music.
I'd say that it being from december is in 2.x's favour ;P
same, but it's not that interesting to argue because everyone really just wants to support what they love and not change their mind etc
I just downloaded about 1000 loras, and at least 4 of them were not of artstyles or women. In a couple months all I can say to people wanting to create something like a man is: Good luck, you'll need it :P
when you just feel the moment inspires a music and you have to squat and impress the lady
six is a little better but I have to restart constantly
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 408.00 MiB (GPU 0; 6.00 GiB total capacity; 4.95 GiB already allocated; 0 bytes free; 5.18 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
once that hits you have to restart
Why tf does it make this when the prompt is :aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
my model can make family photos now but what the heyull lmfao
Because it doesn't know who Fonzi was
i got bluepastel model and it is nice
i tried artius 2.1 but it got me an oom
as i have only 4gb vram
is there a way to use shared memory so i can run larger models
--lowvram on startup
i have to go to bed now but i will try that tmr
The hand π¦
I wonder how much longer before we get conformity and uniformity?
conformity and uniformity? sorry, im not that good with words lol
when everything starts to look the same
well, half right. How can we do a film when we can't even get a character to wear something? I had a great example of this from a Children's book author who has the main character being an elephant. They could not get it to wear a tie all the time, or the same tie, all the time and it was really screwing them over. That was just a handful of images for a Children's book can you imagine a full on short film to even a full length one?
Controlnet helps but not enough plus I am unsure how it would do in a motion video.
You lost me there, conformity is when you conform to something, like a standard. And uniformity is when you uni' toward something. And the use of 'and' brings the two together to form into a "move toward the same standard." in this example anyway :P
one day we'll be there, but it won't be for years I think. One day the ai will be so advance that it's going to be, frankly, scary! :D
bring the two together or this is never going to work right
I agree
Here is when I will know we have arrived. Take a picture. Give it to the AI. It gives you the info to spit out an AI generated image exactly the same. That day will come.
Probably faster than we realize.
for me it will be when you can write a prompt like: Harry Potter running in Hogwarts and get something like a still image from the movies. Then you can add on and on and every prompt word is 100% correct as if said to a master artist of 59 years of experience in the art-school of "wizards running in hallways" :P
I notice a lot of the time I can give a prompt, even a short one, and it skips over words that I know it knows. They simply are not in the image.
that's why I was so happy to try the neutral prompter extension, while not perfect, it is such a leap forward in my eyes! :D
Nah, I can't stand that and removed it
I'm using it in all my images now. Mostly for negative prompts, loras, etc, but sometimes I use them for normal words as well :D
if it works for you for me it was a dud
yeah, it really was a game changer :D
Regional Prompter?
i don't see any extensions called "neutral propter"
no, that one is awesome as well, but not the one where you paint regions, but where you can use BREAK, ADDCOMM, etc
no wait
I'm stupid, that's the same thing, it's the one where you ADD_SALT me know keywords :P
find problems
where is the thing you put your hands on
bingo
it usually has good handlebars and no pedals
no, pedals and no handlebars
weird
child gone π¦
steals bike and pedals to sleep π€
just found this nvidia datacenter commercial randomly. It reminds me of old 90s intel dotcom boom energy
What happens when every part of the data center works in harmony? From infrastructure-scale cooling down to individual chips, every piece is critical to performance.
The NVIDIA accelerated computing platform is the new engine for the worldβs AI infrastructure. Advanced technologies across the full stackβbuilt on the pillars of GPU, CPU, and DP...
https://youtu.be/GMt1djPS688?t=2 height of dotcom boom energy
fixed all those issues
shit π¦
if not hands, bent, eyes that would look like an actual decent fan art of something
eeeh...and piece of cloth connected between stick and dress
and bottom cloth thing...
okaaaay....
Can't tell if gay or based
Tried to create an image with adventurers standing on a mountain looking at foggy dungeon entrance with red eye in it, but SD wasn't having it at all
This one seems pretty cool, though
The Best movie of all time: "ADHISAYA PIRAVI" Mini Me Dance
better , but previous looked more fan-art like
if it weren't for the bright colours this'd be some elden ring stuff
cartoon version of god of war 
Ok, this one is looking significantly better
LN2
?
Liquid Nitrogen
What
Jibberish
Gibberish*
gazuntite
The edges are all open, and the fan creates negative pressure that draws it in, then forces our of the top holes. Pretty standard design lol
Lease stomp braying gumball blings, your knot bleven taking tense 
Shut the fu
TOP STORIES FOR YOU
Quora
β
I caught my son playing his Xbox at 12:00 in the morning on a school night. As a result, I broke his console and now he won't talk to me. How can I tell him that it is his fault?

@smoky oak i expanded the dataset to include a few thousand high qual national geographic photos
they took me A WHILE to download, not many seeders. like a month i waited
i can provide to you if you like
i'm hoping to keep things like instruments, bikes, landscapes in tact. i had to turn off learning rate scaling because i'm using multiple GPUs to train now and it really goes wild
I am not sure I have a need for them, but it might be nice to have them on hand
yeah and i'm not sure how well they work either
I'm gonna be messing around more with tensor RT today. I really hope I can somehow get it working with batch sizes greater than 1, that would speed up my generations massively
I could only imagine how fast it could go if I could get a full BS8 working lol
on my cluster training i can do batch size 128 now with no gradient accumulations LOL
@cyan snow
@smoky oak those images are captioned at least so you can search for bits out of it, which is what i've been doing
i love how mindless these robots are usually
i hope the standard robot personality is paranoid android
what's this magic, how do you fit so many details here
Why am I always refactoring my promts to have as low amount of things as possible lol
I would have expected more smoke π
Oh nice, that's actually useful
I just need to get BS 8 working with tensor RT, and I will be going faster than a stock 4090
I wonder if running the command on its own will help. They recommend doing that, but I'm not sure what they mean exactly
I just prompt but do not forget to use the word (lowercase) "AND".
I can imagine that on an actual 4090
Have somebody here who did it, I actually got a considerably bigger perf uift than they did
*uplift
well, that makes zero sense
They went from 35it/s to 53its/, and my 3080 went from 15.3its/s to 27.7its/
like how an AMD 7900XT trains 4 times faster than it generates
I saw like an 87% speed increase
for training?
Tensor RT doesn't do anything for training, only generations from what I knoe
well, that fucking sucks
That's not at all what it's made for lol
it can though just not implemented yet
GPT wants me to sing you a song called Salad Fingers 
Cause you don't have to make one for every single BS and dimension
there are tensor cores in all 2k+ cards and those can be used for anything as they are so damn fast, but looks like no one has yet
that man looks so happy 
My current trt unet works for anything between 512-768 on either dimension, and up to 375 tokens
But I can't get the batch size range to work :<
wait, what are you calling unet? Unet and TE for training is the only unet I know
So try makes a modified unet, you apply that when generating and that's what speeds it up
*trt
sounds like it isn't the real deal yet.
You go into stable diffusion and then change it from automatic to the specific one you just made, and it only supports the ranges you specified
NVIDIA's official version should be even better still
If I could get the batch size optimization working, I would be as fast as a stock 4090
he's poppin'
Oh wait, I have an idea
wednesdays on nopeTV
hilarious that it lost the wizard dude but his stuff is on the bench??? unsolved mystery
I am becoming VERY ill at ease with how cozy Nvidia is with Intel and working together.
oh, okay. i updated my prompts and changed the seed i'm testing with
definitely did a good job on that one
you might think those hands look unnatural, but i encourage you to look at what Paul Gilbert's hands look like 
morning all
@sterile templehowdy!
I have a quick question for you, if you don't mind
I'm trying to figure out how to run the onnx to trt out of SD to free up VRAM, and potentially allow it to do BS 8, but I am not too sure how to run it outside with the command they provide
Even on my card there is something running onnx but I forget now as I have seen it error out before.
Something in auto
I just need to figure out how to get the command running outside of SD, cause I really wanna get this working with batch size 8 to get the real speed increases
the command to create the trt file?
yeah. I wanna run it with Sd clsoed like they suggest, I am just not too sure how
what if you saved the commands into a bat file and then ran that?
this is what it gives me to run
like this
just put it all into a bat and run it?
yep
Is ONNX faster than TensorFlow?
Overall, the study found that ONNX outperformed TensorFlow on all three datasets. This suggests that ONNX is a more effective tool for deep learning models than TensorFlow. As such, it may be a better choice for developers who are looking to build and deploy deep learning models.Apr 9, 2023
alright, that worked, but it had the same error
so annoying ._.
IDK why I can't do greater than 1 batch size
Isn't onnx using the diffuser directly?
this speed benefit isn't really important for single image gens, its much more important for multi image gens
but it looks like its broken for multi images, even though it has a setting for them
I am not caring about tensorrt just more for the onnx
not sure why onnx is worth caring about
it is better than tensorflow even on my card
looks like the product of the image size and batch size can't be more than 92160
any idea on how I could try and fix that limitation, or is it a hard limit?
so I have to make sure that none of the numberxnumberxnumber parts are over 92160?
@smoky oak Do you have a link on installingthis and what to do to try it?
Damn thing even works on maxwell based cards
Humble mikey was the only one that was able to help me and everybody else with the install
yeah, cause its just a cut down unet
its not using any special tensor cores or anything, just optimizing the unet
that is the maximum size you can do? ._.
seems it takes 16, and 32bit into 8 bit realm
Now I wanna tryit as I thought tensorrt demanded tensorcores
but it appears like it may be far too limited to be particularly useful where speed matters lol
just reading through the issues, trying to make sense of it π
yes
thats what it looks like from my math
looks like the absolute max is about 842x842
only say it MAY
thats the price to pay for 2.1
besides I use weird rez (half FHD)
from someone working adding the option for batch conversion, they have been playing around with the sliders trying to figure out the max settings possible
No way in hell will I go back to 512x512
but it does limit you to batch size of 1
damn, this is super super disappointing
its almost useless ._.
no high res fix, limited to one image at a time, low res
its like, they chose the already fast part to speed up lmao
Oh, and no controlnet
I don't really care about controlnet, but it sure is a lot of drawbacks
too many to have it be viable for most
yeah, huge shame cause damn it is a lot faster
Maybe the Nvidia one will work around these limitations
if I could get batch size 8 out of it, I would be at stock 4090 speeds
I hope somebody new comes along in the SD webui space, cause I don't like having to pick between two assholes in order to have a decent webui lol
This is insane
it's only a new thing. hopefully it will be improved
Do a google search and find TensorRT isn't really new.
well yeah, but support for stable diffusion sure is
That is just a couple of dicks trying to out script each other. Once Nvidia's new ui happens we may then see stuff change.
You know what would actually be a massive time saver? Faster post processing
What is with that long ass pause anyway? Done with the steps and another 5-10s pause
cause with tensor RT, the slowest part at 512x512 for me is post processing
I get 27it/s on a 15 step image, yet it takes 1.2 seconds, cause of post processing
on larger images that pause can be up 20-30s
btw, @wispy ether you can disable by setting this option to None in the settings. no need to uninstall or switch branches
freaking out for a minute there. my outputs were suddenty complete shite. thought I broke something. turns out it was just that neutral prompt extension doing something weird with my prompt
evenin'
Man, i really wanna find cool and new models, but I am so damn tired of seeing sexualized female EVERYTHING all over the damn place
I've tried to make mine non sexy
like its all just hypersexualized and fetishized women
I just want a cool model FFS
hypersexualized and fetishized
._.
a very cool model!
ugh
hope she don't get a cold ;P
my brain! π΅βπ« π
I really wanna play around with a model that is more abstract and freeform
but like, still looks good lol
I've noticed the ai like to create arms at the end of the character's hair if you prompt in something like long braid :P
Can sometimes look rather cool! :D
Never tried that, lol
I don't know, it somehow look like it'd fit :P
does low vram affect quality
yeah yesterday I was having a very hard time getting anything other than lolis out of aom3
then I added nsfw to the negatives tag
and it fixed it
genuinely so damn tired of the blatant hypersexualization of these models
loli loli loli get your adverb here.
so yeah its quite easy to fix
Hyper sexed children all Homer Simpson drooling over their waifus so I am glad to have 2.1 tbh
some of the outputs can be slightly sus even with the negative tag but not too bad and easy to fix by just regenerating, most are ok if you add nsfw to negative tag
nsfw didn't help me yesterday until I gave up after 5 or 6 models
was it nsfw or just slightly suggestive sometimes
even a Disney one had nipples and tits. Clyde would not let it pass
I most often get the result I want when it comes to output. Can't say I get chocked by, "why did it create this I told it not to do." ever :P
i thought maybe it was just slightly sus (like mine seem to be 20-50% of the time) but how did it make that so blatant when you had the negative
strange
I have no idea. I even tried nude, titties, nipples. That is when I threw in the towel when even Disney had it.
well, the first one is a color, the second one is slang'ish, and the third is a detail :P
Well, fuck it nothing worked so I went back to 2.1 without all the damn nudity.
it's all about the words, some are more, let's say, "fine tuned" than others :P
Some 2.1 models are all nudes with a dash of sfw in them
The other day I saw a "peeing" model, that was ... interesting ...
Nice tree
It's uh ... yep ...
NFSW
https://prompthero.com/ai-models/realpiss-v1-download
NFSW
I was trying to get info on "realistic-vision-v1-3 (by SG_161222)" and unfortunately found that along the way
The dprevity amuses me
There's a market for EVERYTHING!
One of the things I did to my mix was calculate the difference between beautiful realistic asians and realistic vision 2, and subtract 0.9 of that from my mix. Boom, bias towards drawing pretty asian girls gone!
too bad it is for 1.5 I would like to see how it does for non pee
I still haven't had a success like that
MBW/Super Merger as the classic 50/50 type is meh
Like the nude ones Walach clued me in on a trick of adding Corset and sure enough it works.
it's easier to trick the ai into making what you want, then telling it what you want sometimes :P
@sterile temple uhhhgggggggg
that's how I actually "see" most artist names used as prompt words. Like a shortcut to get the artstyle instead of writing it out in detail :P
the Sd update broke controlnet hard for me
I am not sure why I am getting this comic strip like white bars now
I sometimes add things like panel to the negative when I get too many "comic book white border effects
oh, good one
you okay there? lol
Alright I just got straight up gay porn. NGL, I dare not even post this as clyde would freak
has anyone else just slapped this script with random stuff and just let it run overnight?
the SD update destroyed my controlnet install

none of any of it works now
but if you use artist names then it might not be enough as I've noticed they use different things there so start with one, then add or change it with similar stuff like border, bar, strip (also work against lewd stuff by the way :P ), frame, etc
all sorts of file errors, and other issues

are you using the same seed?
No, random
same here, I updated to pytorch 2, and its been a little better now, but the extensions don't like moving on from a 4 month old SD install lol
oh i've got a question, when you guys inpaint or latent upscale, do you paste the same seed

I couldn't get the tile diffusion working with the controlnet tile model either
no, thats a good way to get seed issues
aww, too bad, maybe my "wonderful," but mostly lazy skills don't work in 2.1! π π±
what's the error?
this, along with many MANY others
I just updated all of my extensions again, hope that fixes it
ah, gradio, that one is always like that :(
so just leave it at -1
I'm gonna try that too. See if I can get upscaling working again
seems like the issue might be the placement of the entire prompt as you get those bars more constancy than anything else in the image :P
The ai reads each word in more than one way and the word after it might transform it to something else entirely as well. That's why it's hard to get more than two colors named one after the other because a lot of people just detail the first two colors :P

if I get many errors at one time, then I just delete (after backup!) the entire venv folder. Has worked 100% of the time so far :P

Barrylin
nope, still ruined
probably gonna have to gut out all of my extensions and redo everything like I REALLY didn't want to have to
weird, updated extensions. now when I click generate, it opens up the file browser and I get some javascript error in the terminal window
I had to do that last time I updated so I don't update though I am soon going to need to as extensions are bugging out lately
they at least seemed to fix the issue of pytorch 2 being slower for me, so that isn't holding me back anymore
I learned my lesson about updating when auto1111's webui changed how their high res fix worked :P
you can still use the old version, tho the new one is much more reliable, and controllable
looks like taking out neutral prompt extension at least lets me generate images now
@sterile templeI reinstalled all of controlnet, still fucked
tile diffusion with controlnet working again
can I just delete it or something?
yeah, if an extension is playing up you can just delete the folder
I have a timeout folder I move them to π
yeah so it looks like I can't use controlnet at all now
dope I guess
Glad to see my concerns about updating were valid lmao
What are you trying to do, i'll test it on my instance
reference only
ahh, after 20 cups of coffee I'm finally ready to take on the world! or at least until my body starts shaking from withdrawal again, but then I just fill up again! >:D
yeah, I've seen those errors lots of times before
I have no gradio file
what the hell happened
I am so damn tired of everything breaking lmao
This is the exact reason why I was SO against updating, cause nothing good ever comes from it
Let me see if I can just restore my old install
I'd delete the venv folder and let it build it back up. But I don't offer much help because I know that one person's settings often isn't the same as someone elses :(
not true once we merge with the singularity
I cached my old venv and extensions, but knowing how A1111 is, it will still be broken
yeahβ¦waitβwhat do you mean with "we?" π±
I'm using gradio: 3.32.0
it deleted my gradio folder @sterile temple
I think going to dev branch ruined everything, its all unusable now
version: v1.3.1ββ’βpython: 3.10.6 β’ torch: 2.0.1+cu118 β’ xformers: 0.0.17 β’βgradio: 3.31.0

you could try installing it manually
on my old install, still fucked
I knew I should have never updated, nothing good ever comes from it
did you install it by a file, or by git?
ugh i feel that, i had 2 days of not being able to train because i installed mixture diffusers and it reinstalled bitsandbytes






liminal space



