#general-chat
1 messages · Page 496 of 1
LOL
14700k on ddr4???
how stupid would ddr4 on a 14700k be
Not at all if you have a valid use case
SIX ROOMS WITH A SINGLE BREAKER (probably 15a)
lets just say id be buying a 14700k just to waste money
If you just play games and mess with crap then changing from a 13600k is pointless
Well you know my take on that one 
At your age I would never expect a 13600k to not be enough
now i just gotta decide if i wanna go thorugh, recommendation was also just going ddr5 tho
dwim trying to figure out why my 1% lows are so ass in some games, im stuck between gpu and cpu and ram
Maybe it's just my age but 3 years ago a 13600K was king
We had 12900K
11900K 10900K
13600K hangs with that
Which games
fortnite is the main one rn
i load into a red vs blue match and my lows and general peak fps was so low
it did nOT feel like i was getting 160fps
13600K scales well enough so you want better ram/cache perf
felt more like 70
woudlnt the 1% lows make it feel poop
Frametime variance can feel slow
its prob the frametimes
Like steps fluctuating over 10ms
If your ram or cpu is like, even a little unstable it can make games feel awful depending on the pc
It's like a corrupted video driver type of behaviour
are you... hyperlinking an emote everytime you want to use it?
Like your displayed fps just feels dogwater
Numbers high but actual feel and visual monitor feedback is terrible
gotta love over specing your monitors
My 7950X3D did this when it was killed by an ssd backfeeding into the io die
The fps looked fine
But I was actually really underperforming
My suspicion would be power or hardware instability if it feels like ass
Dirty power is a common perpetrator of bad feeling fps
psu good
Like low 12v droop
I'm spitballing also cables go bad all the time
my precious extentions
Yeah a bad psu cable can be at fault
Ah yes
Extensions
Those are soooo often a big issue
its only forntie that feels poop anyways
But a good one tbh
That game has caused so many people issues in the last couple months
It's way up there rn
even my friend with the same cpu but diffrent gpu was saying that his fn felt so laggy
Latest AMD driver gave a warning of not to play Fortnite at DX12 mode aswell
I have a video that goes over some fortnite stuff from ztt that might help
i dont get that anymore
You probably know the steps tho
Avoid perf mode, fps cap are the main ones
The vid is good regardless
i cap my fps to my monitor refreshrate and then i use dx12
Ye
If you want to rule out the gpu completely, DDU is good at that
DDU + win update pause
presnt mon
I've fixed hundreds of fortnite issues by now getting used to seeing the signs on that game specifically
Where presentmon
144fps on dx12 with a 7700XT isn't too far off expectations
You probably are missing the uplift in OC tbh
i find DX11 to actually be faster than DX12 on the same settings
Ngl
That's outlier talk for radeon

☠️
Set it a little lower than the refresh rate
A 13600K done right can play virtually like a i7/i9 of the same gen on that game if you oc it properly
Like if its 144 do like 130
i have 240hz, so i should do 200?
Yeah try that
CPU busy is a bit high
Maybe your monitor is the issue
Some with vrr can look wonky af with varying fpa
vrrr prob doesnt liek my fps going all over kek
Which monitor is it
jumpscare
this gs27q x
I CAN GO MUCH HIGHEEEEEEEEEEEEEEEEEEEEEEER
Ah yes the updated gigglebit
im going on a map that has nothing on it to feel good framerates
i like it
its my first 1440p display
oo this feels so good
why cant pubs be like this
also 1 ping is nice
fr
165-240 feels smooth when it doesnt feel like poo
like roblox lower fps feels fine
im only limited to 170hz refresh
i should have went 360hz
1440p 360
montor is the best birthday gift i ever got frfr
Had to dig a bit. Cheaper panel than the M lineup, often horrible factory calibration (This could be a genuine reason here), blurriness is common on panels from this series and older at lower fps
somehow better than my my asus
i keep fortnite locked at 180fps
mix of ultra/high at 1440p
DX11
no lumen or nanite bs
i this thing is a blurry mess even at full 165hz obvious not running 1440p on a 1080p panel
I think the VG is even old VA
its ips
Ah well you didn't get the worst of them then
atleast on every site if looked it up on says it is
I can never remember which is which
Asus is almost as confusing as acer for monitor codes
But all VG is bad I definitely remember that
At least IPS is not the worst of them tho
finnalyl a reason to justify a better gpu, so i can stay at 240hz
Yeah I could see that, try a bit of OC tho first
my gpu is at its thermal limit currently kek~4
the most this thing is going to do is a vram tune
Fortnite scales tremendously with cpu and ram oc
and a uv
my cpu.. and ram. i have explored those limits before
ass far as im aware my 3200 corsair vengence can run 3500mt/s cl17 stable, 3600 becomes poopy unstable mess
cpu can run 5.6ghz but i never got it stable, now its just stock
Sounds like kekw c dead
this is the way
higher boost clocks as a result
Ye cos lower temps
thinkin bout it, i could prob get my cpu to run 5.4ghz on p cores
but im lazy
im a retired ocer
i can do that with 1.18v
Fn I think doesn't like lasso
imo takes too much power
So it's likely just oc yeah
lol
You'll probably bring your lows up about a third to halfway even with a pretty lazy tune
im hoping really bad that the 5070 is good
It's just 4070 +10-15%
You don't need a review cos 5080 is all but confirmed this fast rn
o
31% improvment for me mhhh
So it's whatevs
To me you'd prefer a 7900XT imo
30% more performance, could fill in the gapp
goin depend on the price and if i wanna deal with amd even longer
7900XT is similar price bracket, way more performance
Ye it's near 4080 raster
hmmm if i were to sell my 7800xt now i would like to get a 7900XT or XTX for cheap but that aint happenin
amd seems to cater twords the higher end cards
Sits between 4070 TiS and 4080 for raster
giving us scraps
but then nvidia has better raytracing and upscaling, but amd might close that gap with fsr 4.0
rn the only game that seems to feel like poop, yeah
other games. well i just dont run them
Yeah I wouldn't put stock in that then
indana jones is an intresting video game

RT really isn't all it's cracked up to be
It's like
You get better looking puddles
Lmao
The rest is harder to notice

i love it in cyberpunk, i will run cyberpunk at 40fps fsr balanced
I WILL
it somehow feels smooth
7900XT isn't even that far off a 4070/S in RT iirc
i think ima wait till i lockin my college classes
depending on what i finally decide to do, will determin which gpu is the best
i think ima do video editing and just end up using the laptop ima buy kek~4
meaning i can just use amd on my pc and not care
Yeah I'm right it's actually better overall
how is it.. so close
So true but fr tho
Wym
RDNA 3 RT is ≈ Ampere
What do you expect lol
It's hw based
It's not like rdna 2
mhh
Yeah amd is basically a gen behind for rt
i had a horrible expreince with rdna 2
I believe you, I had a gamut of experiences with it
Late rdna 2 is wayyy better than older rdna 2
I think next gen will be the same but probably less of a difference. Like itll still be behind but not a generational difference
had a rx6600, driver issue after driver issue, games would cause timeouts just for alt tabbing, loading a match, being on my mf desktop... litterly looking at it wrong afk in game could cause a crash
now.. the rx6600 has no issues and its pissing me off cause thats the entire reason i bought 7700xt intsead
Next gen is basically rdna 3 but cheaper, or rather, supposed to be
@hoary zodiac I know you use Librewolf, so wanted to ask something. When you go to YouTube and watch a few videos, does the interface sometimes have this "lag" where it takes too long to do certain actions, such as hovering the mouse over the progress bar, pausing the video, going to the home page, etc?
Yes that what I mean
Old rdna 2 sucked
Like early early
i bought my 7700xt the week it dropped
Once rdna 3 hit, rdna 2 became way better
thast how pissed off i was
LITTERLY
once i swapped gpus the 6600 is fine
Lmao
and now the 7700xt is just being too slow for my montior
Nah its itll still be better but will be better value
I'd go used 7900xt imo
i might
im waiting to see what happens with 50 serise and 40 series.. and well money
If the $480 leak is true then amd is back
I've seen too many synthetics and game benchmarks by now, it's like, really close (9070XT vs XTX)
Next gen saves power, die size and money
I think they overhyped rt uplift cos I don't see it rn
Bro
Gotta be realistic
There's like maybe a little bump?
and raytacing in a select few titles
Ok I can't comment on that one ig
On Navi 31 I don't see this
But navi 31 is different support set
Real
Quick sync is ridiculously good
If they make a good gpu I’ll buy it
Well they are good
But good performance higher end
Yeah and the leak saying 48% didn’t help either. I still think they will be a gen behind
So itll have like ada rt
If its true its going to get scalped
Imo given the way trump is playing tariff roulette I wouldn't wait rn
Next gen looks a wash
True amd users will wait for the price to fall, like a year or something when amd gets wven cheaper
True
Either way, used prices funna change
Amd always goes down
Where'd you see this btw
I forgot the guys name but he was saying between 480-530 for partner cards. I also remember seeing a listing that when converted and vat subtracted, was 530
Frank Azor yes
But thats just one example though so idk
And that was the PH article
They've shot down the $900 and $750 msrps
But no confirmation of any price rn
Like reference would be 480 and partners would go up to 530
Yeah
They've hinted at this yes
But if true, the 530 cards are probably those chonkers with 3 8pins
But let's just wait and see cos the rumour mill is insane rn
Don't get hopes too high
Yeah

Imo based on what I've seen, sniping a used current gen rn is a better approach
Nvidia will fix my life
That's a funny way to spell retail therapy
I think it’s dead, it’s stuck
Ikr
@mortal grail do I hold off for more water blocks to come out then recycle the ggf PC radiators and cooling stuff

Do you really want the hassle of redoing hard lines
I switched them to soft tubing months ago
Ye and the blue dye stained EVERYTHING
Haha

Do I want to void 5090 warranty
But I wouldn't buy a high end nvidia card doing that

If you're going to all that trouble just to remove the cooler you won't get much
Maybe like a gainward
Or a palit reference
The high end cards now on 90s don't offer anything going to water man
At least on reference you could get msrp or close to it, go water and make up the difference
High end you just spend more, change it, gain basically nothing
Like the suprim aio will not get better on a loop
At all

Last one didn't this one certainly won't with the same tdp
Bigger rad
So there that's as nice of a two cents I will give
Lol
Optimus was putting out a pny block
CHA
can't wait for the inevitable r/pcmasterrace question about water cooling where it starts off with "How would you get a small cylinder soft tube-"
THE s9 BOOTS
Do what I did

Find a new case theme
Changing the build is way more fun with a new aesthetic than putting a bigger gpu in

Costs way less too
I'm using a open benchtable
Sounds boring af
As my daily

i wonder how considering it's a smaller size
my thought is, smaller size = smaller noise no?
Higher quality parts
Whine increases as it gets better
built-in noise machine to help you fall asleep
The caps are better so more vibration
Dang controller broke smh
Idk what controller feels best for racing games
@rancid juniper ?
Gamesir he
Mmm Xbox controller
I will destructionist u
😏
🤨


I had some cheap(ish) off brand Xbox controller and it was ok but I was thinking about the dualsense bc of the triggers
Ps5 one is nice tbh
But stick drift
I don’t even know if my pc has Bluetooth lol
Do any PC racing game even make use of the dual sense hapticks?
Wifi?
You can check right now
Nope 💀
does any PC game aside from official playstation games use the dualsense haptic triggers?
Uh like any with xinput
I took my WiFi card out ages ago when I got ethernetering
Rog pog
Put it back in and you got bluetooth
chat
Hmmm
tahc
If I can find
the phone booted, i looked at the search history.. im wiping it
Do I have to have the antennas on the back of the card for Bluetooth 
freak ahh
Bro is an idiot
he said its broken
sir it indeed wasnt broken
i fixed it
but im not telling him that
orang
Youtube ai be like:
way to kill the mood
hahaha
The elevator has been down for two days and I have 8.4k steps recordered today over 4 floors

getting the exercise in
thats good, theo
Too real
Bro spit truth twice in one hour
@mortal grail @sweet phoenix the 5700g and associates have been traded
I pasted a log snippet into llama3.2 prompt and it attempted to explain it lol
MIKU HAS ENTERED THE CHAT~
Hatsune Miku x Rocket League kicks off tomorrow!
55668
why is miku spreading everywhere
because she can
She keeps leeking everywhere
Damn the whole kit is only 157 bucks
Where at
Put a 5900X in it
the miku i know
i got the phone on my pc
I feel dumb

personally if I had a mobo with exposed VRMs I would put a heatsink on top of them
motor
im moving my mc server to this phone kek~4
i think it will be fine running on a s9 and 4gb ram
You must first learn the skill from the wizard
bruh what
Sponsor: Arctic Liquid Freezer III on Amazon - https://geni.us/NrMtDT
This benchmark compares PCIe generation differences on the NVIDIA RTX 5090 GPU. We're testing PCIe 5.0 x16 vs. PCIe 4.0 x16 vs. PCIe 3.0 x16. This also helps serve as an effective PCIe 5.0 x8 vs. PCIe 5.0 x16 benchmark, as PCIe 5.0 x8 is represented by PCIe 4.0 x16. The testin...
1-4%...
Big surprise
It's almost like I've been saying a 3090 maxes out 2.0x16
It's amazing how pcie gen 3 is still practically the standard
LMAOO
Because you just don't need that much bandwidth most of the time
💡 Useful Links & Resources:
🎵 Consumer Action Taskforce Muzio Article:
https://wiki.rossmanngroup.com/wiki/Red_Sky_Labs_Muzio_Player_Premium_post-purchase_terms_change
📱 abMuzio Music Player App:
https://play.google.com/store/apps/details?id=com.shaiban.audioplayer.mplayer&pli=1
🔍 **Video on Browser Plugin for Consumer Pro...
Termux
Wanna join me in my server if I can figure out how to get playit to work on it
I just gotta disable my real server for a sec
Playit premium is dirt cheap
I’m not spending money
Unless your offering to buy it for me
☠️
What are you, poor
NGL I still have playit premium even though I haven't hosted anything with it in a while
No, I just don’t wanna spend money??
If I liked spending money I wouldn’t be using the setup I have now
Yeah idc about pcie 5
I actually kinda dont want it because gen 5 drives would get really hot unless they already have new controllers
But probably even then they would still get really hot for now
man i need more anime that make me like wanna go out and lift a car off the ground
the ending of blue lock s2 did it for me
fr
Have you tried far cry 5 funny moments
that's me but gen 4
for most people it doesn't make much of a difference (except 6500XT users)
even ssds are meh
I'd rather have less heat
than fast speeds
Even even gen 3 drives are fast enough for me
mostly because I'm on mobile
Like my other drives are sata rn
my gen 4 drive died
controller shenanigans
samsung 970 evo plus still going strong
back when samsung made good drives
A 4060 can see a dip
u weird

Probably interference
Interference in my computer deducts my speeds about a quarter
I should get 300-330 down but get around 220-250
its suppose to be usb 3.1 according to samsung specs
but idc that much
I remember the days when that was simply called usb 3
finally @mortal grail
ugh
i wanna get a s10 or something
kek~4 its cheaper to get this over a new screen for the s9
super cheap stuff over here
New oneplus is really cheap and you get a watch too
...
Android is just goated like that
id use that phone as my everything besides apple exclusive features and social media phone..
?
But family kept pressing me to get a new phone but mine is good enough, never needed a new one
i think i can get a cheap one at my carrier thinking abt it, but im lazy
gonna post a benchmark video on assetto corsa evo later today
Regardless my brother fell for consoomerism and bought a new iphone
I got his old one handmedown
Do you like that or tokyo more
i want anything 15 pro max or newer
TXR ALL DAY
Nah oneplus sweeps
Yeah it does
no it doesnt
neither does my wife
ur mom sweeps
u dont even know what i want
Neither do because there's no broom


Why buy a phone for a broom job smh
there is career mode ?
not yet
But fr tho im prob gonna sell this iphone
im going to see if i can trade mines in when i get money
The feds would like to know ur location
why..

o..


this phone has a snapdragon 845 2.80ghz cpu
i still find it funny its cheaper to buy a s20 over a new display

I was getting low 220s and after rotating my computer I almost got 270
No more porch pirates
Front toward enemy
Yeah exactly. Deleting them too. Basically helping the community
Prime subscription has been reinstated
"Just get a door camera or a Ring" goofy 💀💀



💀
Kinda wanna order some uranium-235 and see what happens
Packages might stop getting stolen idk
Might see a SWAT team come visit a couple houses down
Would be a fun day tbh
Did you see the story about the kid that ordered like 20 different depleted nuclear materia
He got visited by the federal police 💀
They went after him when plutonium showed up
He was just collecting them for fun
I think nilered might've gotten a call at some point when he ordered uranium. I don't think they go after you if it's small amounts and depending what you plan to do with it
its sad that you can unlock the bootloader?
oh
oh
time to get iphone gesturs on it
Where do these go on a b550m-K
yeah the white one
Yep
Read manual for which goes where it's a bloody pain to describe it over discord lol
Bro just sat his burger on top of his PC
whats the max score (with most background processes gone)?
whoa its that music used in memes: https://youtu.be/25EIZboEuAQ?si=gjby-29c08t9rSj1
Composer: Manabu Namik and Noriyuki Kamikura
Copyright Atlus 2008
popped up in my recommendations
I have done one power connector on so far
the single hardest part of building a PC
nvidia dipping sauce
if they made a dipping sauce rick and morty would be all over that
just like the szechuan sauce
how would you even concoct a flavor for that
Liquid metal flavor
Ew
I've put more effort into this than I'd prefer to admit but it's still at least partially borked afik
something with tang, lots of tang
where the Linux geniuses at? lol
Liquid metal flavor with a hint of sand thrown in to get the silicon in the mix
sprinkle some copper residue from lapped IHS lol
artificial flavoring meant to resemble a flavor you can get naturally for the AI upscaling twist
something like AI orange twist
What if it is the flavor that is the result of asking an AI what the flavor of a gpu would be
Plastic-flavored sauce
So it'd be a crunchy paste that tastes of metal, burnt plastic and solder, a hint of artificial sugar and some raw caffeine that you scooped sorta like salse
GPU salsa
asking the real questions
"It'd probably be more of a texture experience" sent me
hi
i also run pihole

yes I know. Party in #networks-security-and-home-servers lol
so what seems to be the problem
party!!!
Straight cut gears FTW
My bottom front case fan is no longer working but I’ll figure that out later
Garbage LEDs
No idea
But they’re cheap plastic
I’m gonna probably get a new case eventually
This one has a plastic side panel and sheet metal siding
NEVER
https://pcpartpicker.com/product/Xm92FT/msi-mag-forge-m100r-microatx-mini-tower-case-mag-forge-m100r
@dusk knot
not bad
It’s such a bad case though
Yeah
@sweet phoenix this cpu is already faster lmao
Need to get a 5700xt now but I’m waiting for the money for that to come
Also I cannot find where this one goes
Everything else should be in place (outside of that bottom fan)
front IO part of your motherboard
also says which pins in your mobo's manual
Thermal Grizzly KryoSheet is on the way... I am going to use it with 9800x3d and Thermalright 120SE
Any way to cancel that and get a joyjom sheet instead
Same thing but way less expensive
And
@idle nexus
it'll be the "PLED"
lmao pee lead
I’ll show you here in a sec

I remember my first ever pc build this was the most confusing thing ever
but new pcu’s come with a diagram now
?
idk
Again
Manual
This part is cancer to explain over discord
You guys will be here like 10 minutes per plug
I have a “power sw”
“LED•”
“HDD +/-“ (in same connector)
And “power LED + and -“ in two different connectors
Manual sucks
@mortal grail
Yeah now you match the pins to that diagram
But which pled is the right
I don't deal with more than four plugs (Lian Li things I guess idk)
Either
See top left
Those two first
If you have others
Bottom right
I'm pretty sure both do the same thing
one mistake and your PC could explode
Or the usb don't work sure
Gimme like 20 minutes and I’ll go down and do the changes
What is it?
My second GPU. I am so excited to finally be back to 2 again 😅
4060ti 16gb iirc?
3060ti 16GB
Yes
Plus its actually faster for some things
This is the cheapest one I can find, and thats refurb price
My 3060ti with the 16GB mod was $309 with tax and shipping, and it was re-pasted and has much faster memory as well now
Oh that's not bad at all for a modded card
Plus, its an EVGA FTW, which I will take over some crappy Asus any day 😅
Man 4060Ti 16gb still going to go down as one of the worst nvidia cards to date with prices like that
Also I realized 4060ti has lower bandwidth
Yes smaller bus
128bit vs 256 on the 3060ti lol
Yeah! I sold my normal 3060ti for $230 to a family friend cause he was building his son a PC for christmas
It's for this reason as well the 3060 12gb is sometimes preferable
And that's definitively slower typically
Does that matter for AI I wonder
And for the stuff I do, the 3060ti faster bus and faster mem (in this case), is better
very much so
Absolutely does
especially text gen, which I do a ton of
$309 for that is lowkey a steal then
It matters for crypto too, many 40 cards suck ass for crypto
100%, its great
Barely better than 30
4090 for example gets basically the same hashrate as a 3090Ti
Crypto mining kinda irrelevant nowadays anyways
he buys them broken, desolders their bad mem, upgrades with top binned Samsung 2GB GDDR6 modules, OC's the mem, fixes the coolers/fans, re-pastes and then sells them
Yeah it is, it's just one of the things bus matters on tho
If ever you find yourself needing it
Lol
He said that the Samsung 2GB modules can overclock over 1GHz higher than the micron 1GB chips
I ran some stable diffusion on my 8gb 3060ti, worked fairly well
So yeah, for that type of mod and what it offers, its fantasdtic 😅
2GB chips in general are pretty good yeah
Oh yeah, SD is a very light load for AI
Fairly low resolution limit on 8gb
:3
After the solder job
He has an actual job doing these mods, and I know multiple people who have bought from him
the really really cool one is the 2080ti 22GB mod
However, its too old and unsupported for new AI to be worth anything for me
He probably does lots of repairs too
That as well. Like I said, he usually buys junk cards and upgrades them. Its dope
I was boutta say, pretty sure 20 series isn't nearly as good for ai
If you can bga a vram chip you can do almost anything
I know a friend with 8x 2080ti 22GB's from him
As far as gpu repair
Hell, do you guys know if there are PCIE risers that can split a slot? If I could get that, I could buy more GPU's lmao
My mobo is sooo annoying. It has 16x Gen 5, then 1x gen 3 😭
so my 3060ti is gonna run at 1gb/s
There are iirc
which is insanneelllyyy slow. Its not the end of the world, but I would get a lot better perf if I could run it at even just 4x gen3
They split into like 4
if I could do 16x gen 5 into 4 8x gen 4, that would be GOATED
Wait is the 2080ti 11x1gb chips?
But if you want full bandwidth then you probably want a hedt board tbh
yessir
Hm
it only needs to be a little faster really
even 4x gen 4 would be massive
I could throw in my 3080 as well lol
Pretty sure there are splitters, crypto miners use em
have 50GB VRAM. That would be sooooo cooolll
I am gonna be buying a digit if they aren't trash, so I am excited for that
I shoulddd be closing a well paying gig in the next few days
Apparently it's a thing
not enough to buy a digit, but its a big start
I was just about to ask if AI was something you made $$ from lol
yessir!
Not much, cause contract work can be so hard to find, but when I land one, it pays disgusting lmao
my first job from the comapny I worked with, I was 19 and I was working with the CEO of Calm (the phone app), and I was paid $100/hr 😅
You gonna mess with deepseek?
I don't have anywhere near that level of hardware. However, I have been messing with the Distills of it for a while
Its not as new as people think
However, I DO want a digit for running models like that
I think I saw someone running it on a Mac mini cluster lol
Yeah, you can, but its soooo slowwww lmao
Ah
Mac Mini's have a lot of mem, but they are pitifully slow
like... They have about 1/3rd the AI accel of a 2060 😅
Ooof
Now, if they are clustered properly, they MIGHT have tensor parallel, which could nearly multiply the speed by how many they have
but even then, something like a digit will cannibalize that
Assuming the digit isn't trash in some unseen way (I have no idea why it would be, I can elaborate on that), the digit will blow the mac mini out of the water for value
Internet says the 8x cluster ran deepseek at ~5.4 tokens/sec
That is REALLY slow 😅
well, I mean
its not, but it is lmao
like, 5.4t/s is fine for a normal model
however, deepseek can spent 5-10k+ tokens per response
Genuine question Sytan what level of work do you find yourself doing and how much do you think I could make with the gpus I have
My friend has 6x A100's, and without tensor parallel (so only running on one A100), he gets about 90t/s 😅
A side hussle would be nice
To be fair those are like 8k each
local tech stores arent going to have 5090 stock
I have a ton of downtime on the PC's so if I can use that then money lol

Reject 5090
Return to monke
I do a wide range of work in specialized ways
And I don't think you could make much. I have connections from being a day one adopter of all things AI, and I have spent an obscene amount of time doing all of this
For example, I have over 1.5 MILLION generated images just on my PC. I have been using LLM's for over 4 years, I have connections to friends who train their own and write the code
Oh wait maybe not 8k. eBay has em for $5k
The work I am doing right now is optimizing a super fast training process that can use just a few images to look like somebody as fast as possible with as little compute as possible
but if you wanna really cringe... The weakest hardware I can run it on is an A100 lmao
Batch size 2 requires at least an H200
Hm ok lead on question
What's a day look like in a job like this lol
Do you composite lots of data
Maybe leave a system to train
But my results are extremely promising. I am close to shipping
Generally the process takes abour 2 hours to train a good one. I can do it in abouttt... 5 minutes
Build code for a client
Press "generate" button and wait for result; profit.
(/s)
It can be different every day, honestly. Its all free lance work, and I very very VERY rarely land a paid gig. Like, my last well paying one was... a year ago 😭
Ah ok
Damn
Want to find something equitable with all this hardware downtime lol
For this job, I have had to manage datasets, come up with some tools to augment data, and then tune hyperparameters by hand, and run dozens and dozens of trainings, extrapolating the best results by comparing and contrasting settings, and then coming up with an AI assistant on my PC to go through all that data and suggest better methods. That worked exceptionally well
What all hardware do you have?
depending on what it is, you might be very limited in what you can do
Now that mining is dead your best bet might just be charity i.e folding@home tbh
An example of the likeness I can get in about 5 minutes with only 10 images
granted the one on the right is of him like 7 years older
I have rn running?
13900KS + XTX
13900KF + XTX
9800X3D + 4090
5900X + 6900XT
About, 214GB? Between them
I share these devices
About 40TB usable space
wow rich
Mr dual 4090 user
Ok, so for more serious AI work, only the 4090 is really useable. Everything else is prettyyyyy worthless for AI stuff as a job
Its unfortunate
Bro could buy a car with that
Damn lol
Yeaah
Amd kinda poop for ai
Ye wasn't expecting a whole lot
Most training tools can't run on AMD. The XTX could do some stuff, but even a 4060ti 16GB would likely be faster and more memory efficient
the 6900XT is 100% useless for AI
UNLESS, AMD does the new ROCm update
then it would be as useful as the XTX but like half the speed 😅
On another segway, I'm hearing dogecoin is equitable
However, I will say, you can RUN AI models
I considered looking in to being a rental type server, looked really pointlessly expensive
There are all sorts of fun AI tools and toys out now
A new one allows a VLM to look at your screen and do actions based off of pre-made instructions or talking to it
ohhh, yeah, for AI that would not work. 24GB VRAM is extremely limited for the newer AI stuff
Interesting
For example, 24GB can run 11B at full precision
Deepseek V3/R1 is 671B 😅
Slow training Flux Dev, the image gen model I am optimizing, requires hours on a single 4090 at low quality
And I'm guessing the bigger vram pool helps?
You can pool with ecc on those cards, add system ram but I'm guessing that's not all quick
But yeah, 24GB VRAM isn't very useful when models like Mistral small (280GB+), Llama 3.2 405b (900GB+), minimax (1TB+) and R1 (1.4TB+) exist 😅
That isn't to say you can't run cool crap, cause you ABSOLUTELY can
I can run models that are incredibly good for specific things
Oh yeah no I get it
If you have all NVIDIA cards, you can pool them quite easy for text gen models
I'm not interested in a career level investment lol
You can also use system ram if you use special formats. They are way smaller, but they let you get wayyy higher quality cause you can run much bigger models
So the gpu perf doesn't matter as much for some of these?
Can't do a huge amount tho, I run 1 dimmer boards which don't have extra slots
Lol
I might lowkey get a used s23
Here's the dilemma with Local AI right now
We have nowhere near enough VRAM
Its not speed. The 5090 can already generate 8x faster than people can read. But it can't generate with hardly any better model than a 3090 or 4090
So in order to get better results, you need more memory, which uses CPU, at which point the speed of that 5090 becomes 100% completely worthless
Like, here. The common model sizes are:
7b, 12b 14b, 20b, 32b, 70b
24GB can run a 32B at low quality
32GB can tun 32b at slightly higher quality. Its not like you can run a bigger model. 32GB is still too low to run 70b,s o like... whats the point?
no no, its a VRAM issue
Ya but you can pool system ram into vram on newer cards
here, if you have say 24GB on my 3090, it will generate at 100t/s
If even just 1 additional GB is on system mem, it will drop down to like 20t/s
add 40GB to system, and you're looking at like 1t/s
Very much so, yes
Or well, the CPU itself can't keep up with the GPU
the split has the CPU do some of the compute, and the GPU do the rest
So the GPU has to wait a ton for the CPU
So you need a basic degree of cpu, not much ram, lots of vram
Many lanes
This sounds like a job for epyc 4000
Lol
It kinda reminds me of covid crypto stuff
Thats how, even with my 1x gen3 PCIe to my 3060ti, I only lose like 30% speed while being able to use bigger models
It works like this:
Both GPU's get their "layers" of the model. They solve their numbers, then just send the tiny packets with the final numbers to each other. Its not like its streaming massive amounts of info between
they are doing their local calcs, then passing the results through PCIe. Thats why I said I don't need much faster at all
Also, very fun fact. If you can load all of the model in the VRAM of a GPU, even on a super slow connection like PCIE 1x gen3, it will not slow down at all. It will gen at the same speed as if its on gen 5 x16
This sounds very much like covid crypto
Lol
So you want one or more ridiculous psus
A bunch of x1 risers
And a shelf rack of gpus
Tensor parallel is witch craft, but it needs much faster PCIE
That one will use all the GPU's at the same time to sequentially calculate things. That can massively improve speed
Ye
For example, a normal 3060 is say 50% as fast as a 3090 for text gen (about right)
If you paired 2 together for 24GB VRAM without tensor parallel, they would drop to about 40% the speed of the 3090 cause of overhead
But WITh tensor parallel, they are about 93% as fast as a 3090
This type thing lol
Also, another fun fact. Text gen is very energy efficient
Then you get a 1600W psu
My 3090 has a 420 watt base TDP that can go to 510
But if I drop the power down to 250 watts, I get 99% the same text speed as if it was at the full 420 watts, cause the VRAM speed matters the most
Interesting
Down to 180 watts, its about 80% as fast
Does sli do anything
Image gen falls off faster, but text gen is very energy efficient
I'm guessing no
NV link does, yes
It can help a lot, actually
The connection is several times faster than PCIE







