#programming
1 messages · Page 320 of 1
sudo nh clean all
deranged together 
-# also
waking up so late that you're almost back to a normal sleep schedule
big ben scrambled ur PC
Thanks flash attention
it would be worse but Im just now realizing I grabbed my xeon silver server and not the one with golds
im fine with nix-collect-garbage 
Thats how i roll
Ma days are longer than 24 hours so my sleepchedule drifts
dead by 30 
don't say that
Was meant to be joking but the lack of tone i can send through text doesnt help here

Maybe the neuro arg will be solved in 2038 
ye unfortunately you wouldn't have been the first or last person to say that and mean it, i am for some reason surrounded by people who live by that "i'll die by 30 anyway who cares if i drink 14 red bulls a day"

yummers
I dont really have any big goals i want to reach, but i think by the time im 30 ill have a good life
i have absolutely zero idea of where i'll be by then
so much can change so fast, not having any well articulated goals doesn't help either
I think ill be doing the same exact stuff as im doing now, just a bit more employed and a bit more back pain
I just do what i enjoy
Within reason ofcourse
are there things beyond reason you enjoy 
I mean
I could spend 4 weeks binge-watching adventure time and completely ignoring everything else in my life
But i dont because i have other thing i should be doing
I enjoy my work so its not too bad 
what's your wokr
Im a "technical artist" or whatever its called
So i do programming of graphics and 3d modeling
ooohhhhh...
there are too many things i enjoy and i have huge issues doing other things i should
because usually the thing i’m supposed to do isn’t what i want to do in the moment
but i can do so many things i never feel unproductive i just end up fulfilling that urge with the wrong thing
strawberry donut 
sure i just like nh as a nice wrapper since it has some good shortcuts like the clean all one e.g.
do something often -> will be in shell history anyway
well yea ofcourse
Mhmm

I struggle with this 2 but it's a bit different. basically I can't plan and carry out a big goal. I know the way to do it is just focus each day without worrying bout the big picture but it's hard to execute
I have to break big things down into smaller tasks. For example today I got two things done, the discord bot api working for my AI to handle voice chat properly and the ministral 8b memory recall model model set up on the back end server
Anyone seen a YT vid describing the process someone took to make an AI inspired by Neuro, named Rose?
no i dont think i have
not interested in neuro clones personally, I'd rather see the tech that comes after LLMs.
yes, why so
(keeping in mind it's kinda weird to talk about it here)
i wonder if anyone outside of tech understood any of that
they probably understood the windows update breakign neuro stuff
I think there is a pretty big difference between Neuro clone and inspired
but i doubt many of them know what nixos even is
or x11 tbh
ye
That rant made my day
lmao I need that rant clipped
Maybe not wayland users because there is already something wrong with them
om
"my sliiight penchant for windows has nothing to do with me being a microsoft spy, by the way."
Hacks Microsoft to steal Tay source code
🔎 "where does satya nadella live"
Installing a kernel level root kit on Vedal's pc



I wish I was sponsored by big tech, maybe then I could spend more time coding AI (the NN repo) because I'd actually get paid for it.
I think there is an important distinction, especially in programming: works similarly/takes inspiration from doesn't necessarily mean clone. In general clones are going to be worse but there is countless permutations that someone can take in development that can result in a similar outcome... It reminds me of something a professor told my class years ago: I'm not going to prevent any of you from cheating but I'll know. There is next to zero reason any of you should have the same code and it's not hard to tell who is the one being copied off and who is copying
My brother, you know what I mean. The only type of LLM based persona I'm interested in is neuro and evil. That is it
I wouldn't even be phased by something better as long as it still has a LLM under the hood
That's like saying you're only ever going to be interested in one vtuber because they are just a person behind a model.
Not saying that how you feel now will change, especially since everything elae I've seen does fit the "bad clone" label pretty well, just that taking an overly harsh viewpoint isn't generally great
a lot of people are just sick of llm tech because of an understandable reaction to the feeling of forced overhype and ubiquity
God forbid I have opinions diffrent from yours
I still personally find llm tech exciting but I also think integrating models into everything is uninspiring and 99% slop
But I can also see what you mean as even removing the persona skin, people have pretty stiff opinions of which model responds the best
I just don't find LLMs personas as a general concept interesting full stop, that part of me died out a long time ago. I'm just interested in Neuro and Evil because of them, not the tech behind them.
That's my opinion
What? Lol
Nvm, I can already tell by the logical fallacies there that there's no point in attempting a discussion
its not fallacious even if you think 'the tech behind them' 'is a part' 'of them' because they arent mutually exclusive concepts
it is valid to think the tech behind them is involved in making them interesting without that being the center of why one finds them interesting
Right but if that's the case then the possibility of something using the same tech "part" but that acts completely differently being possibly appealing later on to you should be considered. If its not what makes you interested in them then someone else using it doesn't preclude you from being interested in them
Idk
there is only room for 2 ai in iggly dot npys cold cold heart
also like neuro and evil are a large part interesting because of the media and social ecosystem thats developed around them
which any llm as clever as them cant easily attain
because it takes a lot of cultivation
I don't think the LLM is even relevant to that
the fact that it is an llm is interesting and idiosyncratically shapes how people feel about it and also the ceiling and dynamics of attahcment
at least thats how i see it
its interesting in how singular a phenomenon it is
I think a part of it is that it wasn't planned, it was mostly organic. The problem with developing something like Neuro and Evil is that you can't just decide one day to build it and get the same outcome. As with anything that is in part popular due to its novelty, it's hard to create something similar unless it is unique in some way
youd need some unique twist to not be seen as utterly derivative and trying to ride on coattails
Yes. And I don't think that it's impossible to do with something like this, the thing is that unlike something like say general vtubing, the barrier to entry is pretty damn high.
As an example: the project I've been working on is pretty bare bones and it requires something like 3-4k in just GPUs. Sure you can rent cloud compute but that gets stupid expensive fast

The other thing is that even with the gear, it's not simple to get to work even remotely correctly
Make it a parasocial train wreck with the creator slowly losing rheir mind
the discussion above here is stupid
thats like saying, "why is this person your friend? at the end of the day they're just made of flesh. you should actually go befriend a cow because its basically the same thing and im right"
i said unique twist...
I don't think it's possible to come close to what Vedal has created without losing your mind
I’m currently struggling to understand the point trying to be conveyed
iggly said they dont care about different llms other than neuro and evil that much
It could be much muuuuch worse
i think hascrack got disheartened that iggly.npy is not excited about the general idea of llm persona training and tried to construct a logical reason why they should be (even though thats not how it works)
yea ik i actually thought about like played up main creator personas that could be valid that are very diff from vedals persona
tbh kinda valid, the human in the loop being a diff kinda compelling could make it
No, that wasn't the point
thats what it felt like to me, what was your point then
The idea that nothing similar could possibly be interesting but yet that isn't the reason you find them interesting.
Either you like them for some other reason (in which case you could like something similar for a different reason) or you do actually like them for that reason (and you are just saying that you don't)
I too like saying words
I'm not sure where the disheartened came from
he's implying that he only likes neuro and evil because of their character, not the llm or whatever
simple as that, because i view the neuro twins the same way.
oh i see it was the appearance of fallacy that bothered you
iggly said they don't find LLMs personas as a general concept interesting. not that they dont find evil and neuro as personas interesting
idk i just try to steelman and figure out how their view can be logically consistent and its usually in some alternate view on dependency or relevancy

it doesn't have to always be logical and technical

At the end of the day my point was simply if you aren't sure why then it's better to keep an open mind, not you have to like something else
"i like neuro and evil" doesn't have to be "i like anything llm". the llm behind is just being used to power their interaction, some people already knows the tech behind and find it boring but neuro and evil themself are a separate character that you can love separately from whatever is behind them


Right that goes both ways though
I'm not saying that if you like them you must like anything like them.
I'm saying that if it isn't what interests you, yet you like them, then there is a chance down the road something different comes along that you like for a different reason
yea but the prior antecedent was like being interested in llm tech itself (on a programming level)
and thats what they seem firm on
and programming is a huge world so like
its a disinterest one could easily sustain (on the programming level)
i thought the original message was "not liking llm persona stuff, but liking neuro and evil despite that", not "liking only neuro and evil's persona"
so from what i understood iggly doesnt like llm perosna tech at all

Idk I think it's kinda a pointless conversation. And there is like 4-5 different ways every piece of this could be taken and they are all completely valid and not mutually exclusive
Quack has the correct answer, end of thought
i can yap infinitely because i love words dont let me keep you here
As far as the programming side goes, from what I've learned from my own testing, the model is only a piece of the whole pie.
Did I say you didn't, I Just said that because I've been finding working through those parts interesting
It was implied 
raid shadow legends
neuro no
I think it would be funny if neuro just kept berating Vedal until he caves and does a raid shadow legends ad in the most defeated monotone way possible

In the same way that he gave up fixing his headphones and gave in to using the razer ones
Fun fact (idk if this is still the case) the razer software that Vedal mentioned popped up when he plugged them in use to be a method for privileged escalation attacks
erm
tbh i mainly love neuro because she is basically me i have the exact same personality and im a narcissist
Basically the software launched with administrative privileges and when you chose where to install it, the file explorer window it pulls up is an elevated window
Even for a standard user
i see
https://adcy.io/zero-day-vulnerability-in-razer-devices/
It should no longer work but it was funny af
i have prob never used a pc where the user account wasn't an administrator, so to me it sounds like a non-issue ngl
The problem: in a corporate environment with standard accounts, you could plug in a mouse, a normal mouse, and gain local admin rights
i'm so confused, does it somehow bypass uac? is it because the synapse installation thing gets pulled in with the driver by windows and gets launched with admin privileges
Yes
also 4tb nvme arrived
And it doesn't check if the user account has the rights to do so because it's handed by the system
Good call then

now its up to $350 wtf
and every time you look at ram prices, you have a deadly heart attack
what ssd did you get?
EN870
i have no frame of reference for that one so everytime i look its jsut more number
4TB TLC
damn fuck
samsung 990 pro 4tb is 380
yeah about there
hm?
damn
and is increasing...
ye
not even a day and that's another $60 increase
not me mistyping
im considering getting 2 990 pros
4tb?
$356.99USD
single 4tb is better than 2x 2tb
less prone to fail
but uh
the advantage with 2 drives is that you get to use it separately from the bandwidth
1tb is 140 euro, 2tb is 206 euro, and 4tb is 380 euro
christ
yes
140 euro already??
sam triangle is good tho, is a real bro
one rise, the other fall

those bulky heatsinks are dirt cheap off ali
yep
and my mobo has its own heatsink so it would only get in the way
lemme check if i got paid already
Capacity of yes is just 500gb to 4tb
$2 heatsink
no infinite storage
this thing is usually meant for gen 5 drive
kek
1 star means it is good
no way the speed is 4TB
Advertised as a 4tb ssd at what appeared to be a very good price, but in fat it was/is a 1tb ssd at an inflated price. Basically fraudulently advertised to catch buyers. Thankfully i was refunded after complaining
its a 1tb at an even more exorbitant price
140 was enough
could've been worse.
how did I not catch that 
20TB per second? per year?

hey surely 20TB meant the TBW endurance
-# 8GB flash having over 20TBW endurance would be crazy tho
also preordered some 22TB sas hdd
surely the 4TB read speed is just an option 
i need to expand my 88/132TB raid 6 lol
lookign through aliexpress. the legit listings are even more expensive than jsut buying on amazon
and the reasonably priced ones are like this
only things worth buying from there is usually CPUs chinese people sell on bulk or OEM CPUs
and motherboard sometimes
or if you're looking for niche old stuff
don't you love it when certain grey haired someone bombard you with lga 3647 xeons in bulk shipped to your address from ali
-# not that im complaining
grey haired?
who else im talking about 
https://frame.work/products/storage-expansion-card?v=FRACCFBZ0A Oh how slow this is
I grabbed the 250gb with my initial order, hasn't been through much use though.
chirp???
om
I just have a pile of these as well as some 1.92tb ones
let me see what i need to buy fdor storage before these prices get even worse
Mood
im laughing my ass off rn
I'd rather just scrape together storage than deal with these prices
I not saying anything
an nvme for linux since im still running on sata.
a big hard drive to store a fuckton of data on.
and maybe a new ssd for windows so i can put the old one in an external enclosure

6x 22tb sas coming soon yippie
$210 each
also im planning to snatch like 3 3090 during my visit at my home town
I just really don't have the infra to get decent hardware yet. I'm just going to stall this out as I thankfully don't need it for my projects.
$400 each probably
letsgooooooo
My desktop has a mishmash of ssds in it, i think currently I have a 1tb WD Black sn750, a 1 tb crucial P1, 2 960Gb Intel DC S4600s and a 2tb 870qvo
My servers have dual 960gb Intel DC S4600 for the boot drive and the DB server runs 8 1.6tb SAS 12ssds while the vm host has 8 1.92TB ones
at this point its actually either 4tb ssd or 24tb hard drive. both are 380
Time to balance out everyone else with my own setup, which is 3(7*) laptops and a mini PC.
rn i have 1tb nvme for windows.
2x200gb sata ssd, one of those being linux
and a 500gb hard drive
Ehh depends. Desktop ones each have a use and servers are either hardware raid or ceph
all my sata are hdd
you know how there are these external hard drive enclosures? how do those even work?
are they slow compared to straight sata?
framework 13 for most work, some gaming (including VRC), RTX 3060 laptop for VR titles, GTX 970 laptop that is being used as just cold archive, and N100 mini PC just as extra IO devices.
but some probably uses Ethernet
Depends on the controller
usb 3.0 supposedly
forgets a laptop
wouldn't recommend 

some USB some thunderbolt, depends on which
i don't use a dedicated external hard drive enclosures either
Most are usb 3.0/3.1. I've used an external usb3. 1 one that works well enough for large transfers
i dont think its worth it
Mostly use it when shooting astro all night
5Gbps
thouht it might have been handy for using the files on my laptop too as some sort of central server thing without actually getting a server
i mean, that's plenty of bandwidth but i still wouldn't
especially when you can set a caching system, just use pcie sas controllers imo
the 10Gbps nvme usb adapter treats me well, but I wouldn't use it for anything major.
we love the gen 4 rocket drive being used inside of it as a flash drivr
its been in my house for like a week already but i have no drive to put in it
im tempted for a trx50 system
For me I treat it as a flash drive because flash drives suck
depends on the drive
the 5mb/s ones suck, but the usb 3.2x2 super plus ultra pro rtx ones are nice
Compared to a mid range nvme in a 10gbps usb enclosure, all flash drives suck
Nothing comes close to the time I configured a zfs pool with a 512Gb dirty cache ram buffer
That was fast but sketch af
Man this drive is overkill
https://www.amazon.com/SABRENT-Rocket-2230-Performance-SB-2130-1TB/dp/B0BQG6JCRP
sidenote for anyone who checks link, 3rd size option
Actually the nvme enclosure I use is a sabrent
the one i got is anker
aight i should still have about 32 free pcie lanes on my sp5
Anker is solid. I'm currently using one of their 100w Gan wall adapters
I have some noname enclosure, it was free so no compaints
anker is afaik just a drop-shipping company but with decent quality 
shopping list rq
- 6x 22TB sas HDD
- 1x 4TB nvme (arrived)
- 4x V100 32GB SXM (with SXM to PCIe adapter)
- 3x 3090
yall got a fuckton of money jesus
i am NOT affording another sp5 system, my current one should do fine
I should figure out what funds I have
i could get the V100 + SXM adapter for $300 from another dealer
I was going to ask on that actually
BTW that A2 is working perfectly for my DB server
I only maybe have 1.5k only thing I'd want to do is get a gpu upgrade
my sp5 should support bifurcation
quick lmao
50 series prod getting cut by 2026
with your current storage situation im suprised you think using a riser cable with a better priced gpu is such a sin
Way better than cpu for a system that needs a little gpu compute
That server is using Dell enterprise ssds, my desktop has the scuffed storage
i find it a bit more amusing that dude thought risers are "scuffed"
I honestly might just accept the jank and try a V100. I'm not getting anything better while staying decently cheap. Don't really use gpus for video out anyways so no loss 
why though
eh
honestly
I was using a riser in my desktop before I went watercooled. Caused issues
you can still try configuring the V100 to P0 state
and overclock it to near match 3080 performance
volta is hella overclockable
Toshiba X300 PRO 20TB for 357 bucks? 
Not bad
oh F
1, I don't mind the jank and am just curious. 2, 3080s are $300 in the used market here.
the hbm memory is nice
just sucks that its hard to overclock them lol
the major reason im opting for V100 is because they're the cheapest gpus that has good fp64 rates
I'd also like 3x the memory capacity compared to a 3080, that is also a factor if I'm looking at cost.
huh, where are you getting the 32gb ones for $300
I've got hbm in the jank that is my laptop
you're not me
Nowhere yet
The 8705g is a cursed cpu
I doubt I'd be able to get any at that nice price anyways, so it'll stay on the backburner for awhile.
I am way too patient
you can def get the 16gb for $300 though
Yeah, that is possible
Seagate Exos X18 Enterprise 16TB, 237 euro
free shipping with prime
nice
I'm better off waiting honestly, it's better for purchases like this to be able to swing a lot more cash around to do it.
quack approved. aight imma buy it
uh
gpu supply gonna get fucked in 2026 lmao
Oh I'm aware
I'll just simply not need it for many years
as far as I'm aware, I can stall until the AI bubble collapses
Still the same 4x P40 cards on thunderbolt egpu docks
Idk why but I just had a thought that should work: using my desktop as the heat source for a lava lamp
I would be test booting this but I have cable issues
Nah, I have a better version for you
It should work
I know it does
Now I need to do it
god fucking damn it

let me propose what I would do if I were to redo this first, alright?
because it keeps the same spirit, but more cost efficent and useful personally
what is the cursing baout? what happened?
12v 1.95A
They apparently run at 55-60c which is what my loop runs at under full load
lack pcie lanes

that's the internal bottle temp, not the heater.
the heater itself reach 110-130C
its a 12V 1.95A PTC, max power draw around 23W but overtime goes down to 20W
Depends on the heater source, that's just to heat up quickly
max you'll see this thing run on is 140C, but the minimum is definitely above 100C
no lol
uh
have you read the thread
I'm saying lava lamps in general
the thread for lava lamp parts and replacement
ours is using that PTC heater which just averages at there
the average lamp uses hotter ceramic heater.
there
this is why the neuro lamp took quite long to heat up
because we didn't have it shove 200+ C
your 60C ish PC won't do anything realistically due to heat transfer limitations and heat dissipation
What? There are 15w incandescent lamp powered lamps
if I were to redo this, I would instead of using thunderbolt because lack of bandwidth, I would instead take the extra cash for this thing https://c-payne.com/products/pcie-gen5-mcio-switch-100-lane-microchip-switchtec-pm50100?pr_prod_strat=e5_desc&pr_rec_id=062baceb0&pr_rec_pid=10242691465483&pr_ref_pid=8642442035467&pr_seq=uniform as the all of the thunderbolt equipment costed close to the amount of this board anyways. 2k for the chip board, and 50 for each of the pci gen 5x16 slots. Instead of the $300 (tbf $200 ones exist) thunderbolt docks and $200 for each of the two thunderbolt hubs.
and they run hotter than our neuro's lamp heater
They don't make direct contact
15W lamp can get to between 200 and 260C
and even if its not direct contact you're still looking at about above 120C being radiated lol
They produce 45btu of heat. Period
the meme in this one is 4 of the x16 slots for gpu, 1 x16 for a quad nvme, and the final x4 to the host system
15w is a fixed input power it doesn't magically make more heat
surely it is a valid configuration 
15W lamps for lava lamps are not the same type as the ones used in lighting homes
lava lamp lamps are made to run a lot hotter by having less light output
bro throws out the heat accumulation in the equation
that too yes
In conclusion, whoever wants to redo the thunderbolt thing. what about instead of only being limited to pci gene 3x4, you get a full pcie 5x16 connection?
given different function the 15W is going to produce higher temperature than your 200W pc or something. thermal density also has to be considered
My PC pulls 1400w
so?
i know one way that could work for what you're thinking. put the lava lamp bottle directly on your CPU IHS
doesn't matter, heat density also has to be considered
my server pulls above 3000W
doesn't make it ideal to heat up a lava lamp
im sure if you turned of the cooling in your pc at 1400W it too would easily reach 200C easily if it didnt melt and thermal thorttle
a lot faster even
lava lamps take hours to heat up
and pls don't blame me if it explodes thx 
when he said 1400W, i can only think of him either redirecting the whole airflow to the lamp which just straight up won't work, considering that ambient bottle base needs to be above 180C if its not a direct contact, or him putting the bottle on one of the chip and ends up exploding it instead

I quite literally have run full power for 36 hours batch processing data. Airflow is mostly running through a large low speed rad into the case and a higher speed 240mm rad on top.
The semiconductor properties turn funky long before 200°C 
Exhaust temp is 50c when I keep my fan speed at 30%
yep that wouldn't work
Dropping it to 15% would spike temps significantly
if you have a 100W cpu without the cooler on it. that thing gets to 100C in seconds or even in miliseconds during full usage
so it isnt that far fetched to think a 15W energy source could get to double that temperature over 60x60x3 times the duration
that is 10800 times the duration
ten thousand times
you wouldn't want to heat the lamp in just few seconds either
you need to let the heat build up
which is why heater under 25W are used
You are aware you can literally calculate the btu output based on wattage input
this generation is so cooked
you are aware that eventho wattage is a unit that takes time into account, we're discussign different periods here?
with this kind of reading comprehension
as in, there may or may not be a small difference of ten thousand times the length
that lets the heat build up
The heat doesn't build up. It reaches 60c inside floats up and cools. It shouldn't get hotter or it wolnt flow
also 50C airflow, i can't stop thinking about how thermodynamics is also being thrown outta the window if he wanted the internal bottle to be above 65C with just that kind of airflow
and what happens when it cools?
heat dissipation

there's a reason we make 15W build up to above 180C on the base
heat transfer is slow
50c is the temperature if I am running at 30% fan speed. Temperature goes up the lower the speed is
lava lamps are designed to insulate tho. the whole point is to let the heat build up?
and heat dissipation has to be considered
therefore
even if you make your PC exhaust 80C
it still wouldn't melt the wax
what makes you think it could, when the ambient temperature on the bottle base is literally above 180C
i dont even get what we're arguing anymore
if you immerse it in the exhaust maybe it will in like a day
ive had enough
same
and it wouldn't flow up and down because by then you made the whole bottle have the same temperature 
ye
Well kinda... I could then point a spare case fan at the top
ours is at 130C for the neuro lamp, and that's direct contact
then that'll turn it into "never melt" because you're also dissipating all the heat lol
my argument is simple, even if you have 80C from your exhaust it wouldn't be enough
If you get the bottle temp up enough to melt it then it's hot enough
this is so silly. have you ever tried to heat anything with warm air, it takes forever
It does yes
heat gun time

for what purpose lol
Batch processing of data

1
It was quite literally a dumb thought I had and yall are focusing in on a very specific lamp with one of many wax compositions and reading off its specs and over analyzing a dumb idea
are 1TB ssd's even worth considering? they're 75% the cost of a 2tb while being 50% the capacity
Welcome to #programming
Fair
shittier endurance too, no
im thinking about getting a 2tb for linux and getting another 1tb cuz they're cheaper for windows. butt he pricing on 1tb is so ass
ssd endurance scales with capacity

In case yall forgot I don't do smart... That is 11 delta pfc1212DEs in my case
damn soft tubing
pedantry central fr
Your questioning soft tubing when I have 550w of fans
honestly? doesn't seem like 550W
unless if for some reason you push them beyond 8000RPM
no, more
Yes
i have some of those aswell
Yah, tbh they are pretty quiet below 40%
was also given an industrial 6000rpm 120mm fan, though that one is 28mm thick
and loud asf lol
I have some 93mm hp 18k rpm fans but they need a bldc controller and pull 17a
550W of fans seems excessive but i guess you're never actually ussing that much power
lmao that
Why do you think the Deltas with exposed blades have guards on them
Been there
Final dumb thought, neuro can write some simple code but how bad do you think the outcome would be if she was given unfettered access to something like claude code in a non sandboxed environment
How about we test that?
(not the unsandboxed part tho)
how did I get 3 different versions of esbuild in my project
Have you tried Bun?
yes. i dont particularly like it
but I will give it some more time to smooth out
also the docker node sdk doesn't work with it anyways lol
What is it you don't like about it? 
From a DX perspective it was so nice to be able to massively cut my dependencies list, not having a ts-compile step, built-in bundler, etc.
I don't know, it just doesn't particularly vibe with me
Probably because I use pnpm rn and it saves so much storage space and is better at working with monorepos
Ah! Don't have experience with Bun in monorepos. Would have to do research how well it behaves.
But given size of Bun I wouldn't be surprised if they have fixed support for that
And I so wanna talk "monorepo vs separate" with you, but don't have time right now 
I see value to both
I do really like the fact that Bun has a compiler so you can make EXEs, though
anyways, do want to have a discussion about it because I find it so interesting
just realized the grass being fucking green isn’t normal for the end of december 
it’s that bad ye
what do you mean green grass not normal for end of december

ive not seen it snow more than once a year
not normal where i live 
it will be 


autismu
i keep hearing きのこ in random sentences and thinking "mushroom"

pattern recognition is dangerous
now i think everything is about mushrooms
ye
in a more traditional font
or handwriting
you could see it
fair enough
here's one font
uh
here's another font
the right one is more curved sure
but on htis one it looks like they jsut smooshed it to be smaller
it completely different shape NeuroCatUHH
looks same size for me
compact mode
mobile moment?
oh
i see
is this twilight in the marketing material for this thing? 
I just got my first copilot generated slop PR on my GitHub project
it's clear the submitter did not know what they were doing

I wanna see
Yo guys, any solid app recommendations for remote access to CasaOS? Just set it up and I'm a bit lost on how to get it working outside my home network
@jade kindle wanted help making their own chat bot, and I thought the vid would have useful info.
I'm working on something inspired by Neuro-sama using my Python knowledge, and so far I have a chatbot with short-term memory. Do you guys know where I can find some material to learn? Sorry if my question is bothersome
OH. I copied their message text. Not link. Ah.
And I couldn't find the vid again because I had bad search-fu.
Found it. Just needed to search "made an ai" and was like 3rd result. https://www.youtube.com/watch?v=muhbxvJxfQc 😤
they closed the PR after I questioned them LOL
at least they're admitting that they have no clue what they're doing 
reopening the PR is so funny though
yeah
i feel like they don't know github very well
reopening just to comment 
it'd be funnier if they made another issue to comment about their previous issue
hmm
B68S
micron?
iirc they have B68S 8Tbit chips
that means TLC, though. nice
https://youtube.com/shorts/sWz1soDjfQI
The only true use.for these
I've been thinking of making a website that's like a radio station for neuros covers. Anyone's down for that idea?
@jagged turtle 
Thanks for taking the time to find the video, I'll watch it now! 
flight tomorrow so i need to pack my whole briefcase PC in my checked luggage ig
that thing survived being dropped to concrete thrice already and it broke the concrete, no doubt its surviving the flight
Problems I see:
- The visual model isn't the best point to start on something like this.
- Immediately going to streaming responses before the LLM finishes it's response without first getting non streamed responses to work is a nightmare to debug
- Most critical: this is a basic chat bot. It's missing everything but the basic llm pipeline
2 highly depends on your back end
just wrap llama.cpp or something lmao
or any supporting compute backend that you want
Unfortunately the llama.cpp Java bindings kinda suck
Sure they do all the basic functionality
But it's unfortunately unable to unload a model
I guess true, I found it easier to implement later mostly because STT and LLM currently share a gpu for me
Currently I just use openai api to my existing api for the primary model. For the memory recall/deep embedding model on the memory server I went with Exllamav3 with a custom api wrapper because I'm trying to strip assistant naming conventions from calls
ai "devs" nowdays smh
Hopefully that model unloading issue will be fixed some day because I want to make an app around those bindings
But then again I don't use ggufs so that means no Llama.cpp
Fine control and performance with exl3
how big of a model and how fast of token per second
on what hardware
exl3 also has quantization though 
Depends:
- mistral small 24b 8bpw HB16 on a 3090ti and A4000 with 32k context - 25t/s
- mistral small 24b 8bpw HB16 with 72k context on 2x 3090ti and the A4000 - 20t/s
- Llama3.1 6bpw HB6 (I forget the context, most likely 32k) 2x 3090ti and the A4000 - 15t/s
- 2x mistral small 24b 6bpw HB16 and 1x mistral small 24b 5bpw HB16 all with 6k context (batched together) - 90t/s
- Ministral 8b 6bpw HB16 on an A2 with 8-16k context (unsure of t/s)
It's split between the a4000
Meanwhile my 3090 (not even Ti) 30B 190 t/s (though MoE)
Context on a slightly above Q8 equivalent model
Why use a model above Q4?
get Q6, the A4000 is seriously bottlenecking it + overhead
can only see in september here
A4000 is less than half the bandwidth of the 3090Ti
I think it was something like IQ4 something something
At 32k+ context q4 is a joke
Is it though?
q6
Q6 still introduces some errors and conversations are being fed into training data
????????
"conversations are being fed into training data"
😭
this is so wrong in so many ways
you'd NEVER feed its own output back to training data
RL is a separate case
Well not raw but ideally with minimal editing. Mostly selective data selection based on classification after running it through several filters
you still wouldn't, it'll just overall slightly degrade the model because the thing it output is almost always lower quality of its initial training data
ideally, also do not finetune the model with small data often
the model's generalization would be fucked up
Initial training data is multi lingual and shaped for an assistant role. I'm not doing fine tunes rapidly, I wait until I get enough good training data from the backend crony job to fill a specific training type dataset before training
I think my last fine tune was 25mb of raw text
i need to swap the aio with my sff cooler and pack this thing 

don't mind the random cpu cooler, that was used for my vrm cooling for my overclocking setup last time
yep the sff cooler would do fine
4.9W at 5GHz
for basic usage
Also BTW from last night's conversation, this is what full speed sounds like
sounds like my 7u
Probably because the fans came from a 4u
my beloved
gonna visit my home town for few weeks so im bringing this bad boi with me
Wait how does 24/32 work (I'm not use to the last couple gens of consumer cpus)
8 p cores with SMT + 16 e cores with no SMT
I figured that was probably why
its an i9 13900, just that its an engineering sample
except this one is cherry picked so a -225mV undervolt somehow works on it
same CPU i've used to get #1 in this leaderboard alongside with some samsung b die https://github.com/samvanmaele/vulkan
I'm running a 10900x in my desktop and second Gen scaleables in my servers
2 epochs on an LLM seems like a lot but also I don't know how differently epochs behave on finetuning
@quick condor should give a try
hint: its more of CPU single thread bench technically, the fun part is figuring out the optimized compiling flags on your machine
It was cheaper and I didn't really need more cpu performance on my desktop, I was just replacing the 7820x that it had since I built it since intel filtered you on pcie lanes
I guess my triangle score was somewhat limited by me not messing with the compile flags too much, but I'm also no C/C++ dev so I'm not super familiar with the compiler
nah
yours makes sense
i could get that high just because the overclock + some pipeline config + memory overclock and timing tuning
I guess that makes sense
extreme overclocking gets you that far lmao
Though I'm also pushing my mem to its limits
CPU not so much though
but i can't do it for long
else im degrading my poor chips
im using samsung b die
that is meant for overclocking
its a 2x8GB but iirc its gone up to over $600 for that specific kit rn
I have a pretty conservative oc on my cpu since it's the last thing before the 480mm rad. The 120 and 240mm ones just take the edge off the GPU heat dump
My CPU has 50mV undervoltage and 200MHz extra clocks on both P and E cores
you don't get extra heat that way and in fact it gives you less heat becase the voltage curve is being tightened
I should try to undervolt and overclock more after subathon or something
iirc on very specific scenario mine can handle over -400mV (its how i can hit 5.2GHz at just 800ish mV) but that's for really short period of validation
I need to get around to undervoltin but it's kinda finicky with mixed windows/wsl2 workloads
For the cpu though I just haven't really bothered much since it isn't my bottleneck in most cases
i love it when engineering sample are actually cherry picked
Funny
My -50mV 5.2GHz is fully stable I think
I wonder if I can do -100mV or run higher clocks
Depends, cpu eng samples are normally, gpu not so much... This was a system I hated dealing with because it kept chewing up cards
(the p41 doesn't exist officially)
one hell of a clusterfuck
You still have the warranty Ad sticker on the monitor? 
i forgot about it lmao
lol
everyone forgets it
Does anyone know how the Neurosama vr architecture works or is it just smoke and mirrors?
its a combination of models is all i can tell you 
vedal works on neuro full time he has lots of time to experiment and find something that works
MEOW


watched "1922"
it was alright
there was a scene where they showed a doorknob where the paint was peeling, and then i had to hear a rant about how thats inaccurate since they didnt do that in the 20s



i watched the new avatar today, it was one of the movies of all time for sure 
My guess is something simple (bassicly a way to translate her normal movements into vrc inputs) but thats just a guess... Its what id do, simple and effective
avatar blue people or arrow?
ah
story kinda eh but very pretty, would watch again
(ok that's a lie i won't it's like 3h15m or sth)
meow
my 3D teachers say the same thing about the new star wars movies
bad story, good CGI
i wouldn't say it's bad per se, it's just the same again 

sometimes all you need is some good cgi 
Man it was fun to play around with it, I believe bred actually had better results with like 3 core LLVM software driver on their system, so some curveballs exist.
I say this as the highest ranking laptop result. Then you look to see somehow it beat some interesting systems despite being only going to 3.5Ghz during that benchmark.
If I had decent cooling I would have ranked higher trust
neuro guitar 
wrrr

enub
its been actual months since i bought the game
that neuro might as well
wrrr
wrrrrr
wrrrrrrrr
00:00 Intro
00:50 What rust does
02:59 Memory management principles
05:30 Stack memory
08:04 Heap memory
09:07 Arenas
11:05 Maths vs Silicon
13:04 Garbage collectors
13:55 Example of Rust borrowing and lifetime subtyping
17:10 Safe in bounds access via dependent type.
18:37 Theory
19:45 Granule: Linearity
21:15 Linearity limitations
22:39 Owners...
not agree with all interesting anyway 
me take back after all 
me need 
Anyone know of a Greasemonkey script to auto-block people in Twitch chat, who spam repetitive stuff? The old AntiKappa script is from like 9 years ago.. doubt that still works.
@tender river ya, probably, but never know. I remember using something liek that, that worked quite well, at one point.
no idea sorry
not Greasemonkey but FrankerFaceZ has a few addons to help with this
Declutterer and Emote Less Chat mostly I think
I don't use them though 
(this technically doesn't block people but it does remove the messages)
oh okay, I'll look into that too. Thnx
yah I honestly dont understand the spam... it makes chat completely non functional.
herd mentality maybe. people just wanna participate, and the culture of twitchchat has just sorta devolved to spam lol
share 

I mean I get it when there is something big but like... all the time?
work for me please confirm lack of warranty of fitness for a particular purpose
🔪
thats just how it is for big streamers. you cant expect anyone to hold a conversation at 200 messages per second

me not give any confirmation
its cake
Claude buit this pretty quick. its nowhere near perfect but thats like 2 min since starting it and chat ground to a halt
up to 1200 now
Oh neato. I also just found a script called "Twitch chat cleaner" that seems to do somethign similar.
who bake
croco
nice. Yah for something simple like this NGL, claude threw together something functional enough
That's awesome!
3500 removed in 7 minutes... thats sad
not paradox just recursive
I think that the message filtered stat isnt updating correctly as its updating too fast
this is actually readable
wait... you don't have 7tv?
no wonder you have issues reading chat
I dont usually watch twitch. and emotes are just a part of why
I have FFZ, it's kinda buggy
wondering if I should switch
It reminds me of someone saying that all big streamers have this issue, it is just emotes. Smaller streamers have a readable chat because it isn't just reactions all the time.
Considering someone was trying to use AI to filter down chat, seeing this work well makes me question why that approach is even being taken. Just void all of chat and show a collection of the words that were said in that time frame.
There are also projects to do the opposite
The real question is if any project just moves them to two separate windows.
That makes sense actually
hah if that ends up working well enough, might be worth posting somewhere
you should try and remove messages that are
punctuated
with
emotes
like
this 
also fetch the 7tv emotes to add to the blocklist
do you not like my jah lerolero0 EDM juh EDM
not as many as i was expecting from 15k concurrent viewers
Im like 80% sure it didnt count right... It sometimes struggled (blank gaps in chat)
can you compile stuff for me if I give you the instruct. pls
eh, depends
and then upload the binaries to mega or smth
I have no clue about cpp, but I have no more disk space to get the entire VS cpp package to try all of it
and I have to have some cpp components in my python venvs somewhere that are interfering somewhere because VS can't fucking find any compilers
Ah, running Linux so I can't anyways.
dang

thx 4 the ping
https://github.com/VedalAI/NetCord another discord .net library fork
@sage crag
i implemented like 50-70% of the new vm (in js), for fun asked deepseek to implement the other part, it started writing a step by step plan and just gave up after writing 100 steps
just like me frfr
because i need circular structures
and also js is like the least boilerplate when you need an imperative language
i dont really care about performance at this stage i care about understanding what i'm even doing 
ye anyway this attempt is promising js made it easier than c++ but i still need to sleep on it i think
i dont know why the inlined while loop looks so cursed to me whenever i see it in a language
c# has it 
wrrr me think lazy evaluation make thing harder 
i guess i'll just give up on lazy if it wont work
not big issue since it only for interactive mode which may benefit from eager evaluation anyway
for batch non-incremental processing me not need any of this 
laziness good for performance but at least incremental computation mean only have to do extra work once
and conversely eager eval mean better performance on certain incremental changes (because it's essentially partial evaluation)
i know but using it in C# is vile
its like putting a whole class on a single line
idiomatic c# take lot of vertical space
me not like
honestly i prefer vertical space to horizontal
horizontal -> can find thing you want by just looking
vertical -> have to find thing you want by looking AND scrolling
more work 
idk my brain just runs faster vertically
part of why i dont like var either in a lot of cases is seeing the type lets me infer things before i finish reading to the end of the line
i dont really have to know how a particular loop or if works if i already know what it does
and if i really do i can just look, its just less useful to me
my brain just works like stepping with a debugging tool i suppose
<msg above was deleted>


i'm fine




🪱




52 minutes?
