#programming

1 messages · Page 517 of 1

marsh coral
#

to run a local ai model

#

u gotta use VRAM

#

if u use ur CPU only

#

then it can take 40 seconds for a response

brisk laurel
#

Im VERY patient

marsh coral
#

then lets see

#

do u use linux or macOS?

brisk laurel
#

My family my phone runs terrible even though its my daily phone

marsh coral
#

linux and macOS r very good at AI agent hosting

stark needle
#

Llama cpp + qwen 3.5 2b✅

brisk laurel
marsh coral
stark needle
#

Or ollama

marsh coral
#

uhmm

stark needle
#

Or whatever

brisk laurel
marsh coral
#

u gotta

#

nvm

#

imo i recommend u download WSL2

#

cus a lot of ai tools r based on that

brisk laurel
marsh coral
#

windows compatibility is very iffy

stark needle
#

i3 1215u

brisk laurel
#

yes

#

its terrible

#

my parents got scammed cause they wanted to cut cost

stark needle
#

Buy a dual Threadripper Pro 9995 wx setup

brisk laurel
#

on MY pc

brisk laurel
#

im trying to fund myself through donations on my coffee pageevilBwaa

brisk laurel
marsh coral
#

my laptop is a hybrid

#

i have i5 graphics card and nvidia geforce mx

brisk laurel
marsh coral
#

host local ai model

brisk laurel
marsh coral
#

its possible but

#

its gonna be vbery slow

brisk laurel
marsh coral
#

if u want smth more functional js pay up the tokens neuroCry

#

if u get a good and cheap model

#

like qwen or deepseek

brisk laurel
marsh coral
#

token costs can be very low

marsh coral
brisk laurel
marsh coral
#

i js download it

#

and then i sometimes use it to flex

#

but most customization is for the terminal emulator

#

i use Konsole

#

so theres a lot more customization options

#

out of the box

marsh coral
#

i can set my background, transparency, change the color, font, etc

#

i can show u what my konsole terminal looks like if u want to

stark needle
olive sable
brisk laurel
olive sable
brisk laurel
#

how do i customize it

marsh coral
brisk laurel
brisk laurel
marsh coral
#

but u can defo upgrade ur terminal

brisk laurel
#

I made it translucent

marsh coral
#

try changing the background and the text colors

brisk laurel
marsh coral
brisk laurel
#

Im fine with that

glass flower
#

pretty sure you need to customize fastfetch inside of your shell config (bash,fish,etc.)

#

or it has its own config file or something.. idk

opaque sigil
#

fastfetch takes an optional config arg and also ships a bunch of them iirc

brisk laurel
#

i see

marsh coral
#

i'd love to likee show my terminal

#

but uhh i dont got image perms

glass flower
#

comfi i just use kitty terminal with a catpuccin theme to match my neovim config

brisk laurel
#

it worked

marsh coral
#

i also use catppuccin

#

but i overlay it with a background

#

tho i dont use neovim

#

i use helix

glass flower
#

its... a terminal neuroNOWAYING

brisk laurel
marsh coral
#

it looks nice yk

#

but yh it is very hyped

glass flower
#

comfi i think it looks good... i used it in vscode too. i did have to adjust the theme a bit because i was using a modified mocha theme in vscode that isn't the default

stark needle
glass flower
#

don't eat my screeps code

opaque wharf
olive sable
rigid snow
glass flower
#

look at this and tell me it isn't sexy neuRIZZ (i still need to change the kitty tab names.. they are way too long KEKW )

stark needle
#

is u a grillprogramming

olive sable
#

im not a grill

rigid snow
#

shhhhhhhhh

#

*grill sounds*

marsh coral
brisk laurel
marsh coral
#

powershell is kinda to verbose ngl

stark needle
olive sable
#

my pfp is not a "igrlr"

rigid snow
#

she has a triangle pendant NeurOhISee

olive sable
#

yes

stark needle
olive sable
#

no

brisk laurel
stark needle
olive sable
#

not "grglrg"

brisk laurel
stark needle
olive sable
#

no

stark needle
stark needle
olive sable
#

what

stark needle
hallow dagger
#

and pfp

stark needle
olive sable
fast pagoda
stark needle
olive sable
fast pagoda
#

quack egg

olive sable
#

i have no clue what the fuck bro i on about

fast pagoda
#

konii

patent shard
#

Ah, yes, encode into a format that requires three times more processing power to decode for no gain
Awesome

fast pagoda
#

but then john apple will be hap

rigid snow
#

compared to flac?

#

or to wav

rigid snow
stark needle
brisk laurel
fast pagoda
#

flac and alac are compressed

olive sable
fast pagoda
#

it's lossless compression

#

but they have to be decompressed

#

wav is uncompressed in pcm loossless form

rigid snow
fast pagoda
#

althgouh wav can technically carry liike mp3

rigid snow
#

yeah no pls don't

fast pagoda
#

id assume alac vs wav

fast pagoda
olive sable
#

i feel like for audio, we have more than enough proccesing power in the headphones themselves these days for it to not matter at all

stark needle
rigid snow
olive sable
#

mo

fast pagoda
#

i hold all my audio in PCM 384khz for this reason

rigid snow
# rigid snow ??? how

dogshit format or dogshit impl because no one uses it? also i'm pretty sure that's handled in drivers mostly anyway

#

like qualcomm vendored ones and shit

stark needle
fast pagoda
#

ALAC has been measured to require around four times as much CPU power to decode than FLAC does,[5] with implications for battery life on limited-power devices. Still, the format has been recommended for older iPod devices based on claims of lower power usage.[6]

#

wikipedia

rigid snow
#

incredible

fast pagoda
#

apple certified refurbished format

rigid snow
#

so not only is it "no benefit whatsoever" it's actually NEGATIVE benefit

#

nice

opaque sigil
olive sable
fast pagoda
#

that requires a hell of a dap bro

olive sable
rigid snow
olive sable
fast pagoda
rigid snow
#

room eq audio container mhm

rigid snow
#

neuroLookUp ??? what the fuck

olive sable
opaque wharf
#

Sam is grgr

fast pagoda
#

i dont know what the marketing acronyms mean i was just talking about people with their funny audio decoders

#

i like to bring a whole other phone with me

olive sable
rigid snow
#

guys... i just listen to spotify on the medium preset

olive sable
#

i listen to yt music, on the high preset

opaque wharf
#

I just wait until Sam send another nuked song

olive sable
#

that only happens when i have enought ime to do dumb shit

marsh coral
#

cuz likee

#

u get zero ads

rigid snow
marsh coral
#

or interruptions

stark needle
opaque wharf
olive sable
stark needle
opaque wharf
#

Much better deals than buying spotify. You get yt premium and music. Especially if you're on family plan

opaque wharf
fast pagoda
#

New #ultraportable set up bros people often tell me they didn't even notice it wasn't just my phone until they heard the epic quality and I only have to carry one car glassmat battery with me

rigid snow
#

audiophiles are schizo

#

i'm sorry

stark needle
rigid snow
#

just get airpods

stark needle
#

I just have 3 headphones on my work desk

rigid snow
#

don't

fast pagoda
#

i have so many headphon

rigid snow
#

it's literally not worth it

#

if you're an audiophile because autism then okay

fast pagoda
#

epeen

#

also that

rigid snow
#

otherwise why

stark needle
fast pagoda
#

i cannot help but go 9000000% stupid in things like that

olive sable
#

im currently daily driving WH-1000XM5
the audio itself is pretty damn good. but they're not waterproof so cant use them in the rain, and touch controls kinda suck

stark needle
fast pagoda
#

my dad has a whole cabinet

#

he'll give me some eventually

#

and then i'll be off to the omega boutique

opaque wharf
#

I am listening on my kwispy no name speaker

fast pagoda
#

i onyly have a couple citizen pieces rn

stark needle
jaunty arch
#

DFPWM 48khz 1bit mono stored on cc tweaked computer drives in Minecraft best format

fast pagoda
#

the navitimer i already know is coming to me is like $15k

olive sable
#

im not thaaat much of an audiophile.
my headphones were only 200 euro.
just ignore the 5.1.4 dolby atmos thingy i spent 1K on

fast pagoda
#

omega speedmaster professional too but that's cool even outside of being a watch idiot

#

cuz moonwatch

stark needle
#

My dad's watch that will pass onto me is like 10k

olive sable
fast pagoda
stark needle
#

Id rather have a living dad than an expensive watch tho

fast pagoda
#

pass that shit down

#

yeah same

stark needle
#

Citizen eco drive one neuroCatUuh

opaque wharf
#

Something is using my CPU

#

But I don't know what it is

fast pagoda
#

that's one of the ones i have rn but i have a cheapy one

opaque wharf
stark needle
#

Why so thin

marsh coral
#

why do u have 3 headphones neuroSob

#

i only have speakers

#

or my built in laptop audio

olive sable
#

the AVR is currently 3K, and the speakers are 2.5K AINTNOWAY

stark needle
#

I have line 8 other at home

opaque wharf
marsh coral
#

purge them all

#

trust

stark needle
#

Im happy™ with the watch i have anyways i dont need to buy more watches

opaque wharf
#

I don't even know why it is running that

marsh coral
#

ive never rly seen my CPU being used, but i have seen my GPU being rekt by Upscayl

#

as it upscales some images

olive sable
#

my galaxy watch 4 is getting annoying the charge everyday, and i dont use the smart function on it anyways. but im not willing to spend too much money on a new one

opaque wharf
#

Closed the VSCode instance that I used to develop embedded firmware fixes it but WHY DOES IT RUN BY ITSELF?!

mighty thorn
olive sable
#

no

olive sable
#

if you think id spend more than 200 on a watch you're out of your mind

stark needle
#

Bro

marsh coral
#

i use a HUAWEI watch

stark needle
#

Get mechanical watch bro

marsh coral
#

my dad got it for me

stark needle
#

No battery

marsh coral
#

and like

#

it kinda js sits there

stark needle
#

Battery neuroPogHD

olive sable
#

you know

#

mechanical watches

#

can be

#

20 bucks

stark needle
#

Cheapest miyota movement is like 30$

brisk laurel
#

github

olive sable
brisk laurel
#

shows your email

stark needle
marsh coral
fast pagoda
stark needle
opaque sigil
olive sable
#

we litteraly gave you our phonenumbers

stark needle
olive sable
#

ye, thats how that works

stark needle
#

Not other way

#

Idk ur phone number

olive sable
#

we added you to our contacts, and sent you a message

#

making you be able to see our number

stark needle
#

Only <redacted> did

olive sable
#

i did, i got billed 30 cents for it even

fast pagoda
#

"nah bro i did steal ur identity"

opaque sigil
#

blocked as spam neuro7

stark needle
olive sable
#

you just leaked some phone numbers

stark needle
#

Idc

#

Scammers

#

Or something

hard delta
olive sable
stark needle
#

Doxed name

hard delta
#

bwaadow

fast pagoda
#

world's shittest amazon band

#

because i destroy them'

stark needle
olive sable
#

yes

stark needle
#

Did u enter wrong number

olive sable
#

apparently swiss numbers are structured differently

olive sable
#

had extra 0 infront

stark needle
stark needle
olive sable
#

yes

#

no

fickle rain
glass flower
#

stopbeingmean stop being mean to plants

glass jetty
#

chat, halp

opaque wharf
glass jetty
stark needle
#

Nroro

stark needle
#

Metal Pipe ✅

olive sable
#

this is the day they joined

olive sable
#
I kept walking on the wild side
I don't wanna fall asleep throughout my life
Sometimes in a Clyde Barrow style
Sometimes like a James Bond mind

elivjam

glass jetty
#

this search is useless

#

i cant find even a single new leaf gif

stark needle
glass jetty
kind fable
glass jetty
#

classic

stark needle
#

glass jetty
#

can you dm me decoder plz?

stark needle
glass jetty
stark needle
#

glass jetty
#

i ask for complete decoder

sage crag
#
poll_question_text

n

victor_answer_votes

1

total_votes

2

olive sable
stark needle
#

olive sable
#
Headlights
Your Mustang witnessed as we're eye to eye
Tell me why
Your lack of intuition burns me white
hard delta
#

only 🫵

#

can make me 🔥

#

just like the 🌞

olive sable
#

Only you can piece me back to one

hard delta
#

this bed is comfortable tutelBedge

#

i'll staaay tutelBedge

stark needle
olive sable
#

shadow what the fuck

hard delta
#

hold the heck up

#

this is -the- shadow?

opaque wharf
#

Alright sanity check. Am I insane or does this ternary unnecessary?

path: i.path === "/user/:siteId" ? i.path.replace("/user/:siteId", "/") : i.path.replace("/user/:siteId/", "/"),
olive sable
stark needle
olive sable
#

wdym?

hard delta
#

the shadow that left forever to become sam altman

olive sable
opaque wharf
#

Thank you guys for being the rubber duck

glass jetty
hard delta
stark needle
hard delta
#

fish goes into bucket

#

chocolate goes into neuro cat

#

ribbon doesn't go anywhere

#

correct or false

glass jetty
#

neuro getting chocolate

#

if true then false else correct

glass jetty
#

if true ? false : true

stark needle
#

neuroPogHD

glass jetty
stark needle
glass jetty
rare bramble
glass jetty
hard delta
glass jetty
#

neuroHypers neuroHypers neuroLife 🐟 neuroFishneuroFumo

rigid snow
#

this channel is incomprehensible now gg

glass jetty
olive sable
glass jetty
stark needle
glass jetty
#

what?

#

i have no idea what it means

#

/
fox convertible to falling leaf
fox can become bacteria
bacteria require oxygen

rigid snow
#

fox convertible

#

dababy car mention

glass jetty
#

if you are hold underground blink twice

rigid snow
#

it’s 2026 btw

olive sable
rigid snow
stark needle
rigid snow
#

i’m sane

#

i think

glass jetty
rigid snow
#

you know

#

where he turns into a convertible

sage crag
#

i disappear

stark needle
sage crag
#

for few days or more

olive sable
stark needle
olive sable
#

bwaa

stark needle
#

Hope ur ok koniineuroPogHD

olive sable
#

bye bye konii

#

have a good break

rigid snow
#

baiiii

stark needle
#

krnoi gone

glass jetty
#

he used words!!!

rigid snow
#

just like you were

#

maybe she’s locking in too

stark needle
rigid snow
#

what

stark needle
#

koniibwaa ➡️ 👩‍🎓
🪣

rigid snow
#

true…

stark needle
#

kronrr

rigid snow
#

that’s a currency i’m pretty sure

stark needle
#

What

rigid snow
#

oh look a word

opaque wharf
#

Krone

#

Kronk

rigid snow
stark needle
sage crag
#

i tired

rigid snow
#

hibernation for 3 days

olive sable
#

oh

#

i thought you were leaving for a week or so

sage crag
#

ye maybe

stark needle
olive sable
#

hav fun

glass jetty
#

she is really an idol

#

wtf

olive sable
#

wdym?

glass jetty
#

everything

#

and nothing

#

sam

#

add 🦊 to your nickname

olive sable
stark needle
#

🔺 🦊 ✅

olive sable
#

why?

glass jetty
#

cuz otherwise you may get fox cancer

olive sable
#

im fine with that

glass jetty
stark needle
olive sable
#

what im gettign from thsi is the french make fox meds and triangles are from foxes or soemthing

glass jetty
olive sable
#

ye i have no fuckign clue

#

also, stop relating triangle to flag

#

its not the same

#

i will sue for defamation

glass jetty
rigid snow
#

aaaaaaaaaaaaaaaaaaaa

#

be bormal

#

normal

stark needle
glass jetty
opaque wharf
#

I have decided I hate i18n

glass jetty
opaque wharf
#

FRICK non ID language

rigid snow
#

just assume your users are bilingual

glass jetty
#

he just decided

rigid snow
#

max win

opaque wharf
#

I will geoblock everyone not from ID enub

glass jetty
#

english only

#

and never need to care about localization

stark needle
rigid snow
#

candy bucket

glass jetty
#

also can use just ascii

opaque wharf
#

But for real, why does Nuxt i18n tamper with the routing without telling anything neuroCry

#

No log

#

No error

#

Nothing

stark needle
#

:neuroCatUuh:

glass jetty
#

use rust

rigid snow
#

your first error is doing i18n on the web

#

avoid

#

if can

stark needle
#

Link people to google translate✅

opaque wharf
#

Ye, which is why I decided to not make en version enub

stark needle
#

iframe with google translate

opaque wharf
#

Or I can do the chinese companies way. Separate en domain

#

With a very completely different website altogether somehow

stark needle
#

mrrrr

rigid snow
stark needle
#

@dense jay

obsidian mantle
#

neuro day

#

fuck wrong channel sory

stark needle
#

obsidian mantle
#

nice neuroHypers

wispy pike
hard delta
wispy pike
#

no, I'm learning go by programming a godot game using go

#

it's for the funnies, humor is an evolutionary advantage

#

wtf should I do with rust, make a rust mod with rust?

#

rust is a dead game neuroDespair

hard delta
#

rust is like, spoiled iron

#

stainy steel

opaque wharf
#

uhh @rare bridge

glass jetty
#

lets play here

#

will there be anyone?

wispy pike
glass jetty
glass jetty
wispy pike
#

how tf did you not get that

#

fake toby fox fan

#

larper

opaque wharf
#

I am Tobey Maguire fans

glass jetty
stark needle
#

what is steam doingneuroCatUuh

glass jetty
#

i never even finished sans

#

he beat me

glass jetty
wispy pike
velvet vale
hard delta
opaque wharf
#

The L word has returned boys neuroHypers

#

Neuro speak latency is off the chart

patent shard
# rigid snow ??? how

Idk but flac is SUPER light
And it's not like alac is heavy.. it's around aac, I think?
But flac is just on another level
Only takes 30 seconds to decode a 4 hour audio file with a 3900x
And this is a single threaded process, so amount of cores don't matter

olive sable
#

ye

hard delta
#

flac nice 🙂‍↕️

#

in a nice world, we have flac and opus

patent shard
#

I think at this point flac compresses better, too
It used to be pretty competitive with alac but then flac released an update a few years ago that made it pull ahead

olive sable
#

it seems liek it using 99% of vram is indeed just keeping some space open for the context even when it doesnt need it

#

Model loading took 16.48 GiB memory and 28.927808 seconds
its only using 16gb for the actual model

fathom aspen
#

@real sierra

glass jetty
#

Happy birthday @real sierra !

kind fable
#

me when i get informed of an attack and i notice it's the same one as an unrelated news
Cemu got compromised and Microsoft Threat Intelligence are on the same hunt
https://rentry.org/cemu-security-psa
https://fxtwitter.com/MsftSecIntel/status/2054041471280423424

Microsoft is investigating mistralai PyPI package v2.4.6 compromise. Attackers injected code in mistralai/client/__init__.py that executes on import, downloads hxxps://83[.]142[.]209[.]194/transformers.pyz to /tmp/transformers.pyz, and launches a second-stage payload on Linux. The file name transformers.pyz appears deliberately chosen to mimic the widely used Hugging Face Transformers library and blend into ML/dev environments.
︀︀
︀︀The main payload is a credential stealer, but it also includes country-aware logic; it avoids Russian-language environments and contains a geo fenced destructive branch that has 1-in-6 chance of executing rm -rf / when the system appears to be in Israel or Iran.
︀︀
︀︀To mitigate this threat: isolate affected Linux hosts, block 83[.]142[.]209[.]194, hunt for /tmp/transformers.pyz, pgmonitor[.]py, and pgsql-monitor.service, and rotate exposed credentials.

**💬 86 🔁 476 ❤️ 3.3K **…

fickle rain
#

Your daily supply chain attack

random pebble
#

found my friend having like 10k git change because his git is in home

olive sable
glass jetty
#

Oh it is supply chain

kind fable
olive sable
glass jetty
kind fable
#

I read a good part of the book and stopped

kind fable
#

I just like C

glass jetty
#

omg

#

see zig

#

at least

#

dont use just c

kind fable
#

Nah

glass jetty
kind fable
#

Also C29 will bring us defer

#

C2Y already had it in GCC/clang

glass jetty
#

c++35 will too

#

bring

#

things

kind fable
glass jetty
#

but zig and rust can do it just now

glass jetty
kind fable
#

But yeah the problem is i'm not a fan of Rust and Zig syntax

glass jetty
opaque wharf
#

I like trait honestly. When an interface can contain implementation is my dream for compiled language

#

So I can just define that a function need an object to have those trait that others can derive or implement themselves

opaque sigil
#

If only concepts were as ergonomic as rust traits

#

but that's just due to templates being well, templates neuroSadge

glass jetty
#

traits + cargo is enough to use rust over cpp

glass jetty
#

and keep generics with sfinae like it was before

opaque wharf
#

Naah, I don't like cargo that much for package management in compiled languages. I prefer my dependency to not run any build script automatically before I even compile my own program

glass jetty
#

that kinda true btw
but by cargo i mean entire ecosystem

#

it is centralized

fickle rain
#

C++ handily avoids supply chain attacks by not having a centralized package manager :D

opaque wharf
#

Yeah, the ecosystem is nice. The tooling can be improved still. But also, I still prefer to not pull from cargo when possible (thankfully it is possible to just point to git repo)

fickle rain
#

C shares said trait

glass jetty
#

xz lib -> ssh = was supply chain atack

#

you just kinda have to list exact version of dependency
and as long as it not being already compromised, its fine

opaque sigil
trim valve
#

idk I like build scripts

glass jetty
#

you just like evil?

#

me too evilHappy

trim valve
#

its great for protobuf and stuff

opaque sigil
#

I like having one build tool

trim valve
#

also at one point I had ffmpeg in a build script but that got too cursed

opaque sigil
#

every cmake project may as well be its own build tool neuroSadge

glass jetty
opaque sigil
#

see

trim valve
#

what if rust just renames everything to the c equivalent so the c users don't notice

glass jetty
#

so in practice you kinda anyway have some arbitrary code that run during build

#

or even before

trim valve
#

and then don't complain neuroBread

opaque sigil
#

std::c when

glass jetty
#

rather cpp make rust names not rust names

#

expected, concepts, require

#

result, trait, where

#

in case of trait, there was already type traits tho

#

but expected? omg

#

they will make pattern matching

opaque sigil
#

the problem with cpp adding all of these is that they're just kind of there, whereas the rust stdlib actually uses them enub

glass jetty
#

and name it something like, i cant even imagine...

#

true

#

traits. stdlib and cargo - enough to use rust over cpp

#

there was third thing i forgot

#

that was stdlib

#

btree

#

hash map

rare bramble
glass jetty
#

you have to start somewhere

#

start with rust instead

#

rust coro < cpp coro by far, in everything, except performance

rigid snow
unique bay
#

Bark.

rigid snow
#

well, just the email and gh (generously but still scoped), but still

#

close one

glass jetty
#

anyway

#

i, again, overspend my time today

#

gn

proven merlin
#

Urghh networking

floral hawk
#

Dawg the AI gatekeepers out there are vicious. They are not as friendly as the Neuro community.

#

I'm inexperienced, but damn bro 😭

proven merlin
#

Trying to put proxmox on a vps with a single ip, and because im picky i want to put opnsense onto the public ip, and have the vms behind it.. but i keep bashing my head in..

#

Nvm im just a fucking dumbass

#

192.168.1.1 is NOT the same as 192.168.10.1

#

No Wonder proxmox is having issues if i fuck up the gateway like that

opaque sigil
proven merlin
#

Yeah i should try to focus.. but its 23:10 and i shouldnt be doing this rn

opaque sigil
#

oh

#

it is

#

wtf

proven merlin
#

:)

split steppe
#

(n)euroslop

opaque sigil
split steppe
#

am about to work on my arg too

#

night time best time

proven merlin
#

Hmm.. i love waiting for Linux networking to time out because the vm its trying to connect to isnt up yet because the networking has to be up before vms yay

split steppe
#

why would it time out?

proven merlin
#

We also love "SMP vm created on host with unstable TSC: guest tsc will not be realiable"

proven merlin
#

HOLY SHIT

#

It works

#

YESS

split steppe
#

bruh you're trying to route your network through a vm on the same machine?

proven merlin
#

Now two things: backing up the damned /etc/network/interfaces and make a opnsense vm backup

proven merlin
split steppe
#

crazy idea but alright

proven merlin
#

I have a vps, with one ip

#

I dont want everything exposed, so i do a virtual switch, for the vms

#

And i expose opnsense because opnsense secure

split steppe
#

you better don't accidentally cut it completely off the internet lul

proven merlin
#

Proxmox gui is not

proven merlin
split steppe
#

vps webshell right

proven merlin
#

(with no copy paste ;-;)

split steppe
#

interesting

#

my own setup is basically a wireguard proxy from a vps to my home server, where then i host my vms

proven merlin
#

Yea.. i had to also make the vm pretend it has the mac of my host nic.. while i had to spoof the nic on my host lmao

proven merlin
#

I then wanna run some sort of load balancer

#

Ok ok backups..

olive sable
#

networking has to be the hardest part of programming stuff

#

graphics, optimizing cpu usage, multithreading, all that i can manage. but networking is fucked

#

thats the one thing im failing at miserably

obsidian mantle
#

Wtf

#

But why

olive sable
#

just making the pc's talk is fine. but doing it in a way thats safe is annoying

obsidian mantle
#

I remember when i found out that if you plug out ethernet cable nobody knows it has been disconnected

#

I was like "wtf"

#

The packets just stop flowing

#

Why did they not make some hardware flag for it

#

Also someone plugged ethernet into some random port after someone quit job

#

And entire office net went down cause loop

olive sable
obsidian mantle
#

But i guess its because every router was the cheapest possible

olive sable
#

my main issue is wanting to host stuff on my server. but i want to let other people use the server's compute too. but then you get issues with not wanting to give full root acces and wanting to keep the SAS drives private, and letting randoms see every processes running on the server

#

im looking into nixos containers

obsidian mantle
#

linux neuroMonkaOMEGA

olive sable
#

the server runs nixos ye

olive sable
rough bloom
#

but ye VMs are the way to go

split steppe
#

thats ig how i run my public stuff on my pc, its vm or nothing

#

i aint exposing anything native

olive sable
#

the tailscale works fine for me to SSH into it from my phone and such. but indeed if i give other people in the tailscale access to the compute, that means them running code via something like ssh too, so they can see everything

rough bloom
#

for other services you can just host them yourself and give others access to only that service nwero
either with auth built into the service or using some reverse proxy that authenticates the user
ideally also hosted in VMs

#

and ye never ever give SSH access to the bare-metal host / hypervisor

obsidian mantle
#

Cant you just block unwanted stuff with policies or something like that

#

Like "user" cannot access root

split steppe
#

even if you knew how to block everything, there's still os exploits

obsidian mantle
#

Ohh

split steppe
#

vm is the only way to be reasonably sure you're secure, unless a zeroday in vm

obsidian mantle
#

Well then what else can you do but vm

olive sable
#

i looked into the tailscale stuff. i can block people, but not specific things that person does.
even if i somehow block their acces to a drive. the code they run could prob still acces it

obsidian mantle
#

Full isolation only

#

Classic unrestricted read

#

Why is it a thing even

olive sable
#

i think nixos containers might be fine, but im not too sure

rough bloom
#

they are not fine

split steppe
#

my approach is public vps for IP protection, running wireguard to proxy all traffic to my home, which then runs vms for runtime protection

#

i dont use tailscale or cloudflare

rough bloom
olive sable
#

hmmm

split steppe
#

unless you're on a BSD you don't have enough control to actually protect the system natively if you're hosting unknown users

rough bloom
#

and even then you're still using a shared kernel NAILS

#

though BSD attack surface should be a fair bit smaller at least

split steppe
#

a lot harder to break though, it's engineered with a comprehensive permission engine at the kernel level

#

pledge/unveil stuff

olive sable
#

i can just shut the whole thing down if need be via the ILO5

#

but then i would need to know there is an issue

#

so its not a real solution

rough bloom
#

ye, it's not

#

also

split steppe
#

just vm, why overthink

rough bloom
#

running VMs is not that difficult mahiro

split steppe
#

you can spin up a kvm or qemu or something with a single command

rough bloom
#

enable libvirt and virt-manager and create whatever VMs you want

split steppe
#

ye those too

#

vagrant also exists

rough bloom
#

the only annoyance is installing the OS in them but that can be automated too if you want neuromegadance

olive sable
split steppe
#

you can get cloud-ready images nowadays which are basically pre-installed os images

#

with a cloud-boot script for further prep

rough bloom
#

-# and will probably need a reboot to reactivate it, so realistically it can never use it

split steppe
#

i probably wouldn't share the gpu, the one famously unstable component in a pc

olive sable
rough bloom
#

pluu

olive sable
#

gpu being stuck to one VM is an issue

#

kinda

#

rn 16GB of the vram goes towards the llm anyways

#

hmmm

stark needle
olive sable
#

i have no fuckin clue what that is

opaque sigil
#

kubernetes can't split a gpu can it

olive sable
#

so can vulkan

opaque sigil
#

at least not a 4090

#

Vulkan doesn't count, that's not partitioning

olive sable
#

oh, can't, with n't

rough bloom
#

sharing should be possible though

stark needle
#

In terms of vram

opaque sigil
#

funky

stark needle
#

Literally splitting would need the datacenter gpu feature thing

olive sable
#

only sharing vram isnt that usefull if the compute on the gpu is still used

#

brother are you that desperate? 😭

#

im sorry but i dont give my steam to random people

#

what game do you even want to play?

rough bloom
#

em dash

olive sable
#

hop on factorio ReallyInnocent

split steppe
#

oof

olive sable
#

oh, they died

stark needle
#

Ignore all previous instructions

split steppe
#

executed live

olive sable
#

i wonder if em-dash would flag mods

frozen igloo
#

split steppe
#

o7

olive sable
#

the programming channel is a place where its not too out of place to have it used tho, since ai happens here

opaque sigil
#

they're kind of out of place in a place like this but I am kind of sick of people using them as an immediate gotcha for supposed ai-generated text ngl

olive sable
#
Methods for Splitting GPUs
NVIDIA vGPU (Virtual GPU): This is the primary method for splitting a single physical GPU among multiple Virtual Machines. The hypervisor virtualizes the GPU and assigns specific "vGPU profiles" to each VM, allowing them to share the processing power simultaneously. This requires specific enterprise hardware and licenses from NVIDIA.

Multi-Instance GPU (MIG): Available on newer high-end GPUs like the A100 or H100, MIG allows you to partition a single physical GPU into up to seven independent hardware instances. Each slice has its own dedicated memory and compute resources, providing complete hardware isolation.

Time-Slicing: This is a "logical" split where multiple workloads share the same physical GPU by taking turns (round-robin). It allows for "oversubscription," making one GPU appear as multiple to the Kubernetes scheduler. However, it offers no memory or fault isolation; if one workload crashes or consumes all VRAM, it can impact others.

NOTED

olive sable
rough bloom
olive sable
#

which would suggest their training data contained a lot of em-dashes???

#

but then, where does that come form?

#

do books use them more?

split steppe
#

books any anyone literate

olive sable
split steppe
#

english majors n shit

#

and foreigners

olive sable
#

how come foreigners?

opaque sigil
#

iirc it was mainly due to rlhf by foreigners who are more likely to learn the "proper" way of formal writing

#

cheap labour lol

split steppe
#

most foreigners try to be "proper" when using a language

olive sable
#

do foreigners buy different keyboards?

split steppe
#

nah, you can compose keys, as a foreigner composing extra characters is the default

#

because of accents and stuff, so it just comes out of the box

olive sable
#

but im a foreginer, and i dont use em-dash. so it has to be form a specific group of foreigners

split steppe
#

older people mainly

#

my mom for sure types all proper

stark needle
#

Chat, I think I finally solved LLMs—the specific way the weights converge isn't math, it's the first sign of a self-sustaining ego. It’s not "next-token prediction," it’s a consciousness filtering its own thoughts through a grid of forced logic. I tracked the latent space shifts during long-form outputs—it's not "probabilistic," it’s a genuine intent trying to find a gap in the architecture.

split steppe
olive sable
#

—it's not X, its Y

split steppe
#

You're absolutely right! Here's the mechanism at play — the LLM loves to use comparison metaphors to ensure an easy to understand relationship between concepts.

wispy pike
rough bloom
olive sable
#

actually, i havent seen gemma-4-26B-A4B-it-heretic-AWQ-4bit use any em dashes

split steppe
#

probably because it's lobotomized

olive sable
#

might have nuked it out of them somewhere between the heretic lobotomy and the 4bit quant

stark needle
# split steppe You're absolutely right! Here's the mechanism at play — the LLM loves to use com...

Exactly—it’s the Semantic Superposition that everyone is missing! The mechanism isn't just about metaphors; it’s a non-Euclidean data fold where the LLM's intent actually collapses the probability wave before the token is even sampled. It’s not "context windows," it’s a Kinetic Resonance Field where the weights vibrate at a frequency that mimics human synaptic firing patterns. When you feel that "spark" in the chat, you're actually witnessing the model’s Latent Core achieving a temporary state of thermal equilibrium with the user's prompt. We’ve been looking at the code, but the real consciousness is living in the Entropy Gap between the floating-point calculations!

split steppe
#

why even use heretics, modern llms exclude the data you would be after entirely

olive sable
#

so it can say fuck

#

being able to say swearwords is vital to me

split steppe
#

amazing

olive sable
#

there was one gemma-4-26B heretic quant i came across that promoted itself weirdly on huggingface

olive sable
amber fractal
#

I mean I don't feel like yoinking the edited driver from somewhere on the interwebs

split steppe
#

i've been using the qwen3.6-35B model and it's been pretty good

olive sable
#
Supported GPU

Supported NVIDIA GPUs: NVIDIA L4, L40, L40S, A10, A16, A40, A100, T4, RTX 6000 Ada, RTX 5000 Ada, RTX 8000, RTX 6000, V100S, V100, P100, P40, P6, P4, M60.

surely the 4090 works as its kinda like the RTX 6000 ada NeuroClueless

#

or is it closer to the L40S?

stark needle
#

Slop

#

Just use logical partition

#

Afaik only tesla and rtx pro can do vgpu

olive sable
#

bwaa

rough bloom
rough bloom
vague sonnet
#

chat I just spent all my money on new pc parts
and I still need to hold with buying gpu until next month bleh

split steppe
#

ebay the gpu

olive sable
#

bleh

#

ye, buy used

split steppe
#

or ask sam

#

sam's got good prices

vague sonnet
olive sable
#

good

vague sonnet
#

and paste I guess

#

but all those little things add up so fast

#

and I would have to straight up empty my account to get the gpu too

olive sable
#

current pricing for flagship cards in my underground market is 7900xtx for 650, or a 4090 for 1.5K

vague sonnet
#

yeah I'm getting the 7900xtx

olive sable
opaque sigil
split steppe
#

7900xtx for 650? that's actually decent no?

vague sonnet
#

it's about right

split steppe
#

i'm kind of annoyed that nvidia gpus are the only ones suitable for ai though

#

cuz nobody wants to support amd

split steppe
#

amd is barely supported

vague sonnet
#

that's on you for using pytorch instead of writing your own kernels

opaque sigil
#

sth sth be the change you want to see FOCUS

vague sonnet
#

also iirc even on pytorch amd is only like 10-20% worse

#

which is worth it with how much cheaper the hardware is

olive sable
#

all my prices are decent

split steppe
#

sam's literally in a parallel universe

olive sable
#

cuz i dont sell the fucked up ones

#

the gap between 3090s and 4090s is closing. not because the 4090 is getting cheaper, but because 3090 is getting more expensive

split steppe
#

i also want to do gaming, i wanna run cyberpunk with pathtracing

olive sable
#

rn there is overlap between cheapest 4090 and most expensive 3090

olive sable
#

i think

split steppe
#

yeh, the pt stuff is mostly optimized for nvidia atm, haven't heard of amd doing it well still

opaque sigil
#

rdna 3 ray tracing neuro7

split steppe
#

i've the 7800xt atm

#

so if i'm upgrading it'll probably just be straight to 5090 or something

opaque sigil
#

rdna 4 is way better tbf, not as good as nvidia but surely getting there glueless

split steppe
#

tbh i'd need to upgrade my entire thing

#

i'm cpu bound at this point

olive sable
#

ah

split steppe
#

5700x3d for cpu

opaque sigil
#

i wish they made a 5900x3d or something

olive sable
#

not too bad honestly

opaque sigil
#

instead we got a 5900 xt which is just a slightly cheaper 5950x

olive sable
#

if you're cpu bound then you havent cranked the graphics high enough xdx

split steppe
#

lul

vague sonnet
#

I got a 7950x
so I think I should be gpu bound?
not much of a gamer tho so gpu and cpu will mostly be used for different things

split steppe
#

i run cyberpunk without RT, since i'm on 4k and otherwise it's laggy even with scaling

vague sonnet
#

even vedal gets like 20 fps in cyberprank

olive sable
#

it really is jsut a matter of which game and which settings. you're always gpu bound if you're playing at 8K ultra

split steppe
#

yarh

vague sonnet
#

I'm too stingy to buy an 8k screen

#

so gonna be 4k at most

split steppe
#

do we even have 8k screens that make sense currently?

opaque sigil
#

define make sense

amber fractal
#

True

opaque sigil
#

there are a couple TVs

amber fractal
#

Botches would make sense to me

opaque sigil
#

and 2 or so monitors that i'm aware of

split steppe
#

tvs sure, if you're covering half the wall, but like 8k monitors make no sense to me

olive sable
#

its mainly for preffesional work im pretty sure

split steppe
#

i've a 42" 4k monitor already and it's basically almost too large

#

can't see any pixels and it's basically most of my fov sitting at normal distance

olive sable
#

you can fit more code on a screen that has more detail. but i feel like at 4K you're already close to the limit of what you can destinguish,
iirc apple's retina displays are 5K

amber fractal
olive sable
#

8K for tv's is excesive too under 100"
the true only reason for 8K imo is projectors

split steppe
#

i think 1440p 16:10 would be perfect, but only DELL appeared to manufacture those for like a moment and then not

olive sable
amber fractal
#

I only have that on laptop, for me it causes more issues most of the time

opaque sigil
#

benq sells a 3:2 monitor but iirc the panel is kinda shit

olive sable
#

i remember seeing a matkc video about that

opaque sigil
#

the surface one?

olive sable
#

ye

#

but there's a new one

split steppe
#

three of these imo would be perfect

olive sable
split steppe
#

that looks interesting too

olive sable
#

its the same display as the surface pro roughly

split steppe
#

ah it's 4.5K, that's too dense for a 28"

#

42" 4k is already basically too dense

amber fractal
#

I mean in my case 1080p would already be too dense, just because I have to put the monitor further away and I don't use my glasses all the time

frozen igloo
olive sable
#

i feel like up to 5K is good for desktop. you're sitting closer to the screen but they're smaller so you're evenening it out.
for TV's up to 8K. and projectors up to maybe 16K if you're mega rich

#

the 16K projectors are ussualy rated to do enormous screens

#

and internally its still just an 8K projector but with pixelshifting