programming

[fast pagoda]

reversed i think

[sage crag]

i think so

wrr

[fast pagoda]

it was uploaded in oct 2024

so there were a couple video models around that could've maybe pooped that out but wouldnt have been as easy as today

went sleuthing, the void stared back

around that time we had like kling 1.5

which would not have produced that i do not think

[sage crag]

https://tenor.com/view/crash-out-bunny-rabbit-im-gif-10075768982376662002

[fast pagoda]

Eep

[nocturne olive]

That's crazy how the 27B is almost as good as the 122B and not far from the full size

[rigid snow]

i just did this

[sage crag]

@rigid snow

@rigid snow

[rigid snow]

can confirm i do this

[sage crag]

@rigid snow

[rigid snow]

hello

hi

[sage crag]

you didnt say it a third time

[rigid snow]

why do you like to triple mention me

what is this new thing

[sage crag]

a fairy told me to

[rigid snow]

what is their name

[sage crag]

probably fairy

[rigid snow]

fairy the fairy

[leaden crest]

interesting

[sage crag]

yes but consider

if you translated it to another language

[leaden crest]

is the fairy french

[sage crag]

the name would still be fairy

but "the fairy" would be different

[rigid snow]

what if the language uses a different script

[sage crag]

[rigid snow]

it wouldn't be "fairy" exactly

[sage crag]

mlntcan

[rigid snow]

it may even sound different

[sage crag]

(baaast)d

[rigid snow]

yes that me

[sage crag]

not for long

[rigid snow]

account stolen by order of fairy the fairy

[sage crag]

loam also

wants your account

[rigid snow]

whos loam

[fast pagoda]

mlem

[sage crag]

loam is loam

:LoamPat:

[rigid snow]

OH

yeah mb i rember now

[sage crag]

go on then

:LoamPat:

[rigid snow]

ok

also my discord token is

[sage crag]

waiting

bored

waiting takes so long

not fun

[rigid snow]

uuuuuuh getting it is taking some time you must understand

[sage crag]

https://tenor.com/view/crash-out-bunny-rabbit-im-gif-10075768982376662002

give it to me

i mean loam

give it to loam

[rigid snow]

loam it to you

[sage crag]

...sure

[rigid snow]

...sure

[sage crag]

beady eyes

stingy money grubber

give me your token

[rigid snow]

here you go 🪙

[sage crag]

cryptocurrency

[rigid snow]

not

[sage crag]

[rigid snow]

just token

[sage crag]

currency

not crypto

or

crypto

not currency

[rigid snow]

is a token currency necessarily

[sage crag]

no

[rigid snow]

it's just something you use in exchange for something else

so what do i get then

[sage crag]

a token is used for exchanges but a currency has the requirement of being reproducible which a token doesnt

for example

for example

my brain is a token

can be used for exchange

but cannot be replicated (yet)

[sage crag]

probably

the knowledge that you gave your token away

high value

[rigid snow]

[sage crag]

allows you to implement security measure

ye

unhappy

https://cdn.discordapp.com/attachments/1300807614032121950/1409945130810609695/3dgifmaker99373.gif

no token

[silent cloak]

What is that gif

[sage crag]

konorb enub orbit

[silent cloak]

https://tenor.com/view/cat-stare-sleepy-gif-9558558281283765110

[sage crag]

https://cdn.discordapp.com/attachments/1126496895246807123/1433049661270261871/ShouldICelebrate.gif

[silent cloak]

the transformers in my brain trying to decode those words in the morning

[fast pagoda]

dense model thing, it's the largest non-MoE

generally have seen consensus for a whiel that to estimate what the dense equivalent of an MoE is, you do geometric mean aka the sqrt of total params x active - for the 397a17, that's sqrt(397 * 17) or ~=~82B

for 122b, that is sqrt(122 * 10) ~=~35B

that checks out to me, given MoE weirdness causing some losses along the experts domain covg or something. routing errors, expert load imbalance, incomplete specialization

MoE tends to have a better showing at the lower end, if you do it for the 35Ba3B, geometric mean on that is about 10b but that one is comfortably ahead of the 9b in comparison

[sage crag]

https://cdn.discordapp.com/attachments/1187930764873056278/1411143072489672838/minyan-orbit.gif

wrr

[silent cloak]

i did villager asmr with her in a voice call once

[fast pagoda]

roblox oof sound

oh right i forgor you're just vedal

that makes sense

[silent cloak]

im American though

[fast pagoda]

and

[amber fractal]

tutel is terminally british

[minor sail]

[velvet crest]

You have unlocked new role

[fast pagoda]

You have unlocked new role

[silent cloak]

You have unlocked new role

[minor sail]

wow, but what role

[fast pagoda]

imag

[silent cloak]

role

[fast pagoda]

you can embed

[minor sail]

omg wow

[sage crag]

could you pick a better message to unlock new role on

[minor sail]

;_;

[sage crag]

[silent cloak]

You have unlocked new troll

[sage crag]

yoy

[fast pagoda]

was there an attempt though, was there really

[silent cloak]

in my head

[fast pagoda]

jason derulo

i h8 u

[fast pagoda]

me when any pop garbage from 2010 i used to shit on comes on

[silent cloak]

honestly yeah

i have plenty in my work playlist

[fast pagoda]

it took 15 years but they finally got me

[silent cloak]

my music taste would give someone a stroke

though im editing the vocals of 4 streamers rn for a song so i cant listen to music atm

[fast pagoda]

i used to say that but i think my tastes have converged on a more stable place now

i used to confuse people because all i liked in like middle school was

rush

[olive sable]

Goodmorning/3pm

The lightcrafter 4500

It has arrived

[silent cloak]

mine is still insane

[fast pagoda]

i hope i have cpu on the way

[sage crag]

sam

sam

sam

@olive sable

@olive sable

[silent cloak]

my CPU got destroyed last music project

[olive sable]

Its at the post office. Im in class tho

[silent cloak]

this time i moved to cubase in hopes that it runs better

[fast pagoda]

i mean it's all over the place still. maybe i have just desensitized to it

[olive sable]

Lop

[olive sable]

Lop

[silent cloak]

no struggle yet

[sage crag]

dragonfruit

[silent cloak]

thankfully

[olive sable]

Lop

[rough bloom]

samuel vanuel manuel

[sage crag]

True!

[olive sable]

@sage crag

[olive sable]

@sage crag

[sage crag]

https://tenor.com/view/baothelop-glasses-bunny-professorial-gif-5087943380944875848

[olive sable]

So uh

What do you need me for?

[rough bloom]

educated

[silent cloak]

https://tenor.com/view/duck-with-sunglasses-driving-car-gif-1633248089450137490

[olive sable]

I have a cookie

[fast pagoda]

i kinda just bounce

all over

example

[rough bloom]

[silent cloak]

literally what i do

i got music from games movies tv shows anime normal music old music covers

etc

[fast pagoda]

https://tenor.com/view/doggo-floppy-ears-cute-gif-15057646

ear go like this

i add it

[silent cloak]

SAME

i dont vibe with alot of common music but when i hear something great it becomes an ear worm for weeks

[fast pagoda]

i like the recaps and stuff at the end of the year

because itll be like

you listened to this track 713 times

and itll be something i rememebr was like a week

[silent cloak]

lmao i usually use youtube so i dont have that but i imagine id be in a similar boat

[fast pagoda]

they started doing a youtube year end thing :o

[silent cloak]

i think i missed that

[fast pagoda]

it was on the you page but i cant find the damn thing

youtube doesnt know what the hell im talking about, theyve never heard the term recap in their life apparently

[silent cloak]

lmao

they beamed it into your brain

[fast pagoda]

they can see when i was trying to figure out how to find the discord one since my buddy wasnt able to see it

but they have no record i ever watched my own on youtube itself

that was the one i didnt need to be reminded

because i sent them this from mine

and they were flabberghasted

apparentlly this is a few messages

[silent cloak]

damn

[fast pagoda]

my spotify wrapped, the top song is literally always "cyberstrike" by shirobon, and that is because that is my alarm

because it's so loud

[silent cloak]

lmao i cant imagine a song waking me up

[fast pagoda]

for years now

[silent cloak]

this is my alarm clock and even then it doesnt always work

[fast pagoda]

lmao

the reason mine is cyberstrike is because it starts super abruptly and i used to not be able to get up in like hs

so i set up an alarm clock on my pc

and it would set my speakers to maximum volume

and then start playing cyberstrike

and it would shake the entire house

could not stop it except by getting out of bed because i had a loft

and the computer was below

and usually i sprinted out the mf to avoid getting murdered by the rest of my family

i could be a fireman

[silent cloak]

lmao reminds me of this alarm clock i saw back in the day that had wheels on it

it would roll off and play a loud sound around ur room so u had to catch it

[fast pagoda]

kek

yeah if it didnt force me out of bed it was joeever

[silent cloak]

this one

[fast pagoda]

now i have the opposite problem

aw

cmere you lil shit

[glass flower]

my dad uses that exact one but in white

[silent cloak]

glad to hear it works

[glass flower]

but he disabled the rolling so just uses it as a normal clock

[silent cloak]

lmaoo

[fast pagoda]

now i can only stay in bed like 4 hours anyways

[glass flower]

it sounds like a dying r2d2 when ringing

[fast pagoda]

https://www.youtube.com/watch?v=FA3yNGU0L2E

[silent cloak]

reminds me of this old video

https://www.youtube.com/watch?v=SckcB099zrg

[fast pagoda]

https://www.youtube.com/watch?v=MIgMeyW4TEM this one as well

worst thumbnail

[silent cloak]

its certainly up there

[fast pagoda]

man

cisco opus #1 10 hours got removed from youtube

i unironically listened to that entire video probably 50 times at least

ok but some guy has done a 1 hour vip megamix

lmfao

https://www.youtube.com/watch?v=eh3SK-97Sss

i hate how much i love opus #1

it's likke my cia activation tone and i become pacified when hearing it

[silent cloak]

opus playing on the opus codec

[fast pagoda]

it predates the codec by 20 years

he just knew he had peaked and named it opus

then optimistically named it #1

when #2

[silent cloak]

based

[sick owl]

27B remains the undisputed king imo

Very nice, my old 360Hz Asus had the same

I think my current OLED might have too but I don't remember since its less impressive the second go around

[fast pagoda]

https://tenor.com/view/squidward-daring-today-spongebob-spongebob-meme-daring-today-arent-we-gif-23808696

[fast pagoda]

I keep seeing it out performing or being very close to like Claude 4.5 , that's crazy

[midnight sigil]

I guess it's common for monitors that advertised for their color performances

[fast pagoda]

I was sad when qwen3 was meh

[midnight sigil]

[trim valve]

[fast pagoda]

I used 2.5 for the first echo and then 3 was just not gonna happen based on the runs of training* I did complete

[sage crag]

luf

lop

[nocturne olive]

Big number but also small number? Wa

[rigid snow]

loud signal quiet audio

[sage crag]

[rigid snow]

or like

what is big signal

high amplitude

powerful

or probably actually not

-fs makes this interesting

nah no way intersample peaks do 30db

[fast pagoda]

Reduce the overall volume but increase you byhe specific bits

[hard delta]

peak af

[glass jetty]

no way ppl choice 1 box
that just stupid
https://www.youtube.com/watch?v=Ol18JoeXlVI

[olive sable]

Discord broken on desktop only for me?

[rough bloom]

only you

[olive sable]

Mobile seems to not be showing me much backlog either

Altho the current messages work

[rough bloom]

Discord is die

[fast pagoda]

it's broken for me

[rough bloom]

https://discordstatus.com/

[fast pagoda]

google wanted to suppress my post about gemma4 maybe soon

they dont want @sick owl to be told things he already knows by me for no reason

[olive sable]

Files dont seem to be sending, eventho normal text works

On occasion

[fast pagoda]

yeah, if i sent an image it just flies off into the void

[hard delta]

discord fine cause me not looking

🍌 2026

[olive sable]

[fast pagoda]

they took the bananer off the image gen option in gemini

this means they officially done ruined everything

[olive sable]

[amber fractal]

[olive sable]

discord back?

ok so

now that i can send images

[amber fractal]

we are so back

mabe

nah these taking forever to send

[olive sable]

The lightcrafter 4500 hath arrived

its small

really small

i know i had the measurements even before buting, but it still feels so small

with shipping and import tax, close to 900 euro

[rough bloom]

knife

are you planning to threaten the Lightcrafter 4500 with that

[sage crag]

dentge autopatchelf

pls fix

[olive sable]

i opened the box witht hatr knife

[glass jetty]

setup

[olive sable]

i cant power it yet

[rough bloom]

@silent anvil

[olive sable]

i need to solder the usb decoy board into 28V mode

[sage crag]

why patchelf brokege

[glass jetty]

cuz it is python

who know why it broke

[sage crag]

no, its obvious why its broken

im asking why someone broke it

https://cdn.discordapp.com/emojis/1455273822625333375.webp?size=48&name=mlntcandy&lossless=true

[glass jetty]

next time try to checkout stable branch

[sage crag]

next time try to checkout this branch

[olive sable]

i thought discord was broken again cuz i couldnt send the emote, but my keyboard was still in the pi

[sage crag]

sam

buy

[olive sable]

konii

[sage crag]

usb splitter

[olive sable]

buy what?

[sage crag]

just type to both

[olive sable]

no

[sage crag]

[olive sable]

i just use ssh after making the user account

[sage crag]

no one else on the entire internet has the same problem as me

im not submitting an issue

[olive sable]

it worksn't on my pc

[sage crag]

no osu until someone else figures this out

https://cdn.discordapp.com/emojis/1154436961277313126.webp?size=48&animated=true&name=evilSlam&lossless=true

b ut seriously

missing dependency ye, but name.name

[minor sail]

why name.name?

[sage crag]

because someone broke it

it was updated last in january, so why did it only break in march

[olive sable]

code that it depends on?

[sage crag]

the commit that did it is 4 years old

i think its

a dependency issue

[rough bloom]

no

[sage crag]

https://cdn.discordapp.com/emojis/1425862407800230051.webp?size=48&name=TheEvilEye&lossless=true

[rough bloom]

the dep.name.name is correct

[sage crag]

ye

since

it wasnt broken in 2022

https://cdn.discordapp.com/emojis/1479070544677699745.webp?size=48&name=Evilhiro&lossless=true

so, why is dep.name a string iif

[rough bloom]

issue is this probably
dep_name = dep[0] if len(dep) == 1 else f"any({', '.join(map(str, dep))})"

format string

not path

[sage crag]

looks like that line was originally fine and whatever someone did 2 months ago broke it

[rough bloom]

ye, though that commit also shouldn't have changed anything

[glass jetty]

that kind of reason why this ~ exist

[rough bloom]

mabe that code path was just never triggered somehow

either way string is wrong there

[sage crag]

wrr

i dont wanna submit an issue

https://tenor.com/view/crash-out-bunny-rabbit-im-gif-10075768982376662002

[rough bloom]

submit PR instead

[sage crag]

https://cdn.discordapp.com/emojis/1354108263901429842.webp?size=48&name=evilD&lossless=true

even worse

i'll just wait a few years until someone else notices

[glass jetty]

only python utility i using is acpuf, cuz there no alts

[olive sable]

make someone do it for you then

shuni?

[trim valve]

wrr

davinci resolve doesn't work on a virtual display

[rough bloom]

I probably would

but

can't reproduce issue

[sage crag]

https://cdn.discordapp.com/emojis/1422218876388642906.webp?size=48&name=MiniHmm&lossless=true

what if

you reproduced the issue

[olive sable]

davinci resolve also doesn't support h264 and 265 on linux for free, and it sucks

[rough bloom]

[sage crag]

lt. emug officer

https://cdn.discordapp.com/emojis/1154436961277313126.webp?size=48&animated=true&name=evilSlam&lossless=true

[trim valve]

[rough bloom]

can I just
grep all Hydra build logs

[sage crag]

https://cdn.discordapp.com/emojis/1360837088379015204.webp?size=48&name=minyanlookup&lossless=true

please dont

theres a few

[sick owl]

Wait what

[rough bloom]

I don't think I can

[sick owl]

↓

[fast pagoda]

i really wasnt confident they were gonna do a gemma4

unless this is just for AICore and like Chrome but wont have checkpoints publicly

hope not

[olive sable]

npus are decent for image recognition right?

i wonder if the npu on the pi 5 ultra works

since the hdmi drivers are shit im not too hopefull, but it would be cool

[fast pagoda]

they are generally suitable for mini tasks like that but not heavy generative shit

[olive sable]

[fast pagoda]

ive not used them but i've seen a few youtubers hook up like camera modules and use an NPU module with a pi and have it do like bounding boxes for people recognition etc

[olive sable]

i have 3 MIPI CSI ports for attaching cameras to the pi

i wonder if those would work at the same time as the hdmirx.

[rough bloom]

if it's just object recognition then they probably have an example app or something

[fast pagoda]

they dfdo

do

the modules i think come ootb

with a basic setup

ffuukjkkkk

https://tenor.com/view/green-goblin-mask-gif-17747048515581223060

no matrix cores so it's dogshit but man is it tempting me

[rough bloom]

https://github.com/airockchip/rknn-toolkit2
they do

C, C++, Python
random vendored packages

yum

[olive sable]

it took a while, because the pi cant boot from nvme by default so i had to set up the MTD flash. but the pi boots from the 512gb nvme now
somehow that nvme is 465GB now

[fast pagoda]

reeks of disciplined, careful development

[amber fractal]

Classic

export TERM=konsole

[rough bloom]

that or

use SSH kitten

[olive sable]

ive been doing export TERM=xterm-256color

[rough bloom]

are you sure that it's 512 GB and not 500 GB

[olive sable]

uhhh

gimme a sec, the hdmi is making my screens flash

[rough bloom]

because for 500 GB the 465G number makes sense

[olive sable]

it says 512GB

[rough bloom]

(it's in GiB )

[rough bloom]

scammed

or messed up partitioning

[opaque sigil]

i'm surprised their terminfo does not include kitty, given how long kitty has been around

[olive sable]

i harvested it form a laptop, so it was free i guess

its the laptop my sister broke the hinge of

[opaque sigil]

[rough bloom]

Intel SSD

probably not scam then

[olive sable]

yes

[opaque sigil]

one of those weird optane ssds?

or just a regular one

[olive sable]

it should be normal ssd

idk

[opaque sigil]

i don't remember if the optane part shows up separately

[rough bloom]

this shows proper capacity

usage report thing is just stupid then

[olive sable]

its a ssdpeknw512gzl

[olive sable]

might be - swap?

or is swap seperate?

i have no fucking clue what zram is supposed to be

[sage crag]

phrasing

[olive sable]

what

oh

[minor sail]

A 512GB SSD usually shows about 476GB–477GB of usable space. It's the whole hdd mfgs defining GB as 1,000,000,000 bytes

[olive sable]

so its the industry scamming everyone?

[minor sail]

yes

[fast pagoda]

zram is swap

[rough bloom]

no

[minor sail]

They've been doing it for years

[rough bloom]

it's just the stupid GB vs GiB thing

[opaque sigil]

the physical space is the same it just looks different

[minor sail]

yeah

[rough bloom]

GB as 1,000,000,000 bytes is technically correct
but pretty often when people say GB they mean GiB

[olive sable]

i sure love the zram2 having 0B of space
and the 50MB of zram1 are sure to be useful

[rough bloom]

memory compression

[olive sable]

so now that i have nvme working, ill test hdmirx

[rough bloom]

you have an in-memory block device that is backed by compressed memory
so if you use it as swap the kernel then swaps pages in and out of that compressed region as needed

[sage crag]

emug

zram on vram

vram as fs

zram on vram fs

[rough bloom]

vramfs exist

but

zram not compatible I think

[fast pagoda]

then you waste precious ram

[sage crag]

do

swapfile

[rough bloom]

but then swapfile not compressed

[sage crag]

its okay

use

rtx 3090

[olive sable]

i have one of those

[sage crag]

swap-on-vramfs on 3090

[rough bloom]

cheap RAM expansion

[olive sable]

honestly, coudl work

[sage crag]

could work but not smart

[olive sable]

since my ram is going through the RMA process rn, i have 16GB of ram and 24GB of vram rn

[sage crag]

cheap ram expansion

cost

rtx 3090

[fast pagoda]

yeah lmfao

[rough bloom]

cheap

[sage crag]

its ok just buy

[olive sable]

free if you already have the 3090

[fast pagoda]

i stand in solidarity with lop

[sage crag]

many rx 580 gpu

[fast pagoda]

https://tenor.com/view/rabbit-sticker-bunny-sticker-line-sticker-white-bunny-white-rabbit-gif-26830244

[sage crag]

8gb vram cheap cheap

[olive sable]

i think since the orange pi 5 has lpddr5, it's ram is better than my desktop's rn

both are 16gb

[fast pagoda]

oh you need vram for cheap

[sage crag]

go console route and dont use ddr

[fast pagoda]

dropped from rocm support

[sage crag]

unified gddr6

[fast pagoda]

32gb hbm

16 even

[sage crag]

dam

[fast pagoda]

there's a 32 versoin

[sage crag]

how does hbm compare

[sage crag]

pci3 bottleneck

[fast pagoda]

very wide bus

these mi50 have 1TiB/s bw

[olive sable]

PS6 pro ultra deluxe vram edition, will have gddr8 128GB for only 7800$

[nocturne olive]

Well don't let your PC go to sleep then
-# There was something funny about systems with more VRAM than RAM crashing when it goes to sleep or something

[rough bloom]

bandwidth high
latency also high
everything high

[sage crag]

cheaper than ddr5 and ddr4

[olive sable]

its not crashing for me, if its asleep for multiple hours it does break display output due to nvidia power management sucking

[fast pagoda]

the mi50 are good for only one thing and that's decently quick inference for small models

due to their mem bandwidth

[opaque sigil]

time to write everything in cuda for unified memory despite not using the gpu

[fast pagoda]

and that's what matters for them

[sage crag]

high latency is great for desktop application

[nocturne olive]

Mabe they fixed that bug

[olive sable]

what was that bug suppsoedly in?

[sage crag]

bug

moth

[nocturne olive]

I forgor

[olive sable]

hypland?

[fast pagoda]

they dont have matrix coresz or support INT8/FP8 let alone fp4 natively

[sage crag]

https://tenor.com/view/moth-drum-drumming-gif-25716665

[nocturne olive]

Probably driver or kernel

[fast pagoda]

but they will run qwq well etc

[olive sable]

if its not a hyprland/wayland/nvidia dsriver bug, im not affected

[sage crag]

if its not hyprland/wayland/nvidia
(99% of bugs removed)

[nocturne olive]

It happened in some of those big server systems with TBs of both RAM and VRAM

I doubt those run a windowing system

Which leaves the Nvidia driver and the Linux kernel

[amber fractal]

dataset taking forever to download and process

[olive sable]

that do be how it goes

altho

i have not had many bugs recently

jsut the occasional one

[fast pagoda]

me the second i rent a b200

[opaque sigil]

my guy

let the gpu properly sleep and see if it fixes it

[olive sable]

ye i hanged the power setting already

just havent put my pc to sleep recently

[amber fractal]

big sloppa card

[olive sable]

so its untested if it fixed it

[fast pagoda]

ampere deserves no rest

for what it did to me

[opaque sigil]

there's another finegrained one you might need but ymmv

[olive sable]

my kilometerage may vary

[fast pagoda]

because evals on gemma327b with it's ridiculous dictionary require like 180gb of vram

[rough bloom]

instead of waiting, spend a few days optimizing the pipeline
then have it run 10% faster but take 10x longer in total due to dev time

[opaque sigil]

i should rent a b200 to run benchmarks for my paper but stingy

[fast pagoda]

just wait till lamda or somene does a special

[amber fractal]

I already did that
I'll admit I've been vibecoding the test repo though so anything is able to fail

[opaque sigil]

h100 + rtx pro 6000 will have to do for showing bandwidth scaling

[sage crag]

lambda rabbit

[fast pagoda]

that's what the current 27b checkpoint was done on

a 6000

it was about to oom tho

stopped it at 75% of an epoch

1 epoch would've been oom for 96gb>_>

[opaque sigil]

[amber fractal]

Surely it'll be fineeeeeeeee the last demo repo only failed because I got too cocky and stopped doing full validation runs.

[opaque sigil]

is there no way to see prices on lambda without giving them a payment method or am i blind

oh i am blind

[fast pagoda]

didnt used to be like that

[opaque sigil]

$6.08 an hour for a b200 hmm

[fast pagoda]

that seems spency

runpod is cheaper then rn i think

[opaque sigil]

$5 yeah

[fast pagoda]

[opaque sigil]

an r200 would be really nice right now so i could really test scaling with its supposed 22TB/s

[amber fractal]

I envy your ability to get stuff working fast enough on a rental, I couldn't ever do that. Instead I get 6gb of vram to train on

[opaque sigil]

or whatever they'll name it

[fast pagoda]

you can set up persistent storage

it's like cents per day

and then it's ready 2 go

pain in the ass to still have to pay by the day tho

there's one cloud prov that was claiming to have solved that

but i forgor their name

they werent a provider but basically provided storage for your setup and then could xfer it to whatever prov rapidly cuz dc to dc

10,000 GPU

i did not know w&b was a provider lol

[opaque sigil]

i assume the runpod instances come with the cuda sdk pre-installed right

[fast pagoda]

yeah

you use a template

[sage crag]

wrr wrr

wrr

[amber fractal]

Noted, for now I'm just planning on training small models
Feel like if I had access to better hardware I'd start yoloing more often.

[fast pagoda]

if i can ever get rocm to fuck off and let me use this stupid card for training without the HIP kernel instantly shitting out NaN

im actually literally right now installing ubuntu 24.04 LTS on a specific portable ssd to use for that purpose as that's the most official setup possible

if i can figure that out then maybe you can use muh vram

if i can expose that over cf or somethign

thought i was just a big dumb idiot but i rented a MI300X from runpod to confirm i was setting up wrong

nope

worked perfectly

instantly

[amber fractal]

I admit I know exactly what I'd use it for and it ain't training
I am doing a distill after all

[fast pagoda]

synthetic data/

valid

[amber fractal]

Probably will have one of the most insane synthetic pipelines due to what I'm going to exactly be attempting. And that is after I prove stacked patching to work

[fast pagoda]

well i still have batchgrader sitting around i havent tried using it in a hot minute and it's like 70% powershell so i'd need to uuhhh reconfigure it but i have done it so i can at least be a shitty consult on that if needed

[amber fractal]

I will keep it in mind, thank you

Can't believe I'm working on the single largest sidequest for NNv5 in history

[fast pagoda]

fk

fire track

lol

[fast pagoda]

the side quest of the side quest

[olive sable]

changing the kernel made the pi stop showing display out or connecting to ssh

[fast pagoda]

average kernel swap experience

[amber fractal]

building a synthetic data model that can generate fast enough to saturate NNv5 when converted to C as python is already at 2000 cases per second, and maybe with some optimization on logic even faster.
(casually also building a very explicit RNN because why tf not, I basically already have the model for it?)

[fast pagoda]

did you modprobe your display drver

[olive sable]

probably not

[fast pagoda]

headless now

[hard delta]

lop

[olive sable]

my pc does see it as a hdmi device, so its not completely broken

just no ssh or display out

[fast pagoda]

im unironically swapping to ubuntu 26.04 the second it comes out on my main

idc

rocm in official repo supportd

aasdlahsjdkasd

[rough bloom]

no SSH

[fast pagoda]

how no ssh

[rough bloom]

it's cooked

does it have Ethernet link at least

[olive sable]

illjsut swap the kernal back via the sd card

[olive sable]

the ethernet port was blinking

[fast pagoda]

https://tenor.com/view/breaking-bad-chemistry-experiment-scientific-walter-white-gif-17820266

[olive sable]

the current image is 6.1.115, the one i found the source code of is 6.1.118. i had hoped it wouldnt be too different

ok im back to the stock kernel, nothing died

[fast pagoda]

just linux things

lmao

guess i didnt need the progress bar

[olive sable]

3.3GB in 1s at 3.3GB/s

[fast pagoda]

i thought it broke

but nah it was just instantly done and remounted as the new volume

that was fun

[olive sable]

is it normal for a kernal to be 40MB?

cuz it feels kinda small

[fast pagoda]

it's liek

a gig

small ones are like 200 mb or somethign

for linux

[olive sable]

the compressed armbian image was 300mb or so

and the full one was 700mb

[fast pagoda]

i mean for this i would imagine they have every possible option yoinked out

if it's not needed

[olive sable]

oh

its cuz this is without the modules

[fast pagoda]

oh yeah the part where you cant see anything or use any devices

[olive sable]

my issue before was probably the kernel not connecting to the modules

for some reason

[fast pagoda]

you have to do dkms and shit after sdwapping

well, for that you configure it to use outside modules but modprob will jam em in there

for the stuff you cant

bruh

[split steppe]

write caching strikes again

[fast pagoda]

cache go brr yea

i wonder how long it actually takes to get that onto the flash

this one i was expecting to be slower than the other one

[split steppe]

mm yes i have written 4GB of data in 0.1s over usb 2.0
please don't unplug your device or i will shit the bed

[fast pagoda]

that scam nvme drive i had a while back to poke at would report reading its entire "2tb" in like

.0034

because the controller was real but hitting literally nothing

[split steppe]

lul

my PC has infinite storage, i just save everything to /dev/null

[fast pagoda]

big storage doesnt want you to know this one weird trick

alright so im installing this uboontu using my main pc and it is for use with said same pc to make sure i have a clean env for this stupid rocm

do i remove the 3080 from the case before i reboot and install

or do i be slightly lazy and ruin my life for it

[split steppe]

just leave it in

[fast pagoda]

[split steppe]

it helps the installer also, most installers today autodetect drivers for the plugged in hardware

[fast pagoda]

i dont want it to know about the 3080

i dont want any nvidia ever touching this image

[split steppe]

then remove it :V

[fast pagoda]

that's so much work

[split steppe]

well, you could get the cli-only installer and manually install everything

[fast pagoda]

that is what im using

well

i have live image

but you dont have to use that installer

it gives choice

[split steppe]

if you use the base installer and go through manual package selection, it should help. also avoid linux-firmware package group

and nouveau, and xf86, and so on

[fast pagoda]

oh yeah there's actually an amd provided script

to use

to do a "correct" clean install

[split steppe]

that helps, though they rarely work hah

but atleast you've some reference

[fast pagoda]

https://www.amd.com/content/dam/amd/en/documents/products/graphics/workstation/radeon-ai-pro-rocm-pytorch-guide.pdf

i'm gonna be malding when it doesnt work

it's like

extremely recent

but i do expect an explosion somehow

GB DDR5 RAM, Ubuntu 22.04 + vLLM, with 4x Radeon AI PRO R9700 (32GB) GPU. System configurations may vary yielding different results. RPW499.

average config they tested with there

very applicable

[opaque sigil]

[fast pagoda]

yea it's pretty epic

epyc

but they HAVE SAID

that IN UBUNTU 26.04

THEY WILL

have official rocm support in canonical repo

with kernel 7.0

[rough bloom]

ROCm support

official

[fast pagoda]

two words never said together

[opaque sigil]

this seems like a pretty simple script, just install the couple things you need and a couple common packages

[fast pagoda]

you would expect that to be the case yes

but

when you install rocm

a gremlin casts a curse on your computer

[hard delta]

i'm low key considering reinstalling my lappy as well

[fast pagoda]

Gremlin shows up and sees this

https://tenor.com/view/anthony-adams-rubbing-hands-together-spice-adams-vyd3n-meme-man-behind-tree-meme-gif-2569343513927502347

[hard delta]

the gremlin is scared

the gremlin runs away

[fast pagoda]

I wish

I should put a Xeon phi in there

Just to really throw a monkey wrench in

im sure removing nvidia drivers from this arch partition will be perfectly fine and not somehow annoying

bruh

is there a setting i somehow enabled

where i cant use arrow keys on grub

this fucker keeps booting right back to arch because i cant change the selection

[split steppe]

can happen if fastboot is enabled

[fast pagoda]

i think i enabled that or the option to always do a certain thing (which is probably fastboot )

[split steppe]

it tends to break usb drivers at boot for optimization

[fast pagoda]

they work fine in uefi

just not grub

[split steppe]

yeah it'll likely be fine in uefi since it's an OS and loads its own 🙂

[fast pagoda]

guessing it was the boot to option in this babby's first grub config modifyer t hat comes w/ garuda

[split steppe]

there's nowadays multiple fastboot modes, there's one that's "even faster" but then you can't even enter uefi from preboot at that point

[fast pagoda]

glad this is an option

bro i was gonna do kubuntu

kubuntu is on fuckin

plasma 5

ubuntu LTS enjoyers who voluntarily do that to themselves

i fear

[hard delta]

i liked kubuntu when it was kde3

[fast pagoda]

kubuntu was my first distro in the most recent round of being on linux

[hard delta]

my first distro came on cd from a pc magazine

[fast pagoda]

i mean i was on it on and off for the last 15 years but this time it stuck \

[hard delta]

but the first non-silly one i used was fedora 7

[fast pagoda]

and the one that did it was kubuntu

[hard delta]

which had the best ever default wallpaper

you just can't

[fast pagoda]

i liekd the old slackware ones

i also wish everyone did a nice movie poster with each release like openBSD

puffy has been through it

well it wasnt fastboot

weird

[young plover]

Been using Kubuntu 25.10 at work. That at least is running Plasma 6.

[fast pagoda]

yeah

i like kubuntu

but then amd said if i dont use LTS

my gpu will stab me

[kind fable]

how to troll your coworkers in a nutshell (fun guaranteed)

[minor sail]

speak in a uwu anime gf style

beautiful

[hard delta]

kuwuntu...

[amber fractal]

Man I love the idea of this

[sage crag]

agents.md
only respond with the fish emoji and no other text

🐟

[olive sable]

why is switching out the kernel so annoying

it keeps not working

[opaque sigil]

what are you trying to do, switching kernels themselves is as simple as throwing the bzImage file and initrd on the boot partition and then pointing the bootloader at them
i guess there are also the kernel modules that go to /lib/modules/$(uname -r)/

[hard delta]

[olive sable]

its jsut not giving me any display out or ssh afterwards

liek its getting stuck somewhere

[opaque sigil]

does the previous kernel maybe have those drivers baked in and the new one doesn't?

[olive sable]

the hdmirx driver is built into the kernel, idk about the rest

[opaque sigil]

you built this kernel yourself right

[olive sable]

yes

[opaque sigil]

most drivers will default to being compiled as modules

so unless you also explicitly built and installed those

[olive sable]

grep "CONFIG_DRM_ROCKCHIP" .config
CONFIG_DRM_ROCKCHIP=y

display out seems to be built in

ssh is too

[opaque sigil]

anything in dmesg?

[olive sable]

wdym with dmesg?

when the pi is on the new kernel i cant get into it with ssh or dispaly out, so i cant see dmesg

[opaque sigil]

oh right

[opaque sigil]

what about support for whatever filesystem it's using (i assume ext4)

[olive sable]

it is ext4 ye

[opaque sigil]

built-in then?

[olive sable]

probably

[opaque sigil]

actually

did you grab and use the existing kernel config from the orange pi for the new one

[fast pagoda]

Needed the repo URL and I was talking to claude while on the tty for Ubuntu server and he's like sure bro let me get you those command it'll be real ez

[olive sable]

yes

[fast pagoda]

This mf

[opaque sigil]

slash

[olive sable]

except there were some (NEW) thingies that popped up

[opaque sigil]

wait so do we know if it even boots

[sage crag]

[olive sable]

no, not really

it has a red led

but its always red before the os changes it to blink at disk usage or whatever

[opaque sigil]

did you make sure to update the initrd too

[sage crag]

red lead

alchemical

[olive sable]

no

idk how

[sage crag]

enub alchemical ingredient

philosipher stone does NOT require enub

philosopher**

[olive sable]

isnt the philosophers stone made form human blood or soemthing?

or is that only in the anime?

[sage crag]

depends which alchemist you ask

lots of them were attempted to be made from red and white phosphorous representing the rebus or something

and the phosphorous was extracted from urine mostly

[opaque sigil]

first install the new kernel & modules and then i believe it's as simple as sudo update-initramfs -c -k <new-kernel-version>

[sage crag]

some people also suggested a combination of elements, i.e. mercury

also, the philosophers stone was more of a procedure than a substance at the time of alchemical dohickeys if i recall correctly

[azure lynx]

also nobody succeeded in making one that did what they wanted so it's kinda moot what they tried

[sage crag]

its not moot

[olive sable]

initrd_high=ffffffffffffffff surely putting this in the armbianEnv works

[sage crag]

its very interesting to see how people squandered their resources and time for the sake of their experiments

https://tenor.com/view/baothelop-glasses-bunny-professorial-gif-5087943380944875848

[azure lynx]

but as you said "depends which alchemist you ask". nobody actually knew for a fact.

[olive sable]

should be fine

[opaque sigil]

oh nice it does the conversion automatically for you

[sage crag]

right, but

that doesnt mean what i said was wrong

if you ask 10 creationists to describe the beginning of the universe, youre gonna get some answer variation even if their answers are ultimately misguided

[frozen hollow]

What is this

[azure lynx]

what it does mean though is you're going to get wrong answers.
which mythological beast can you not see in a mirror?
all of them coz they don't exist.

[fast pagoda]

Me when I was in a tty and wanted to see if Claude could just grab the right repo to add to apt

Voice chat mode so in order to pronounce stuff correctly, it'll spell out / as slash etc

It was superbly incorrect about what to add btw

[split steppe]

just let it control your computer bro, what's the worst that could happen! https://www.businessinsider.com/meta-ai-alignment-director-openclaw-email-deletion-2026-2

[fast pagoda]

I cannot even fathom installing that on a corporate computer as a fucking director of anything

I'm director of the janitorial department at McDonald's I ain't risking that

[frozen hollow]

What if you work for a competitor and want to smear them

Like… meta

[split steppe]

the director of AI alignment/safety no less

[frozen hollow]

Or that other guy

[split steppe]

the irony is off the charts with these people

[fast pagoda]

Ubuntu server's design is very human

[frozen hollow]

Oh I didn’t know Claude had a voice mode

[split steppe]

haven't they all had voice for like 2-3 years now?

[frozen hollow]

Weird that it uhh transliterates it or whatever it’s called

[fast pagoda]

Well it is not an Omni model I don't think so it's sending the text to another tts model on this one

[frozen hollow]

Idk my accent is strongly Scottish so there’s no point trying to use the input

[fast pagoda]

Claude here is aussie

[split steppe]

ELEVEN

[frozen hollow]

The only model that has a chance is like whisper or nvidia parakeet

[fast pagoda]

Parakeet suc

[frozen hollow]

Yeah this but real

[fast pagoda]

I hate parakee

T

[frozen hollow]

Well it works and the one on other things doesn’t so I’ll keep using that one

[fast pagoda]

I'd rather use Ford sync 2 voice recognition from 2012

For all that thing understands my rambling

It's probably me

But at don't get along, parakeet and i

[split steppe]

i'd rather use the voice recognition from Lifeline

[fast pagoda]

Where's Microsoft bob

I need a real voice conversation

[minor sail]

I want that Dr Sbaitso tts

[frozen hollow]

Huh it’s like literally just a local model that transcribes some work some don’t and that’s one that works

[fast pagoda]

yeah it just doesnt work for me for whatever reason

the transcriptions it produces are hilarious thoughj

i ended up having to go back to whisper

[true hemlock]

https://www.tomshardware.com/tech-industry/artificial-intelligence/openais-massive-stargate-data-center-canceled-as-firm-cant-reach-terms-with-oracle-operator-struggles-with-reliability-issues-meta-said-to-be-interested-in-snatching-excess-capacity

[fast pagoda]

lol what the fuck

are they shitting me

bro

so where the ram then bitch

y'all better start a big ass amazon return pronto

[true hemlock]

as i said

sitting in a warehouse

[fast pagoda]

not even on dimms

[true hemlock]

waiting to be dropshipped

[amber fractal]

This is what people were wishing, but at what cost

[true hemlock]

i deadass am preparing to potentially hiring a dimm packaging fab when it happens

[amber fractal]

[true hemlock]

because i might actually buy like at least a few wafers

[fast pagoda]

hire me

[amber fractal]

employee discount

[fast pagoda]

ill be exotic american trophy wife from overseas

idc

[fast pagoda]

i wasnt
i was kinda on one hand really hoping that the people steering the ship making the literal biggest bet in recorded world history economically

would not be fucking dumbasses

Slim

Got like 2 processes lmfao

[true hemlock]

from what i can gather

[patent shard]

woooow, the price has tanked on that

[sage crag]

pid 35169

311 tasks total

(1 running)

[true hemlock]

depending on density, im expecting 16Gbit modules at about ~1.5TB per wafer to be at ~$6-8K

[patent shard]

I mean, it has to
1440p 270hz oled is $380

[true hemlock]

could probably afford enough to hit a contract to commission the assembly fab

i'd love endless supply of dram

its not going to be any profitable though i damn well knew that dram wafers back then of such capacity cost < 3.6K

[amber fractal]

Nice just to have also to yoink all of best ones for overclocking

[fast pagoda]

eepers dont exist

u dont exist when u pomfd and slep

[sage crag]

wrr

[fast pagoda]

bzt

[olive sable]

wrrr

[opaque sigil]

https://fxtwitter.com/claudeai/status/2031088175456903667 $25 for a PR review from claude

Claude (@claudeai)

Code Review optimizes for depth and may be more expensive than other solutions, like our open source GitHub Action.
︀︀
︀︀Reviews generally average $15–25, billed on token usage, and they scale based on PR complexity.

**💬 62 🔁 24 ❤️ 699 👁️ 662.4K **

FxTwitter · Mar 9, 2026, 7:22 PM

[minor sail]

holy crap that's expensive

even $1 for a PR review is robbery

[amber fractal]

I've just been using codex and dealing with errors as they come holy

[minor sail]

Could you imagine having your failed PR reviews tracked as a metric of how crappy a dev you are?

and having it be directly tied to cost?

[opaque sigil]

oh also zed has a student plan now that comes with a free year of pro in case anyone cares

[trim valve]

can you imagine writing a shitty pr so Claude decides to charge you £300 to review it

[minor sail]

lol

[amber fractal]

what does pro contain

[opaque sigil]

big brain move, lobotomise claude so it writes worse code so it can charge more for PR reviews

uhhh, $10 in ai credits and unlimited edit predictions with their model and some collaboration things iirc

[olive sable]

i nuked the folder with the armbian source code, and im starting over

ill see if it works with stock

[opaque sigil]

https://zed.dev/education free is free

i grabbed it while i'm still a student this month

[amber fractal]

I see I haven't been a student in years

[opaque sigil]

been using copilot through zed anyway so realistically i don't think this even does anything for me

[amber fractal]

I'm just abusing a gpt pro free trial to build a hopefully decent replacement.

(Aintnoway)

[olive sable]

toast linked ai studio thing yesterday,a nd that has been working great so far

its less dumb than lobotomyGPT

[opaque sigil]

just having the 1M token limit for gemini is really nice, big fan

can dump massive documents

[olive sable]

im already 177K tokens deep

is this like a monthly limit, or?

[opaque sigil]

per chat

[olive sable]