I spitting shit 12000 LOC on pr github
https://github.com/weenachuangkud/FastCast2/pull/39
#programming
1 messages · Page 524 of 1
Yes it's working but I've not implemented everything yet
you can't stop me
-# (my wallet and sanity will)
(If you don't have money for Ai)
nintendo and DMCA, name a better duo
(Opencode feels so good ngl bro)
2000000~ tokens used
also to whoever said their manager doesn't know github, I really hope that manager isn't your manager soon
Its normal here
We arent really IT
?
I think manager will not understand my PR about Motor6D, SoA, AoSoA, parallel luau, load balancing robin-round cycling, queueEvent, Serial/Parallel supports
(This is summary of my PR)
Somewhat between normal engineering and IT
All our projects are one-guy only
oh looooooool
The most programming i did in my life is derived from this server
Chess tournament and skyrim integration thats it

What i do at my job is trash compared to this
what do you do at your job then
Me scripting legos for 3 years
They give you a programmable controller that is currently in meta (in meta means its not banned yet and its cheap enough)
I wanna see your lua shrine
uh huh
It has some ide for it
You make program that takes info from sensors, processes it, lays it out in registers for the server to read
It's in the name ig "engineer-programmer"
Because sometimes i have to go to some forest and modify my program and do a lot of shit with wires
Screwdriver work too
Like that
oml
1 day left and I'm about go robotic engineering cus I wanna build some cute girls to cuddle
Currently i am waiting for the guys to let me into their computer so i can configure it so the data is shown on their screens
They are not letting us in because no licence
Licence is impossible to get rn
Pray for me
Wait, where do you store your code?
I just put my version control inside of source code "version 1.2.2 - fixed bug that crashed the device"
On my laptop and copy it sometimes on company server
Basically we face new shit all the time
Its not about what you know
Its about how you can work with shit you dont know
And since im an uneducated fuck who doesnt know shit about programming, it suits me
Random ides, sometimes you need to find ancient program to configure some radio
Ride to some forest shithole for a week
Find spot where there is cell signal to find some manual for a device that wasnt declared in the project but its actually is there and you must configure it
All kind random engineering and programming shit
Thats why my position is called like that. Technically correct name
Work trips are nice you get 12$ a day as a bonus (its absolutely not worth it i hate my job
)
Advice: dont get born in eastern europe
oh brother
true
i don't think that's what you do in robotic engineering but I could be wrong
just be in a right place in a right time in a right mindset with a right set of competences
clearly, the homeless are just lazy for not buying a house
https://youtube.com/shorts/68QlDd8_jaE
how to avoid seeing other opinions 101
Writer:
Editor: Rikus Strauss
Music by: @UFD-Music

just another day in #baking 

Sam. I found a way to cheat during exam 
okay
Try this one simple trick 
you could have studied instead
How much did he pay you to vote no
$50k?
100k?
holy smokes, and an NDA?
hello omemga

:omemga
nice
pytorch immediately exploded due to having an nvidia card and an amd card installed at the same time

🎸
fuck i havent played gh in so long
just use the crappy cpu that you found in the mysterious tech pile + hopes and dreams fr
Greetings I come here seeking help
the CPUs in my server were $35 each
mine are like 15 each iirc
Long story short, I have a veadotube avatar that i want to use in OBS but it shows black
But even then, when I tried to use autoconfiguration wizard, it also failed
I checked if my GPUs were up do date and they are, so I dont know what am I doing wrong
its a pngtube thing
i’m getting a black/blank/pink/green screen on Windows!
that’s usually a graphics card issue. update your drivers, and DirectX also! refer to the install guide. you can also try to run the app as administrator!
veadotube
veadotube on OBS gives me a blank screen!
lots of possible issues here!
if using Game Capture on Windows, try selecting SLI/Crossfire Capture Mode (Slow)!
try switching between Game Capture, Window Capture, Spout2 Capture, Syphon Capture… see which works!
if on Windows, try forcing both OBS and veadotube to run in Performance mode, in your system graphics settings.
in general, refer to the OBS guide, which goes through each capture mode.
veadotube
ye that
thanks

i am just tired of having to deal with GPU related issues i hope it is not the gpu
Do you think the GPU is the primary reason why when you turn on your computer it sometimes show a glowing black screen?
if my computer does not boot immediately i usually assume it is memory training
Like, I see the logo and the spinning wheel after the Windows jingle, most of the time is a black screen
does it ever boot after that
it's a black screen BEFORE the windows logo sequence?
it may just be configured not to show uefi/bios splash
glowing black screen as in the backlight is on bu no display?
what OS are you using?
windows or linux?
From scratch or fine tune?
After
Windows
hmm
hmmmmm
I have FR this laptop 3 times and the issue persists
laptop 
you said you updated the gpu drivers right?
undertale ost
Somebody understood 🥹
i checked all of the stuff and is all updated
Qwen3 TTS is being a bitch to setup but I got my Hungarian homegirl to let me clone her voice
I had to run it through CUDA BC latency was hell and it was zero-shot generating voices per sentence. It's still not stable
undertale references in 2k26, ok grandpa
then i have no clue
honestly at that point it's time to pack it in and swap to a different software for this purpose
So no OBS
it's probably not OBS if i had to guess
never heard of veadotube but it's definitely the easier sacrifice if i had to guess
im guessing 2x
Yeah
Ensure both programs run on the same GPU
It might bug out if they arent, i Personally can bypass the black screen by using a different capture method
That one hurts, as i dislike Python, like C, but am fairly blind
I feel attacked
(but good one)
C destroys python anyday
this is going great
That pan is killing me
thy true's
Norall thou not thou thy thou before it shave, thee lover of
Which to'llBatch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
Batch size or sequence length mismatch
``` shakespeare himself
Just random pytorch output
i cloned some random guy's zig .12 repo for an implementation of https://github.com/openai/gpt-2/blob/master/src/model.py and have been porting it to .16
i havent replaced 99% of it like the diff implies it's just been formatted lol
nice svelte 1928 lines
this is the first time it has actually compiled tho'
turns out
lotta shit changed between .12 and .16 
std.io.getStdOut() was used a lot and has obviously been slain so i replaced with std.debug.print, std.rand is gone for std.Random very important to rename that , readVarInt died with I/o changes so std.Io.Reader lacks it completely, had to swap a bunch of var to const due local vars no longer allowed if they dont mutate, and he had a @cImport("math.h") that was not needed because Zig can in fact do math without c's help
fast
it do be tensorflow
i just kept it because that's what it was and i figured port first and then deal w/ figuring out how nightmarish that part i s
yeah my first loras were TF
i miss the dashboard tbh
i barely remember anything about it ngl
Keras and tensorflow are both relics now
it was when i first was running any training of any kind
mostly in colab notebooks which skipped a lot of the pain probably
Those and deeplearning4j were the first libraries i used
Before that it was from scratch
<scratch language joke here>
I didnt like how clunky they were until i didnt have much of a choice
as jank as it still is it is kinda wild how much MORE dogshit these frameworks were a few years ago even
Scratch LLM
i know tf and jax are still supported alongside pytorch in google cloud infra but idk what they get used for other than google's own stuff for jax
I never used jax
It was pure TF for me or TF with Keras2
Sometimes DL4J
Then just torch
I used other libraries too for other use cases but alot of the times i just wrote it all myself
I forgot what one I used for NLU though
lmao
Nintendo never sent "the email" to me personally and I'm keeping it that way.
I'm also not convinced it'll ever be possible unless some NSA backdoor is discovered. They locked the Switch 2 down tight.
Cap
It'll happen
Unless they come and take away the hardware or stream the console to the device
we aint converging with this one kekw
what size u training?
switch 2 hardware bricks itself if it detects tampering attempts
very annoying
W
its diverging lol
honestly that might describe it well if it really explodes
they put all their money and effort into preventing mods than making good games
but it will still be broken with time
as every console eventually is
what exactly is the benefit to owning a switch 2
understood. Carry on
$500 dlc to your physical hardware
My favorite creature
compelling
you forgor
he's helping how he can
gpu pytorch version LMAO
So guys, qwen TTS sounds good but it spikes the hell out of my CPU and the latency is hell, what am I missing here??
It's also literally crashing my animation controller. I'm not sure where I went wrong, but 15s of latency AND it's absolutely eating my CPU even tho it's GPU CUDA bound
Well I found out why it was eating my CPU, but the latency is still very real
I can see online that it has 97ms to first packet so like what the actual fuck


I can't see the joker 
that's what i saw first, how

look at this then the original maybe you'll see it
it's super clear to me 

also this: run it on gpu, you need maybe 3gb of vram, i already tested it on cpu yesterday and it just does not work, from my testing i got 0.25x realtime on 8 threads xeon e5 2680 v2
on latency being 15s: what the fuck? i'm pretty sure you can configure streaming, here's the first google hit https://github.com/dffdeeq/Qwen3-TTS-streaming
Yeah I had a similar reaction to the latency, even with streaming it was like 6s
I shifted and I'm going for Kyutai Pocket TTS, Qwen legitimately just isnt fuckin worth
streaming tokens in or streaming audio out? because i'm thinking the latter, idk if the first one is possible with this model'
I was also running full on GPU but piper voice modulation (built for cpu) was running over Qwen and causing issues.
Audio out
For twitch its just not practical.
i suppose you weren't running the gguf quant
I tried both it and the FP16
damn
I think it was user error, or incompatibility at some point in my codebase
Zero is built very fucking convulutedly so it's entirely possible I overlooked something somewhere but I don't think so
Nonetheless, I don't wanna keep fw it
probably not user error
I mean I was even doing full GPU inference

Yer
Somewhere, somehow, I probably fucked something up tbh
Or maybe not
I trust your judgement.
I'm gonna do Kyutai tho. 200ms latency and voice cloning is actually wild, and running fully on ram is even moreso
Then I can just shift my vision over to GPU.
en only, no training code 
Big sad, yeah
That was my main pro for Qwen
Zero is meant to be JP bilingual
She initially was
But over evolving use case it got canned. i was hopeful to bring it back
oops not en only but still no jp
right side console is python//pytorch running the same trainin vs cpu on left w/ scuffed zig trainer lmao

i think its closer to a fish than a plant
or smth more ancient
Pocket TTS goated

what
this shit is predatory????
i just know clownfish protect them and get protection back
or osmething
they eat crabs 
I usually pasted some command too but never keys lol
aminal

NOT fish
cnidarian
related to
jellyfish
coral
and hydra
they are hydras?
poor mans rust
LMAO yeah why do this when rust exists
they renamed structs to shape...
there is no reason...
where are you getting this from, did you look into it or is there a digest somewhere i can look at
random twitter message that popped up after i read the original tweet
skills are docs
easy search
"zero language docs"
"zero language ai docs"
"zero language new ai docs"
are you the agent
"zero language new agentic ai docs"
no itd be like "zero language new docs 2025 hello world example how to print"
wait... their filename suffix is a 0
hello_world.0 is a filename 
ye
they renamed Option to choice too...
i found it first
all the examples are like 5 lines long
i didn't think they would manage to make rust uglier... but they did it
[N]T waow
What is this language meant to be used for?
To be fair, rust is not ugly, just verbose
better typesystem const expr than rust

struct Wow<T, const N: usize> where [T; N]: (), {
items: [T; N],
}

How do I do that?
genuinely why use this instead of rust
idk
rust == -ai 
Is this an example? The code doesn't set len if you init with values 

E = mc²+AI 
ye
its from here: https://zerolang.ai/reference#functions
buket
The current native checker tracks simple lexical borrow conflicts, rejects assignment while a value is borrowed, and rejects returning references to local bindings. Borrows lower to direct address expressions; there is no borrow registry or runtime alias metadata.
well
big word
me 

cant assign to value that has references
cant take reference to local value
doesnt support
lifetimes
or
interior mutability
so essentially
useless, not real borrow checker
My first triple-A gaming experience on Linux 
(game doesn't launch)
you picked like
the most recent major game that doesnt work

due to
NOT drm reason
can vibe coders please all switch to zerolang
i dont want my eyes to accidentally stumble upon any of their output
based on protondb it should just work.. https://www.protondb.com/app/2483190
Yeah that's the weird thing, it just doesn't
mojo
Tried several of the env variables to try and change it but nope
i hope you mean launch options
me make ying language
game env vars 
main.🦊
helloworld.🦊
MAKE
No, env variables, like PROTON_ENABLE_WAYLAND, VKD3D_CONFIG etc
but you use them through the launch options in steam right? like copy that block and then put it into your steam launch options.
but also what proton version you using? 
huli allowed
Yeah that's where I put them. I tried Proton-GE, proton-cachyos-slr and Proton Experimental, same thing on all of them
this is really odd since its steam deck verified 
I guess Linus isn't the only one with the Linux curse 
just hu sufficient
try following this: https://steamcommunity.com/app/2483190/discussions/0/839502231284745285/
like read the comments and see what works
compiler will reject hushou
lsp that registers all 2-letter acronyms as the possible extensions for the language 
At least my main games do work better on Linux, so it's not all that bad. Enough to make Linux my main OS instead of Windows
though I hoped I would only need Windows for VR
i mean... the game obviously officially works on linux.. so it has to be a issue with your setup and not directly the game
wrr
Clearly, but hell if I know what is it if other people also shrug their hands trying to help me out
i did notice that you ran it with umu?
atleast that what it says in the screenshot you sent
you didn't pirate it right?
wdym you don't know what umu is... umu shouldn't just launch with steam. its a way to launch non-steam games through a steam emulation layer iirc.
do you have it on gamepass?
xiao huniang
No, I have it on Steam, but since Steam and its launch options didn't do anything to get it to run, I've been also trying to run it via Lutris
That's what the screenshot is from
i see...
wrr
what exactly happens when you launch it through steam? just nothing?
pogga
Different things.
Most of the time, absolutely nothing.
Sometimes I'll see the splash image for a few seconds.
And like one or two times I even got a black screen, as if the game actually tried to open for once.
that game isnt even out yet
what gpu do you have?
It's in early preorder access
4080S
sounds like a great recipe for not working immediately with every linux setup
nvidia open or the proprietary drivers?
What compositor did you use? Because I know I've experienced similar things with KDE and when using gamescope, it just works
probably doesnt even work with every windows setup
The proprietary, the most recent driver
gamescope and nvidia are a very bad combo
(sometimes)
It is KDE, I didn't try gamescope but I can give it a try
Yeah, sadly it isn't
but that means you didn't try all the launch commands because all the ones i saw used gamescope
.no
But then again, I do know that from experience because when I play Sun Haven, it just changes the button from Play to Stop then back to Play
I focused on the env variables lol, I thought people were only using gamescope out of preference unrelated to the game not launching
Wasn't aware gamescope can solve such issues
When I use gamescope the game runs just fine
it might. it might not... idk
isn't proprietary done
580 being the last proprietary driver
maybe update to the current 595
trying to run it with an old driver wont be great prob
It is 595.something, lemme double check
proprietary is still alive and well...
Yeah, 595.71.05
Yeah it's like proprietary with open kernel modules or something?
Or the other way around
nvidia package is nvidia-open now though so if you're on just nvidia it'll be open ig
last nvidia driver i installed was for volta so im stuck on 580 anyways idk, im probably conflating the open becoming default to proprietary ending completely
but i dont think you need proprietary anymore unless you are on a below turing card

but its still the proprietary ones just named differently no? otherwise they would just be in the kernel
Device-1: NVIDIA AD103 [GeForce RTX 4080 SUPER] vendor: Gigabyte
driver: nvidia v: 595.71.05 alternate: nouveau,nvidia_drm
non-free: 550-580.xx+ status: current (as of 2025-11) arch: Lovelace
code: AD1xx process: TSMC n4 (5nm) built: 2022+ pcie: gen: 4
speed: 16 GT/s lanes: 16 ports: active: DP-2,DP-3 empty: DP-1,HDMI-A-1
bus-ID: 01:00.0 chip-ID: 10de:2702 class-ID: 0300
so yea non-free the proprietary module only goes up to 580.xx
after that it's open only
These aren't fully open though, are they?
but i dont think it functionally is any different to install like there isnt another package ig
Maybe it's more complicated and I just don't get it yet lmao
it's nvidia it's stupid
I thought nouveau is the fully open one but it has poor gaming compatibility
<insert nvidia copypasta>
driver 590, arch in the aur pkgs replaced nvidia with nvidia-open, nvidia-dkms with nvidia-open-dkms, and nvidia-lts with nvidia-lts-open
This mf stole my name
Absurd
so yea anything post 580 is open
omg it's u

But having her in public servers besides my own is something ill prob never do
Just not really smart.
she'd get you b& here anyways
youd need admin permissions anyway
only if its a self bot, otherwise an admin would have to allow it
Not really something I want to do, just curious
not generally without permission, if they dont have bot tag and are a bot it's a self bot which is TOS which isnt allowed due to community server
Tru tru
@fast pagoda btw the dflash didnt work cause my model is fp8 quantized
F
I'm working on the final polish for V1 of her runtime then it's just twitch integration and her first full release is final
the GDN layers use 80x less compute
The minecraft brain definitely needs work tho, she's really not that smart in there
:omemga
i still need to figure out how to do actual dynamic thinking
wait the dflash model was also using kv cache
what
it involves kv tho right it just blasts hidden features into the kv
DFlash adopts a fundamentally different strategy. We treat the fused target context feature as persistent contextual information and directly inject it into the Key and Value projections of every draft model layer. The projected features are stored in the draft model’s KV cache and reused across drafting iterations. This design provides strong and consistent conditioning throughout the draft model, enabling acceptance length to scale effectively with the number of draft layers https://arxiv.org/html/2602.06036v1
so it'd have some sort of kv
mtp?
how speed
1.7m and a dream
:omemga
i'm getting <0.4s latency with https://github.com/andimarafioti/faster-qwen3-tts (not quant, ~5gb vram) streaming. you have to be doing something wrong
That's what I figured. I switched to Pocket TTS and got practically the same effect and quality for no GPU use so idrc now

Yee good times all around
Can't wait for a stable V1, I'm so ready to not be coding 7 hours a day
I've been putting dayjob hours into Zero for over a month now
Alongside my full time
And learning japanese. I'm losing my mind (and my sleep schedule)
now let's see paul allen's Qwen3.5-397B-A17B
well then what's even the point really
what on earth could you possibly need that much for...

discord bot
you are doing.... what
making llm process 750k tokens input
all at once
i get that... but... why
testing performance
dam 
"hello everyone welcome to my benchmark today I'm going to be feeding 750k tokens at once to a model hope you enjoy"

this was performance at 100k token prefill
Avg prompt throughput: 10000.9 tokens/s
i can prob optimize this tho
what sort of god pc do you have
2x gb10 connected with 200gbe infiniband
Hi, any tips for understanding better js dom? It is difficult for me to make a logical bridge between the element that I want it to do things and the code I'm writing. Should I think from a specific perspective?
just think it as a box, u tag an elem and just throw it in, if u want to retrieve a specific one u reuse the same tag
hmmm
hey since when did you come here
since now
but why
why not
fair enough
good boy
OK BUDDY
are you sure
wait what
who said i was going to use it
you usually do...
yeah but thats in a private server in public servers uhh
i think its against the rules?
hi wlc
hi
get on jjs
why
helo
hi but it was for him xd
"Erm this is the programming channel, move this to general"
insert more yap here
good point

at least you're familiar with the rules already
update: it works. for prompting tts emotion - insane. great. added latency for tool calls is kinda ouch but i like it nevertheless. need a description -> facial expr system next
its so hard to tell if my pc is running slower because of matlab or if discord is just incredibly slow to use
both are not mutually exclusive
true
maybe clean some dust?
nah it comes and goes, so who knows
I have found the real reason Wayland is unusable for me
Wayland does not allow choosing what GPU applications and games run on using the convenient set of environment variables
For whatever reason
erm
average cs grad
none of them win, the claude instance they had secretly participating got the job
Neuro and evil got a job 
vedal docks their pay tho
Anyone here
Like a expert on html or website making?
I got a homie here like with Alot of questions
$0-$10 they must pay the shellac ATM a deposit
The person below you in question
Can confirm 100%. He is HTML expert
Created NeuroSynth website
child
only 100? man this is tutorial level
@fast pagoda what benefit did you get as konii's adoptive child? 
🇦 ➡️ 🇫 🇺 🇳
↕️
🇾 🇺 🇳 
You think Starforge would be a great investment?
As in, investing in the company?
why tf is my git folder taking up 26gb of storage
once every 6.7 years, konii bequeaths upon me one nugget of wisdom regarding what yuri to watch next
you committed binaries or models or something thicc
actually now that you mention it it's probably compiled binary files
That seems like a good deal 
buying a pc
Are you comfortable opening up electronics in general?
now you get the joy of learning how to unfuck a git repo
?
absolutely not, i am having way too many issues with my pc, i tried using obs and the cheapest and less stressing methods for vtubing and that did not work
oh actually it's probably also a shit ton of python wheels
rm -rf ./repo && git clone <repo>
the most upsetting thing is that this laptop is brand new
oh wait i imagined a .git folder
so i am running out of options, i updated all of my graphics cards, did everything to the book, and nothing works
I thought you were comitting all the binary files lol
this just feels unfair
I'm not stupid enough to commit build artifacts 
Then I think not. Buying pre made will not solve your software issue
Their after sales will only get you so far
this is what it see
i keep seeing that it is a gpu issue, and since this is a laptop, it is a dead end
try changing the capture backend
how do i do that
in source properties
how do i get there
double click on the source named "leyend"
okay
idr the exact setting name, im not at my pc
but you should have a dropdown between a few different capture methods
i did the allow transparency since it is recommended everywhere
scroll down a bit in those settings

oh wait try window capture instead of game capture
tl;dr delete that source and make a new one using window capture instead
you mean display capture?
No, window
OBS (Open Broadcaster Software) is free and open source software for video recording and live streaming. Stream to Twitch, YouTube and many other providers or record your own videos with high quality H264 / AAC encoding.
alright, what would be the next step?
This is the most progress i have ever done so far
is that what it should be displaying?
yeah
then just click ok
what about the green screen?
you should be able to get rid of it with a filter
You filter it with different menu later
color key is what you're looking for
change the colour type to "custom colour", set the colour to the one the app is outputting
@fair cipher
brand recognition
is this in OBS or VT
you should also be able to lower similarity and smoothness as low as they go
okay okay
Acri theme user
why am i so weak to these
Wtf is even that bro
thats grandma
an unavoidable click black hole
Turbo granny? The urban legend?
shiiiiiiiiiiiiit

they say that the first thought that comes into your head should typically not be shared
but
slightly surprised that you're only getting 29fps out of a max of 30
whatever that is, it looks like a jaundiced ugly feraligatr
See? Buying a new PC wouldn't help 
👀

10 months of effort
dont be mean to him, he is doing his best
i will be mean
one of the swarm members helped me on doing a 2.0 model with better colors
this u? 
it took a similar amount of effort for you to be created

i owe so much to the swarm because i got a laptop from them, I think it was R who helped me, and now this
I was so losing hope
10 months damn
wtf based
Go on, use this
sorry for your loss
swarm
youre adopted, it not my problem
Actually a month 

you were just staring in a window or
adopted

i am starting, now i need to figure out how to make the other things to work
also, i do have an important question
i tried using auto configuration wizard and it failed, it told me to check on my internet connection but the internet connection works fine
OBS auto config?
and that is why i said that it must be a gpu issue since everything is updated
yes, in obs
config wizard
if you click tools on the top bar it should let you rerun the wizard
id say, trust that its a network issue
that is the strange part, i updated everything, and the issue persists

is it necessary to use autoconfig wiz or not
I barely use it

like, do you really need it

you can do all the config in settings
i see i see
convenient doesnt mean good

for example
my phone is very convenient
however
it speaks only lies
ye
I am more impressed they even thought about making the site responsive in the first place 

Also, is it fine if bits of the green screen are visible or is it normal
It's normal for irl stuff. But it can be fixed for digital stuff
in vtubing, like, i shrinked him down and i see random green bits
oops
you can increase the sliders I told you to turn down a bit
I forgot that rotating would happen
how do i do that
reopen the filters for your source
drag the similarity and/or smoothness sliders to the right a tiny bit
Blud atp just make a call center lmao
This fr?
This person
:omemga
↩ (@steipete)
I’m sorry that you’re this desperate that you will take such an unscientific benchmark instead of any established one.
︀︀
︀︀Also qwen local is one of the most random length models there is with all its looping. And we smoke you all on quality benchmarks on every open model. Here’s wildclawbench by internlm, same speed on open models, much better results.
Holy clapback

Did you see his post where he spent over 1m in a month with nothing to show
'I must code but never ship'
1m just in code, damn
openclaw is genuinely the worst performing piece of software i’ve had the displeasure of touching ever
It's actually really bad, even the usage command print outs take time
open crawl
Have y'all tried openclaw
I still havent
In theory my gb10 Supports the Nvidia nemoclaw thing
Im just gonna write my own harness
or that
I've played with it, I would say its most useful for automated things. Like checking the news for you or going over your stores reviews every week and emailing the important ones to you, if you don't have daily things an AI can help with it isn't worth your time to setup
I'm checking out the Aurora optimizer, on the left is Muon and its prefered batch/gradient accumulation numbers, on the right is Aurora using the same everything
even better
it's not automatically fixed stuff this time
There is also now Nvidia NemoClaw i think
Is there a decent coding-optimized llm I can fit into 16GB vram? Most models I have tried are either so slow my ide runs into timeouts, or so dumb if I ask them to scan my code for todo comments they ask me where to fucking look, even though context is provided and/or get things wrong like trying to add vitest to a rust project.
terraria NEW
mind you, I was asking on a project using a new/customized rust react-ssr backend
isnt loss of 9 suspiciously bad
for llms
as in "not converging"
These are new models pretraining
still its suppsoed to drop to 3.8 immediately
They're tiny. It depends on the size of the model what it starts at
I'm comparing optimizers right now
tiny model supposed to converge faster
scaling law moment
Onto a bad score, I would assume. It might be that the tokenizer for this one is too big, I actually tried out a 128k tokenizer and that started at 11 somehow
istg
I have a new run for Aurora. I guess it's just unstable
Im gonna have this laptop on Linux by the end of the day if it keeps pulling shit like this
ive had gemma 24m converge to 2.4 loss
24m parameters
ur doing sth wrong then cause
with heavy gradient accumulation
I'm doing lots of random things
I actually didn't change that I think from whatever it was last
LEARNING_RATE = 0.0003
MIN_LR = 0.000003
The graphing slope and angle should be the same whether its doing good or really good
gemma 2 120m on 70k training examples (which is basically nothing)
does anyone know if intel gpus are decent for AI interference purposes?
And that's a pretrained model?
wait lemme find the 24m
this is from scratch pretrain
Ohh you're just using the same arch
lemme find the exact params of the 24M params run
All that matters is the VRAM
If you mean inference then they're great value but you will find faffing around with the software a bit more annoying than Nvidia or AMD
Oh also actually, as in this is a tiny model; for testing speed, this model has a context window of 20 LMAO
I'd still say the money to VRAM ratio makes them worth it if there isn't a competitively priced AMD offering where you are
what is the llm supposed to learn with ctx of 20
https://www.newegg.com/intel-arc-pro-b70-32gb-graphics-card/p/N82E16814883008 32GB for 1k is tempting, but I don't think I can mix-and-match with my 5070ti, could I
The most common single word with the highest score
luck maxxing really
Higher context windows increase training time
You probably can mix them
I will day you can get the radeon pro 9700 with 32 gigs for around that price
Which would be faster and better supported
I could prototype on colab but there's brand new code, instead that's for longer term tests
so, this might be a bit off topic, but I'm surprised that growpramming from schlock mercenary became not only somewhat real (via trained AI models) in a few years after the concept was introduced in the comic, but also one of the most relevant parts of the field I chose to study
If you mean VRAM sharing then no
oh :(
NVlink is proprietary and Nvidia aint gonna encourage you to buy competitors products
Its a shame
@bitter phoenix try this
{
"_sliding_window_pattern": 6,
"architectures": [
"Gemma3ForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"attn_logit_softcapping": null,
"bos_token_id": 2,
"cache_implementation": "hybrid",
"eos_token_id": 1,
"final_logit_softcapping": 30.0,
"head_dim": 256,
"hidden_activation": "gelu_pytorch_tanh",
"hidden_size": 512,
"initializer_range": 0.02,
"intermediate_size": 3072,
"layer_types": [
"sliding_attention",
"sliding_attention",
"sliding_attention",
"full_attention"
],
"max_position_embeddings": 131072,
"model_type": "gemma3_text",
"num_attention_heads": 4,
"num_hidden_layers": 4,
"num_key_value_heads": 1,
"pad_token_id": 0,
"query_pre_attn_scalar": 256,
"rms_norm_eps": 1e-06,
"rope_local_base_freq": 10000.0,
"rope_scaling": {
"factor": 8.0,
"rope_type": "linear"
},
"rope_theta": 1000000.0,
"sliding_window": 512,
"torch_dtype": "bfloat16",
"transformers_version": "4.53.3",
"unsloth_version": "2025.7.8",
"use_cache": false,
"vocab_size": 262144
}
24m
(excluding embeddings)
Okay thanks, currently I'm recording data to compare optimizers. But I'll try out this out as soon as I'm done
what gpu do u have
CPU only, I use my gpu for inference or it'll overheat 
i see
I'll get a liquid cooling system for my PC before putting AI on my computer ngl
seems dumb to only use a cpu to do this stuff
The only benifit is higher model sizes for inference/training if you have higher Dram than Vram, but worse latancy and everything else
they just fuckin rented colossus 1 and said they'd lift those
are they seriously out of capacity already

LMAO
I knew they'd lifted Musks compute but the fact it couldn't hack it for training Grok is peak comedy
meh i just went back from linux 7.0 to 6.18.31 LTS.
There seem to be some serious regressions in the i915 driver. My laptop screen just stays black and does not wake up anymore after idle on 7.0 
he used the rrat strat and just yeeted anything in there
but what about experimental guacamole functionality
I've been using LTS kernels forever and haven't seen a single panic since
Zen is a nothingburger
bro i was on intel xe for a while initially before i found out that i should rather use i915 for my hardware
ngl that shit cost me so much headaches. My laptop was hard freezing completely locking up the entire kernel randomly
i troubleshooted every piece of hardware before i finally found out that its the shitty xe driver causing that.
NeuroSynth is here https://discord.com/channels/574720535888396288/1505584795856535592
ugh, now I'm considering a motherboard upgrade to maybe buy two arc b70s to have 64GB of vram, but that'd probably mean an upgrade from dd4 to 5 for sysram and getting the same amount as I have now would be almost as expensive as the two cards
on pcpartpicker rn my ram alone is so absurd it's just sad
;_;
my selected ram is more expensive than the cpu
maybe ill get lucky and someone will just come take me out
money has no meaning and i dont even know what i actually paid because of it
i find myself looking at like a $4000 gpu and im like
hmmm
not great not terrible
and then i have to remember how stupid that is
just find a sugar partner atp or gamble
i definitely paid less than 50% of what it costs now






it not come up






