#programming

1 messages · Page 362 of 1

opaque wharf
#

Still on those slow coax?

sage crag
#

vdsl

opaque wharf
#

Noice

sage crag
#

the 8 bit model is 65% faster than the 4 bit model

#

the translation is better too

#

ok

opaque wharf
#

I wonder if LLM for translation have a different architecture than other more general LLM

sage crag
#

the translation is nonsensical

#

ow

rough bloom
sage crag
#

i tried to make it translate something longer and its taking its sweet time

#

also my pc sounds like its gonna explode

sage crag
#

all of my cores are pinned at 100

opaque wharf
#

But yeah, in hindsight it does makes sense it would need encoder-decoder

patent shard
#

You can't compare crf levels between encoders, svt-av1 and x264 are VERY different
Yeah, higher bframes won't always make a difference
I think qcomp has something to do with how much it compresses with motion? Or maybe more accurately how variable the bitrate will be depending on content

sage crag
#

oh, it started

#

it sucks

opaque wharf
#

I heard they are unveiling a "handheld" game console at CES with unified memory and Ryzen AI CPU. I wonder how viable it is to (ab)use those to run some LLM lol

sage crag
#

at 27 tokens per second its getting a little difficult to follow

#

that's something like 1000wpm, which is decent reading speed

mighty thorn
#

wrrrr wrr

echo eagle
#

Hi

sage crag
#

i wonder why the 4-bit quantised model is so slow

opaque wharf
sage crag
sage crag
# opaque wharf You tokenize by word?

vedalShrug this is the simplest inference i could put together, its like, 10 lines, i have no clue if it goes word-by-word, but its approximated that every 1.3 tokens is a word

#

yeah its 74 tokens and 54 words

trim valve
#

my uni explicity allowed vibe coding on a group project

hard delta
#

ai won't replace my job
i will be a "look into the actual code" expert

#

(agents replacing me in 3 years: SMILE)

trim valve
#

I am hopeful that ai plateaus

hard delta
#

i tell every young person that they should vibecode as much as possible and never waste time understanding what they do

#

gotta thin the competition

left solstice
# patent shard You can't compare crf levels between encoders, svt-av1 and x264 are VERY differe...

Yeah, qcomp uses less bits for low complex scenes and more for higher complexity scenes (stuff like grain, more motion, higher detail scenes etc if I understand correctly). Increases size overall but I still increased it slightly so I can use a higher crf (27,25) instead of lowering it while still having it look decent. Since crf is different between av1 and h264, If av1 was more reasonable in terms of time to encode and filesize then I probably would've done some trial and error testing to find a good balance of crf but I don't think it would be worth it on my hardware so I'll probably stick with h264

sage crag
#
output = ""
for chunk in res:
  output += (text := chunk["choices"][0]["text"])
  print(text, end="", flush=True)

i like that python supports inline declaration in the same way c does

#

it lets me write bad code

#

wrr

#

wrr

fickle rain
#

It even comes in tablets like the ROG Flow Z13

opaque wharf
fickle rain
#

OFC handheld will be more thermally constrained prob

quick condor
feral cobalt
#

peak llm usage (am making neuro integration for funsies)

trim valve
#

redacts name
has vscode rich presence showing folder name

feral cobalt
#

fudge

#

welp

#

too bad

trim valve
quick condor
#

Which 8b

sage crag
#

this model is 8b, 1.9gb in size, quantised to 8 bits, gguf, and its cpu inference

feral cobalt
fickle rain
quick condor
feral cobalt
fickle rain
#

Well that’s great

frozen hollow
#

I want to use a series of agents with persona files to play test my board game prototype by making it with the react-based boardgame.io framework and an MCP or something.. I’m gonna have to beg a friend with a fast computer to let me run it as a docker instance or something neuroD

quick condor
#

Q8_0 is 9Gb (closest perplexity) , Q6_0 is 7Gb, Q4_0 is 5Gb and IQ2_XSS is 2.6Gb so an 8 bit 8b at 2Gb is wild

frozen hollow
#

How much power is needed realistically to do a low-rank adaptation on a model that’s good enough to call tools reliably (ig that’s the core of neuro but I’m only guessing)

quick condor
#

Depends, with sharing weights across 2 3090tis and an A4000 I can do loras on 24b at full weight with ram offload (60Gb offload and 60Gb to write layers) but smaller models using qlora can use less

frozen hollow
#

I’ll check what he has It might be a 4090 and 128 memory

nocturne olive
#

It's all on the memory

#

Now pretraining is a whole another thing

quick condor
#

For neuro size (my best educated guess Llama2 13b) likely 4090 with 128Gb ram is fine

nocturne olive
#

That's like more than enough

frozen hollow
#

A prompt file might be enough for what I need it for this is basically extra credit

fickle rain
#

Would DGX Spark or the like run better

nocturne olive
quick condor
nocturne olive
#

For LoRA you can finetune even on a 4-bit loaded model just fine

#

8-bit base model is plenty

quick condor
#

There is a difference between "you can do it" and "what is ideal"

frozen hollow
#

Basically I’m using it for actual design work but making it fancy is just for me

nocturne olive
#

The final LoRA can be applied to whatever variant of the model anyway

#

You're just obsessed with wasting as much memory as possible on marginal quality increases

frozen hollow
#

Persona files (Timmy Johnny spike kinda thing) and a running agent loop for each on the same model is my mvp

quick condor
nocturne olive
#

Hem
Training LLMs on themselves

#

That's gonna be not great

quick condor
quick condor
# nocturne olive Hem Training LLMs on themselves

Yes and no. I mean memories get injected as context, errors in memories causes defects in output which then become new memories. That's the problem.
For training I am using model output but that is coming from 50/50 model user interaction which is actually ideal for rlhf

quick condor
#

Silly tavern

#

It's a lot to set up but solid once set up

frozen hollow
#

Ah I will look thanks!

#

I’ve heard the name but I didn’t know people used it for anything other than like.. roleplaying or something?

quick condor
#

It's solid for building persona profiles and can handle multi persona switching in a single conversation

frozen hollow
#

I also wanted to look at fine tuning a vector embedding model (for a diff project) but I found such a good one it’s hard to justify the effort realistically

#

Considering I can run both the encoder and decoder models on my 16GB MacBook m1 it’s probably more a question of data curation

floral wraith
#

i want to run AIs at work the only problem is that we dont have gpus at work we have like 4tb of ram and 6 servers but 0 gpus and we cant get gpus

floral wraith
wary mauve
#

probably been asked a bunch of times but im getting into models, LLMs, RAG and the whole works and ive hit a bit of a problem

so to be blunt im attempting to create something similar to neuro, not neuro as a personality but the architecture she encompesses just for friends in a discord server

ive currently got it working so its a bot that joins a discord vc, ive hooked up each input stream from each user into a joint whisper queue ad ive got a decent mvp

now im trying to have the ability to allow it so the llm itself / the bot, is able to perform "actions"

such as, send_discord_message, play_sound_effect, leave_call, join_call, mute_member, unmute_member, etc etc

now i initially added a prompt injection that explained "actions" and how they should be used and when to use them, in the system prompt, and also examples and then the list of available tools

now this was good but my llm output is straight text so it'd be

"
My speech is here and this is what I say

[ACTION:name key=value key2=value2]
"

Which was fine but sometimes the action was malformed, which is okay I know LLMs arent guaranteed and giving you exactly what you want or what you specify

so I changed to using "tools" which some models are trained on and it seemed like an easier system because it was json, I could be more verbose without adding more noise to the system prompt

but ive just ran into a BIG issue, my assumption was the LLM would respond with text content + tool_choice (whatever the property name is) so it could kill 2 birds one stone

but i was wrong and it can only either

A) give a response of what the bot wants to say
B) tell me that it wants to run a tool

now I hate this because say I want it to react and run a tool, for example

"ive just sent a message" -> also runs a tool

anyone got any good recommendations / techniques I could use to improve this? been non stop workingn on this bot since he was born last saturday so slowly losing my will to live but its a fun project

tl;dr -> need to figure out a good way to run code that the LLM can tell my system to run and also respond with what he wanted to say too

#

SORRY FOR THE DUMP

#

thought this was the best place to ask

stuck ocean
wary mauve
#

ive heard of mcp too but didnt give it too much of a read ngl

frozen hollow
wary mauve
floral wraith
stuck ocean
floral wraith
trim valve
stuck ocean
#

And what do u need the bot to do exactly

floral wraith
floral wraith
stuck ocean
proven merlin
frozen hollow
stuck ocean
frozen hollow
#

Also I guess I should buy GLM4.7 access for my little persona project? Has anyone used it for that kind of work?

stuck ocean
#

What's that

wary mauve
floral wraith
stuck ocean
#

I should prob learn more abt llms i barely know anything and everyone seems to be using it now

stuck ocean
floral wraith
stuck ocean
#

U should look up sum tutorials or ask someone who knows more

frozen hollow
# stuck ocean What's that

Like.. Chinese knockoff Claude neurOMEGALUL - but specifically you can get banned from Claude and I assume Google trying to do what I’m doing and the GLM stuff supports what I want to use it for

floral wraith
stuck ocean
floral wraith
frozen hollow
#

Idk if it will work but that’s what I wanna try

frozen hollow
#

Can’t get them to test my rules sheet for readability.. LLMs are too smart

#

They can read terrible instructions and figure it out anyway

stuck ocean
#

Lol

#

Well uh anyway I gtg config my waybar for 6 more hours lol

#

Cya

nocturne olive
wary mauve
# nocturne olive Try returning something from the tool immediately for the model to "react" to, t...

yeah I just ended up doing that, I specify a "say" parameter on each tool with a description that basically says put whatever in here that you want bot_name to say

and as for latent info ive got that too with my tool setup, like for example if its a web search, my generic Tool class has a returns_data property, which i check for, and if it exists I dont emit my LLM_RESPONSE event I just rerun the prompt but with the new context that it was asked so and so and you did it and here were the results essentially

#

well thats how itll work, ive not done the reprompting or context part yet

nocturne olive
#

I wouldn't put what to say as a tool parameter, rather give the LLM a turn after executing the tool

wary mauve
#

Well that was the second option but that introduces more latency as it has to go through a second LLM request which is slower than the tool parameter way even if its a bit hacky

Still need to dive into latency as my model isn't local but using openrouter for now as Im running faster-whisper (distiled model) + a vad and thats already using like 5GB vram out of my 8GB OMEGALUL

#

Secondn LLM request I'll do if theres data that needed to be fetched by a tool

nocturne olive
#

8GB is very not ideal indeed

#

And I guess with a cloud model high latency kinda makes sense

wary mauve
#

yeah exactly, i mean avg response with deepseek 3.2 1.8s so not good, not to mention I check for silence and such

#

3070ti, looking to upgrade to a 4090 this year but with the costs of RAM and GPUs rn might not happen

#

or i bite the bullet

nocturne olive
#

24GB VRAM, inference performance almost same as 4090, and prices as low as 500€ each

wary mauve
#

had no clue might look into it, i do game still so a 4090 would still keep me in the loop for the next few years

#

well youd hope

#

not with ue5 games 😏

nocturne olive
#

Yeah 4090 is faster in gaming than a 3090

#

In ML though unless you're doing training the 4090 doesn't have significant benefits

wary mauve
#

well i do eventually want to fine-tune models for personality traits similar to what i assume vedal does just to learn and trty it, but i can always use a service like brev from nvidia

wary mauve
#

looking at pre-owned i lie

nocturne olive
#

There's this one triangle in #programming that knows where to get really cheap ones

wary mauve
#

how does one get in this triangle 😏

floral wraith
amber fractal
#

The triangle only deals in 3090s because all of the others are inflated to hell

floral wraith
amber fractal
#

600 euro last time I asked

#

some 500 ones exist

floral wraith
amber fractal
#

(triangle offline igglybwaa)

wary mauve
#

dont

#

come back

#

might have a friend who can get them cheap

#

but need the funds first

#

so waiting to start the new job

#

then when i get paid

#

its so over for my 3070 ti

amber fractal
#

I'm not the triangle man, just a friend of his

floral wraith
amber fractal
#

My forcast is if you get paid in a month+ you'll be paying 600 for the 3090 otherwise might be able to get 500

wary mauve
#

but the real question is from who

#

but i assume u mean

#

cus prices will go down

amber fractal
wary mauve
#

oh hey haha...

#

so uhm

#

got a gpu?

opaque sigil
amber fractal
#

still offline, will be on in maybe 3 hours?

wary mauve
#

naw but ill ask my friend before i pester peeps i dont know or dont know me

#

ty

opaque sigil
amber fractal
#

What sleep schedule?

#

I only know he sleeps

opaque sigil
#

True

amber fractal
floral wraith
#

how hard is it to get only the vram

wary mauve
#

not hard at all

#

and its cheap af

#

but

#

you need to solder it on ( heat gun ) which isnt the worst part

#

the worst part

#

is that

#

the firmware

#

wont support it

#

ad writing custom firmware / patching ca lead to bricked gpus pretty sure

#

and its generally

#

super hard to do

#

so

#

so it is hard

floral wraith
wary mauve
#

well the firmware is possible the pcb part no clue sounds pretty op

floral wraith
opaque sigil
#

it's doable provided someone at nvidia has previously leaked a compatible vbios YES

floral wraith
floral wraith
amber fractal
#

That reminds me of the 48gb 3090 cards

#

I imagine that is how those came to exist

floral wraith
frozen hollow
#

yeah that sounds sick

fleet jungle
#

Man, GPUs these days have become lards

#

Oh. I'm starting to sound like a cynnical boomer. I'll just stop myself while I'm ahead

frozen hollow
#

idk lol it's clearly gone a bit nuts when you look at the port and the assumed support structure and the voltage of the PSU

#

I'm surprised they haven't gone up in voltage to supply less current or something to reduce melted connectors? I don't really look inside my computer much

rigid snow
#

yo programming chat

#

it was too far to friends home and too cold and dark and late

#

he's staying over at mine

#

he wanted to test the 5070 in my pc but

#

case WAY too small ICANT

nocturne olive
rigid snow
#

it's regular 4090s too

#

they mod

nocturne olive
#

Either way I want one
But expensive

olive sable
olive sable
#

3060 12GB 110 euro + shipping

#

3080 320 euro + shipping

rigid snow
olive sable
#

that 3060 is actually a good deal

fiery anchor
#

sounds pretty cheap.

olive sable
#

i can also deal cpus ai guess

#

7800x3d for 280 euro

amber fractal
olive sable
#

ye

#

i can also do ram i guess with curreent pricing

wary mauve
#

😏

#

oh really

#

now

olive sable
#

4x16Gb=64Gb PC3-14900R 1866MHz (Serveurs/Mac Pro) € 70,00

#

ReallyInnocent ddr 3

wary mauve
#

ddr3?

#

😭

#

nno pls

#

does speed matter though for LLMs / AIs

olive sable
#

for ai i think you'd want to use vram

amber fractal
olive sable
#

its sad that ddr3 for 70 bucks is not the worst

#

you used to get 2x32gb ddr4 brand new at 100 euro

amber fractal
#

compared to ddr4? that is a sacrifice I'd be willing to make

wary mauve
#

yeah ofc but if VRAM isnt available it goes to RAM but i sort of also meant if ram is useful outside of that

fleet jungle
#

More vram the better for LLMs, but if you have even just an ordinary dedicated graphics card, you should be relatively good.

olive sable
#

if it flows ovcer into ram its gonna be really slow, no matter the type of ram

#

iirc

amber fractal
#

That is correct

amber fractal
#

the process of fetching is heavy

fleet jungle
#

I've run gemma 3 12b quantized to some degree on a 1070 and it works alright.

olive sable
#

HP 4x 16GB 64GB 752369-081 774172-001 726719-b21 ddr4 ecc € 140,00
cheapest ddr4 64gb i can find

#

its ecc even

amber fractal
olive sable
#

seems to be 2133mhz

amber fractal
#

decent for ecc

fiery anchor
#

and not necessarily a lot slower. For general compilation and stuff more than usable.

#

(vs ddr5)

wary mauve
olive sable
#

the cheapest ram i can find is all ecc neurOMEGALUL

#

i guess not a lot of people have ecc support

wary mauve
amber fractal
#

better grab a xeon then

wary mauve
#

i need to enable xmp or whatever its called i bios

fiery anchor
wary mauve
#

forgot the name

#

i just got my new work laptop thats got 32GB DDR5 but its a laptop so its probs soldered Sadge

olive sable
#

i think overall its still a better deal to buy a 2ndhand prebuilt pc. before the ram crisis it was only slightly more expensive, but now even getting ram that fits is pricey

wary mauve
#

which i have the tools to remove but id feel like even if u ca make it compatible for desktops it'd be aids

wary mauve
#

Sadge i tried to get a framework

olive sable
wary mauve
#

but framework 16s are all on batch

#

or well

#

decent ones

#

it is sodimm

amber fractal
#

framework 16 didn't exist when I was hunting, so had to go for a levono boi

wary mauve
#

not sure wehat that means

amber fractal
#

I do have a 13 tho

fiery anchor
wary mauve
rigid snow
#

wait we spent how much i wonder

#

all new parts

frozen hollow
#

are the higher end macbooks any good for this? I need a lot of memory anyway just to run stuff but if I can justify 64 on one that'd be cool. I guess they suck for training?

olive sable
#

these are available for 130 euro in my school's discord, i jsut dont have a ddr5 laptop

frozen hollow
#

Sodium ram!

amber fractal
#

ddr5 as well

wary mauve
#

goated

rigid snow
rigid snow
#

not counting the fucking case which he already had

rigid snow
olive sable
#

who's pc?

rigid snow
#

in a LIAN LI O11 DYNAMIC EVO XL

#

fuck my life

amber fractal
rigid snow
#

but i’m also pretty excited to see how the 5070 performs

#

shits supposed to be crazy

fiery anchor
#

for cheap parts always check what local businesses are throwing away.

rigid snow
#

same price new as a used 3090 here

olive sable
#

i got mobo + 5950x + 4x16gb 3600 ram for 300 bucks
3090 for 600
psu for 50
case for 70
cpu cooler for 50
and i recently bought new storage so 600 euro in that

rough bloom
rigid snow
#

ok so the funniest part about all this is

#

bro plays esports titles and fucking valheim

olive sable
#

ReallyInnocent spent as much on storage as on gpu

rigid snow
olive sable
rigid snow
#

for context i have like 150 fps stable and drops to 30 in intense battles

#

fights

#

“battles” mlntcandy neuroOhISay

wet monolith
#

@burnt marsh someone asked about this before and vedal's direct response was "you can't rn" #programming message
so it may be the case in the future, but for now this is how it is.
also,

No chatting here
per the channel topic in #merch

#

and technically it wouldn't be reverse engineering if the app was open-sourced. lol. the protocol would be right there for you to see

#

reverse engineering would be e.g. capturing packets to/from the lava lamp

burnt marsh
#

wrong word, mb. i could easily make it myself and take colour from stream without swarm sync, but that app would be nice to use

#

thanks for the answer!

wet monolith
#

i agree though, people could probably make some really cool stuff with it

burnt marsh
#

N E U R O T O I L E T

wet monolith
#

lmao

burnt marsh
#

/jk

#

ill reply to vedal in like 6 months and see if the answer changes lol, [unless that would get me banned, if so then nvm. appears to be fine in rules, as long as i dont send notification to him]

wet monolith
#

can't say for sure whether or not that would get you banned lol. you'll be trying your luck anyway

burnt marsh
#

ill ask the mods beforehand, but thats a job for august me

wet monolith
#

i recall he said that it's technically just a smart light. the real question is the firmware.
i'm not sure of the specifics, or whether or not the phone is still required after pairing. it obtains the color from a remote server, that much is obvious. and with negative latency, might i add; although that's probably just a side-effect of streaming (an action performed irl always appears on stream a few seconds later)
as for the protocol, no idea. it could be repeated http requests or it could be a websocket. it could even be a raw socket for all i know (that is, i don't know.)
anyway, your best bet if you really want it is to find someone with a lava lamp that also is willing (and knows how) to capture traffic between the lamp and the internet. from there, you read the traffic using something like wireshark; something that can recognize patterns in the data. then you can really start figuring out how things work from there

burnt marsh
#

i was planning to do that but i dont know anyone with a lava lamp lol

#

im pretty sure im one of like 4 people in my county who like neuro enough to buy one

real sierra
burnt marsh
#

hi shiro

wet monolith
#

lol hi shiro

real sierra
#

hiiiii

#

I have programmer's block

burnt marsh
#

oof

real sierra
#

I need to just write code

wet monolith
real sierra
#

too much worrying about if it'll work or not

wet monolith
#

too real ^

azure lynx
#

write code to help you determine which path of pain and sorrow you should spiral down into: gambling, drinking, video games, Netflix.

wary mauve
fiery anchor
wary mauve
#

^

real sierra
#

YES I get stuck in this loop a lot

#

most bad ideas are quickest spotted by good planning, but some are quickest spotted by trying them

wet monolith
#

i just have no motivation. not sure where to pull it from

rigid snow
wet monolith
#

last time i wrote code was probably like a week ago lmao

wary mauve
#

im a perfectionist when it comes to my code, but ive learnt to loosen up a bit, not everythig i write needs to be perfect on the first try, get somethig basic adn workig and iterate as you see fit, if you dont like looking back at some code u wrote yesterday, you refactor it, boom progress

#

my n key is so fucked

wet monolith
#

it puts a real damper on my motivation i think

frozen hollow
burnt marsh
wary mauve
#

yuh its a horrible habbit but just tell yourself you can always implement a harder feature later, youll always iterate even subconsiouslly

#

just let it happen over time

frozen hollow
#

Are you just wanting to jack like a nano panel into the neuro light system

wet monolith
fiery anchor
rigid snow
# rigid snow NOT listen. .shipping garbage make your image garbage

as long as it actually does what it’s supposed to and if it involves ui it doesn’t make the user gouge their eyes out with different types of cutlery and workshop tools then yeah ship it. maybe it doesn’t do it well but you can fix that. can’t fix bad impression that’s forever stuck with you

tender river
burnt marsh
rigid snow
real sierra
#

i think at the end of the day, my developing woes are self-inflicted

rigid snow
wet monolith
burnt marsh
olive sable
#

neuroWaveA hi shiro

rigid snow
#

step 1: obtain official lava lamp to reverse engineer

wet monolith
#

pay vedal for the code and sign two NDAs

burnt marsh
burnt marsh
#

i just want my neuwo lava lamp

rigid snow
wary mauve
real sierra
#

im completely new to unity and i'm trying to make a melee attack for a multiplayer game, and while i can kinda apply experience and say "okay, so i'll need some kind of animation for the attack, and then a hitbox of some form for the weapon, and i need to make sure these calculations are run on the server", you could watch a 4-hour tutorial video on any single one of the components involved before getting a good foundational understanding

tender river
#

it because

#

it uses

#

tuya servers

olive sable
#

i wonder if they would ever make a second edition of the lava lamps

tender river
#

for synchronization

real sierra
#

in lieu of that, i've been trying to trust my instincts and go with "yeah that sounds like it should work intuitively" and applying the same paradigms i have for other engines

burnt marsh
real sierra
#

and it always leaves me with some element of "idk how any of this works but if i wrote the engine, i'd imagine it would work this way"

tender river
real sierra
#

and i think thats why i have programmer block and cant trust my own plans enough

fleet jungle
real sierra
wary mauve
wary mauve
#

then if u are really interested

wet monolith
#

what is a

wary mauve
#

read about it

wet monolith
#

tuya server

wary mauve
#

and explore it anothe rtime as another project

tender river
#

tuya is

#

iot thing

wet monolith
tender river
real sierra
burnt marsh
wary mauve
#

it is but do it system by system

#

first

real sierra
#

well that's what ive been trying to do

tender river
wary mauve
#

do it in singleplayer

#

first id say

real sierra
#

too late

#

its already multiplayer

wary mauve
#

😭

burnt marsh
#

and that would make it very hard to make a custom one because those servers are encrypteddd

wary mauve
#

okay change it, or make a new unity and learn how to do the parts that make up your system, break it down

real sierra
#

see that takes too long tho

#

my motivation is gone in like 1.5 weeks

frozen hollow
real sierra
#

thats the deadline

real sierra
#

ive already tried to do that and so there's existing logic for characters' health and hitboxes

frozen hollow
#

Well for one you don’t need hitboxes for the animation right?

real sierra
#

but the rest kinda has to come all at once to be testable

wary mauve
#

yeah thats the same with me i do thinks for like 2 weeks then dont touch them for months or forever again it sucks and it is the cycle that i cant break but keepingn yourself entertained with a project that may die isnt the worst thing in the world, you still gain from it

wet monolith
real sierra
#

oh god i forgot i need to add inputs too so you can actually use the attack

burnt marsh
#

if it runs on tuya servers id assume the web traffic is encrypted

#

big iot company

fleet jungle
#

wow

tender river
fleet jungle
#

All these third parties really gives a scale of what the neuro osu project has become

olive sable
fleet jungle
#

One would think its some company or something glueless

olive sable
#

the 3 seperate conversations happening at once is confussing

burnt marsh
burnt marsh
tender river
olive sable
wary mauve
#

with unity the best way in singleplayer is to use

animation events, where you fire an event when an animation gets to a certain part

for example a sword swing would be

click mouse1 -> at 0.3s of the animation, this is the part that ca hit the enemy, so create an animation event that is like enable_hitbox_detection -> at 0.7s turn that detection off

and so tyou have these frames where your sword is active, and if you get any collision events or however you detect that hitbox collission when its enabled, you hit em :)

fleet jungle
#

hey there's still more room to discuss security

fleet jungle
#

Haven't seen that happening since joining 2 days ago (?)

wet monolith
#

making a game sounds super fun but i don't think unity's ide or whatever works on linux sad

#

would have to resort to like

#

godot

#

or lwjgl

wary mauve
olive sable
wet monolith
#

or raw c++ sdl or something

wary mauve
#

yeah it does

wet monolith
azure lynx
#

i'm going to imagine it's possible to open the lamp up and dump the contents of any storage on the board and maybe also work out which processor it's using. if you're lucky there may be some pads for a serial port and that might give you console access to it. once you have the filesystem you can probably dump whatever config it uses to connect.

burnt marsh
wary mauve
burnt marsh
#

but thats annoyyinnnngggg

wary mauve
#

you get to choose ur ide

#

:)

wet monolith
#

how to 3d

#

and assets

#

and etc

wary mauve
#

blender

olive sable
#

iirc there's a unity AUR or whatever

fleet jungle
wary mauve
#

free assetys all over the intnernet

fleet jungle
#

unless thats not what you mean

frozen hollow
wary mauve
#

Debug.Log is your debugger 😏

wet monolith
fleet jungle
#

I worked a little with python's cryptography lib just to try getting a https server working. Terrible headache that was

olive sable
fleet jungle
#

oh

#

Well that was just with my joke about having room for more :p

#

To make it even more tangled

olive sable
#

neuroLookUp not enough yellow

real sierra
#

good enough

fleet jungle
#

I will respectfully (fearfully) resolve myself to my current colour (I don't wanna join a cult sounds scary)

#

wait hold on

#

this is vedal's server and he's not using U in colour??

real sierra
wet monolith
#

the project of mine i'm most impressed with and proud of to this day because of its complexity, is for a website that i've completely lost interest in. so the project is basically dead, and i've thought about deleting it before but i haven't because i'm proud of how far it came.
does anyone else have a situation like this lol

real sierra
#

as a canadian im also sad there's no U

wet monolith
unkempt citrus
#

Americans SMH

fleet jungle
#

As a fellow member of the Commonwealth and even a child country to the Brits, this makes me sad.

olive sable
azure lynx
#

the u does nothing. the word is still distinct.

olive sable
#

the u is absolutely vital

burnt marsh
olive sable
#

her?

burnt marsh
frozen hollow
#

I’ve been bitten by <colour> tagging before

fleet jungle
#

My man!

azure lynx
#

my favorite wourds don't exist.

amber fractal
#

bwaa

olive sable
burnt marsh
burnt marsh
olive sable
#

pronouns are happy/birthday

amber fractal
azure lynx
#

maybe they're american... did you check under pronons?

olive sable
#

apparently

olive sable
#

ye same

wary mauve
#

uuhhh too many modules

olive sable
frozen hollow
amber fractal
#

Who has that these days?

olive sable
#

not me

wary mauve
#

he did just say he was being held hostage

amber fractal
frozen hollow
#

Whaa why would you do that

amber fractal
#

in internal repos I tend to be unpredicatable with imports

azure lynx
#

why would you only expose the things that you want to import and then import *? convenience and brevity?

olive sable
#

me when i import

wary mauve
olive sable
#

the amount of imports we had in the python engine wasnt even that bad

from PIL import Image
import numpy as np
import asyncio
import pygame
import zengl
import sys
import platform
import time
amber fractal
olive sable
#

fair enough

feral cobalt
burnt marsh
#

maybe ill see if vedal could just get the current hex of the lava lamp and put it on a website, that doesn't seem too difficult, but hey idk.

wary mauve
#

even if i use something like discord x ts

azure lynx
burnt marsh
#

i remember when swarm control got ddosed, probably similar thing would happen, whether intentional or not

azure lynx
#

especially considering the use cases is that it doesn't change very often but when it does change, you want to know immediately, it seems like this would be better off being push notifications instead of client polling

burnt marsh
#

maybe block ips that make too many requests?

burnt marsh
wet monolith
burnt marsh
#

i guess its up to vedal what he does with it

#

or even if he does it

azure lynx
#

also if it's opened to everyone then it would have a lot more consumers than it currently does. the only people using it currently are the people who have paid for it. but if you don't need to pay anything to use it, it's the sort of thing people would have a software version of it just because it's cool and free and that'd put the server under a lot more load. so i wouldn't be surprised if it's not opened.

amber fractal
#

I don't have any projects with massive imports I'm working on. At most it is numpy and typing at the moment.

olive sable
#

most of the imports i have to do are code i have to write myself

#

the amout of external stuff im importing is small

amber fractal
#

I honestly don't even know why I'm bothering with a base class tbh, I only have one other one

#

so I just keep altering the base to match the only other one

wary mauve
#

i do the same thing dont worry 😭

#

you always think u nened another when one class is fine

amber fractal
#

The previous iteration worked with two, so it was a healthy assumption. But I decided to not continue on that path.

#

so only one remains

#

I might reintroduce it later, but it'll probably not share this base class anyways

obsidian mantle
#

my compiler says i have something redefined but its not redefined what do i do neuroBwaa

amber fractal
#

The only base class I'd actually use is just some random one for post class init, similar to how torch does it with it's modules

frozen hollow
obsidian mantle
#

also vs studio compiler and xmake give different errors now

olive sable
obsidian mantle
#

i guess i fucked up my project

obsidian mantle
frozen hollow
#

Oh well

obsidian mantle
#

i just tried to add some new repo as module and it all went to shit

#

i mean i have backup i hope it will work

amber fractal
#

dealing with all of the shape casting and stuff

obsidian mantle
#

i mean maybe it is redefined and i just dont see how

#

its actually link problem or how is it called im not good at it

#

i dont know where these things even are

#

ok they are in build directory

fiery anchor
#

same symbol in multiple translation units.

#

i guess?

fleet jungle
#

Just found out numpy isn't a standard library for python like I was thinking. That's a surprise, considering how many people know and use it.

obsidian mantle
#

i have main.cpp and socket.cpp
both have #include socket.hpp

#

can i not do that

#

the thing thats conflicting is inside of socket.hpp

opaque sigil
#

not without an include guard enub

azure lynx
#

#pragma once as thefirst line in the .hpp file i think will fix it

jagged turtle
obsidian mantle
#

i think i understand it now.. initially this thing was in the socket.cpp file
i moved it into .hpp file because i needed to access it from main
its a member of some namespaced class and i couldnt access namespace without doing it

frozen hollow
burnt marsh
obsidian mantle
#

does this cancel pragma once

fiery anchor
#

ye. remember includ is basically a copy and paste of text. if you don't have include guards, the symbol gets duplicated onto both .obj. later when combining those it sees double and is confused.

olive sable
#

i got a wrapped form nintendo now too in my email AINTNOWAY
everything needs a wrapped these days i guess

obsidian mantle
frozen hollow
obsidian mantle
#

no its lower

jagged turtle
#

people just want to hop on trends

frozen hollow
#

It’s like for making foldable segments of code in IDEs I don’t think it interacts with the compiler

jagged turtle
fiery anchor
#

not used to working with pragmas -> banned at work by coding guidelines.

azure lynx
#
#ifndef __filename__
#def __filename__
{rest of include file}
#endif

then this instead?

#

with actual filename of the .hpp like __socket_hpp__

rigid snow
#

ssjdjddjfjdfhkjhksj

fiery anchor
#

sortof.

obsidian mantle
#

so __socket_hpp__ will point to Socket.hpp file

#

wait i think i got what you mean

rigid snow
#

I Need Sleep

#

Send Me Sleep

fiery anchor
#

only got sleep debt, want that?

jagged turtle
#

why is queen from deltarune in chat

rigid snow
#

sleep not work

#

valve pls fix

sage crag
#

wrrr

#

wrr

#

wrr

rigid snow
obsidian mantle
#

so i have this in both files that include it

#

and it doesnt help

opaque sigil
#

no that's for the socket.hpp itself enub

rigid snow
#

what am i looking at mlntcandy

opaque sigil
#

not that it matters if you already had a pragma once inside

obsidian mantle
#

yeah i guess

#

so wtf does it want

#

maybe im blind

azure lynx
#

maybe need to change to order you include things?

obsidian mantle
#

surely VS search works correctly when i search across whole project glueless

opaque sigil
#

well it's complaining about socket.cpp

rigid snow
#

meow

fiery anchor
#

doing any #include *.cpp shenanigans?

obsidian mantle
#

no

#

i think its fucking xmake or cmake or clang or whoever the hell is in those modules

azure lynx
#

i think you said you put stuff in the .hpp file so you could access it in main.cpp?
is it saying that stuff is redefined?

opaque sigil
#

i can guarantee you this is not the build system's fault

rigid snow
#

catEat header fiel

opaque sigil
#

headers were a mistake neuroSadge

frozen hollow
#

You’re learning!

obsidian mantle
#

i have 3 files
main.cpp
socket.cpp
socket.hpp

socket.hpp has pragma once
both main.cpp and socket.cpp include socket.hpp

#

the ActionList object from error is defined in socket.hpp

opaque sigil
#

personally i'd cut out the socket.cpp but that's just me

obsidian mantle
#

yeah every time i deal with this shit i have an urge to slam everything in one .cpp file

#

its so stupid

fiery anchor
#

try making the variable static.

opaque sigil
#

do you have forward declarations inside the cpp files

azure lynx
#

what is the actual error: what does it actually say is wrong?

obsidian mantle
#

full error

azure lynx
#

so you're doing includes wrong. you should just declare that there will be a function in the include file, and have the actual function in your .cpp file

obsidian mantle
#

then i will have to do stupid copies in main.cpp file because i cant access namespace of socket.cpp

#

or can i somehow relay namespace from cpp to hpp

opaque sigil
#

that's what the socket header is for

obsidian mantle
#

i tried it didnt work

opaque sigil
#

it contains all the necessary declarations

#

and the cpp file only fills those in

#

then you messed up enub

azure lynx
#

just declare the function exactly like you have it but when you get to the { change it it to ;
the move the original code back into the socket.cpp

#

(deleting it from the .hpp but leaving the declaration)

fiery anchor
#

declaration: void foo ();
definition: voif foo() { /* body */ }

no extraneus {} anywhere?

obsidian mantle
#

i know i can put empty functions in header file which are actually defined in .c file
but what do i do if its not a function but a struct within namespace

#

the namespace is accessible from header file

#

its not accessible from other .c file that has this header included

opaque sigil
frozen hollow
#

Woah interesting font choice

opaque sigil
opaque sigil
obsidian mantle
#

i need to relay this into header from cpp

#

its not a function

#

i make class and define function to access it?

#

only way?

azure lynx
#

if you are doing C++ it's the way you should.

obsidian mantle
#

this is bullshit i will rather make fucking manual copy it will have like 10-20 strings anyway

#

i see i see

fiery anchor
#

depends.

opaque sigil
#

you can do extern neurosdk_action ActionsList[]; i guess

#

or static i don't remember

frozen hollow
azure lynx
#

extern in the .hpp and actually declared in the .cpp

obsidian mantle
#

i actually dont even need this structure in another file i need namespaces from that file

#

uhh

#

so i put namespaces into header and this structure into cpp file

#

this is just a mess

opaque sigil
#

why do you think people like rust so much

azure lynx
#

the pretty color? ;]

fiery anchor
#

propaganda?

frozen hollow
obsidian mantle
#

yes

#

the cpp file will have this structure without namespace

frozen hollow
#

Hol up

#

It should be in the namespace inside both no?

opaque sigil
fiery anchor
frozen hollow
#

So I think you’re importing the declaration out of namespace then redefining it which is why you get that error (I have very little view of what you’re doing)

fiery anchor
#

"something"

obsidian mantle
#

i think it worked

#

at least the build is successful

olive sable
patent shard
#

@left solstice I should of also mentioned, you hit diminishing returns very quickly
I'd do "slower" preset MAX, as it's just kind of silly to push it any further
really medium or slow is already really good

#

you also can't just look at file size for same crf to determine if it's better, the subjective quality will change drastically when settings or changed even if the crf is the same

obsidian mantle
#

nice now it all works
now i only need to define name of action in only one place neuroHypers no need to make manual copies when i add something new

#

thank you guys

sage crag
#

reading in "Extra Light"

opaque sigil
#

only normal light NOPE

sage crag
fleet jungle
#

This is gonna be a incredibly stupid question because I'm not well-versed with LLMs or NNs even, but does the LLM decide the "emotions" the twins should have? Or is that a separate model? Further, could it be possible for such a "emotions" centre to control the LLM instead? I apologize in advance for evaporated brain cells.

quick condor
#

Most likely either a separate model or the main model adjusts perameters that affect various aspects of the prompt generation that affects emotional expressivness

hearty notch
fleet jungle
#

I'm guessing if it were possible, it'd require far more training data that includes things that have never reliably been measured before (what was the speaker feeling at this moment?).

hearty notch
#

if you mean the facial expressions for emotions

#

i think they used to be directly linked to certain phrases

#

and they seem to have a lever to pull to change their own expression sometimes

fleet jungle
hearty notch
#

but e.g. using the word embarrassed regardless of context would trigger the embarrassed blush for quite awhile (i havent paid tooo much attn recently)

hearty notch
#

also im pretty sure the text to speech input from collab partners also now tries to embed tone to some extent (and like parses noise into sfx tokens)

fleet jungle
#

Not that I would have any clue as to what exactly the training data contains.

unkempt citrus
#

My guess its a combination of keyword detection and sentiment analysis

#

you can see how sometimes the displayed emotion when a specific word appears even if the actual sentence itself is more neutral

#

I think scary/creepy does that someitmes

hearty notch
fleet jungle
#

That's true. 🤔 Still, the vibe I get is that a certain word gets picked up which effects the expression display, but then its gone by the next stream of text.

fleet jungle
quick condor
#

yall are really overthinking it

opaque wharf
real sierra
#

i find it hilarious how many people are clearly doing the exact same things as i am

#

my mmorpg needs a way to save account data to disk

#

and read it from disk as well

#

and i figure json is nice for this so i wanted to know if there was a nice built-in json serializer

#

and the first result is

real sierra
#

flatbuffer?

opaque wharf
real sierra
#

(hi uncomputable evilHyperYay )

olive sable
#

neuroWaveA hi shiro

opaque wharf
olive sable
#

hi uncomp

real sierra
#

idk what flatbuffer is

#

which part of the process is it meant to replace

opaque wharf
real sierra
olive sable
real sierra
#

WAYTOOBIRTHDAY happy birthday uncomputable

opaque wharf
real sierra
#

its a day late but im sure its fine

olive sable
#

happy birthday

#

damn that was fast

opaque wharf
real sierra
opaque wharf
real sierra
#

forsenCD y'know, for reasons

opaque wharf
#

Hey, my birthday is yesterday neuroD

real sierra
#

Sadgi but i didnt get to give it to u yesterday...

opaque wharf
#

Why am I purple neuroD

olive sable
#

bday

opaque wharf
#

Lmao, thanks

#

Anyway, I think flatbuffer has JSON mode too. But at that point yeah, just use JSON

orchid crest
olive sable
#

no

#

purple magic

orchid crest
olive sable
#

evil is red and black

opaque wharf
olive sable
real sierra
#

bro...

#

you're telling me my options for serialization are

#
  • a good package that does binary only
#
  • a terrible json package
#
  • a json package that isnt supported or recommended for use
#
  • a serializer that works on only very specific platforms
#

am i to believe everyone making save files in their games is running their own serialization

opaque wharf
#

Unity is C# right?

real sierra
#

yeah

opaque wharf
#

Yeah, you're on your own neuro7

real sierra
#

do u know what im making

opaque wharf
#

MMORPG?

real sierra
#

YES ok i told u already

opaque wharf
#

Why not use System.Text.JSON?

#

Isn't there .NET for linux too?

real sierra
#

nevermind

#

its not in unity

#

for.. some reason

olive sable
sick owl
#

So about the cocoon inference network someone posted here the other day

#

Looked good, but it just clicked for me

#

Its just vast with crypto tacked on

opaque wharf
real sierra
#

WHAT wait the unity serializer can do json serialization

#

that other forum thread lied to me UltraMad

opaque wharf
#

You think someone would just do that? Lie on the internet?

real sierra
#

NeuroClueless never

patent shard
#

I keep hearing pops in the audio on the recent neurosama YT vids
I think the audio is just super compressed, or something
I'm pretty certain it's not YT causing most of this...

#

and the voices just sound kinda like a bunch of frequencies were taken out

olive sable
#

if i procrastinate till the last day, i only have to work on it for a day neuro5head

idle dune
#

I wanna get into running a local LLM for funsies, is it worth grabbing a used Tesla P40? They are like 200-300 bucks. I wanna make one to help my legal document wirting and creative writing. hmmThinkers

#

GrimmiNotLikeThis I don't even know where to start either.

olive sable
real sierra
#

im liking this

#

it feels very java-esque all of a sudden

#

the unity specific stuff has all felt super foreign

#

but now that im working in my little pseudo-singleton box again

#

it feels like home

idle dune
#

I know they are old as fuck and a modenr GPU would crush it

#

But 300 bucks for an AI accelerator card is not bad (imo).

true hemlock
#

3060 level performance

real sierra
#

im so exhausted

true hemlock
#

except it can't do fp16

real sierra
#

i find myself going back to code i wrote 5 mins ago and being totally confused at why i made it so bad

idle dune
true hemlock
#

if you don't really need the vram yeah but for 200-300 bucks a 3060 is overpriced imo

flint dome
#

@opaque wharf happy birthday 🥳 🎂 🎊 🎉

true hemlock
#

like really overpriced

idle dune
opaque wharf
opaque wharf
flint dome
opaque wharf
idle dune
flint dome
#

@real sierra HEY thats not funny you changed the solar and gas generator thingamajig to a transformer

idle dune
#

Dramatically cuts editing time down.

flint dome
#

also wheres the nya at the end

olive sable
real sierra
#

you'll have to check back later

idle dune
#

I think my highest so far for just legal analysis assignment sis 54 pages with 4 of those being sources. Despairge

#

Its a whole lotta words.

#

To say very little.

flint dome
# opaque wharf <:neuroD:1134963217676906606>

you have no idea how much my father loves using perplexity pro to draft financial reports for a BANK because the interns are worse at writing them (he's smart enough to ask him for public stuff only, no confidential)

burnt marsh
opaque wharf
flint dome
opaque wharf
flint dome
quick condor
real sierra
#

why do ceil and floor methods always return as floating-point types

#

i dont care about the edge cases just be convenient

opaque wharf
idle dune
real sierra
#

if someone gets NaN or Inf exp then im just deleting their account

#

non issue

idle dune
quick condor
#

A local model trained on legal English prose would be a decent first pass for editing. I wouldn't have it write things but I'd imagine it would be a good way to avoid dumb mistakes

idle dune
#

Your right, it wil make tons of mistakes and interprete all kinds of shit incorrctly. But if I can make a lawyer court binder in thirty minutes rather than three hours I rather that.

opaque wharf
quick condor
#

Well like I've seen enough reviews of legal briefs where there are basic mistakes that a model could catch. If it can reduce time spent looking for minor mistakes it would let you focus on the important things

quick condor
idle dune
# opaque wharf Why not pass it to hunspell or something?

Its not just grammar and spelling its formatting and logic. Its looking like for my career I am heading into criminal legal assistant which is going to require me to aid in the creation and documentation of my lawyers court proceeding. Many times the process is I research for them, they present my research, if I fuck up at any step then its a pathway for the opposition to argue and then its on me to fix that.

opaque wharf
#

I sure hope the logic part is triple checked if you use AI. Because that is what I am worried about the most

amber fractal
unkempt citrus
opaque wharf
unkempt citrus
#

allows you to implement exp multupliers too

idle dune
#

I'll give an example, while a rather extreme one, of the lengths that these write ups can get too.

amber fractal
unkempt citrus
#

I did genshin calcs for awhile

#

numbers wao

opaque wharf
amber fractal
#

My goal was to use that mod to actually not have the armor value be hardcapped by the formula, I'd like to think I suceeded in that regard.

amber fractal
real sierra
#

exp scaling will be exponential, with it increasing 10x every 20 levels

olive sable
opaque wharf
real sierra
#

this will make sure people dont grind early-game areas for xp

amber fractal
real sierra
#

and also means big number go up for flexing purposes

olive sable
#

Pick a curve. Any curve.
that specific wording makes me think of how magicians do card tricks

amber fractal
#

XP boring, I want to deal some damage

real sierra
#

ReallyMad save file important

amber fractal
#

Where is that desmos page

#

I already have one up there

real sierra
#

but i think save file done

#

sooo... ReallyInnocent

#

now we do ui work xdx

amber fractal
opaque wharf
olive sable
idle dune
# opaque wharf Yeah, I am just worried it will ended up like valve v rothschild

Thats a pretty valid concern ngl. But this is not going to be used for finding my case law and hallucinating case law that never existed. WestLaw, LexisNexis, and CanLii are pretty much the only supported digital law libraries that courts accept. Also I was never going to use it to "Find me x for citation." its a "Does my research and conclusion on X make sense.". Also as a sidenote I find there is no good AI for finding citations, even Claude, an AI that is marketed towards legal professionals is incredibly ass for finding citations and aiding in research. Smadge

amber fractal
idle dune
#

I would also need to find my firms LLM policy becuase thye might jsut say "No we don't allow it" and all this convo and planning is basically usless.

amber fractal
#

Why did past me allow for armor to go negative neurOMEGALUL

unkempt citrus
simple sky
#

So, tf is lambda calculus?

amber fractal
olive sable
patent walrus
#

any pc building nerds around

unkempt citrus
#

I know a bit

olive sable
real sierra
patent walrus
#

FUCK

simple sky
olive sable
#

as long as the teacher explains it well it might be fine

simple sky
real sierra
#

gg

simple sky
#

Word for word on the syllabus

real sierra
#

you're cooked

#

drop course

unkempt citrus
#

Welcometo university

#

teach yourself

simple sky
#

I mean. In the past 2 years no one has gotten less than a C

real sierra
#

if the university wants my money they can do their job

#

otherwise i will take my time and value elsewhere

#

their loss

olive sable
idle dune
olive sable
simple sky
#

How cooked am I, here’s all the topics:

lambda calculus, debruijn indicies, computation passing style, monadic programming and proofs

amber fractal
#

also for my 3rd attempt at it

olive sable
simple sky
olive sable
#

ok you're fucked

#

my discord reloaded for some reason neuroCatUuh

patent walrus
# patent walrus any pc building nerds around

okay so
broad strokes: i've got a huge ass PC and i want to downsize
i have an ATX motherboard (GIGABYTE X670E AORUS MASTER) and everything's stuffed into this case https://phanteks.com/product/evolv-x2-black/
when i first heard about the steam machine i thought "wow... it's such a cute cube, i wish my PC were that small... so i can carry it around places..." because sometimes i'm going between places for weeks at a time

unkempt citrus
#

Memory leak reload YEP

#

Smaller than ATX are miniATX and ITX

#

ITX also gets some custom case form factors

patent walrus
#

i'd like to keep my CPU, GPU, RAM, and PSU (if possible)
something something
AMD Ryzen 9 9950X
PNY XLR8 RTX 4090 VERTO EPIC-X RGB
64 GB - 2x G.Skill F5-6400J3239G32G (DDR5)
Corsair HX1200i

#

so i'm tryna think of a motherboard and case combination that would support those components

idle dune