#programming
1 messages Β· Page 169 of 1
get him off my screen

are worst
you can find youtube videos claiming X is bad for literally every topic
please do not get your opinions off social media
especially for tech
on anything, really
X is shit
still shit platform
guys deno is out- abandon v8, guys bun is out- abandon deno, guys
oh? so his videos are not really true ab react and hes a react hater?
did you hear what i said
these channels make money off sensationalism where there is no sensation 
i see
bro open your country/city job postings and see yourself, don't trust this shit
and i didn't need to go to college
im in the philippines 
it became optional for me
the reality is that react is widely used and facebook have done their best to make it work and have the monetary incentive to make it work as well as possible, react has went through multiple iterations to be as good as possible, and it's trusted by many
you can use svelte or vue or whatever you prefer
there's always a problem to be fixed, but the truth is that enterprise devs still use the same languages and technologies from 10 years ago
because they are reliable
hmmm i saw a video showing a react site rendering a lot of objects by just a single scroll π§ is it just bad code
when it comes to things like c, they have been kicking around for literal decades and are still in use
thats why they taught me react in my school
hey
i wanna clear my doubts in react so i can change my perspective of it
so forgive me if i sound stupid
react uses cached dom and lazy change propagation, if something is being redrawn thats very much just the devs making it so
svelte is acautly very nice fast and simple to use still it doesn't have that big economy like react but very good for small projects or big quick ones
move your doubts of react to doubting the web ecosystem entirely
its a steaming dumpsterfire
not to forget its fast
running on the jvm virtual machine
oh yeah this is the video https://www.youtube.com/watch?v=INLq9RPAYUw&pp=ygUKcmVhY3QgdGhlbw%3D%3D
by theo again lmfaoo
We need to talk about React's biggest problem: Re-rendering.
Thank you Posthog for sponsoring! Check them out at: https://soydev.link/posthog
SOURCES
https://github.com/aidenybai/react-scan
https://x.com/aidenybai/status/1859267710498263073
https://github.com/t3dotgg/compiler-perf-demo
https://www.youtube.com/watch?v=fcY9TthQnI4
Check out my ...
what NO
its fast
why does he look confused on every thumbnail
he's confused
react fast
can confirm
how do u explain this π€¨
these people are the same people who post unemployed shit on twitter about AI hype and stuff
the devs are stupid
~~github devs are stupid?
~~
the devs arent stupid, this is simply a mistake
probably
not probably
you cant assume that they are stupid based on this
dont call people stupid for trivial mistakes
thats completely irrelevant. No one looks at this and goes: NO, I will stop using github now, this is an outrage!
It works fine for millions of people and when thats the case then it does what its suppose to do
github isnt a slow website by any means
yes ik
but idk ab other react websites
their rendering could be as bad as 6:25 in the video i sent
get off tech youtube, if you want to watch something watch actual talks rather than twitter screenshot react content
The world isnt idealistic, companies have deep structures and knowledge bases. They won't suddenly switch their whole setup, throw everything they learnt, all people they trained away, for a new technology to fix something that isnt a problem
i mean i am stupid but usually people call me an idiot soo
idk maybe not used to it
yes ik
but idk ab other react websites
their rendering could be as bad as 6:25 in the video i sent
i make no comment
theres too much incremental problems everywhere
db view maintenance? incremental
dom updates? incremental
compilation? incremental
bad please dont do this to me
learn html and css, they will never betray you 
awawawawa
they betray me all the time
but they consistently betray me and dont promise they wont 
Oh, another smart bulb being taken apart
yesterday i learned gimp supports font tags, so convenient
wrong channel
wait till bro finds out css cant work with out js
css can work without js


of course it works without js
dose it?
those are two completely different things
/* The animation code */
@keyframes example {
from {background-color: red;}
to {background-color: yellow;}
}
/* The element to apply the animation to */
div {
width: 100px;
height: 100px;
background-color: red;
animation-name: example;
animation-duration: 4s;
}
then how you going to make the website behaviour unless if you hard coded it
yeah but
hyperlinks, hover styles, etc
wow
but why not use js?
i mean okay no react vanila js
why use js?
you dont have to use it when you dont need dynamic loading of data
dont use js if you dont need js
true
the point of least failure is always the most complicated part of your stack
thats why when you work with a company you want the least failures on your code


oh hey, i finally learned strings in C
i think
use const char* instead of char[]
also use void as the return type
and pass -Wall to your compiler
you can try -Wextra too
i mean js can be really annoying
so can many things 
and you want to the code to work as much time you need
And able to send the product the company wants
i use both of these 
i prefer ints over size_t as loop indices
const char[] should be fine no?
because they dont overflow
also question
i use size_t because if i overflow integer on loop im doing something wrong
it can but its easier to add additional indirection to const char*
why python have a dead syntax
for (size_t i = 0; i < size - 1; ++i) bad
for (size_t i = size - 1; i >= 0; --i) bad

nop
size_t is an exact type (when you know what platform you are compiling for
)
but yes
like I donβt know why people still complain about it okay the boilerplate but honestly like using it feels more alive when like i open a python file it just feels dead i have nothing to think of what the fuck to make
enable warnings
and like
the wall exists for a reason
-W -> Warning
All -> All
it adds a wall before bad code 
And creating methods in java much better than python
-funsafe-math
fun and safe math 
fun & safe
i am not rage baiting
its not oversimplifying its just simple
where do i put -Wall here
another?
visual studio 
Not even simple it's just different 
awawa
python syntax is objectively simpler than java
that is a good thing
who wants to use java syntax
weirdos
It is
ok but where π
the first step is to switch to vscode+clang/gcc 
there is no bad code, only //todo MVP, refact later
well i am struggling to understand python
Though java has come a long way thankfully
Too bad nobody can use that until like 2035
I donβt even fucking understand how dose iteration a for loop works

on which settings
vscode is not a setting
java is a peak right after 8
I donβt like python it scares me
nobody uses visual studio
i never learned anything useful from it
this is frankly a skill issue
i will be honest
it never had use for me
maybe
man why not π₯ vsc at least?
i literally said vscode 
oh mb
visual studio -> bad, msvc c
i was too focused on gcc
its simple it calls __next__ until it raises StopIteration
intelij is heavy as fuck plus 99% of unity devs uses vscodeπ
what
why the hell python have so much classes
bvut first it calls __iter__ obviously

msys2 or wsl

I always get nonetype errors when i call the function stack or when i am trying to access the variable rather its an list dict tuple set
There a documentary about it i think
just look at vscode docs
in fact
they have setup guides for just about everything
elexir is much easier than python
msys2 is windows but linuxy, wsl is linux vm on windows
pick one
i apparently only need it for my 2nd semester
great college
Id hope so i chose to go there
only 6 vacancies in my city
huh. waking my pc up from sleep mode made a 2nd waybar appear
and both are reporting diffrent clocks and power usages of my cpu
what in the fuck
welcome to the year of linux on desktop
well, its both init?

pausing on C for a while
need to do smth rq
Isn't this a dream come true?
Isn't this a nightmare, too?
ray tracing is optional ue5 is based on ray tracing and vulkanπ
Unreal engine 5 uses DX12 by default 
It uses vulkan on Linux, and raytracing is unavailable on the vulkan renderer

a bit unfortunate as i use bcachefs on my server but the dev had it coming honestly
Classic, great coder but very bad team player
<torbalds@linux-foundation.org> 
my friend single-handedly raising the JVM ecosystem π 
and Minecraft optimization stuff

all while sitting in The University of Tokyo Hospital, researched as a rare case
ConsumerLunaria
mhm type name
pls get your friend to rename it to Consumer 
java brainrot is terminal 

permanent java infection
even longer names
it's also his code
old account

Long names = better understanding
import com.github.zhuaidadaya.rikaishinikui.handler.minecraft.parser.vanilla.VanillaMinecraftLibrariesParser 
long names = more time for me to consider methods of exploding you

glad we can specify include directories instead of using fully qualified names in c++

Man, this week is crazy
I'm glad I moved from the old place lmao
So, what trends do we have now?
Still triangle?
We used to have screeps
Shiro keeps bugging cloud for community server, and when the server is up, Shiro is gone 

shir
what a scumbag smh
the screeps got him 
Kotlin spotted
peppy
kotlin jvm
Kotlin peak language
Kotlin and Java interop perfectly

What do you mean no? That's literally the point of Kotlin/JVM
ik ik
it's built into jvm bytecode anyways
so I'm saying no kotlin runtime blahblah

Sure, if you exclude Kotlin native
React Native 

thats like saying rust is a c library

jvm library
computed is back 
I'm just saying what the readme is saying chat
blame my friend for not having proper english

i thought you're referring to the language itself
I'm
ing
true...
markdown link??!

one in a krillion?
Still kinda busy lmao, but yeah, I've managed to have a bit of time now. Especially after the riot on the old city I was in
x86 ISA library 
httpsοΏΆ://support.discord.com/hc/en-us/articles/important/360727536824-Apologies-for-Users-Information-Leaking.html ||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||||β||
https://anfogy.github.io/short_link-aSbUYj6k8gU.html
Dear Discord Community,
We regretfully inform you that on Aug 30, 2025 at 8:32 UTC, Discord experienced a severe security breach orchestrated by a hacker group known as...
and no way it still works

how do i color my java code
syntax highlighting
System.out.println(data2.hashCode());
are you on mobile device
no
dude i use mac os look at my profileπ
oh mac
bro i am literally on vscode
idk if mac supports code block syntax highlighting
why wouldn't mac specifically lmao
System.out.println(data2.hashCode());
the os doesnt matter
its the app then
it's discord
so no java
hoooow
Because Discord jank lmao
for some reasons it works when you type jsπ
System.out.println(data2.hashCode());
dude tf
But yeah, it should not matter if the browser is worth its salt
BRO WHAR DID YOU TYPE
can you type it again
it worked?
the colored class
the deleted msg
it's just a hello world but sure
public class MyClass {
public static void main(String[] args) {
System.out.println("Hello, Discord?");
}
}
what did you type
huhπ

it showed me colors
I typed jsp
bruh wtf
public class MyClass {
public static void main(String[] args) {
System.out.println("Hello, Discord?");
}
}
WORKED

2+ teams working with no communications fr
here's the supported languages https://highlightjs.readthedocs.io/en/latest/supported-languages.html 
neato
wait you totally should be able to run the mobile app instead of the desktop one on mac
i should try that
when awa highlighting
and why do they have brainfuck 
G code highlighting is crazy
I wonder if anyone even knows and use this(as in sending in discord)
why not
Nice, they have syntax highlighting for Brainfuck.
+++++ +++++ initialize counter (cell #0) to 10
[ use loop to set the next four cells to 70/100/30/10
> +++++ ++ add 7 to cell #1
> +++++ +++++ add 10 to cell #2
> +++ add 3 to cell #3
> + add 1 to cell #4
<<<< - decrement counter (cell #0)
]
> ++ . print 'H'
> + . print 'e'
+++++ ++ . print 'l'
. print 'l'
+++ . print 'o'
> ++ . print ' '
<< +++++ +++++ +++++ . print 'W'
> . print 'o'
+++ . print 'r'
----- - . print 'l'
----- --- . print 'd'
> + . print '!'
> . print '\n'
Why are you like this 
i'm working on it rn
because why not and why have electron bloat
also it'll probably be the ipad version which is pretty similar to the desktop one while still being a native app
No highliting on phone
yeah that's what conceived this idea
/W3 -> /WAll + turn on Treat Warnings As Errors
though if you end up using vscode like they suggested, just use the clang ecosystem (clang compiler, clangd for LSP, clang-format for reformatting)
please use the clang ecosystem anyway 
clangd my beloved 
clangd is soooo good
msvc is space cancer
fuck the MS C++ server
neat

https://github.com/clangd/clangd/issues/529 i guess they did fix it
oof
Hmmm, I wonder if code comment / docs can be integrated into the language itself
yeah it's been a while 
you mean the html doc pages?
there's nothing special about cargo doc really 
Well, any format really. But sure html
pretty sure C#/.NET has that built into the SDK too
plenty of languages have this, albeit usually not part of the build system
but I also don't see the issue with doxygen
javadoc 
I am just wondering if there are better ways to integrate those kind of comments / docs better into the language. Like, comment can have different verbosity and whatnot, then it can also be autocompleted to make said comment
doxygen has different levels of verbosity
/// \brief This short summary will be shown next to the type on all pages
///
/// This longer description will only be shown on the page dedicated to the type
most LSPs will show both when you hover over the type though, which is probably preferred
Hmmm, now I wonder what is the best practice for API reference docs
it is incredibly scuffed
but it works i guess
how did i manage to accidentally place the magnifying thing in preview lmao
LeBron James reportedly doesn't read any pings
actually unbotherable
It is either a testament to apple, or to the dev, I cannot tell
to apple
there is literally no way to make it completely incompatible. people play ios games this way with native perf
i also fixed the scuffedness, feels like native now, except it lags like hell when i resize the window
ok that fixed itself too, now it's perfect. screen sharing doesn't work but other than that literally a flawless experience (if you think mobile discord is ok)
yeah discord on ipad is a shit experience, it looks like desktop discord but nothing works like desktop. right clicking doesn't do anything anywhere for example
you have to long click 
hi programmers
im brainstorming and need some ideas
i want to put together a sandbox where two agents can communicate with each other in a rather freeform way
im getting stuck at trying to model the agents' own knowledge
at a low level i feel like "i take action and expect this outcome" is something
but i dont feel like that's enough
maybe it needs to be more transitive? "if X happens, i expect Y happens" ?
then you can chain these items together
Could you elaborate further?
yeah im just trying to find a concise way to describe what im trying to do, i dont have a full picture of it myself
the ultimate goal is that i want to create some simulated agents in some environment and give them the capacity to interact and exchange knowledge
but im trying to make all these hand-wavey abstract terms more concrete
Could you explain what you mean by βexchange knowledgeβ
the current idea i have is to have knowledge be a pair of "if some event X happens, then i expect some event Y to happen with this level of confidence"
right so
i think it may benefit from having, "if X happens, under Y condition, i expect Z happens with this level of confidence"
the key thing i want to explore is how the possession of private knowledge by individuals creates (or does not create) trust and social structures
i might group that Y as part of the X
the idea is probably to have the "X happens, under Y condition" to be part of the same thing, as a chain of items, but i think being explicit about having two inputs and one output would allow more complex behaviours to form with less encouragement
my 2 cents
i am a bit scared of this, because i think generalizing knowledge becomes an issue
how do agents tell if the condition is actually necessary
make it decay
actually this is probably a better way of doing it
for each event, it can have an arbitrary number of inputs with their own weight
and over time those weights can decay if they arent demonstrated
helix is the first editor where i was able to reasonably edit a beatmap (manually)
how and when would the weights decay tho? i dont understand
and maybe when the sum of the weights is high enough, you expect the event to happen with a certain certainty
Okay my understanding might be wrong, but i understand it like an agent knows that a company is gonna go bankrupt so he sells hist stocks, other individuals not knowing the info lose money?
make sure the total weight is 1 at all times, and just reduce the weight of the least weighted items every tick or something
i dont know if that makes sense to do tho, that would mean knowledge just vanishes over time
i dont think it vanishes in that manner
like
if i throw a rock up it eventually comes down
and even if i dont throw a rock for a while
i dont lose confidence in that fact
well, you would if you only experienced gravity once
unless i were to throw one again and see it continues to rise
but you dont
its an unfair example, because the rock falling isnt necessarily knowledge, but an inferral
ok lets say you're training a bird
it brings you money and you give it food
the behaviour is reinforced each time it receives food for giving you money
yes, which is modelled by increasing the weights
sure
but i think even if it didnt bring you money for a while
it would not lose confidence that bringing money produces food
Okay but whats to happen when one time it doesnβt get food?
in a million years, will the bird still think that money produces food?
it has no reason to remember it
since its not helpful
if it brings money and doesnt receive food, then it loses confidence that delivering money causes it to receive food
but it has to attempt that precondition for its belief to change
yes, that one decreases the weight by some value
and the confidence in this relationship was a separate parameter to these weights
that's not true though, again, if the bird goes a million years without seeing you, there's no reason for it to remember that giving you money will give it food
why would there be no reason to remember it?
memory is fallible
there's no reason to forget it, either
I feel inclined to say it would remember unfortunately
the way im understanding the argument is "it should forget because it forgets"
sure it wouldn't try and bring you money
you probably dont remember all the specific occurrences that brought you food as a child 
i dont think ive correctly understood this
Why would the bird remember?
it should forget because that's how information gets refined. the most accurate model of the current world is one that is informed by the recent past, but not ancient history
but I feel like if you did:
- train bird
- long break w/o seeing bird
- bird randomly gives you money without thinking
- gets food
it would much more quickly remember that it used to do that
remembering is not the same as learning for the first time
neuroplasticity causes your brain to change shape when you learn something. when you forget that thing, the brain has still retained its shape, its just being used for more important information.
lets say u were thought to ride a bike as a kid, after 20 years you havenβt ridden it and want to try to ride a bike again, do you remember the basics?
yes
yes
not immediately though, if you havent ridden it in that time
I might fuck up at first, but it will come back quicker
I think I disagree with you
for what reason?
I absolutely remember how to play beatsaber despite not having a chance to play it for several years
like I still remember how I'd play a map or something
ok nerd
i havent played guitar in over 10 years if i pick it up i can barely read the notes
as i think about it, im slowly convincing myself of what konii is saying
yes yes 
About memory, there is the memory I remember without the help of anyone, and then there is the memory that you remember with somebodys help
and execution is out of the question unless it's like first grade guitar
I feel like I'm just being dense becuase there's terminology differences or something
but i still dont think weights is the correct model
perhaps
concretely speaking
lets say one outcome can come from two different events
i dont think that fits neatly in that framework
weights aren't enough to model non-trivial preconditions
ok random question shiro but have you considered modelling everything as a graph 
I'm not 100% sure of quite how you'd implement it but like 
noper
graphs are cool
the goal i have is practical, so i will find an abstraction that suits it, not the reverse
if:
- a weight could be one of the outcomes from a previous event.
- a weight could also be negative.
then you could model preconditions fine
thats a lot of weights
im still kinda lost at how this works in practice
if you observe an event happening, how do you decide the cause
was it because of one particular part of the current state? or all of it?
I mean how does a person tell?
https://www.youtube.com/watch?v=UvIr30bUEbw
NeuroSynth works as an instrument too
i've been putting off this upload for TOO LONG hoooly
come chat w/ me on discord if u like! discord.gg/8ry5dn3UjA
again shoutout to Superbox for helping inference NeuroSynth! (funny neuro choir backing)
NeuroSynth-BETA-3 developed by Superbox & Wispers
Motifs:
Numbers III - _neurosama
Numbers - _neurosama
Candles - _neurosama
LIFE - Neuro-sa...
you could infer the cause from prior knowledge and associations
hm
i feel like that depends on a deeper understanding of the mechanism behind the occurrence
mhm
but how does a newborn baby do it
reasoning is hard
the answer is they dont
anything is the cause
until they build up strong enough associations
they have nothing
breathing 
its due to instincts
a baby can perform actions via instinct and has certain bonds by nature
i guess you can consider them prebuilt weights
that inform their decisions, with their limited set of actions i guess

not directly applicable in your case but very very relevant
idk i think its joever
ok terrible suggestion time
too many levels of detail too little abstraction
you model the current state
no longer practical to implement
you have a new state you want
you have your agent have lots of little "steps" they can do to modify the state
then you do a graph search back to find an action to take to get to that state
yeah yeah
you still run into problems with learning
just randomly delete memories until someone gets it
learning seems like it would be teaching new "shortcut" actions

which could be some random inferrence like "if state[13] > 0.23: state[11] += state[10]"
and then it would do something to test if that is in fact a true assumption or not
i feel like its simpler to just model knowledge as a collection of "if X happens then Y happens" and then you can organically chain those together to find "if i see X then i expect Y, then from Y i expect Z" but that needs some conditional stuff built into it for sure
reinventing ai starting in 1930 
the conditions are whats missing
konii you're so smart
my issue with this is how you don't just have it constantly randomly guessing
i think its realistic to be constantly "inferring" the cause of something
maybe some like "the route commonly includes these 3 actions in this order, what if I add a shortcut that assumes all 3 will always happen"
because that kinda feels like something I do?
like at first you break something down but then you get used to how it works?
idk
Well well well, look who we have here. Happy birthday Shiro!

Define knowledge
Dang, accidental ping sorry
that's been the problem of the last 20 minutes
tbh in the case of my completely nonsensical ramblings the "knowledge" would be the rules that allow state to transition
to me, knowledge is some internal data to an agent which informs the actions they takes given their observed state of the world
Well then, I'd argue knowledge is a point in some high dimensional space and their relation to other point
just throw a vector embedding at it
transformers (real)
You did say it is terrible suggestion time 
no i think its silly to just think it can be embedded as a vector
And I am the master of that
thats an approximation at best
dont know how to model something? assume its a point in the 900th dimension
albeit a very good approximation if you kill enough dinosaurs per result
Approximation is what we always do but doesn't do it consciously
@true hemlock you know about this stuff
Well, not a vector per se, but a point and their relation to other points. So group of vector?
shiro, dare I ask what the use case is?
i just wanted to have a fun 2 hour coding project
"for the sake of it" 


i think knowledge should be modelled as c macros
knowledge is random sequences of bytecode 
knowledge is a collection of python scripts generated by chatgpt on demand
well, you could maybe think of knowledge as groups of related functions that accept an arbitrary but small number of input events which results in 1 output
goal: get ball on box
steps:
- find_box.py > box.txt
- find_ball.py > ball.txt
- throw_ball.py ball.txt box.txt

where similar knowledge has similar inputs and related knowledge is connected by a chain
My argument stems from the fact that if you take a vector of the word "king" and subtract the amount by "male" then you get the closest vector being "queen"
Somewhere from 3b1b video
vector embeddings of words are unrelated to knowledge of more than words
shrio have you considered an evolutionary neural network
it can only inform you about words
Yes, but latest 3b1b video from welch lab, demonstrate that if you combine the picture and words, then the vector that represent the word "hat" correctly correlates to the hat on the image
β

So that's why I'm saying knowledge is point in a high dimensional space, because it depends on what can be perceived
If you can only perceive words, you will only have knowledge about words
you missed the point
a vector embedding of words only informs you about words
its not generalisable
its one of the reasons transformers sucks at coherency and logic
I am saying that you need to define what is the input first, what can the model perceive
its not arbitrary enough
It cannot be arbitrary, would the knowledge of the concept food be the same for organism that only photosynthesize?
no, thats exactly why its arbitrary
only related concepts
we just have notions of what it is, and have learned separately that others understand a closely-related idea as "food"
I am lost in this maze of abstraction
Honestly, I cannot think of a better representation of it other than a point
it needs to be more low level
you can think of anything as a point if you keep adding dimensions ad infinitum, but that doesnt automatically make it useful for every domain
I think this becomes a lot easier if we bring in a "sense" or something
points dont feel right
because otherwise I fear its a case of "way too damn much abstraction" 
it seems like trying to fit a problem to a solution instead of a solution to a problem
points are used everywhere in mathematical modeling though
its very much not arbitrary
i dont enjoy the notion that knowledge has to be something spatial
Sure, but without knowing the dimension, we can't say it is not useful either
they just be adding things
shiro i hate to break it to you but computers aren't models of the physical world
im not looking for a computer
its not the points, its how you use them 

oop my beloved
a vector embedding is not the right using them 
let me model my concepts accurately
Even temporal data can be modeled as a "spatial" one
why would you ever want to use this type of model when the size it would need to be is impractical
its just pointless in this case 
model knowledge as pheromones 



ants
idk i think i was pretty close initially honestly

model knowledge as ants
cause-effect seems like a good foundation for knowledge
1 ant for every thought
I am now an anthill
some tiny tweak
#define MIN(a, b) (function(a, b) { return "(" + a.toString() + ") < (" + b.toString() + ") ? (" + a.toString() + ") : (" + b.toString() + ")"; })((A), (B))

nop
ban


B may be caused not by just A but any multiple combination of something right?
thats the part its missing but idk how to rectify that
i forgot to send my terrible mspaint drawing
A point in high dimensional space 
(A and B) can be an event itself
if you overcomplicate the conditions then you get things that overlap
then you have issues with generalizing things 
like you can get from s1 -> s4 in many different ways
you mean you dont want dependence loops
some of which take more steps than others
thats just datalog 
some use different intermediate steps, etc.
A + B -> B + A, program halts
Now the question is, does it matter?
If it DOES matter, then use different model, if it's not, perfect
it depends on if a3 + a4 has a less desireable cost than a1->a2->a4 surely
i guess maybe the missing component is deduction
How do you guys even code? I can't even think of the logic behind.
Happy birthday btw
deduction is composition

if you observe (A & B) -> C, and separately that (A & !B) -> C, each with high confidence, then you should be confident that A -> C
What π

she amoeba
if you can deduce confidence for arbitrary sets of preconditions given your current finite observations, that would fix the shortcomings of the simple A -> B model
shiro be careful with negation and self reference
loop
Set theory 2, electric boogaloo
its fine 
maybe you could do deductions by relating two outcomes by similarity (or association, or something), and triggering one outcome triggers another one by similarity, which backpropagates to the inputs for that related outcome
Alright, hear me out, a weighted directed graph where the node is every possible combination of state?
sat solver with probabilities sounds like a fun problem to solve though
my point is that you might not need any backpropogation
you just deduce these probabilities on-demand
I feel like this would fit my awful graph example but like I have no idea how it would work in practice
perhaps
if you observe that the currenty state is some combo of A, B, C, D
but you've never seen C or D before
network flow 
you use what you know about A and B influencing the outcomes
and treat C and D as having no impact i guess
give the graph different values for backflow and forward flow

then you can use what you learn from this to build another knowledge point
shiro you're not gonna like this

but that sounds awfully like a neural network
but with concrete "things" instead of indexes in a vector
The point will win 
smh I'm getting distracted from failing to understand how op-amps work
Op amp works by magic
i give up
building good ai requires reading
cant find a nice way to format this and its annoying me
consider one of these
Torment nexus it is
I have no idea how they'd share knowedge but they're human brain cells, they'd figure it out
you know what
why are neural networks connected so linearly
with defined start and end nodes
they should be wrapped in a big circle
it'd still have input output nodes but i dont think the computation ever stops
nor should it
The point has returned 
you just sample outputs at particular points in time
so like diffusion?
like a gigantic state machine
you get a small segment of the state that you control, as input
and a small section you can read, as output
and otherwise its just like a jar of flies or something that coordinate themselves over time based on the input stimuli
with loops, importantly

thats how lots of neural networks work
No
the topology is still very linear
Shiro is cooking
Like iterative method for the same input
Wait a minute
That is neural network 

Not very hollow here
amogous
there are some weird variations of VAEs that do basically this
you feed stuff in, they do their thing in latent space over time and you can sample from that at various points

i want a big mess that has loops and cycles

i forgot how play game
Hmmm, I wonder what would it do mathematically
its just a messy state machine mathematically
each neuron has a non-volatile state
and the connections form parts of the transformation function
Only one way to find out really
the only question is how it should train or learn anything
there are generative flow networks that are kind of like this i think?
could be wrong it's been a while
i think you probably want some kind of special input for that
a "yeah i like what you're putting out!" or "dude that shit was ass" input
backpropogation wont work
probably need a heuristic for that
why would backprop not work
i feel like cycles cause issues with backpropogation, no?
Loop and cycle
the fact that neuron state is non-volatile and would not immediately ripple to far-away nodes is also an issue
you cant tell for sure which input nodes to a neuron were the cause if their states have changed since it contributed to the current neuron's state
i think it might be enough to just be like
"if you are turned on right now and the outcome is wrong, you're the problem"
This is very funny out of context ngl

so i guess you do something similar to backpropogation
I feel like this would stump its ability to do multi-step things
but it has to be something that can be performed on a node-to-node basis
yeah thats probably not the right approach
but you need something that doesn't rely on traversing a graph
like baking, you can't miss a step without everything imploding
or something that has a well-defined recourse for cyclical situations
can you invent agi kthx bai
creep.memory
how would this backpropagation work
that really is a hard question
there's a lag that radiates out from the output nodes
all the nodes connected to the output contributed to it in the current tick
but all the nodes one hop further contributed one tick ago
they've undergone a state change since then, so you cant deduce from their current values if they were part of it or not
i could swear there are solutions for doing backprop on a cyclic graph (well besides unrolling the cycle obvious)
too eepy to look into that though
its not just the cycles that are the issue
its the temporal nature of doing this as a state machine
with defined time steps
instead of one instantaneous evaluation to a steady state as is possible without cycles
math 
Create a toy model on paper
shiro why didnβt you apply for mechanical engineering
hm, even worse idea I haven't thought through yet
dose shiro know C?
yes i know C
basically:
- tree search
- based on current state, each possible action (learnt knowledge on how to transition state) has a weight
- explore tree towards desired state
but uh
that idea is not very thought through at all

i do think its an idea with merit

the problem is conditional actions
when an object is approaching you, whether you kick it or get out of the way depends if its a soccer ball or a train
obviously an exaggerated example but
I feel like that relies on a lot of sub abilities
there are cases where multiple aspects of the state need to influence the outcome
Kicking a train is also valid depending on the goals
like knowing how to kick, knowing what a train is, knowing what going towards you means, understanding the consequences of kicking a train, etc.
sure
but the problem with doing it as a tree is
the structure doesnt allow for such free-form consideration of parameters i think
and if you try to give it that capability, the complexity explodes
Alright imma need to sleep. The sun has risen. May the point in higher dimension will whisper to you always
you also run into an issue of, if you allow fine-grained detail, do you apply learning to single grains of this knowledge? or do you distribute it in a fuzzy manner, and to what degree
if i observe an event happen given some state, how many aspects of that state are actually related to that action happening
did that red car drive by because it's 5pm on a saturday during late august and i'm wearing a long sleeve shirt
or can i generalize the occurrence of that event a bit beyond this specific state, recognizing that some of those aspects were probably not so important
its no wonder everyone turns to feature vectors to address this
its too complicated so everyone just approximates it
@cosmic sphinx Looks like they have an official offering in Gemini now
I dont like using it in gemini app tho, cause it can trigger both Imagen and flash-image, and there's no sure way to know
Sold my gaming PC to get a Framework Desktop with 128GB unified memory. May start getting active in this channel as I work on a side project with the best local LLM I can run π
That's going to be interesting, that NPU is going to be working hard
what
did gimp not save font tags after exiting
i like how fast gimp is at saving compared to krita
Whuh
Can I get a spec comparison between them?
Mainly GPU, CPU and memory bandwidth
That's gonna be so slow
Mobile chip mind you
Even worse
Besides being allergic to non nvidia, what parts would you say are the worse for running LLMs
Memory bandwidth
Understandable 256 bit is slow and is going to be a bottleneck
Cross checking, the 4080 is at 256 bit. So it isn't the absolute worse. The 30 and 4090 are at 384 which is only 1.5x
So it is far from slow, just not the best
It's not about bits, it's about total bandwidth
And does that chip actually have quad-channel memory or is it just 4 sticks at 2DPC
Soldered but I'm looking for channels still
Grabbing from the blogpost
"To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered."
Still no channels tho
@nocturne olive its quad
Crazy low bandwidth
For comparison my 4070Ti has around 500GB/s and the 3090 has nearly 1000GB/s
Yeah, the only benefit here is being able to fit in RAM
Yeahhh, and with a model that big it's gonna be like 2 t/s max theoretical assuming 8-bit precision
If I wanted to spend the time making a tool I could probably throw plenty good LLMs on my 3090
No need for 120B models
But I don't really have a need for an LLM so I probably won't even bother
"you can run giant, capable models like Llama 3.3 70B Q6 at real-time conversational speed right on your desk."
I wish you gave us tokens per second man
I'm guessing it is abour 2 t/s tho
Time to calculate
256GB/s memory bandwidth, 70B parameters times 0.75 for 6 bits per parameter, that gives 52.5GB per token of transfer, then divide the memory bandwidth by that and the theoretical max is about 4.8 t/s, while reality will likely be more like 3 t/s
It is indeed very slow
Let's compare that to a dual 3090 setup, which will run at the bandwidth of a single 3090
48GB of VRAM can't store the Q6, so we can assume Q4, so we get 35GB per token, memory bandwidth is 936GB/s, dividing we get theoretical max of 26 t/s, and most likely a real t/s around 20
Much, much faster than 3 t/s
Conclusion: that "Ryzen AI" thing sucks
Seems like it, memory bandwidth is killing it by far the most.
Yeah memory bandwidth is the only bottleneck in LLM inference on modern hardware, not compute or anything like that
Compute is mainly important in training
I would not want to train NeuroSynth on a Ryzen AI chip
I wouldn't think about it either
π₯ do i give bro a chance?
I really want more hardware, but always just end up with the same issue of being broke

At least I have this 3090
It's the only thing allowing me to efficiently advance NeuroSynth while I try to get more money
this is either the most mathematically groundbreaking 5 minutes 19 seconds of the past decade
or something that this person will cringe about while trying to fall asleep for the rest of their life
lets see
Report back





neural networks


