#programming

1 messages Β· Page 169 of 1

tender river
#

techtubers

sage crag
#

get him off my screen

tender river
uneven pulsar
noble zodiac
#

you can find youtube videos claiming X is bad for literally every topic

tender river
#

please do not get your opinions off social media

tender river
#

on anything, really

sage crag
#

not X the platform

uneven pulsar
sage crag
lament igloo
uneven pulsar
sage crag
lament igloo
#

i see

fierce nova
#

bro open your country/city job postings and see yourself, don't trust this shit

uneven pulsar
uneven pulsar
#

it became optional for me

tender river
#

you can use svelte or vue or whatever you prefer

sage crag
#

there's always a problem to be fixed, but the truth is that enterprise devs still use the same languages and technologies from 10 years ago

#

because they are reliable

lament igloo
sage crag
#

when it comes to things like c, they have been kicking around for literal decades and are still in use

uneven pulsar
lament igloo
#

i wanna clear my doubts in react so i can change my perspective of it

#

so forgive me if i sound stupid

tender river
uneven pulsar
sage crag
#

its a steaming dumpsterfire

uneven pulsar
#

running on the jvm virtual machine

noble zodiac
#

why does he look confused on every thumbnail

sage crag
uneven pulsar
sage crag
#

can confirm

sage crag
#

thanks

lament igloo
uneven pulsar
# sage crag thanks

these people are the same people who post unemployed shit on twitter about AI hype and stuff

uneven pulsar
lament igloo
#

~~github devs are stupid? nub ~~

sage crag
uneven pulsar
sage crag
#

you cant assume that they are stupid based on this

#

dont call people stupid for trivial mistakes

noble zodiac
# lament igloo how do u explain this 🀨

thats completely irrelevant. No one looks at this and goes: NO, I will stop using github now, this is an outrage!
It works fine for millions of people and when thats the case then it does what its suppose to do

sage crag
#

github isnt a slow website by any means

lament igloo
#

yes ik

#

but idk ab other react websites
their rendering could be as bad as 6:25 in the video i sent

tender river
#

get off tech youtube, if you want to watch something watch actual talks rather than twitter screenshot react content

noble zodiac
#

The world isnt idealistic, companies have deep structures and knowledge bases. They won't suddenly switch their whole setup, throw everything they learnt, all people they trained away, for a new technology to fix something that isnt a problem

uneven pulsar
lament igloo
tender river
#

theres too much incremental problems everywhere

#

db view maintenance? incremental

#

dom updates? incremental

#

compilation? incremental

#

bad please dont do this to me

noble zodiac
#

learn html and css, they will never betray you SMILE

tender river
#

awawawawa

sage crag
#

they betray me all the time

#

but they consistently betray me and dont promise they wont neuroPogHD

brisk laurel
proper rapids
#

Oh, another smart bulb being taken apart

tender river
#

yesterday i learned gimp supports font tags, so convenient

uneven pulsar
uneven pulsar
lament igloo
#

ahem anywyas

#

back to C

tender river
uneven pulsar
tender river
noble zodiac
#

of course it works without js

uneven pulsar
noble zodiac
#

those are two completely different things

lament igloo
uneven pulsar
#

then how you going to make the website behaviour unless if you hard coded it

tender river
uneven pulsar
#

but why not use js?

#

i mean okay no react vanila js

sage crag
#

why use js?

tender river
#

you dont have to use it when you dont need dynamic loading of data

sage crag
#

dont use js if you dont need js

uneven pulsar
sage crag
#

the point of least failure is always the most complicated part of your stack

uneven pulsar
sage crag
opaque sigil
lament igloo
#

oh hey, i finally learned strings in C

i think

tender river
#

use const char* instead of char[]

#

also use void as the return type

#

and pass -Wall to your compiler

#

you can try -Wextra too

uneven pulsar
sage crag
#

so can many things neuroKufufu

uneven pulsar
#

and you want to the code to work as much time you need

#

And able to send the product the company wants

sage crag
tender river
#

i prefer ints over size_t as loop indices

sage crag
tender river
uneven pulsar
#

also question

sage crag
#

i use size_t because if i overflow integer on loop im doing something wrong

tender river
uneven pulsar
#

why python have a dead syntax

noble zodiac
#

I'm more of an cstdint.h enjoyer

#

give me exact types

tender river
sage crag
#

nop

sage crag
#

but yes

uneven pulsar
#

like I don’t know why people still complain about it okay the boilerplate but honestly like using it feels more alive when like i open a python file it just feels dead i have nothing to think of what the fuck to make

lament igloo
#

😭

tender river
uneven pulsar
#

and like

tender river
#

the wall exists for a reason

sage crag
noble zodiac
#

it adds a wall before bad code SMILE

uneven pulsar
#

And creating methods in java much better than python

tender river
#

-funsafe-math

fun and safe math neuroPogHD

sage crag
#

fun & safe

uneven pulsar
#

i am not rage baiting

sage crag
#

no i can see that

#

its something else

uneven pulsar
#

i think java better in terms of syntax i swear

#

like i hate oversimplifying syntax

sage crag
#

its not oversimplifying its just simple

lament igloo
#

where do i put -Wall here

maiden geyser
tender river
opaque sigil
#

Not even simple it's just different neuroCry

tender river
#

awawa

sage crag
#

that is a good thing

#

who wants to use java syntax

#

weirdos

opaque sigil
#

It is

lament igloo
tender river
fierce nova
#

NeuroClueless there is no bad code, only //todo MVP, refact later

uneven pulsar
opaque sigil
#

Though java has come a long way thankfully

#

Too bad nobody can use that until like 2035

uneven pulsar
opaque sigil
tender river
fierce nova
#

neuroHypers java is a peak right after 8

tender river
#

its a program

#

so are gcc and clang

uneven pulsar
lament igloo
#

so ur telling me

#

to switch to gcc ?

tender river
uneven pulsar
#

i never learned anything useful from it

sage crag
#

i will be honest

uneven pulsar
uneven pulsar
lament igloo
tender river
#

i literally said vscode vedalCry

lament igloo
#

oh mb

sage crag
#

visual studio -> bad, msvc c

lament igloo
#

i was too focused on gcc

tender river
uneven pulsar
uneven pulsar
tender river
lament igloo
#

also how do i use gcc

opaque sigil
tender river
lament igloo
brisk laurel
#

how do i use 7zip

uneven pulsar
uneven pulsar
tender river
uneven pulsar
#

in fact

tender river
#

they have setup guides for just about everything

uneven pulsar
#

elexir is much easier than python

sage crag
#

pick one

olive sable
#

okp i apparently only need it for my 2nd semester

sage crag
#

great college

olive sable
#

Id hope so i chose to go there

fierce nova
olive sable
#

huh. waking my pc up from sleep mode made a 2nd waybar appear

#

and both are reporting diffrent clocks and power usages of my cpu

#

what in the fuck

noble zodiac
#

welcome to the year of linux on desktop

olive sable
#

isnt linux fun

#

always new problems challanges to solve

sage crag
#

this is not a "linux" problem

#

this is a "my choice" problem

olive sable
#

well, its both init?

sage crag
#

not really

#

ive never had an issue like that

olive sable
lament igloo
#

need to do smth rq

uneven pulsar
#

should we tell him?

#

sam

maiden geyser
olive sable
#

ue5 can gp suck it

uneven pulsar
warped narwhal
#

Unreal engine 5 uses DX12 by default evilStare

#

It uses vulkan on Linux, and raytracing is unavailable on the vulkan renderer

tender river
#

a bit unfortunate as i use bcachefs on my server but the dev had it coming honestly

fierce nova
#

Classic, great coder but very bad team player

opaque sigil
#

<torbalds@linux-foundation.org> mhm

midnight sigil
#

my friend single-handedly raising the JVM ecosystem πŸ™ neuroSob

#

and Minecraft optimization stuff

#

all while sitting in The University of Tokyo Hospital, researched as a rare case

sage crag
#

mhm type name

#

pls get your friend to rename it to Consumer FOCUS

midnight sigil
#

he loves long ass class names

#

have no idea why

opaque sigil
#

java brainrot is terminal neuro7

sage crag
#

permanent java infection

midnight sigil
#

even longer names

#

it's also his code

#

old account

fierce nova
#

neuroHypers Long names = better understanding

midnight sigil
#

import com.github.zhuaidadaya.rikaishinikui.handler.minecraft.parser.vanilla.VanillaMinecraftLibrariesParser mhm

sage crag
midnight sigil
#

glad we can specify include directories instead of using fully qualified names in c++

opaque wharf
#

Man, this week is crazy

#

I'm glad I moved from the old place lmao

#

So, what trends do we have now?

#

Still triangle?

sage crag
#

trangle

#

!trianglelinux

#

nop

#

it ded

opaque wharf
#

Is my score still the lowest?

midnight sigil
#

what's more

sage crag
#

wawawa

#

awa

opaque wharf
#

We used to have screeps

midnight sigil
#

shiro's on it, somewhere

opaque wharf
#

Shiro keeps bugging cloud for community server, and when the server is up, Shiro is gone evilWheeze

midnight sigil
sage crag
#

shir

midnight sigil
#

what a scumbag smh

opaque sigil
#

the screeps got him neuroSadge

midnight sigil
#

shirt has been used for an upgrade

tender river
#

awa

#

eepy

nocturne olive
midnight sigil
midnight sigil
nocturne olive
#

Kotlin peak language

midnight sigil
#

it's built to be a java library

#

no kotlin runtime

nocturne olive
#

Kotlin and Java interop perfectly

midnight sigil
nocturne olive
#

What do you mean no? That's literally the point of Kotlin/JVM

midnight sigil
#

ik ik

#

it's built into jvm bytecode anyways

#

so I'm saying no kotlin runtime blahblah

nocturne olive
#

Sure, if you exclude Kotlin native

opaque wharf
#

React Native neuroTroll

midnight sigil
tender river
#

thats like saying rust is a c library

opaque sigil
midnight sigil
rigid snow
#

computed is back neuroHypers

midnight sigil
#

I'm just saying what the readme is saying chat

#

blame my friend for not having proper english

tender river
midnight sigil
maiden geyser
midnight sigil
#

I have an idea

opaque wharf
opaque wharf
midnight sigil
# midnight sigil I have an idea

httpsοΏΆ://support.discord.com/hc/en-us/articles/important/360727536824-Apologies-for-Users-Information-Leaking.html ||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||||​||
https://anfogy.github.io/short_link-aSbUYj6k8gU.html

#

and no way it still works

uneven pulsar
#

how do i color my java code

midnight sigil
#

syntax highlighting

uneven pulsar
#
  System.out.println(data2.hashCode());    
uneven pulsar
#

look

midnight sigil
uneven pulsar
#
    System.out.println(data2.hashCode());    
#

bruh

#

i wrote java

midnight sigil
#

are you on mobile device

uneven pulsar
#

dude i use mac os look at my profile😭

midnight sigil
#

oh mac

uneven pulsar
midnight sigil
#

idk if mac supports code block syntax highlighting

uneven pulsar
#
  print("test")
#

python works but why java not

patent walrus
uneven pulsar
#
  System.out.println(data2.hashCode());    
uneven pulsar
#

its the app then

midnight sigil
uneven pulsar
#

bru

#

how do i make it in java

midnight sigil
#

so no java

uneven pulsar
#

hoooow

opaque wharf
uneven pulsar
#

for some reasons it works when you type js😭

  System.out.println(data2.hashCode());    
#

dude tf

opaque wharf
#

But yeah, it should not matter if the browser is worth its salt

midnight sigil
#

yea no

#

jsp and java doesn't work

#

it's supposed to but nah

uneven pulsar
#

BRO WHAR DID YOU TYPE

midnight sigil
#

discord

#

what

uneven pulsar
midnight sigil
#

it worked?

uneven pulsar
#

the colored class

uneven pulsar
midnight sigil
#

it's just a hello world but sure

#
public class MyClass {
    public static void main(String[] args) {
        System.out.println("Hello, Discord?");
    }
}
midnight sigil
#

it worked?

#

what

uneven pulsar
#

bro

midnight sigil
#

I'm on android I couldn't know

#

no colors on android

uneven pulsar
#

huh😭

midnight sigil
uneven pulsar
midnight sigil
#

I typed jsp

uneven pulsar
#

bruh wtf

#
  public class MyClass {
    public static void main(String[] args) {
        System.out.println("Hello, Discord?");
    }
}
#

WORKED

midnight sigil
#

why do you need syntax highlighting in discord

midnight sigil
#

2+ teams working with no communications fr

midnight sigil
opaque sigil
#

neato

rigid snow
#

i should try that

midnight sigil
#

when awa highlighting

#

and why do they have brainfuck MyHonestReaction

#

G code highlighting is crazy

#

I wonder if anyone even knows and use this(as in sending in discord)

rigid snow
#

why not

midnight sigil
#

ok maybe some home-made CNC maniac would

shadow sinew
#
+++++ +++++             initialize counter (cell #0) to 10
[                       use loop to set the next four cells to 70/100/30/10
    > +++++ ++              add  7 to cell #1
    > +++++ +++++           add 10 to cell #2 
    > +++                   add  3 to cell #3
    > +                     add  1 to cell #4
    <<<< -                  decrement counter (cell #0)
]                   
> ++ .                  print 'H'
> + .                   print 'e'
+++++ ++ .              print 'l'
.                       print 'l'
+++ .                   print 'o'
> ++ .                  print ' '
<< +++++ +++++ +++++ .  print 'W'
> .                     print 'o'
+++ .                   print 'r'
----- - .               print 'l'
----- --- .             print 'd'
> + .                   print '!'
> .                     print '\n'
rigid snow
#

i'm working on it rn

#

because why not and why have electron bloat

#

also it'll probably be the ipad version which is pretty similar to the desktop one while still being a native app

ivory tiger
#

No highliting on phone

rigid snow
#

yeah that's what conceived this idea

pulsar edge
#

though if you end up using vscode like they suggested, just use the clang ecosystem (clang compiler, clangd for LSP, clang-format for reformatting)

sage crag
#

please use the clang ecosystem anyway neuroSadge

opaque sigil
#

clangd my beloved neuroPogHD

pulsar edge
#

clangd is soooo good

sage crag
#

msvc is space cancer

pulsar edge
#

fuck the MS C++ server

opaque sigil
#

now if they could fix their doxygen parsing that'd be great neuroSadge

pulsar edge
#

neat

sage crag
opaque sigil
pulsar edge
opaque wharf
#

Hmmm, I wonder if code comment / docs can be integrated into the language itself

pulsar edge
#

?

#

wdym

opaque sigil
opaque wharf
#

Rust

#

They can generate the docs integrated into the language ecosystem

pulsar edge
#

you mean the html doc pages?

opaque sigil
#

there's nothing special about cargo doc really enub

opaque wharf
pulsar edge
#

pretty sure C#/.NET has that built into the SDK too

opaque sigil
#

plenty of languages have this, albeit usually not part of the build system

pulsar edge
#

but I also don't see the issue with doxygen

opaque wharf
#

I am just wondering if there are better ways to integrate those kind of comments / docs better into the language. Like, comment can have different verbosity and whatnot, then it can also be autocompleted to make said comment

pulsar edge
#

doxygen has different levels of verbosity

#
/// \brief This short summary will be shown next to the type on all pages
/// 
/// This longer description will only be shown on the page dedicated to the type
#

most LSPs will show both when you hover over the type though, which is probably preferred

opaque wharf
#

Hmmm, now I wonder what is the best practice for API reference docs

rigid snow
#

but it works i guess

#

how did i manage to accidentally place the magnifying thing in preview lmao

maiden geyser
#

LeBron James reportedly doesn't read any pings

rigid snow
#

based

#

i just read the notification and never mark it read

#

that's why

maiden geyser
#

actually unbotherable

opaque wharf
rigid snow
#

there is literally no way to make it completely incompatible. people play ios games this way with native perf

#

i also fixed the scuffedness, feels like native now, except it lags like hell when i resize the window

#

ok that fixed itself too, now it's perfect. screen sharing doesn't work but other than that literally a flawless experience (if you think mobile discord is ok)

#

yeah discord on ipad is a shit experience, it looks like desktop discord but nothing works like desktop. right clicking doesn't do anything anywhere for example

#

you have to long click evilDeadge

real sierra
#

hi programmers

#

im brainstorming and need some ideas

#

i want to put together a sandbox where two agents can communicate with each other in a rather freeform way

#

im getting stuck at trying to model the agents' own knowledge

#

at a low level i feel like "i take action and expect this outcome" is something

#

but i dont feel like that's enough

#

maybe it needs to be more transitive? "if X happens, i expect Y happens" ?

#

then you can chain these items together

dapper kernel
real sierra
#

yeah im just trying to find a concise way to describe what im trying to do, i dont have a full picture of it myself

#

the ultimate goal is that i want to create some simulated agents in some environment and give them the capacity to interact and exchange knowledge

#

but im trying to make all these hand-wavey abstract terms more concrete

dapper kernel
real sierra
#

the current idea i have is to have knowledge be a pair of "if some event X happens, then i expect some event Y to happen with this level of confidence"

sage crag
real sierra
#

the key thing i want to explore is how the possession of private knowledge by individuals creates (or does not create) trust and social structures

real sierra
sage crag
#

my 2 cents

real sierra
#

how do agents tell if the condition is actually necessary

sage crag
#

actually this is probably a better way of doing it

#

for each event, it can have an arbitrary number of inputs with their own weight

#

and over time those weights can decay if they arent demonstrated

tender river
#

neuroPogHD helix is the first editor where i was able to reasonably edit a beatmap (manually)

real sierra
sage crag
dapper kernel
sage crag
real sierra
#

i dont know if that makes sense to do tho, that would mean knowledge just vanishes over time

sage crag
#

does it not?

real sierra
#

i dont think it vanishes in that manner

#

like

#

if i throw a rock up it eventually comes down

#

and even if i dont throw a rock for a while

#

i dont lose confidence in that fact

sage crag
#

well, you would if you only experienced gravity once

real sierra
#

unless i were to throw one again and see it continues to rise

sage crag
#

but you dont

#

its an unfair example, because the rock falling isnt necessarily knowledge, but an inferral

real sierra
#

ok lets say you're training a bird

#

it brings you money and you give it food

#

the behaviour is reinforced each time it receives food for giving you money

sage crag
#

yes, which is modelled by increasing the weights

real sierra
#

sure

#

but i think even if it didnt bring you money for a while

#

it would not lose confidence that bringing money produces food

sage crag
#

that's the point though, it's a while

#

assume the hypothetical bird can live forever

dapper kernel
#

Okay but whats to happen when one time it doesn’t get food?

sage crag
#

it has no reason to remember it

#

since its not helpful

real sierra
#

if it brings money and doesnt receive food, then it loses confidence that delivering money causes it to receive food

#

but it has to attempt that precondition for its belief to change

sage crag
#

yes, that one decreases the weight by some value

real sierra
#

and the confidence in this relationship was a separate parameter to these weights

sage crag
real sierra
sage crag
#

memory is fallible

real sierra
#

there's no reason to forget it, either

trim valve
real sierra
trim valve
#

sure it wouldn't try and bring you money

sage crag
real sierra
#

i dont think ive correctly understood this

dapper kernel
#

Why would the bird remember?

sage crag
trim valve
#

but I feel like if you did:

  • train bird
  • long break w/o seeing bird
  • bird randomly gives you money without thinking
  • gets food
    it would much more quickly remember that it used to do that
sage crag
#

remembering is not the same as learning for the first time

#

neuroplasticity causes your brain to change shape when you learn something. when you forget that thing, the brain has still retained its shape, its just being used for more important information.

dapper kernel
real sierra
#

yes

trim valve
#

yes

sage crag
#

not immediately though, if you havent ridden it in that time

trim valve
#

I might fuck up at first, but it will come back quicker

sage crag
#

that isnt remembering though

#

that's relearning

#

its different

trim valve
#

I think I disagree with you

sage crag
#

for what reason?

trim valve
#

I absolutely remember how to play beatsaber despite not having a chance to play it for several years

#

like I still remember how I'd play a map or something

sage crag
#

that's because beatsaber is trivially simple

trim valve
#

enub ok nerd

tender river
#

i havent played guitar in over 10 years if i pick it up i can barely read the notes

real sierra
#

as i think about it, im slowly convincing myself of what konii is saying

sage crag
#

yes yes deliv

dapper kernel
#

About memory, there is the memory I remember without the help of anyone, and then there is the memory that you remember with somebodys help

tender river
#

and execution is out of the question unless it's like first grade guitar

trim valve
#

I feel like I'm just being dense becuase there's terminology differences or something

real sierra
#

but i still dont think weights is the correct model

sage crag
#

perhaps

real sierra
#

concretely speaking

#

lets say one outcome can come from two different events

#

i dont think that fits neatly in that framework

#

weights aren't enough to model non-trivial preconditions

trim valve
#

ok random question shiro but have you considered modelling everything as a graph enub

#

I'm not 100% sure of quite how you'd implement it but like glueless

real sierra
#

noper

trim valve
#

graphs are cool

real sierra
#

the goal i have is practical, so i will find an abstraction that suits it, not the reverse

sage crag
real sierra
#

thats a lot of weights

sage crag
#

yes neuroPogHD

#

numbers

real sierra
#

im still kinda lost at how this works in practice

#

if you observe an event happening, how do you decide the cause

#

was it because of one particular part of the current state? or all of it?

trim valve
#

I mean how does a person tell?

nocturne olive
#

https://www.youtube.com/watch?v=UvIr30bUEbw
NeuroSynth works as an instrument too

i've been putting off this upload for TOO LONG hoooly

come chat w/ me on discord if u like! discord.gg/8ry5dn3UjA

again shoutout to Superbox for helping inference NeuroSynth! (funny neuro choir backing)
NeuroSynth-BETA-3 developed by Superbox & Wispers

Motifs:
Numbers III - _neurosama
Numbers - _neurosama
Candles - _neurosama
LIFE - Neuro-sa...

β–Ά Play video
sage crag
#

hm

real sierra
trim valve
#

mhm

sage crag
#

but how does a newborn baby do it

trim valve
#

reasoning is hard

sage crag
#

anything is the cause

#

until they build up strong enough associations

real sierra
#

but then what do babies even have for knowledge

#

how do you start

sage crag
#

they have nothing

trim valve
#

breathing neuroPogHD

real sierra
#

but how do they build even a single link of stuff

#

how are they not perma dumb

sage crag
#

a baby can perform actions via instinct and has certain bonds by nature

#

i guess you can consider them prebuilt weights

#

that inform their decisions, with their limited set of actions i guess

tender river
#

awawa shiro go learn prolog and datalog

#

its relevant

sage crag
tender river
#

not directly applicable in your case but very very relevant

real sierra
#

idk i think its joever

trim valve
#

ok terrible suggestion time

real sierra
#

too many levels of detail too little abstraction

trim valve
#

you model the current state

real sierra
#

no longer practical to implement

trim valve
#

you have a new state you want

#

you have your agent have lots of little "steps" they can do to modify the state

real sierra
#

then you do a graph search back to find an action to take to get to that state

#

yeah yeah

#

you still run into problems with learning

sage crag
#

just randomly delete memories until someone gets it

trim valve
#

learning seems like it would be teaching new "shortcut" actions

sage crag
trim valve
#

which could be some random inferrence like "if state[13] > 0.23: state[11] += state[10]"

#

and then it would do something to test if that is in fact a true assumption or not

real sierra
#

i feel like its simpler to just model knowledge as a collection of "if X happens then Y happens" and then you can organically chain those together to find "if i see X then i expect Y, then from Y i expect Z" but that needs some conditional stuff built into it for sure

tender river
#

reinventing ai starting in 1930 neuroPogHD

trim valve
#

i.e. weight it less on the graph if it isn't actually true

sage crag
#

throw transformers at it

#

problem solve

#

wahaha

real sierra
#

the conditions are whats missing

tender river
#

konii you're so smart

trim valve
sage crag
#

i think its realistic to be constantly "inferring" the cause of something

trim valve
#

maybe some like "the route commonly includes these 3 actions in this order, what if I add a shortcut that assumes all 3 will always happen"

#

because that kinda feels like something I do?

#

like at first you break something down but then you get used to how it works?

#

idk

opaque wharf
#

Well well well, look who we have here. Happy birthday Shiro!

real sierra
opaque wharf
#

Dang, accidental ping sorry

real sierra
#

that's been the problem of the last 20 minutes

trim valve
#

tbh in the case of my completely nonsensical ramblings the "knowledge" would be the rules that allow state to transition

real sierra
#

to me, knowledge is some internal data to an agent which informs the actions they takes given their observed state of the world

opaque wharf
#

Well then, I'd argue knowledge is a point in some high dimensional space and their relation to other point

real sierra
#

classic just throw a vector embedding at it

opaque wharf
#

You did say it is terrible suggestion time neuroHypers

real sierra
#

no i think its silly to just think it can be embedded as a vector

opaque wharf
#

And I am the master of that

real sierra
#

thats an approximation at best

sage crag
#

dont know how to model something? assume its a point in the 900th dimension

real sierra
#

albeit a very good approximation if you kill enough dinosaurs per result

opaque wharf
opaque wharf
trim valve
#

shiro, dare I ask what the use case is?

real sierra
#

i just wanted to have a fun 2 hour coding project

sage crag
real sierra
trim valve
sage crag
#

i think knowledge should be modelled as c macros

real sierra
#

knowledge is random sequences of bytecode thumbs_up

trim valve
#

knowledge is a collection of python scripts generated by chatgpt on demand

real sierra
#

knowledge is when chatgpt api query

sage crag
#

well, you could maybe think of knowledge as groups of related functions that accept an arbitrary but small number of input events which results in 1 output

trim valve
#

goal: get ball on box
steps:

  • find_box.py > box.txt
  • find_ball.py > ball.txt
  • throw_ball.py ball.txt box.txt
    neuroPogHD
sage crag
opaque wharf
#

My argument stems from the fact that if you take a vector of the word "king" and subtract the amount by "male" then you get the closest vector being "queen"

#

Somewhere from 3b1b video

sage crag
trim valve
#

reallyinnocent shrio have you considered an evolutionary neural network

sage crag
real sierra
#

ReallyMad neural networks

#

they are lacking

#

feature vectors are not the future

sage crag
#

elvyn smart and not lacking

#

she know thing

#

how she do it

opaque wharf
tender river
opaque wharf
#

So that's why I'm saying knowledge is point in a high dimensional space, because it depends on what can be perceived

#

If you can only perceive words, you will only have knowledge about words

sage crag
#

a vector embedding of words only informs you about words

#

its not generalisable

#

its one of the reasons transformers sucks at coherency and logic

opaque wharf
#

I am saying that you need to define what is the input first, what can the model perceive

sage crag
#

its not arbitrary enough

opaque wharf
#

It cannot be arbitrary, would the knowledge of the concept food be the same for organism that only photosynthesize?

sage crag
#

no, thats exactly why its arbitrary

real sierra
#

^

#

there is no global concept "food"

#

not even between you and me

sage crag
#

only related concepts

real sierra
#

we just have notions of what it is, and have learned separately that others understand a closely-related idea as "food"

trim valve
#

enub I am lost in this maze of abstraction

opaque wharf
real sierra
#

it needs to be more low level

tender river
#

you can think of anything as a point if you keep adding dimensions ad infinitum, but that doesnt automatically make it useful for every domain

trim valve
#

I think this becomes a lot easier if we bring in a "sense" or something

real sierra
#

points dont feel right

trim valve
#

because otherwise I fear its a case of "way too damn much abstraction" catdespair

real sierra
#

it seems like trying to fit a problem to a solution instead of a solution to a problem

tender river
#

its very much not arbitrary

rigid snow
real sierra
#

i dont enjoy the notion that knowledge has to be something spatial

opaque wharf
rigid snow
real sierra
#

it doesnt feel like a realistic abstraction

#

just a computationally convenient one

tender river
#

shiro i hate to break it to you but computers aren't models of the physical world

real sierra
#

im not looking for a computer

sage crag
#

its not the points, its how you use them FOCUS

real sierra
tender river
#

oop poisoning

real sierra
#

oop my beloved

sage crag
real sierra
#

let me model my concepts accurately

opaque wharf
real sierra
#

dont need c++ shitfuckery in the way

sage crag
#

its just pointless in this case deliv

#

model knowledge as pheromones ermFishLermFishR

trim valve
sage crag
#

ants

real sierra
#

idk i think i was pretty close initially honestly

sage crag
trim valve
#

model knowledge as ants

real sierra
#

cause-effect seems like a good foundation for knowledge

sage crag
#

1 ant for every thought

real sierra
#

A -> B

#

its just missing something

trim valve
#

I am now an anthill

real sierra
#

some tiny tweak

tender river
trim valve
real sierra
#

sorry chayleaf

#

konii's orders

sage crag
tender river
opaque wharf
real sierra
trim valve
#

i forgot to send my terrible mspaint drawing

opaque wharf
#

A point in high dimensional space neuroHypers

sage crag
real sierra
#

if you overcomplicate the conditions then you get things that overlap

trim valve
sage crag
real sierra
trim valve
#

like you can get from s1 -> s4 in many different ways

sage crag
trim valve
#

some of which take more steps than others

tender river
trim valve
#

some use different intermediate steps, etc.

sage crag
#

A + B -> B + A, program halts

opaque wharf
#

If it DOES matter, then use different model, if it's not, perfect

trim valve
#

it depends on if a3 + a4 has a less desireable cost than a1->a2->a4 surely

real sierra
#

i guess maybe the missing component is deduction

golden hazel
#

How do you guys even code? I can't even think of the logic behind.

tender river
#

i dont think

golden hazel
sage crag
sage crag
real sierra
#

if you observe (A & B) -> C, and separately that (A & !B) -> C, each with high confidence, then you should be confident that A -> C

golden hazel
tender river
sage crag
tender river
#

awawa

real sierra
#

if you can deduce confidence for arbitrary sets of preconditions given your current finite observations, that would fix the shortcomings of the simple A -> B model

tender river
sage crag
#

loop

opaque wharf
real sierra
sage crag
opaque wharf
#

Alright, hear me out, a weighted directed graph where the node is every possible combination of state?

tender river
#

sat solver with probabilities sounds like a fun problem to solve though

real sierra
#

my point is that you might not need any backpropogation

#

you just deduce these probabilities on-demand

trim valve
#

I feel like this would fit my awful graph example but like I have no idea how it would work in practice

sage crag
#

perhaps

real sierra
#

if you observe that the currenty state is some combo of A, B, C, D

#

but you've never seen C or D before

real sierra
#

you use what you know about A and B influencing the outcomes

#

and treat C and D as having no impact i guess

sage crag
real sierra
#

then you can use what you learn from this to build another knowledge point

trim valve
#

shiro you're not gonna like this

sage crag
trim valve
#

but that sounds awfully like a neural network

#

but with concrete "things" instead of indexes in a vector

opaque wharf
#

The point will win neuroHypers

trim valve
#

smh I'm getting distracted from failing to understand how op-amps work

opaque wharf
real sierra
#

i give up

tender river
#

building good ai requires reading

real sierra
#

cant find a nice way to format this and its annoying me

tender river
#

building bad ai requires if conditions

real sierra
#

all approaches seem wrong

#

code feels ill-suited to actually represent this

trim valve
#

consider one of these

tender river
#

code doesnt exist

opaque wharf
#

Torment nexus it is

trim valve
real sierra
#

you know what

#

why are neural networks connected so linearly

#

with defined start and end nodes

#

they should be wrapped in a big circle

real sierra
#

it'd still have input output nodes but i dont think the computation ever stops

#

nor should it

opaque wharf
#

The point has returned neuroHypers

real sierra
#

you just sample outputs at particular points in time

trim valve
#

so like diffusion?

real sierra
#

like a gigantic state machine

#

you get a small segment of the state that you control, as input

#

and a small section you can read, as output

#

and otherwise its just like a jar of flies or something that coordinate themselves over time based on the input stimuli

#

with loops, importantly

sage crag
#

to the beat

tender river
#

thats how lots of neural networks work

opaque wharf
real sierra
#

No

#

there's setups where two neural nets go back and forth

#

but its not the same

real sierra
#

the topology is still very linear

opaque wharf
#

Shiro is cooking

#

Like iterative method for the same input

#

Wait a minute

#

That is neural network neurOMEGALUL

sage crag
#

holow night

#

spacebar

trim valve
opaque wharf
sage crag
opaque sigil
real sierra
#

neural networks are a stupid sheet of neurons

#

i dont want a sheet with layers

opaque sigil
#

you feed stuff in, they do their thing in latent space over time and you can sample from that at various points

tender river
real sierra
#

i want a big mess that has loops and cycles

opaque sigil
tender river
#

never played silksong

#

orry

#

never played hoolow night

sage crag
#

i forgot how play game

opaque wharf
real sierra
#

its just a messy state machine mathematically

#

each neuron has a non-volatile state

#

and the connections form parts of the transformation function

opaque wharf
#

Only one way to find out really

real sierra
#

the only question is how it should train or learn anything

opaque sigil
#

there are generative flow networks that are kind of like this i think?

#

could be wrong it's been a while

real sierra
#

i think you probably want some kind of special input for that

#

a "yeah i like what you're putting out!" or "dude that shit was ass" input

#

backpropogation wont work

#

probably need a heuristic for that

opaque sigil
#

why would backprop not work

real sierra
#

i feel like cycles cause issues with backpropogation, no?

opaque wharf
real sierra
#

the fact that neuron state is non-volatile and would not immediately ripple to far-away nodes is also an issue

#

you cant tell for sure which input nodes to a neuron were the cause if their states have changed since it contributed to the current neuron's state

opaque sigil
#

brute force search neuroPogHD

#

who needs to finish training anyway

real sierra
#

i think it might be enough to just be like

#

"if you are turned on right now and the outcome is wrong, you're the problem"

opaque wharf
real sierra
#

(keep that in context please)

#

i am not known for my elegant wording

opaque wharf
real sierra
#

so i guess you do something similar to backpropogation

trim valve
real sierra
#

but it has to be something that can be performed on a node-to-node basis

real sierra
#

but you need something that doesn't rely on traversing a graph

trim valve
#

like baking, you can't miss a step without everything imploding

real sierra
#

or something that has a well-defined recourse for cyclical situations

trim valve
#

can you invent agi kthx bai

real sierra
#

my pile of neurons will succeed at any task

opaque wharf
#

Hmmm, can a pile of screeps model knowledge?

#

Back to ants neuroPogHD

real sierra
#

creep.memory

#

how would this backpropagation work

#

that really is a hard question

#

there's a lag that radiates out from the output nodes

#

all the nodes connected to the output contributed to it in the current tick

#

but all the nodes one hop further contributed one tick ago

#

they've undergone a state change since then, so you cant deduce from their current values if they were part of it or not

opaque sigil
#

i could swear there are solutions for doing backprop on a cyclic graph (well besides unrolling the cycle obvious)

#

too eepy to look into that though

real sierra
#

its not just the cycles that are the issue

#

its the temporal nature of doing this as a state machine

#

with defined time steps

#

instead of one instantaneous evaluation to a steady state as is possible without cycles

opaque sigil
#

math neuroPogHD

opaque wharf
#

Create a toy model on paper

uneven pulsar
trim valve
#

hm, even worse idea I haven't thought through yet

uneven pulsar
#

dose shiro know C?

real sierra
#

yes i know C

trim valve
#

basically:

  • tree search
  • based on current state, each possible action (learnt knowledge on how to transition state) has a weight
  • explore tree towards desired state
#

but uh

#

that idea is not very thought through at all

real sierra
#

i do think its an idea with merit

trim valve
real sierra
#

the problem is conditional actions

#

when an object is approaching you, whether you kick it or get out of the way depends if its a soccer ball or a train

#

obviously an exaggerated example but

trim valve
#

I feel like that relies on a lot of sub abilities

real sierra
#

there are cases where multiple aspects of the state need to influence the outcome

opaque wharf
trim valve
#

like knowing how to kick, knowing what a train is, knowing what going towards you means, understanding the consequences of kicking a train, etc.

real sierra
#

sure

#

but the problem with doing it as a tree is

#

the structure doesnt allow for such free-form consideration of parameters i think

#

and if you try to give it that capability, the complexity explodes

opaque wharf
#

Alright imma need to sleep. The sun has risen. May the point in higher dimension will whisper to you always

real sierra
#

you also run into an issue of, if you allow fine-grained detail, do you apply learning to single grains of this knowledge? or do you distribute it in a fuzzy manner, and to what degree

#

if i observe an event happen given some state, how many aspects of that state are actually related to that action happening

#

did that red car drive by because it's 5pm on a saturday during late august and i'm wearing a long sleeve shirt

#

or can i generalize the occurrence of that event a bit beyond this specific state, recognizing that some of those aspects were probably not so important

#

its no wonder everyone turns to feature vectors to address this

#

its too complicated so everyone just approximates it

sick owl
#

@cosmic sphinx Looks like they have an official offering in Gemini now

cosmic sphinx
sick owl
#

That's a bit shit

#

Though I imagine its pretty obvious when you get imagen

ruby siren
#

Sold my gaming PC to get a Framework Desktop with 128GB unified memory. May start getting active in this channel as I work on a side project with the best local LLM I can run πŸ˜„

amber fractal
#

That's going to be interesting, that NPU is going to be working hard

tender river
#

neuroPogHD gimp 3 crashed

#

still the gimp i know

tender river
#

what vedalCry did gimp not save font tags after exiting

tender river
#

i like how fast gimp is at saving compared to krita

nocturne olive
#

Mainly GPU, CPU and memory bandwidth

nocturne olive
#

That's gonna be so slow

amber fractal
#

Mobile chip mind you

nocturne olive
#

Even worse

amber fractal
nocturne olive
#

Memory bandwidth

amber fractal
#

Understandable 256 bit is slow and is going to be a bottleneck

#

Cross checking, the 4080 is at 256 bit. So it isn't the absolute worse. The 30 and 4090 are at 384 which is only 1.5x

#

So it is far from slow, just not the best

nocturne olive
#

It's not about bits, it's about total bandwidth

#

And does that chip actually have quad-channel memory or is it just 4 sticks at 2DPC

amber fractal
#

Soldered but I'm looking for channels still

#

Grabbing from the blogpost
"To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered."

#

Still no channels tho

#

@nocturne olive its quad

nocturne olive
#

Crazy low bandwidth

#

For comparison my 4070Ti has around 500GB/s and the 3090 has nearly 1000GB/s

amber fractal
#

Yeah, the only benefit here is being able to fit in RAM

nocturne olive
#

Yeahhh, and with a model that big it's gonna be like 2 t/s max theoretical assuming 8-bit precision

#

If I wanted to spend the time making a tool I could probably throw plenty good LLMs on my 3090

#

No need for 120B models

#

But I don't really have a need for an LLM so I probably won't even bother

amber fractal
#

"you can run giant, capable models like Llama 3.3 70B Q6 at real-time conversational speed right on your desk."
I wish you gave us tokens per second man

#

I'm guessing it is abour 2 t/s tho

nocturne olive
#

Time to calculate
256GB/s memory bandwidth, 70B parameters times 0.75 for 6 bits per parameter, that gives 52.5GB per token of transfer, then divide the memory bandwidth by that and the theoretical max is about 4.8 t/s, while reality will likely be more like 3 t/s

#

It is indeed very slow

#

Let's compare that to a dual 3090 setup, which will run at the bandwidth of a single 3090
48GB of VRAM can't store the Q6, so we can assume Q4, so we get 35GB per token, memory bandwidth is 936GB/s, dividing we get theoretical max of 26 t/s, and most likely a real t/s around 20

#

Much, much faster than 3 t/s

#

Conclusion: that "Ryzen AI" thing sucks

amber fractal
#

Seems like it, memory bandwidth is killing it by far the most.

nocturne olive
#

Yeah memory bandwidth is the only bottleneck in LLM inference on modern hardware, not compute or anything like that

#

Compute is mainly important in training

#

I would not want to train NeuroSynth on a Ryzen AI chip

amber fractal
#

I wouldn't think about it either

real sierra
#

πŸ₯€ do i give bro a chance?

nocturne olive
amber fractal
nocturne olive
#

At least I have this 3090

#

It's the only thing allowing me to efficiently advance NeuroSynth while I try to get more money

real sierra
#

this is either the most mathematically groundbreaking 5 minutes 19 seconds of the past decade

#

or something that this person will cringe about while trying to fall asleep for the rest of their life

#

lets see

amber fractal
#

Report back

pulsar edge
#

its got 207 whole views

#

that means its going viral