#[WIP] Neuro's Desktop (An integration for letting neuro use a computer)

1 messages · Page 2 of 1

timber basin
#

also, pull new changes from upstream

plucky marlin
#

i know whats happening, its not attached at all

timber basin
#

I just commited something

#

It should fix the incorrect pipeline now

plucky marlin
#

neuroCry it will overwrite my prints

#

what is incorrect pipeline

#

ok i'll pull

timber basin
#

From the trace function, it was going from Neuro Backend <> Nakurity Backend <> Intermediary

#

The Nakurity Client was just left out

#

I also removed the debug trace function for the commits

plucky marlin
#

fuck i wanted to save my changes but looks like i backed up wrong files

timber basin
#

to enable it, there's these debug configs
add line to it

plucky marlin
#

what is this

#

it wasnt here yesterday, i remember it was none

#

i need it to be assigned to actual client

#

or attached.. idk how to correctly word it

#

now it doesnt start neuroCry why did i pull

#

i cant just have new pulls every 30 minutes which cancel everything i learned neuroCry

#

it just makes new problems, i have to fix this and not pull until i actually get something useful

#

its like climbing the ladder and jumping down midway

#

all progress lost

#

how do i fix this

#

do i need to install some new packages

timber basin
#

And also comment these, I forgot

timber basin
#

gimme a moment

#

There was a miracle fix function that was being used

plucky marlin
#

looks like this miracle lost another 20 minutes for me neuroCry

timber basin
#

You can either scroll to the top of main.py

#

and remove NakurityRequirement

#

Or pull the new changes

timber basin
#

I should've responded faster

plucky marlin
#

i pulled

timber basin
#

Okay it should work now

plucky marlin
#

noo we need to separately solve something and not just add infinite amount of pulls and traces

timber basin
#

I hope

plucky marlin
#

no pulls until something is achieved

timber basin
#

Neuro Backend receives something now

#

with those code updates

#

I used the miracle function with OpenAI to fix it lol

#

recursive fixing

#

worked, apparently

#

But we have a new issue

#

uhmmmm

#

The tests pass

#

but the Neuro Relay needs to be tested with a more complicated neuro integration

plucky marlin
#

for me neuro backend just receves x2 less messages on connection now

#

nakurity backend says something failed

timber basin
#

since it is kinda hard to tell if jippity would actually work correctly

plucky marlin
#

and integration received message that integration failed

#

???????????

timber basin
#

Screenshot of it all?

plucky marlin
#

"hey man you failed haha"

timber basin
#

For Randy you would need to manually respond to that forced action

plucky marlin
#

old vs new

#

old had 4 lines new has 2

#

oh wait

timber basin
plucky marlin
#

it just doesnt send the other part

timber basin
#

Yeah that was just for context for neuro

#

Try using jippity

#

Uhm, jippity said something is received

#

tho I need to fix that invaild error now

plucky marlin
#

now retry queue in intermediary doesnt run at all

#

where do i put my test messages

#

intermediary has no access to client and cannot send anything to neuro

#

we must fix that first

timber basin
#

Are you sure...?

│  │  │  │  │  │  │  │  │  │  ╭▶ retry_queue() intermediary.py:302 [ 5.455s]
│  │  │  │  │  │  │  │  │  │  │ args: self=<src.dev.nakurity.intermediary.Intermediary object at 0x0...
│  │  │  │  │  │  │  │  │  │  :boom: StopIteration:   intermediary.py:302
│  │  │  │  │  │  │  │  │  │  │ → while True:
│  │  │  │  │  │  │  │  │  │  │ • locals: self=<src.dev.nakurity.intermediary.Intermediary object at 0x0...
│  │  │  │  │  │  │  │  │  │  │ → if not self.queue.empty():
│  │  │  │  │  │  │  │  │  │  │ • locals: self=<src.dev.nakurity.intermediary.Intermediary object at 0x0...
│  │  │  │  │  │  │  │  │  │  │ → await asyncio.sleep(5)
│  │  │  │  │  │  │  │  │  │  │ • locals: self=<src.dev.nakurity.intermediary.Intermediary object at 0x0...
│  │  │  │  │  │  │  │  │  │  ╰↩ return <Future pending> [ 5.479s]
#

tracer said something different

timber basin
#

Its 40 pages for a reason.

#

but I just look at the latest logs, its not that long anymore

timber basin
#

OOOH RIGHT

#

I made intermediary disconnect clients

#

I forgot about that

plucky marlin
#

so server can access this function of intermediary

#

the problem is, nakurity client is not actually attatched to client

timber basin
#

I think its attached

#

I attached it to NakurityLink

timber basin
#

And I assume by client you mean the neuro backend, right?

plucky marlin
#

can you explain what linker is

#

it didnt exist yesterday

plucky marlin
timber basin
#

Its a class that directly links Nakurity Client and Intermediary

plucky marlin
#

nakurity client connects to neuro backend (to server)

timber basin
#

I added it since from yesterday, it wasn't connected to eachother

#

this was done directly, not via websocekts or servers

plucky marlin
#

ok ok its what we need

#

the only problem is it doesnt seem to work

timber basin
#

really?

#

what was the errors?

plucky marlin
#

no errors

timber basin
#

Oh, yup I see the issue

plucky marlin
#

is this init function ever called?

timber basin
#

I forgot to add some methods for communications

timber basin
plucky marlin
#

this calls init?

timber basin
#

Yes

#

and passes the Nakurity Client to it

#

client is nakurity client

#

init is basically the constructor for a class

#

I am fixing some methods

#

Neuro API expects something else

plucky marlin
#

hmm right it all seems to be attached

timber basin
plucky marlin
#

but this function isnt getting called for some reason

timber basin
#

I'm cross-referencing the payload relays

timber basin
#

Lemme check

plucky marlin
#

here how i call it

plucky marlin
timber basin
#

oooh

plucky marlin
plucky marlin
timber basin
#

yeah, that does the same thing as forward to neuro. but just more nested

plucky marlin
#

lets compare

#

this is actual client who actually sends to neuro and works

#

this is object who is accessed from intermediary

#

neurOMEGALUL they are the same

#

so why does it not work neuroWhat

timber basin
#

I have no idea either

#

But I am fixing something, and it seems to be working on my end. Tho I haven't commited it yet

#

Its the greatest thing ever, fixing something. But you don't know what you're fixing

#

I have no idea how or why my brain does this

timber basin
#

I might have an idea

#

is it how its called?

#

Class Intermediary expects Class NakurityLink for self.nakurity_outbound_client

plucky marlin
#

here how its called.

im getting a feeling that its because of functions having different types of arguments

#

its "dict" in the intermediary but "bytes" in the client

timber basin
#

did you trying typing it with dict(payload) ?

#

that should force it to be a dict

#

atleast. when you send it to send_to_neuro func

plucky marlin
#

do i leave client function like this

#

it seems like it works properly when its "bytes", other parts do it normally

timber basin
plucky marlin
#

i want to do some loop in client to see if client is actually online and works

timber basin
plucky marlin
#

maybe client dies midway and discards commands

#

will neuro print something on invalid command from client

#

i think i got it

#

we are calling function with different type of argument

#

its calling non-existent function or smth

#

what is dict?
is it a string?

timber basin
#

A dict is a nested json object

#

Neuro expects something like this

#

this is for a direct implementation into the neuro API

#

could be helpful for the Nakurity Client

plucky marlin
#

client expects bytes

#

we need to convert dict to bytes so client can send it

#

something something base64

timber basin
#

how did it start expecting bytes.....

#

I designed it to expect a dict... what...

plucky marlin
#

it actually does this for its own transmissions

#

can we do something similar to dict?

#

encode it

timber basin
#

Yeah we can

#

json.dumps and stuff

plucky marlin
#

let me try

#

hmm no effect

#

let me try make client accept dict and transform it himself

#

still doesnt work, function doesnt print

#

let me try send it from main..

#

fuck

timber basin
#

what happened?

#

Are you okay?

#

Wait no- ignore that last part

#

pretend I never sent that

plucky marlin
#

it didnt let me save main file

#

i clicked overwrite

#

it removed last pull changes

timber basin
#

that's sadge

plucky marlin
#

ok so i pull

timber basin
#

Though I did fix something

plucky marlin
#

and then start new vscode

#

so it doesnt have shit copy in its memory

timber basin
#

Randy received something!

#

Idk what I did, I just asked the miracle function to do its thing :p

plucky marlin
#

ok new pull killed everything

#

first i get this frozen numpy error

#

oh its 2 lines

plucky marlin
#

who sends this? integration?

#

how does it go? integration->server->intermediary->client->neuro?

timber basin
timber basin
#

Miracle function was a miracle

plucky marlin
#

why does this miracle function not work for me

#

and what does it actually do?

#

where is this function located?

#

i mean, how can function make it go through server and intermediary and client

timber basin
plucky marlin
#

i can see this function just sending it to everyone

timber basin
#

Its basically vibecoding, cheating ik. But it worked.
It basically recursively called openai until it was fixed

plucky marlin
timber basin
#

Caused me 500 usd lol

timber basin
plucky marlin
#

polls integration, then sends result to client intermediary and server separately

#

so the whole structure of program is bypassed

#

because intermediary still has no way to send things to neuro

#

or client

timber basin
#

I'll roll out a new commit you could check it at the github repo page if you wanna see

plucky marlin
#

idk you can just describe it if you dont want to share it

timber basin
#

I meant the fixed code

timber basin
plucky marlin
#

oh

#

do i pull or no

timber basin
#

vibecoding, cheating. ik

timber basin
#

gimme a moment

timber basin
#

uhmmm, hopefully it should work on your end

#

Its 3am again, my sleep schedule is great!

plucky marlin
#

?? how do i just overwrite it

#

do i have to move my files first

timber basin
#

Stash the changes

plucky marlin
#

i dont get it when i open stash it only lets me discard or restore

#

is stash like "one slot"

timber basin
#

it's in the branch section

timber basin
plucky marlin
#

i dont but i found the button

timber basin
#

uhmmm git stash?

plucky marlin
#

it seems it actually fixed it

#

intemediary now uses "send_event" of client which works

timber basin
#

yeah

#

I'm gonna go now, as its 4am

plucky marlin
#

neuroWave bye bye

timber basin
#

I think, I may have accidentally pushed the debug tracer to the main branch, oopsies!

timber basin
#

Now back to integrating neuro-relay into neuro-os

#

The issue has been fixed

#

We might need to test neuro-os more to see if actual relevant context is being passed to the neuro backend

steel dagger
#

this is where unit tests are supposed to help...

timber basin
#

really?

#

I have been adding unit tests already

#

just haven't pushed them to main yet

timber basin
timber basin
steel dagger
#

actually wait

#

how are you determining what is relevant context

timber basin
#

yeah! that's what I meant with relevant context being actually passed to neuro!

timber basin
steel dagger
#

yeah

#

but if you are saying "if actual relevant context is being passed"

#

how are you determining what is relevant at any given time?

timber basin
steel dagger
#

that sounds like not a good idea but... sure?

timber basin
#

I'm not sure either, what else to do then

#

any suggestions?

steel dagger
#

idk

sterile tundra
#

Linux support when impXdx

timber basin
#

But that assumes from that the windows api has an unintended benefit of also supporting linux

#

I'm not sure about other modules like the UI regionalization stuff I'm building rn

timber basin
#

Status on the neuro-os project

neuro-relay is now working.
I'm currently working on neuro-os's regionalization for user interfaces

timber basin
#

oh right! this. Can I ask a bit more about what is DOS? I'm not sure what it is, and maybe I could add it?

#

cassitly said start and then left the job on me lol

timber basin
# timber basin

this could also be something like.

This is such an awesome suggestion
Tag: For Nakurity

Or something like that

#

now I'm stuck, I need some suggestions to know, what to do next.

#

Soooo, @wheat reef can you add the WIP tag for this now? I just realized you were online

wheat reef
#

huh-

#

I was supposed to be set to offline, but okay!

#

[WIP] Neuro Windows Integration

#

There

timber basin
#

ty!

#

Who hardcoded this in this shared environment? @wheat reef was this you????

wheat reef
#

uhhhhhmmmmmmmm, it could be niwatori.....?

timber basin
#

okay...

#

But I still think its u lol

#

its pretty funny overall, so I don't mind

#

atleast some things are still true

timber basin
#

Uhmmmm, sooo. Here is a conclusion as of 21/10/2025

Status of the project

Regionalized UI elemental context has been implemented for neuro-os (basically, neuro gets regional contexts of UI elements)

  • Neuro OS still has to implement the neuro relay intermediary connection
    (This is so that neuro os can host and manage neuro-relay via a custom management ui for vedal ig)
    Configuration management across all neuro-os dependencies.
    This project might actually start relying on a bunch of windows specific packages now:
    I lost the url to the image I was gonna attach, sorry.
timber basin
#

I'm gonna go now, goodnight guys!

plucky marlin
#

what happens if you attach randy to it when its done neurOMEGALUL can it randomly do something bad

timber basin
timber basin
#

I could do that

timber basin
#

I'm also thinking of adding an automatic testing mode for Nakurity Backend in neuro-relay.

timber basin
#

Update on jippity testing

apparently, neuro-os broke while I was sleeping, and now today. Jippity doesn't want to work with neuro-os

#

I assume something rolled back on my pc or something

timber basin
timber basin
#

is this a good idea? @plucky marlin , anyone?

plucky marlin
#

I dont get it

timber basin
#

basically openai

#

but free

#

I'ma use it for neuro-os to get vision-to-text working

plucky marlin
#

I really dont know how that is going to work

timber basin
#

its a session based system where you don't need an api key. but a session connection

plucky marlin
#

Are there no local vision to text ai

timber basin
#

there are

#

but I am too lazy to implement it, and my pc is old af.

plucky marlin
#

Idk about that one sounds bad to me

#

How is it free

timber basin
#

We'll see ig

#

there is no credit cost

plucky marlin
#

Is it limited amount of tokens

timber basin
#

I am paying lol

#

No limited tokens, just ratelimiting

#

Its gonna run on my home server

#

like everything

#

but its gonna forwarded to the internet

#

since I am thinking of using that for prod

plucky marlin
#

Whats the difference between ratelimiting and token limit

timber basin
#

idk

#

token limit is like a limit of how many tokens u can use

#

and ratelimit is how much you can send messages to the api per a set amount of time

plucky marlin
#

So if i use it too much it will say "sorry out of tokens wait 3h"

#

How is that not a bad thing

timber basin
#

Noo

#

its gonna be like 120,000 tokens per 1 minute ig. Thats the ratelimit ima set

#

since neuro-os does use alot of tokens if im gonna use it for context updates

plucky marlin
#

And what do you mean "you are going to pay"

#

So if you ever stop paying it will stop working

timber basin
#

its going to run on my home server, didnt I say that?

#

but yeah!

plucky marlin
#

Oh

timber basin
#

is this a good idea?

plucky marlin
#

So it doesnt work without internet

#

Bad to me

timber basin
#

yes, and the server

timber basin
plucky marlin
#

Because it becomes dependant on stability of your internet

timber basin
#

My internet is fast, 23 gb

#

for that server alone

plucky marlin
#

And my internet

#

But it isnt that bad

#

You can try i guess

timber basin
#

i guess

plucky marlin
#

Also security risks and shit

#

Idk i would think more about it at least

#

See what others think

#

Im not very good in this topic

steel dagger
#

like

#

randy is the forgotton child neuro7

timber basin
timber basin
#

tysm!

timber basin
#

This is such an improvisation for neuro's vision not being on lmao

#

Btw, should I jump neuro-os straight to v2.0.0 ?, right now we're at v0.0.1-alpha

#

hmmmmmmm

#

@steel dagger ?

steel dagger
#

why straight to v2

#

you haven't even released v1 yet

timber basin
#

idk

#

hmmmm, okay.

#

good point

timber basin
#

I'm not sure which version to put this release in

steel dagger
#

Up to you

#

my recommendation: is it fully functional?

yes: v1.0.0
no: v0.1.0-beta

timber basin
#

I'll go with v0.1.0-beta ig, I still need to test some stuff

#

but its functional enough that I can deem it a release

steel dagger
#

test those stuff first

timber basin
#

but testing it with jippity is my main priority atm

steel dagger
#

and then make your decision

timber basin
#

Okay, from my assessment, it is not infact ready for beta.

#

Let's stay in v0.0.1-alpha and move 0.0.2-alpha then

timber basin
timber basin
timber basin
#

YAY! neuro-relay is now working with neuro-os!
logs were a little large, so heres a file!

plucky marlin
#

can you record a cool video nub

timber basin
#

Help wanted

I would want some help with the Neuro Windows Project, implementing some stuff

#

HOW DO I LOSE THE CONFIGURATION FILE FOR NEURO-RELAY IN NEURO-OS, WHAT

#

@steel dagger I.... kinda... need help

#

Idk what's calling this:

│  │  │  │  │  │  │  │  │  │  │  ╭▶ retry_queue() intermediary.py:330 [ 6.590s]
│  │  │  │  │  │  │  │  │  │  │  │ args: self=<src.dev.nakurity.intermediary.Intermediary object at 0x0...
│  │  │  │  │  │  │  │  │  │  │  💥 CancelledError:   intermediary.py:330
│  │  │  │  │  │  │  │  │  │  │  ╰↩ return None [ 6.598s]

│  │  ╭▶ connect_outbound() client.py:156 [ 6.604s]
│  │  │ args: uri='ws://127.0.0.1:8000', router_forward_cb=<bound method NakurityBackend._handle_intermediary_forwar..., max_retries=10, retry_delay=2.0
│  │  💥 CancelledError:   client.py:156
│  │  ╰↩ return None [ 6.608s]

│  │  │  │  │  │  │  │  │  │  │  ╭▶ start_outbound() __main__.py:246 [ 6.612s]
│  │  │  │  │  │  │  │  │  │  │  💥 CancelledError:   __main__.py:246
│  │  │  │  │  │  │  │  │  │  │  ╰↩ return None [ 6.619s]

│  │  │  │  │  │  │  │  │  │  │  ╭▶ main() __main__.py:277 [ 6.637s]
│  │  │  │  │  │  │  │  │  │  │  💥 CancelledError:   __main__.py:277
│  │  │  │  │  │  │  │  │  │  │  ╰↩ return None [ 6.643s]

│  │  │  │  │  │  │  │  │  │  │  ╭▶ run_server() server.py:351 [ 6.655s]
│  │  │  │  │  │  │  │  │  │  │  │ args: self=<src.dev.nakurity.server.NakurityBackend object at 0x0000..., host='127.0.0.1', port=8001, ssl_context=None
│  │  │  │  │  │  │  │  │  │  │  💥 CancelledError:   server.py:351
│  │  │  │  │  │  │  │  │  │  │  │ → async with websockets.serve(handler, host, port, ssl=ssl_context):
│  │  │  │  │  │  │  │  │  │  │  │ • locals: host='127.0.0.1', port=8001, ssl_context=None, self=<src.dev.nakurity.server.NakurityBackend object at 0x0000...
│  │  │  │  │  │  │  │  │  │  │  ╰↩ return <Future pending cb=[shield.<locals>._outer_done_callback(... [ 6.675s]

I disabled the trace function but its still being called

steel dagger
#

that log looks terrible here

timber basin
#

and by this I mean this giant verbose stuff

#

Its meant to look like this

#

coloring and stuff, its for debugging and showing the program is working internally. This is supposed to be combined with VSCode's breakpoint stuff

timber basin
#

@plucky marlin We have another issue! Great!

#

Tracer for neuro-relay can't be disabled

#

(This is in the neuro-os project repository)

timber basin
#

Project Maintainence / Development

I might take a break a bit from this project when school starts at the end of this week
I asked Cassitly to post this here, in hopes some people would be willing to help me work / maintain this project since its a very big idea.
And 3 people maintaining it might be too little, so I'm not sure if this would be finished at all.

plucky marlin
#

It gets enabled by some random function

#

"Set trace" or like that

#

Try commenting entire trace and see where it will error

#

Its where trace is called from

#

(maybe this is all outdated and your code changed very much, but in case this part is the same, you can try)

timber basin
#

Minor stuff

that might confuse people, I renamed the repository from neuro os to neuro windows. Since it might be misleading

timber basin
#

should I implement permissions for neuro os (now neuro windpws integration) ?

steel dagger
#

I mean... you can't really do much with permissions

#

unless you add abstractions

timber basin
plucky marlin
plucky marlin
#

just curious how you doing

timber basin
timber basin
timber basin
timber basin
#

tysm!

plucky marlin
#

so the issue is: huge latency and tony returning 0 client id right?

timber basin
#

no, that's tony's issue. not ours

plucky marlin
#

are you sure

#

do you properly disconnect/reconnect

timber basin
#

Oh uhm, the latest issue appeared out of nowhere, while I was trying to debug the top error

#

also, what programming language are you best at?

#

I can maybe use that next time, so you can understand the codebase better!

plucky marlin
#

python is fine

#

i dont have much practice in any languages, but there are some i actually touched and used for something:
c, c++, python, lua, pascal and st

timber basin
plucky marlin
#

i do st professionally but its not used in anywhere besides my job field

#

alright then lets forget this issue for now. since its fixable by common restart anyway

timber basin
#

Yea

plucky marlin
#

i mean client id 0 issue

plucky marlin
timber basin
#

I understood what you meant

#

Wait- you work at somewhere important like nasa or something?

steel dagger
timber basin
timber basin
plucky marlin
timber basin
#

which was the latest bottom error:
[Nakurity Backend] failed to send action to windows-user: sent 1011 (internal error) error in fragmented message; no close frame received

timber basin
#

Is it at a lower level?

#

it's okay I can understand asm too

plucky marlin
#

all the hard stuff is usually handled completely by the ide and there is not much to do.. its safe but limited and simple

steel dagger
#

yeah no I'm stupid now I don't know wtf is going on in the code anymore

timber basin
#

and timing your pauses

#

it will lock at a very useful log output if you correctly time it every time something happens lol

plucky marlin
#

do i use debugging branch

timber basin
#

I'll pull changes from master rq

steel dagger
timber basin
#

its in the Nakashireyumi github

plucky marlin
#

and in neuro-windows i go master branch

#

oh wait i also need tony now too

plucky marlin
#

oh here

#

wait there is a bunch

#

can you help me set up the environment please

#

so im downloading tony now right?

#

or wait do i have it

#

it comes in neuro sdk bundle

steel dagger
#

no

#

neuro sdk repo only has randy

#

tony you need to run pip install neuro-api-tony

plucky marlin
#

okok see it

#

dayym this takes long

#

why the hell

#

it tells me that it requires trio >= 0.31.0 but installs 0.30.0 and then complains its under 0.31.0

#

and neuro api requires 0.30.0?

#

so after i install neuro api it says this

#

ok it wants trio 0.31.0 lets install that

#

after installation of trio 0.31.0

#

ohh wait its neuro api and neuro api tony

#

i get it now

steel dagger
#

also trio is still on v0.30

#

both require v0.31+

plucky marlin
#

neuro-api wants 0.31
neuro-api-tony wants 0.30

#

hm

#

they want me to do "..venv\Scripts\activate"

#

but i dont have this folder in tony

steel dagger
#

oh hmmm

#

tony should run fine with v0.31 trio

plucky marlin
#

looks like pip install neuro-api-tony command was supposed to create venv but it just never did

#

sometimes i hate this dependency hell we live in so much

plucky marlin
#

so i assume this chain of 2 actions is somehow wrong

#

maybe pip install tony installed it into some random folder on my computer and not the folder i was running my terminal from

steel dagger
#

uv auto-creates venv

steel dagger
plucky marlin
#

weird

steel dagger
#

no that's intentional

plucky marlin
#

they suggest to do just this

steel dagger
plucky marlin
#

alternatively they show "github way" where venv is made

steel dagger
#

yeah

#

if you clone github and want to use github version

plucky marlin
#

so i chose path without venv

steel dagger
#

you use github mode

plucky marlin
#

i want to use whatever version that is going to work

#

rn none work

steel dagger
#

if you use pypi it does not matter if you clone github

steel dagger
timber basin
#

Sorry for not being here. I was eating ||the duck on neuro's head (jkjkjkjk)||.

steel dagger
#

hence why you are running into dependency conflicts

plucky marlin
#

apparently installation did absolutely nothing? idk

steel dagger
timber basin
#

run python -m venv .venv in the neuro-windows directory

plucky marlin
#

is it in my path now

steel dagger
#

yes

plucky marlin
#

i kind of didnt want that but ok

steel dagger
#

why not

#

you wanted to install it didn't you

plucky marlin
#

yeah just filling path with random things seems wrong

#

but it works so i dont mind

timber basin
steel dagger
#

you installed it into your global package directory

#

and because it's an executable binary it adds it to your path

plucky marlin
timber basin
#

Vituha, can you please tell me your current repository setup of neuro windows integration?

plucky marlin
#

ok lets forget tony installation now, i have tony

#

how do i launch neuro windows now

steel dagger
plucky marlin
#

this is the folder

#

oh so the path isnt really clogged, it just tries to run packages from the folder of python packages

#

it is still just one path entry with python folder neuroOhISay

timber basin
#

my gitmodules didn't get commited smh

plucky marlin
#

but i have neuro relay from last time

#

and its freshly fetched

timber basin
#

@steel dagger how did you add the git modules the first time? Mine didn't work

plucky marlin
#

i just need some command like python -m src.dev.tests.test_harness

#

but for new version of your repo

timber basin
#

Neuro Windows rely on neuro relay being inside its own folder

plucky marlin
#

or do i use old commands and use neuro relay

timber basin
#

so, either move it into the neuro windows folder or clone a new relay :D

steel dagger
timber basin
#

Neuro Windows automatically starts up neuro relay and uses it, sooo

plucky marlin
#

it will look like this

#

bottom folder

#

this is correct?

steel dagger
#

is your windows-api folder empty

plucky marlin
#

no its full

#

i just dont know what to launch there are like 10 programs i think

#

nested in 500 subfolders

timber basin
#

but yeah, its correct

steel dagger
plucky marlin
#

how to launch your new api

steel dagger
#

you mean to tell me modularisation is confusing to someone who doesn't understand the codebase?

timber basin
#

python -m src.dev.launch

plucky marlin
timber basin
plucky marlin
#

and see like "oh yeah i should definitely run dev/mev/src/idkkev/windows/linux/apple/lol/123131adjsldjlaneurosomehting.py, its clearly the thing i need"

plucky marlin
# timber basin I could!

i have tony running and my neuro windows repo seems to be correct, can you please tell me terminal command to launch it

#

do i run this

#

or this

#

or maybe this

#

or wait is it on your repo describtion

#

i never read it actually lets see neurOMEGALUL

#

NeurOhISee is it python -m src.dev.launch

timber basin
timber basin
plucky marlin
#

oh sorry

#

anywayy

#

installing requirements.txt seems to kill tony neuroWhat

#

now i start thinking i got some broken tony build by cloning tony repo

timber basin
#

if you don't want to go through a billion folders just run this!
Very useful

## clear output file first (optional)
Remove-Item output.txt -ErrorAction Ignore

## get all .py files and append their contents
Get-ChildItem -Path "src" -Recurse -Filter *.py | ForEach-Object {
    Add-Content -Path "output.txt" -Value "`n# --- $($_.FullName) ---`n"
    Get-Content -Path $_.FullName | Add-Content -Path "output.txt"
}
plucky marlin
#

so you must use venv

#

ok now i see

timber basin
#

python -m venv .venv and .\.venv\Scripts\activate

timber basin
#

and adds everything to ur path

#

like what KTrain said

#

That's how pip works

#

wyd rn?

plucky marlin
#

fixing the install

#

when i launch it it just sends 500 errors

#

no package no package no package

timber basin
#

full error logs?

plucky marlin
#

i did requirements but i also follow the other things in your instruction there

#

let me launch it again, maybe requirements was enough

#

but i need venv for neuro too

timber basin
#

just get the .venv for neuro-windows no?

plucky marlin
#

but this happens before i even reach venv part

timber basin
#

try running node src/bin/neuro-setup.js

#

if you have node

steel dagger
#

iirc someone said the packaging mechanisms around python are a mess.

plucky marlin
steel dagger
timber basin
plucky marlin
#

oh

timber basin
#

just run install the requirements.txt

timber basin
plucky marlin
#

ok then i do venv now and launch it

timber basin
#

since this is an attempt to automate the installation

#

wait- no. try node src/bin/setup/repository-setup.js if it doesn't work

#

that might be better, i'm not sure who put neuro-setup.js there

timber basin
plucky marlin
#

im so much afraid that installing all this in 3 ways will ruin everything

plucky marlin
timber basin
#

don't run neuro-setup

timber basin
#

but neuro setup DOES NOT work

plucky marlin
#

what is "neuro setup"

#

oh i see its in instruction

#

i didnt try it even

timber basin
#

idk its a file that someone put there at src/bin/neuro-setup.js

#

Neuro setup does not work

plucky marlin
#

i didnt do and wont do neuro setup

#

i did this

timber basin
plucky marlin
#

do i just uninstall everything and start from scratch

timber basin
#

just cd into it

#

and change its branch

#

uhmmmm

#

wait- actually

#

start over

#

repository-setup was meant for an installer where its not the source stupid me

#

I'm so sorry

plucky marlin
#

so i uninstall everything neuro windows related ok then i do what

plucky marlin
#

with venv

timber basin
#

yea

plucky marlin
#

without venv

timber basin
#

with .venv

plucky marlin
#

do i clone it first or

timber basin
#

okay, so clone neuro-windows first

#

and then try launching it

#

if it fails

#

try installing the dependencies for each repo (neuro-relay and windows-api) inside the neuro-windows .venv

#

so make a venv in the neuro windows folder

#

install the dependencies of each repo inside that venv

#

and try launching neuro windows in that venv

plucky marlin
#

do i really need to launch it

#

before doing venv

timber basin
#

to see if it works or not

#

its just a sanity check

#

if you don't want to, its fine aswell

#

it won't install anything, that's why we have to setup the dependencies

plucky marlin
#

a bunch of "missing missing missing" errors and it crashes

timber basin
#

okay, so that's good.

plucky marlin
#

now i cd into windows-api?

timber basin
#

nooooo

#

you only need to install the requirements.txt from the neuro-windows venv

#

stay on the venv created in neuro windows

plucky marlin
#

i never created venv yet

#

its empty cloned repo

#

so i make venv now

timber basin
#

then run git clone https://github.com/Nakashireyumi/windows-api.git

timber basin
timber basin
#

then after that, run git clone https://github.com/Nakashireyumi/neuro-relay.git

#

then run pip install -r requirements.txt

plucky marlin
#

done

timber basin
#

then run pip install -r neuro-relay/requirements.txt

plucky marlin
#

done

timber basin
#

then run pip install pyautogui

#

this is the last package, which windows-api needs

plucky marlin
#

done.
anything else before launch?

timber basin
#

that should be everything

#

gosh I really need to automate this process

plucky marlin
#

NeuroPoggers i think it works

#

connected to tony, no errors visible

timber basin
#

give it like 40+ seconds to load

#

that's one of the latency issues

#

and then when actions appear on tony, it should mean it loaded

plucky marlin
#

it seems to loop here

timber basin
plucky marlin
#

now its doing this

timber basin
#

its neuro windows sending neuro the desktop environment to neuro

plucky marlin
#

do i try to execute "screenshot"

timber basin
#

yea

#

make sure its the right schema

#

there should be a show schema button to check

#

schema is basically json format

plucky marlin
#

it just says "yes" in schema column

timber basin
#

No

plucky marlin
#

executing seems to do absolutely nothing

timber basin
#

uhm when you press execute

plucky marlin
#

nothin happens

timber basin
#

it should show a bunch of buttons

#

check the neuro windows logs

plucky marlin
#

oh actually its describtion says it too

#

however no window appears

timber basin
#

@steel dagger help this person with tony please

plucky marlin
#

let me restart it all, maybe tony died while i installed some things

steel dagger
#

Man I'm not even a regular contributor

#

to tony

steel dagger
timber basin
#

oh, I'm so sorry!

steel dagger
#

are you sure

plucky marlin
#

yes i click it and nothing happens

steel dagger
#

nah alg

plucky marlin
#

no dialog window

#

nothing interesting in logs

steel dagger
#

have you tried double clicking it

timber basin
#

ah yes, the ninja art of double clicking

steel dagger
#

reminds me of that one time a governor said f12 was a crime

timber basin
#

waht

#

context matters for us, yk?

plucky marlin
#

restarted tony, double clicking doesnt work anyway

steel dagger
#

what does it say

timber basin
#

maybe spamming hopes and dreams would work lol

plucky marlin
#

nothing

steel dagger
#

on the right side?

#

in the window?

plucky marlin
#

before click

#

after 50 clicks

#

maybe my tony is broken

timber basin
#

we need a petition to label all UI elements on every application in a easily understandable way, so that we don't have to keep describing what we meant by the top right window box

steel dagger
#

iirc

timber basin
#

by an easily understandable way

#

so like. basically label it in the UI lol

#

unless we didn't use its name

steel dagger
timber basin
#

and it was already named

plucky marlin
#

i did all this in correct order when installing tony.
before it, i uninstalled old tony with pip uninstall

steel dagger
steel dagger
timber basin
#

I'm probably stupid then

timber basin
#

sorry!

plucky marlin
steel dagger
plucky marlin
#

deleting works

steel dagger
plucky marlin
timber basin
#

waht

#

why'd u delete it lol?

plucky marlin
#

idk just to see if any button in tony works

timber basin
#

try refresh_context then

#

select it

#

and then click execute

plucky marlin
#

same as screenshot

#

no json dialog opens

#

do i need some json app for it

timber basin
#

hmmm, suddenly tony starts breaking

plucky marlin
#

json dialoger or smth

timber basin
#

maybe let's go back to using randy...

#

the forgotten child

plucky marlin
#

it will delete system32 are you crazy

timber basin
#

yes.

steel dagger
timber basin
#

and then run randy

plucky marlin
#

im not doing that neurOMEGALUL

timber basin
steel dagger
#

cannot reproduce

plucky marlin
#

random os actions

timber basin
#

then its local probably

steel dagger
#

where's that one sticker

#

not that

#

the uh

timber basin
#

lmao

plucky marlin
#

all this dependency nightmare

timber basin
#

I will automate that soon, dw

plucky marlin
#

and it gave absolutely no profit

timber basin
#

Randy is the same as tony

plucky marlin
#

it still doesnt deploy properly

timber basin
#

tony just implements a ui for randy

steel dagger
timber basin
timber basin
plucky marlin
#

do i try to "pip install --upgrade neuro-api-tony"

steel dagger
plucky marlin
#

oh wait no

#

its for another venv-less way

steel dagger
#

if it did you could just send commands via a http port

#

but you can't with tony

timber basin
#

oooh

#

ISee

steel dagger
#

anyways idk why the bug occurs with tony

#

with vituha

timber basin
#
curl --request POST \
  --url http://localhost:1337/ \
  --header 'Content-Type: application/json' \
  --data '{
    "command": "action",
    "data": {
        "id": "blegh",
        "name": "join_friend_lobby",
        "data": "{\"friend_name\": \"jerma985\"}"
    }
}'

If you didn't know, you could do this with randy btw @plucky marlin

timber basin
#

that gives more than what's on screen?

steel dagger
#

it does emit a log file

#

but it's not really more than what you can see on screen I think

plucky marlin
steel dagger
#

just send it here anyways I'll see if I have the time to parse it

timber basin
steel dagger
#

youre just making it more annoying

plucky marlin
timber basin
timber basin
plucky marlin
steel dagger
#

open a separate pwsh/bash terminal and execute the cmd

timber basin
#

in the data tab

#

oh right

#

you have to do that too

#

you can't paste it into randy

#

randy doesn't like that. its gonna say nononono

plucky marlin
#

but i need randy to run because integration has somewhere to connect

plucky marlin
#

and by this command i "insert" traffic into their communication

#

but randy will still do random shit will he not??

plucky marlin
#

i dont want that

steel dagger
#

that's not how randy works

#

uhhhh

#

lemme see if I can find a page

timber basin
#

I mean, I could try implementing an actual testing server with Neuro relay

plucky marlin
#

randy does random actions does it not?

steel dagger
steel dagger
#

not always

plucky marlin
#

so randy will not do anything with current neuro-windows version

#

since it doesnt force actions or smth

steel dagger
#

yup

plucky marlin
#

i'll probably have to reinstall neuro api because it got destroyed by some package versions

#

since tony wants 31 and non-tony wants 30

#

oh nvm it works

steel dagger
#

nice

plucky marlin
#

wait do i need to make this into one-line command

steel dagger
#

?

plucky marlin
steel dagger
#

oh right

plucky marlin
#

or do i need to format it first

steel dagger
#

forgot pwsh/ is not always bash

plucky marlin
#

to be actual command and not jerma987

timber basin
steel dagger
#

replace all \ with `

#

it will work

timber basin
#

I still have no idea where neuro windows exits

#

windows user is neuro windows btw

#

confusing name, ik

plucky marlin
steel dagger
#

not apostrophies

timber basin
#

its where the ~ is

#

but without the shift

plucky marlin
#

what the fuuck

timber basin
plucky marlin
#

who uses symbols absent on keyboard for anything at all

timber basin
#

its not absent

plucky marlin
#

neuroCry are they stupid

timber basin
#

I have it

#

windows just maps it to change the language

steel dagger
timber basin
#

you have to change window's mappings

steel dagger
#

its literally where the ~ key is

plucky marlin
#

i dont think my keyboard has it

steel dagger
#

bruh

timber basin
#

top left

#

before the escape button

steel dagger
#

yeah this is why we should use tony

plucky marlin
#

‘ ’

timber basin
#

above the tab button

plucky marlin
#

ok i see

#

didnt know these are different symbols

timber basin
#

you did have it....

plucky marlin
#

it just looks like 3 pixels

#

shuffled a bit differently

timber basin
#

waht

plucky marlin
#

it made it worse

timber basin
#

Windows API is somehow escaping

plucky marlin
#

or do i actually need ' somewhere

#

and ` in other places

timber basin
#

yea

plucky marlin
#

great

timber basin
#

you replaced the '' in Content type and stuff

#

` just needed to be after a line

#
curl --request 'POST' `
  --url http://localhost:1337/ `
  --header 'Content-Type: application/json' `
  --data '{
    "command": "action",
    "data": {
        "id": "blegh",
        "name": "join_friend_lobby",
        "data": "{\"friend_name\": \"jerma985\"}"
    }
}'

try this

#

@plucky marlin

plucky marlin
timber basin
#

I fixed it

steel dagger
#

it's because pwsh aliases curl to Invoke-WebRequest

timber basin
#

oh, then I'm stupid

steel dagger
#

no you're fine

#

this was also on readme

plucky marlin
#

i would just shift to wsl entirely but this is actually windows integration so i need windows ICANT

timber basin
#

You could try using it with arch

plucky marlin
#

it would create more problems anyway

steel dagger
timber basin
#

Cassitly did say it partially worked

#

but ubuntu wasn't tested

#

arch was, since cass has it installed

timber basin
#

I love how the drive letter is just D:

#

as it's sad, lmao

wheat reef
#

STOP SPAMMING REACTIONS, NAKURITY

plucky marlin
#

wsl says this

timber basin
timber basin
#

Idk anything much about networking

#

@steel dagger do u know?

plucky marlin
#

thonk i could disable firewall

timber basin
#

No, its a vm

#

networking issue

plucky marlin
#

so what

timber basin
#

you need to forward stuff from host to wsl

#

since its a vm

#

and not a app

plucky marlin
#

it sees it as another adapter i think

steel dagger
timber basin
#

vm is a virtual machine

plucky marlin
#

randy in wsl

timber basin
#

That is powershell....

steel dagger
#

thats pwsh

plucky marlin
#

because im running wsl in powershell

#

let me demonstrate one sec

timber basin
#

waht

plucky marlin
timber basin
#

are you running windows in....

plucky marlin
timber basin
#

wtf....

plucky marlin
timber basin
#

oooh

#

I see

#

you just started wsl on powershell

plucky marlin
#

yes

timber basin
#

makeItMakeSense

plucky marlin
#

then i run another powershell

#

run wsl there too

#

paste the post command

timber basin
#

double the workload (on your pc lol)

plucky marlin
#

wtf is port 1337 anyway

timber basin
#

probably because its not the same wsl instance

plucky marlin
#

i think it should work?

timber basin
plucky marlin
#

so wait

timber basin
plucky marlin
#

oh

timber basin
#

you would need a special command to dock into that wsl instance I assume

#

but idfk what that command is

#

command / argument of wsl

plucky marlin
#

i'll go do something real quick, 10 min break

timber basin
#

kay

#

WAIT, I just had an great idea.

#

nvm

#

it wasn't that great of an idea

#

@plucky marlin wyd rn?

plucky marlin
#

wait is wsl connected to windows

timber basin
#

yea

plucky marlin
#

but 2 wsls are not to each other

#

so i just run randy in windows and command form wsl

timber basin
#

probably, yea

#

that might be a great idea

plucky marlin
#

same error, cant connect

#

wsl seems to be isolated from windows too

#

it is connecting to vscode though, but it might be some special case

#

or maybe it doesnt im not sure

#

i was using vscode as text editor i think

#

and stopped when it failed to connect actually

#

riight.. now i remember.. same shit

timber basin
#

vscode has some magic stuff that connects its terminals to wsl

#

maybe try running the command in a vscode terminal?

plucky marlin
#

nah it didnt connect

#

it has to be firewall or smth

timber basin
#

hmmm

#

do you have git bash?

#

run randy in windows

#

and run the command in git bash

plucky marlin
#

im not sure i have git bash, some random command from stackoverflow didnt work

#

start "" "%PROGRAMFILES%\Git\bin\sh.exe" --login didnt work

timber basin
#
curl --request POST \
  --url http://localhost:1337/ \
  --header 'Content-Type: application/json' \
  --data '{
    "command": "action",
    "data": {
        "id": "blegh",
        "name": "join_friend_lobby",
        "data": "{\"friend_name\": \"jerma985\"}"
    }
}'

this command btw, this command is for git bash

#

try searching git bash in the windows search bar

#

if you have the command for git

#

you should have it

#

I would assume

plucky marlin
#

oh yeah it works

#

NeuroPoggers it works

timber basin
#

now is the setup complete?

plucky marlin
#

i think

timber basin
#

kay, if it truly worked

plucky marlin
timber basin
#

neuro windows should've have an error

timber basin
plucky marlin
#

is this wrong
curl --request POST \ --url http://localhost:1337/ \ --header 'Content-Type: application/json' \ --data '{ "command": "screenshot", "data": { "type": "object", "properties": { "name": {"type": "string"}, "region": { "type": "array", "items": {"type": "integer"}, "minItems": 4, "maxItems": 4 } } } }'

plucky marlin
timber basin
#

right click and copy one of my text to see:

curl
#

this also works for python:

from neuro_api.command import Action
import pyautogui

def schema():
    screen_width, screen_height = pyautogui.size()
    return Action(
        "click",
        f"If coordinates for the mouse is provided, move the mouse to that area, then click. Screen dimensions are {screen_width}x{screen_height}. X must be between 0 and {screen_width-1}, Y must be between 0 and {screen_height-1}.",
        {
            "type": "object",
            "properties": {
                "x": {"type": "integer", "minimum": 0, "maximum": screen_width - 1},
                "y": {"type": "integer", "minimum": 0, "maximum": screen_height - 1},
                "button": {"type": "string", "enum": ["left", "right", "middle"]}
            },
            "required": ["button"]
        }
    )
plucky marlin
#

it just copies text neuroBwaa

#

oh no actually

#

test

#

i see

#

anywah