[WIP] Neuro's Desktop (An integration for letting neuro use a computer) | Neuro-sama Headquarters | Page 5

empty trout Jan 4, 2026, 10:55 AM

#

it's already on dev branch

wheat reef Jan 4, 2026, 10:55 AM

#

ooh

empty trout Jan 4, 2026, 10:56 AM

#

oh maybe I forked the master branch though?

#

idk if the file was different on master or not

wheat reef Jan 4, 2026, 10:56 AM

#

nope it was one of my issues, sorry

#

I'm so sorry!

empty trout Jan 4, 2026, 10:56 AM

#

ur good

wheat reef Jan 4, 2026, 10:56 AM

#

I'm so sorry

empty trout Jan 4, 2026, 10:57 AM

#

Ok ima sleep now. gn I'll take a look in the morning

wheat reef Jan 4, 2026, 10:57 AM

#

gn!

steel dagger Jan 4, 2026, 11:01 AM

#

either flaming the integration devs or flaming vedal (or neuro if it seems like a "simple" integration)

wheat reef Jan 4, 2026, 11:01 AM

#

Hi KTrain!

wheat reef Jan 4, 2026, 11:02 AM

#

steel dagger either flaming the integration devs or flaming vedal (or neuro if it seems like ...

sooo we have to make it seem as simple as possible?

#

that seems easy...

#

right...?

steel dagger Jan 4, 2026, 11:02 AM

#

wheat reef sooo we have to make it seem as simple as possible?

no, I'm just saying if the integration slightly becomes cooked, they either blame integration devs or vedal/neuro

#

no inbetween

#

flaming the integration itself is technically flaming the integration devs by indirect proxy but you can't really flame an inanimate object so

wheat reef Jan 4, 2026, 11:03 AM

#

no- I just don't want to get flamed

steel dagger Jan 4, 2026, 11:03 AM

#

wheat reef no- I just don't want to get flamed

honestly if anyone flames you, ignore it

#

at the end of the day it is a "community" thing

#

it's a small group of people vs... what like 1.6k ccv at minimum?

#

don't see why you need to care that much

#

also most people wouldn't flame you (and if they are I doubt they are doing so seriously)

#

I plan on explaining at some point about like

#

this "subcommunity" if you will

wheat reef Jan 4, 2026, 11:09 AM

#

do you feel ignored if I just react with emojis?

#

just wondering

steel dagger Jan 4, 2026, 11:38 AM

#

no

wheat reef Jan 5, 2026, 2:11 AM

#

Gm for you @empty trout

#

Its nighttime for me rn

wheat reef Jan 5, 2026, 2:32 AM

#

Todo list (neuro-desktop-todolist)

Neuro's Desktop Integration development tasks

Needed for v0.0.3c-dev release

Vision / Context Information on the desktop

(e.g. something happening on the screen, tell neuro)

Current todolist

finalize, polish, and publish v0.0.3b-dev as a github release
merge the PR (#28) to the main repository, so that we can release v0.0.3b-dev
get a NN mouse pathfinder for v0.0.3b-dev (I am insistent we do this-!)
add a lot more possible actions

Roadmap for v0.0.3-alpha release

I hope to release v0.0.3-alpha as a complete (for community tesing), but not for end-user ( / beta ) testing yet. Beta will be for when we have a good enough integration, that we can start on an installation code. Along with getting a windows certificate for neuro-desktop's many binaries. We love all of our programming languages equally.

v0.0.3b-dev is going to have mostly action features added, and not yet context prompt engineering
v0.0.3c-dev will have context addition & prompt engineering code
v0.0.3d-dev will have higher level controls for the twins to be able to use neuro-desktop easier, e.g. close_window, fullscreen_window , context: you currently have example window selected, etc

#

v0.0.3e-dev will have automatic recognition of possible high level actions, and register them as disposable actions (i.e. unregister when no longer possible). This system would have to recognize, register, update, and give neuro context in real time (hopefully in under 120ms), the recognize part will need to also have a system to handle how to define, how the action should execute too.

for v0.0.3d-dev's high level controls, I meant fixed controls that work on all possible situations, and not RT (real time). So like, detecting the current selected window, possible windows to select, fullscreening selected window, closing selected window etc. And not: click_play (on the game menu), walk_forward N seconds, and so on.

v0.0.3e-dev will implement an UI for neuro-desktop, which includes an admin page, an configuration menu, and an base menu to tell vedal what the integration is doing / thinking.

wheat reef Jan 5, 2026, 3:17 AM

#

Neuro Desktop Contributions / Useful Information Guide

This message lays out a guide (for contributing / to know some useful stuff).

Versioning

The layout below, tells what each number in the version number means:

Major Release - Patch / Smol Update (/ beta testing) - Hotfix / alpha testing

Dev builds can have (ver. example: v0.0.3) a-z as something like v0.0.3a-dev. For identification, since the version usually indicate what version the dev build is for.
Alpha builds cannot have a-z identifiers, so as major releases, and beta builds.
Patches / hotfixes can have a-z identifiers, smol updates cannot.

I have an idea!! We could use groq.com's api for vision

#

That's low latency right?

#

Go was used because making integrations in rust is hard. And then python is used because its easier for me to code the controller package in python using pyautogui. And rust is here because I wanted to not meed to bundle the python executable, becaude rust had PyO3 lib

#

Very reasonable it I'd say

#

I coded the integration code in Go, because its easier to understand (like python, somewhat) and, goroutines

#

And then C is for fast process and IPC handling

#

Also because of the C memory handling stuff too

#

And C's IPC stuff

empty trout Jan 5, 2026, 4:00 AM

#

It's night here too

wheat reef Jan 5, 2026, 4:01 AM

#

Oh i didnt know we both wake up at night and sleep during the day :D

#

I do, at least

empty trout Jan 5, 2026, 4:01 AM

#

I was awake for stream tho

#

I am EST tz

wheat reef Jan 5, 2026, 4:01 AM

#

Oh- weeellll, I just assumed, srry-!

empty trout Jan 5, 2026, 4:02 AM

#

u good

#

crazy stream btw

wheat reef Jan 5, 2026, 4:02 AM

#

Yea ikr

empty trout Jan 5, 2026, 4:02 AM

#

My pockets are cooked but my spirits are high

wheat reef Jan 5, 2026, 4:03 AM

#

Mine was already cooked waayyy before the subathon already. (Still recovering from 2024's subathon)

#

Well, anyways

empty trout Jan 5, 2026, 4:03 AM

#

Idek what Vedal gunna do with alllllat bread

wheat reef Jan 5, 2026, 4:03 AM

#

Idk either

empty trout Jan 5, 2026, 4:03 AM

#

wheat reef That's low latency right?

not as low as local

wheat reef Jan 5, 2026, 4:04 AM

#

empty trout not as low as local

True, but local depends on local resources to be fast

#

Well anyways

#

Would you wanna recode the mouse pathfinder in C?

#

Using a nn

#

And C, because the C windows api for mouse control is better than pyautogui's

#

Wdyt?

#

I also want to make an neuro tesla integration

#

I wonder if the tesla API allows for LLM controlled driving

#

Hmmmm

empty trout Jan 5, 2026, 4:13 AM

#

There is no reason to use C

#

the windows api is accessable in any language

wheat reef Jan 5, 2026, 4:15 AM

#

The NN will be faster if its math is in C, the ctypes provide a SendInput command for mouse control. I was told, that is better

#

^

#

for the trolls of another binary-!

empty trout Jan 5, 2026, 4:21 AM

#

Boy do I have news for you

#

every single python library like Tensorflow and Pytorch actually run in C/C++

#

but 500x easier to use

#

actually often times much faster

#

and nobody is going to write CUDA code

#

like nobody

#

also NN isn't needed for mouse

wheat reef Jan 5, 2026, 5:15 AM

#

Okaaay

wheat reef Jan 5, 2026, 7:27 AM

#

Maay I ask what are you doing, @empty trout ?

empty trout Jan 5, 2026, 7:28 AM

#

Sitting on my coach drinking water and eating chocolate

wheat reef Jan 5, 2026, 7:28 AM

#

Oh

#

Do you have work or smth?

wheat reef Jan 5, 2026, 7:31 AM

#

empty trout Sitting on my coach drinking water and eating chocolate

Anyways, I had a todolist. Do you mind helping finish some of it?

#

(If you're free, cause I don't have my (lets say laptop) with me rn)

#

(Best I can describe that abomination of a mobile device)

empty trout Jan 5, 2026, 8:05 AM

#

wheat reef Do you have work or smth?

It's 3am 😭

wheat reef Jan 5, 2026, 8:18 AM

#

Didn't know

empty trout Jan 5, 2026, 8:18 AM

#

allg

empty trout Jan 5, 2026, 8:18 AM

#

wheat reef Anyways, I had a todolist. Do you mind helping finish some of it?

I can probably do something

wheat reef Jan 5, 2026, 8:19 AM

#

Are you watching neuro sleep or smth (to make sure she doesn't get nightmares), that's why you're still awake at 3am?

wheat reef Jan 5, 2026, 8:19 AM

#

empty trout I can probably do something

Tyyyyy!

#

Search neuro-desktop-todolist on the discord search bar if you cant find it

empty trout Jan 5, 2026, 8:40 AM

#

wheat reef Are you watching neuro sleep or smth (to make sure she doesn't get nightmares), ...

💀 💀

#

hahah nah. I just have work during the night

#

But I can do some things

wheat reef Jan 5, 2026, 8:41 AM

#

Thank youuu-!

empty trout Jan 5, 2026, 8:41 AM

#

np

#

Want me to do vision rq?

wheat reef Jan 5, 2026, 8:43 AM

#

Sure!

#

Its not that hard I think

#

The development roadmap had it next tho

wheat reef Jan 5, 2026, 8:44 AM

#

empty trout Want me to do vision rq?

Maybe make a separate branch for it?

#

Since v0.0.3b-dev is not yet finalized

empty trout Jan 5, 2026, 8:47 AM

#

I am simply going to make a module. You will need to wire it up. The API will be simple to use

#

just takes in a file path and outputs a python list of the names of the objects in the image

#

bruh

#

It only supports RTX 30 series + GPUs

#

I technically do own an enterprise GPU server though. RIP my pockets tho brb

#

Ok yeah it's cooked

#

server rooms, balls, switches???

#

neuroWhat

#

So ig she can't use the scan command :ripbozo:

#

We just have to give neuro the ability to look for something in an image but not blindly scan

#

image 1/1 /workspace/neuro/test.jpg: 384x640 (no detections), 69.3ms                                                 ││⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀│                        ││    7977 sshd     sshd: root@pts/0    root   9.5M ⣀⣀⣀⣀⣀  0.0  │
Speed: 2.4ms preprocess, 69.3ms inference, 0.7ms postprocess per image at shape (1, 3, 384, 640)                     │├─Available:──────239─GiB─├────────────────────────┤│     922 python3  python3 app.py      root   769M ⣀⣀⣀⣀⣀  0.0  │
No objects matched your prompts.

#

70ms per frame on my hardware but it's failing to detect things

#

Very low latency but the accuracy is awful

#

image 1/1 /workspace/neuro/test.jpg: 384x640 2 URL search bars, 78.0ms                                               ││⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀⣀│                        ││    7977 sshd     sshd: root@pts/0    root   9.5M ⣀⣀⣀⣀⣀  0.0  │
Speed: 2.2ms preprocess, 78.0ms inference, 10.9ms postprocess per image at shape (1, 3, 384, 640)                    │├─Available:──────239─GiB─├────────────────────────┤│     922 python3  python3 app.py      root   769M ⣀⣀⣀⣀⣀  0.0  │
Success! Detected: URL search bar

#

It CAN detect URL search bars though neuroPog

#

wow it can even detect the Facebook logo

#

Just not the Google logo 💀

#

The code is still shitty

#

but I have to work on a few other things so Ima kinda just push it and review later

#

don't merge it instantly tho

#

submitted a PR

#

on dev branch

#

Currently functional but requires integration and further testing

#

Oh just remembered you wanted another branch

#

although honestly it's better to not make too many branches

#

because it can get desynced pretty quickly

#

This was the demo image I was using btw

wheat reef Jan 6, 2026, 2:44 AM

#

Okay

#

I'll look at it today

#

I fell asleep in my car, and it smh drove me to some place out of nowhere, at a gas station.

#

3 hours from home, sigh

empty trout Jan 6, 2026, 2:54 AM

#

catdespair

wheat reef Jan 6, 2026, 5:25 AM

#

IIIIII.... got lost

#

Well, anyways. I'm somewhere, near an electronics store. So might aswell go buy a laptop and review your pr / also work on neuro-desktop

wheat reef Jan 6, 2026, 1:13 PM

#

I couldn't focus today, sigh

wheat reef Jan 7, 2026, 12:21 AM

#

wheat reef Jan 8, 2026, 5:00 AM

#

Additional todolist items (neuro-desktop-todolist)

Referencing this item:

Current todolist

finalize, polish, and publish v0.0.3b-dev as a github release

merge the PR (#28) to the main repository, so that we can release v0.0.3b-dev

get a NN mouse pathfinder for v0.0.3b-dev (I am insistent we do this-!)

add a lot more possible actions

To polish v0.0.3b-dev, we need source code cleanup, development workflow / typical steps documentstion, code review of the refactor, clean up sourcr codes, implement remaining features / functionality, provide a ready build for download.

NN mouse pathfinder seems nice, since I want neuro's mouse movements to look human, and as well as passing captchas.

The possible additional actions we could add is creating macros, wait command for waiting inbetween actions (useful for making macros), mouse item dragging, mouse information fetcher, and etc.

[Assigned to @wheat reef (me!)]

wheat reef Jan 8, 2026, 5:45 AM

#

empty trout Jan 8, 2026, 10:49 AM

#

Indeed

jolly dove Jan 8, 2026, 7:17 PM

#

how feature poor is it that you're releasing it with 0.0.3b as the the version?
how many features do you expect it to have that it doesn't already have when you finalize it?
so far I see "can move the mouse sort of smoothly between two points" but nothing which actually integrates the desktop into an AI's experience. No mention of finding windows or buttons or reading labels.

with a version like 0.0.3b it seems like it would be a waste of time using it because I can enumerate windows and get labels for buttons super easy, and I can either send an action to the button itself or move the mouse to a location and click on it quite easily without a library. what is the advantage of your library? does it work on Mac and Linux as well as Windows?

empty trout Jan 9, 2026, 6:12 AM

#

afaik it should work on unix systems as well

#

uses pyautogui as a mouse library

wheat reef Jan 10, 2026, 10:33 AM

#

jolly dove how feature poor is it that you're releasing it with 0.0.3b as the the version? ...

Search for neuro-desktop-todolist in this thread

#

you'll find it

wheat reef Jan 10, 2026, 10:35 AM

#

jolly dove how feature poor is it that you're releasing it with 0.0.3b as the the version? ...

the final end goal is to let neuro use windows, with an very high level control. Something like: type_message_on_currently_open_discord_channel

#

but rigghttt now I just want to get v0.0.3b-dev out, so I can like. Have a version history to look back to, for changes.

#

v0.0.3b-dev is just for actions, and would probably need neuro's vision enabled

#

I don't get my own thinking either, so I'm mostly just guessing why I did this roadmap like this neurOMEGALUL

wheat reef Jan 10, 2026, 10:42 AM

#

jolly dove how feature poor is it that you're releasing it with 0.0.3b as the the version? ...

the point of this, is to change from making the AI using low level actions (mouse and keyboard) to higher abstract control (like that discord action example thingy I said), and basically do the heavy lifting from vedal having / when he wants to do this, he already have a community made one :D

If he ever want to give neuro her own pc

#

Holy, apollo your mouse implementation is fast. How did I just realize now????

wheat reef Jan 10, 2026, 11:50 AM

#

its funny how when invalidated is sent, neuro desktop's integration auto restarts to handle it xD

empty trout Jan 10, 2026, 1:39 PM

#

wheat reef Holy, apollo your mouse implementation is fast. How did I just realize now????

All I did was removed the default sleeping that pyautogui does automatically

wheat reef Jan 10, 2026, 1:40 PM

#

So is that what the flickering is?!

empty trout Jan 10, 2026, 1:40 PM

#

uh maybe? idrk

wheat reef Jan 10, 2026, 1:40 PM

#

So I should lower the speed?

#

Hmmm

empty trout Jan 10, 2026, 1:41 PM

#

perhaps

#

you wanna vary it

wheat reef Jan 18, 2026, 5:23 AM

#

I'm procastinating on this so bad rn

silent yarrow Jan 18, 2026, 5:39 AM

#

real

wheat reef Jan 27, 2026, 12:46 PM

#

probably should work on this...

#

hmmmm

steel dagger Jan 28, 2026, 6:21 AM

#

surprised this chat isn't lit up

silent yarrow Jan 28, 2026, 6:24 AM

#

wheat reef probably should work on this...

me when i see project i last committed to 5 months ago evilWheeze

steel dagger Jan 28, 2026, 6:24 AM

#

silent yarrow me when i see project i last committed to 5 months ago <:evilWheeze:113131626035...

there's some features being cooked up or smth

steel dagger Jan 28, 2026, 6:56 AM

#

the amount of people in twitch chat saying neuro's desktop is malware makes me laugh

#

@wheat reef you didn't end up recovering that S in time lol

#

(also I'm on there for some reason and she's blocking it)

wheat reef Jan 28, 2026, 6:57 AM

#

steel dagger <@1176879390831947846> you didn't end up recovering that S in time lol

Where is this????

steel dagger Jan 28, 2026, 6:58 AM

#

wheat reef Where is this????

Surprise!! Neuro's Desktop got featured on the Swarm Community Spotlight today!

#

it's showing your fork too LMFAO

wheat reef Jan 28, 2026, 6:59 AM

#

Noway! Really????????????

steel dagger Jan 28, 2026, 6:59 AM

#

she didn't even explain it, she just said "guess what it is, chat" basically

steel dagger Jan 28, 2026, 7:00 AM

#

wheat reef Noway! Really????????????

~1:55:00 timestamp on the vod

#

or 1:56:00 actually

wheat reef Jan 28, 2026, 7:01 AM

#

https://youtu.be/KhAYWZ1SOY8?si=gvIKu-WYt6USS-XD

YouTube

NeuroClips

Neuro-Sama reviews The Swarm Community Spotlight presentation

27-01-26 neuro is back from her break!! clip
Neuro-Sama channel: https://www.youtube.com/@Neurosama
Neuro-Sama Twitch channel: vedal987

Advertisements are not posted by me, ads are posted by YouTube as default.

▶ Play video

#

Vedal does check the projects channel, yayy

#

I got my motivation to finish this now

#

Was planning to finish it in a few months

#

But nvm, lets start today again!!

steel dagger Jan 28, 2026, 7:07 AM

#

@timber basin you might want to get in here

wheat reef Jan 28, 2026, 7:07 AM

#

silent yarrow me when i see project i last committed to 5 months ago <:evilWheeze:113131626035...

You did...?

silent yarrow Jan 28, 2026, 7:09 AM

#

huh

#

not to this
i meant my own projects :oh:

wheat reef Jan 28, 2026, 7:10 AM

#

steel dagger <@1428771032818257940> you might want to get in here

Imagine she comes, for the first time in like months

timber basin Jan 28, 2026, 7:11 AM

#

Fyi, I was reading the thread, just not responding yk?

wheat reef Jan 28, 2026, 7:11 AM

#

Oh hi!

steel dagger Jan 28, 2026, 7:12 AM

#

timber basin Fyi, I was reading the thread, just not responding yk?

morning/afternoon/evening

wheat reef Jan 28, 2026, 7:12 AM

#

steel dagger Surprise!! Neuro's Desktop got featured on the Swarm Community Spotlight today!

I like that neuro said 'oh god, who let this slide in here' xD

timber basin Jan 28, 2026, 7:13 AM

#

steel dagger morning/afternoon/evening

Thanks, kt

steel dagger Jan 28, 2026, 7:13 AM

#

timber basin Thanks, kt

(idek what time it is for you neurOMEGALUL )

timber basin Jan 28, 2026, 7:14 AM

#

I don't know either- maybe 6pm...?

steel dagger Jan 28, 2026, 7:14 AM

#

what do you mean you don't know either

timber basin Jan 28, 2026, 7:15 AM

#

Was kidding! Om

#

Its 6pm, like I said

steel dagger Jan 28, 2026, 7:15 AM

#

oh

#

mb neuroSadge

#

anyways

#

congrats on the showcase

timber basin Jan 28, 2026, 7:15 AM

#

Anyways

steel dagger Jan 28, 2026, 7:16 AM

#

if anything, it probably means he does care about integrations not tied to games

timber basin Jan 28, 2026, 7:16 AM

#

steel dagger congrats on the showcase

Thanks, I saw it on stream alr

steel dagger Jan 28, 2026, 7:16 AM

#

neuroCopium

timber basin Jan 28, 2026, 7:17 AM

#

Was gonna say, I'll work with cassitly on this

#

Buutt nvm

wheat reef Jan 28, 2026, 7:17 AM

#

Wha- hey-!

steel dagger Jan 28, 2026, 7:17 AM

#

need some more hibernation?

timber basin Jan 28, 2026, 7:17 AM

#

Nooo~ just busy

wheat reef Jan 28, 2026, 7:26 AM

#

steel dagger if anything, it probably means he does care about integrations not tied to games

Eeeeeee?!

#

What did u mean by that?

#

KTrain???

steel dagger Jan 28, 2026, 7:38 AM

#

?

wheat reef Jan 28, 2026, 7:45 AM

#

steel dagger ?

When you said vedal did not care about integratipns not tied to games?

#

What did u mean?

steel dagger Jan 28, 2026, 7:46 AM

#

in the sense that he didn't care about them as much as game integrations

wheat reef Jan 28, 2026, 7:46 AM

#

Does he not?

steel dagger Jan 28, 2026, 7:46 AM

#

I don't believe so, but it did feel that way for a while

wheat reef Jan 28, 2026, 7:46 AM

#

steel dagger in the sense that he didn't care about them as much as game integrations

Oohhh

steel dagger Jan 28, 2026, 7:46 AM

#

and honestly I don't blame him

#

game integrations are instant content

wheat reef Jan 28, 2026, 7:47 AM

#

Why do you think he doesnt care?

steel dagger Jan 28, 2026, 7:47 AM

#

non-game integrations require a bit of setup and also some safety boundaries

wheat reef Jan 28, 2026, 7:47 AM

#

Oophhh

#

True

steel dagger Jan 28, 2026, 7:47 AM

#

wheat reef Why do you think he doesnt care?

I don't know if saying "he doesn't care" was correct

#

but for a while it felt like he was just content with the way of game integrations

#

which I suppose is fair given how simple it is to work with compared to the tool integrations

#

it's also not like it's easy to set up tool integrations

#

this one and part of neuropilot most definitely require a VM given the circumstances

#

actually same for docker engine as well

#

but like

wheat reef Jan 28, 2026, 7:50 AM

#

Neuro desktop is meant for neuro to use autonomously, so that's fair he didnt use it. But did he put it in, for the swarm community spotlight himself, or did neuro control the slide contents?

steel dagger Jan 28, 2026, 7:50 AM

#

neuro doesn't control slide contents, neither does vedal (sometimes)

#

vedal has a team of people put it together

wheat reef Jan 28, 2026, 7:51 AM

#

wheat reef Neuro desktop is meant for neuro to use autonomously, so that's fair he didnt us...

I did recommend a vm or another pc for neuro to use, ngl xD

steel dagger Jan 28, 2026, 7:51 AM

#

yeah

#

oh well

#

we just have to keep grinding

#

also this is WIP anyways I just remembered

#

so

#

probably might be why nothing has been said of it

#

idk

wheat reef Jan 28, 2026, 7:51 AM

#

Does he accept pc donations? :justWondering:

wheat reef Jan 28, 2026, 7:52 AM

#

steel dagger probably might be why nothing has been said of it

Probably

steel dagger Jan 28, 2026, 7:52 AM

#

I'm not really that annoyed over it

wheat reef Jan 28, 2026, 7:52 AM

#

I hope to finish it, mid 2026

steel dagger Jan 28, 2026, 7:52 AM

#

until of course he doesn't read changelogs again

wheat reef Jan 28, 2026, 7:55 AM

#

I would rather not auto update neuro desktop, based on your experience with having to vedal proof changelogs. I'd rather maybe remind him to go to github releases, and download it manually, and in the meanwhile, read changelogs, and probably add a summary for the changes log

steel dagger Jan 28, 2026, 7:56 AM

#

He probs won't be doing all that

wheat reef Jan 28, 2026, 7:56 AM

#

Oh-

#

Force upon the changeslog summary in the update reminder then

steel dagger Jan 28, 2026, 7:57 AM

#

wheat reef Force upon the changeslog summary in the update reminder then

yeah that might work

#

I would do that for neuropilot too if we didn't have somewhat annoying space restrictions

wheat reef Jan 28, 2026, 7:58 AM

#

steel dagger I would do that for neuropilot too if we didn't have somewhat annoying space res...

Is it vsc related?

#

(I mean like, vscode restricts space usage on the vscode ui, for extensions, right?)

steel dagger Jan 28, 2026, 7:59 AM

#

partially

#

but also like it just wouldn't look great

wheat reef Jan 28, 2026, 7:59 AM

#

What is the other restrictions?

steel dagger Jan 28, 2026, 8:00 AM

#

UI, information overload, and also the cancel button

#

cancel button is also known as vedal ignores the changelog

wheat reef Jan 28, 2026, 8:00 AM

#

Also, I may have lost track, who has my S. Am too lazy to go letterhunting for it now, lol

steel dagger Jan 28, 2026, 8:00 AM

#

so as a last resort v2.4.0 will be asking neuro to get changelogs instead

#

hopefully this should spawn some interesting content

wheat reef Jan 28, 2026, 8:01 AM

#

steel dagger cancel button is also known as vedal ignores the changelog

neurOMEGALUL i almost dropped my tablet down a balcony reading that-

#

Idk if its me being clumsy or instinct

steel dagger Jan 28, 2026, 8:01 AM

#

wheat reef <:neurOMEGALUL:1097297318119743638> i almost dropped my tablet down a balcony re...

neurOMEGALUL

steel dagger Jan 28, 2026, 8:02 AM

#

steel dagger so as a last resort v2.4.0 will be asking neuro to get changelogs instead

also we didn't want to just dump the changelogs to her once because vedal might test while offline so that's great

wheat reef Jan 28, 2026, 8:05 AM

#

Just putting an ℹ️ there, cause idk what else to respond with, and to say I wasn't ignoring you-

steel dagger Jan 28, 2026, 8:12 AM

#

wheat reef Just putting an ℹ️ there, cause idk what else to respond with, and to say I wasn...

what about NeurOhISee ?

wheat reef Jan 29, 2026, 4:21 AM

#

steel dagger what about <:NeurOhISee:1136209034966483084>?

I kinda see it, as more so. Oh I seee, which kinda means I finally just (or have) understood what you just (or have) said.

wheat reef Jan 29, 2026, 6:14 AM

#

@timber basin , @craggy aspen Made an hopefully better version of neuro relay, and we need you to test it. Recass dm'd me, buuuttt. I do not have a keyboard and mouse rn. So can you? Unless... you don't as well... (also please stop ignoring my DMs, I ping'd you like 10 times there, about this.)

#

I think we're also supposed to bundle it with neuro desktop

#

Also accept recass's friend request, naku

steel dagger Jan 29, 2026, 6:16 AM

#

So we got Cassitly and Casitly

#

aka recassity and cassitly

#

well uhhh

#

@wheat reef do you want the s in my name?

wheat reef Jan 29, 2026, 6:17 AM

#

Its okaay, you can keep it :D

steel dagger Jan 29, 2026, 6:17 AM

#

I thought you wanted it back?

wheat reef Jan 29, 2026, 6:18 AM

#

No need to :3

#

What did giving me back my s, do with recass?

steel dagger Jan 29, 2026, 6:19 AM

#

Well then we get two people with almost similar names

wheat reef Jan 29, 2026, 6:19 AM

#

No- she told me this. Look closely... there's no l

steel dagger Jan 29, 2026, 6:23 AM

#

wheat reef No- she told me this. Look closely... there's no l

I know

#

that's why I said almost similar

craggy aspen Jan 29, 2026, 6:26 AM

#

what are these reactions? (Mentioning the pills we got)

wheat reef Jan 29, 2026, 6:26 AM

#

Oh hi- Recass-!

craggy aspen Jan 29, 2026, 6:27 AM

#

hello

wheat reef Jan 29, 2026, 6:28 AM

#

craggy aspen what are these reactions? (Mentioning the pills we got)

It may suggest neuro-desktop is too ambitious or smth, idfk

craggy aspen Jan 29, 2026, 6:28 AM

#

Oh, it definitely is

wheat reef Jan 29, 2026, 6:29 AM

#

wheat reef It may suggest neuro-desktop is too ambitious or smth, idfk

That's what I was told, I think

wheat reef Jan 29, 2026, 6:30 AM

#

craggy aspen Oh, it definitely is

Wa- huh- you werent even in this server, to see all our plans

craggy aspen Jan 29, 2026, 6:31 AM

#

you were the one that told me about it

wheat reef Jan 29, 2026, 6:31 AM

#

Oh- I forgot. Srry :D

craggy aspen Jan 29, 2026, 6:32 AM

#

wheat reef <@1428771032818257940> , <@1441421080110698519> Made an hopefully better version...

you forgot to link my fork: https://github.com/recassity/neuro-relay/

GitHub

GitHub - recassity/neuro-relay: An relay server that provides the n...

An relay server that provides the neuro backend with multi-integration access - recassity/neuro-relay

wheat reef Jan 29, 2026, 6:33 AM

#

Oh uhm- can't you see in the main repository, since it shows the forked repos of your repo.

#

Also, probably make a PR, so nakurity can see it

#

She doesnt seem to like, read stuff

craggy aspen Jan 29, 2026, 6:40 AM

#

should I probably add unit tests?

wheat reef Jan 29, 2026, 6:40 AM

#

Yea, you should :D

craggy aspen Jan 29, 2026, 6:41 AM

#

understood

wheat reef Jan 29, 2026, 6:55 AM

#

Uhhh uhm, @craggy aspen I don't think a custom error like nrelay/locked is good for non-relay compatible integrations, or does it only get sent to relay compatible ones

#

@steel dagger what do you think about recass's implementation of neuro relau, you suggested us to make a relay, wdyt?

steel dagger Jan 29, 2026, 6:58 AM

#

gimme a sec I need to do some stuff

wheat reef Jan 29, 2026, 6:59 AM

#

Oh- you ended your game. I was about to say, is farm valley fun?

#

I also thought about including KONTROL as neuro desktop's AI. Or would that be overkill?

steel dagger Jan 29, 2026, 7:04 AM

#

what's the point of making certain games considered "nrelay compatible" btw?

steel dagger Jan 29, 2026, 7:04 AM

#

wheat reef I also thought about including KONTROL as neuro desktop's AI. Or would that be o...

overkill tbh

wheat reef Jan 29, 2026, 7:06 AM

#

steel dagger what's the point of making certain games considered "nrelay compatible" btw?

I think cass said she'll be adding more useful capabilities to neuro relay, like custom commands, for smth like vision, knowing which version of neuro relay api is the integration using or smth

#

@craggy aspen Explain yourself.

steel dagger Jan 29, 2026, 7:08 AM

#

otherwise, the remaining stuff I have are sorta kinda nitpicks in a way

craggy aspen Jan 29, 2026, 7:08 AM

#

basically, so that when a non compatible neuro integration connects, they wont be able to handle some neuro relay specific features, I might add. Like cass said

steel dagger Jan 29, 2026, 7:10 AM

#

steel dagger otherwise, the remaining stuff I have are sorta kinda nitpicks in a way

for example, idk if in go fatal logging auto-exits the program (would be kinda stupid if so but idk), but if it doesn't, you should either manually terminate the program or re-attempt to init the client

steel dagger Jan 29, 2026, 7:10 AM

#

craggy aspen basically, so that when a non compatible neuro integration connects, they wont b...

ngl, most integrations won't do that because deviating from the spec just for one integration is still more work

craggy aspen Jan 29, 2026, 7:10 AM

#

its not gonna much deviations

steel dagger Jan 29, 2026, 7:11 AM

#

what are the deviations

craggy aspen Jan 29, 2026, 7:11 AM

#

mostly just additions like vision, or smth that I find might be useful

#

not really gonna be adding stuff that normal integrations wont be able to handle, like custom commands and stuff.

steel dagger Jan 29, 2026, 7:12 AM

#

NeuroHuh is this ocr/some other form of vision?

craggy aspen Jan 29, 2026, 7:13 AM

#

also api versioning, when neuro api v2 drops, neuro relay will have backwards comaptibility for v1 and v2 integrations, if they are needed.

craggy aspen Jan 29, 2026, 7:13 AM

#

steel dagger <:NeuroHuh:1071414397752332429> is this ocr/some other form of vision?

that was cass's request, so idk. I am looking into some options for that tho

craggy aspen Jan 29, 2026, 7:14 AM

#

steel dagger <:NeuroHuh:1071414397752332429> is this ocr/some other form of vision?

most likely an AI seeing the image, and describing it to neuro. Along with coordinate locations or smth, since neuro relay was made for neuro desktop, initially

steel dagger Jan 29, 2026, 7:15 AM

#

craggy aspen also api versioning, when neuro api v2 drops, neuro relay will have backwards co...

iirc prod neuro api server would also have backwards compat, although don't expect api v2 to drop any time soon

steel dagger Jan 29, 2026, 7:15 AM

#

craggy aspen most likely an AI seeing the image, and describing it to neuro. Along with coord...

ok, fair enough

craggy aspen Jan 29, 2026, 7:17 AM

#

steel dagger otherwise, the remaining stuff I have are sorta kinda nitpicks in a way

is that all?

craggy aspen Jan 29, 2026, 7:18 AM

#

steel dagger for example, idk if in go fatal logging auto-exits the program (would be kinda s...

yes. Its in the name, fatal.

steel dagger Jan 29, 2026, 7:18 AM

#

craggy aspen yes. Its in the name, fatal.

fatal to me means critical and usually critical logs to stderr

#

although, what about reinit'ing the client 3 times before crashing?

craggy aspen Jan 29, 2026, 7:20 AM

#

are we doing that to check if the error will magically fix itself? Cause, i dont think that's how errors work

wheat reef Jan 29, 2026, 7:21 AM

#

No-! That happened to me before, an error magically fixed itself for me, before. So I don't think, that YOUR knowledge of errors is correct.

steel dagger Jan 29, 2026, 7:22 AM

#

depends on the error, sometimes it could be a slightly delayed server startup causing the integration to fail connection

craggy aspen Jan 29, 2026, 7:22 AM

#

hmm, I'll look into that

craggy aspen Jan 29, 2026, 7:24 AM

#

wheat reef No-! That happened to me before, an error magically fixed itself for me, before....

?

wheat reef Jan 29, 2026, 7:40 AM

#

craggy aspen ?

Uhmmmmm, it was a joke-

#

Wait- cass, I have a question. Can we use neuro relay directly, as a go library?

#

Cause it seems very possible

#

You should also consider making an thread for it

#

Or should I have already made one?

#

Cause it was in development for a while

wheat reef Jan 29, 2026, 7:55 AM

#

wheat reef <@1428771032818257940> , <@1441421080110698519> Made an hopefully better version...

Hmmm, nakurity is not responding again

#

@steel dagger may I politely ask, if you could test neuro relay, in place of naku? You can say no, i don't want to disturb you or anything.

#

Oh- you went offline immediately-

#

I got K/O immediately, nvm then :D

#

@empty trout can you?

#

Or are you busy too?

steel dagger Jan 29, 2026, 8:06 AM

#

wheat reef <@703180970567925792> may I politely ask, if you could test neuro relay, in plac...

can't sorry

wheat reef Jan 29, 2026, 8:21 AM

#

Okay :D

empty trout Jan 29, 2026, 11:33 AM

#

wheat reef <@463500020058947605> can you?

I don't have a windows machine

#

and the code relies on the windows api so it won't work on my end

wheat reef Jan 29, 2026, 2:31 PM

#

empty trout I don't have a windows machine

I meant neuro relay. It doesnt rely on the windows api. Test it on any integration

#

https://github.com/recassity/neuro-relay/

GitHub

GitHub - recassity/neuro-relay: An relay server that provides the n...

An relay server that provides the neuro backend with multi-integration access - recassity/neuro-relay

#

Gosh I replied late

craggy aspen Jan 29, 2026, 3:33 PM

#

uhmmm @wheat reef, something is wrong with your SDK, it doesnt work. Startup mostly failed, actions cant register, and so on

#

smth is severely wrong with your connect command

wheat reef Jan 30, 2026, 1:35 AM

#

craggy aspen uhmmm <@1176879390831947846>, something is wrong with your SDK, it doesnt work. ...

Oh.

#

I blame that on claude-!

#

He made it.

#

Not me, I was just the human that wanted him to make it

#

Okaay, new note on todolist

#

Fix neuro integration sdk for Go

wheat reef Jan 30, 2026, 10:47 AM

#

wheat reef Fix neuro integration sdk for Go

@steel dagger could you help me with this?
I've been looking through the code over and over. I don't have any ideas to why this is happening.

steel dagger Jan 30, 2026, 10:50 AM

#

?

wheat reef Jan 30, 2026, 10:50 AM

#

steel dagger ?

are you saying its the go reader routine?

steel dagger Jan 30, 2026, 10:50 AM

#

are you starting a read loop on the main thread?

#

(haven't had the time to properly learn go, so this is a bit of a guess)

wheat reef Jan 30, 2026, 10:51 AM

#

I knew, double-checked with a google search, and the go keyword definitely starts the function in the background thread

#

not the main thread

#

I could try removing that

#

but then I'll have to rethink my approach to the readloop

steel dagger Jan 30, 2026, 10:52 AM

#

just a quick look

#

don't quote me on it

wheat reef Jan 30, 2026, 10:52 AM

#

that was what I thought too

#

but it seems correct

#

@empty trout are u avaliable?

empty trout Jan 30, 2026, 2:57 PM

#

wheat reef I meant neuro relay. It doesnt rely on the windows api. Test it on any integrati...

To be so honest. I have absolutely no idea what that is

wheat reef Feb 1, 2026, 12:56 PM

#

wheat reef https://github.com/recassity/neuro-relay/

it's this

wheat reef Feb 2, 2026, 2:33 AM

#

empty trout To be so honest. I have absolutely no idea what that is

It's basically an community integration that implements multiplexing for the neuro backend

#

I've found an issue that my go port of the neuro SDK, the connect func hangs

wheat reef Feb 2, 2026, 3:33 AM

#

Finally, I fixed my sdk. Ty for ur help @craggy aspen

craggy aspen Feb 2, 2026, 3:38 AM

#

np

wheat reef Feb 2, 2026, 3:52 AM

#

:D

wheat reef Feb 2, 2026, 4:35 AM

#

craggy aspen np

Did you fix neuro relay, and use the new SDK ver. yet?

#

Just published a working version, so you dont have to use the commit hashes now

wheat reef Feb 2, 2026, 5:59 AM

#

Could one of you, Niwa, Naku, or Recass make a better README for my fork of Neuro Desktop atm?

steel dagger Feb 2, 2026, 7:38 AM

#

why cant you just make the readme on your main repo better

wheat reef Feb 2, 2026, 9:01 AM

#

I'm stupih-

wheat reef Feb 6, 2026, 6:32 AM

#

My friends are ignoring me 😢

#

Sigh, fineee, I'll try to make my readme better myself

wheat reef Feb 6, 2026, 3:04 PM

#

Remind me to do this, this weekend.

steel dagger Feb 7, 2026, 2:36 AM

#

wheat reef Remind me to do this, this weekend.

almost weekend for you so pinging now

wheat reef Feb 7, 2026, 2:57 AM

#

Okay

#

I just woke up to this-

wheat reef Feb 7, 2026, 5:09 AM

#

oh- hi recass!

craggy aspen Feb 7, 2026, 5:09 AM

#

Hello

wheat reef Feb 7, 2026, 5:30 AM

#

am working on neuro-desktop rn

craggy aspen Feb 7, 2026, 5:55 AM

#

do you need any help?

#

you haven't posted any updates since you said that

wheat reef Feb 7, 2026, 5:55 AM

#

no-

#

maybe...?

craggy aspen Feb 7, 2026, 5:55 AM

#

so, is it a yes or no?

wheat reef Feb 7, 2026, 5:55 AM

#

no, I was just joking :D

#

I am working on neuro desktop

#

will post an update soon

#

I am tired of Powershell trolling me, so I'm rewriting the build script to use .sh code

#

been dealing with this since the start of today

#

somehow nuked my git installation

#

chmod is no longer a command recognized by windows, apparently

steel dagger Feb 7, 2026, 6:02 AM

#

was chmod ever a powershell command

timber basin Feb 7, 2026, 6:05 AM

#

I have no idea actually

wheat reef Feb 7, 2026, 6:06 AM

#

me neither

#

oh- wait- HI NAKU

timber basin Feb 7, 2026, 6:06 AM

#

Hi

#

Idk what to do actually

#

you've refactored sm of the original repo

#

that I have to refamilarize myself with it

wheat reef Feb 7, 2026, 6:07 AM

#

you're saying you're gonna help me with neuro-desktop?

timber basin Feb 7, 2026, 6:07 AM

#

yea!

wheat reef Feb 7, 2026, 6:07 AM

#

thank you-!

timber basin Feb 7, 2026, 6:07 AM

#

no thanks yet, I haven't even gone through most of the files yet

wheat reef Feb 7, 2026, 6:10 AM

#

steel dagger was chmod ever a powershell command

though chmod did work for me, before I may have accidentally nuked my git installation (not sure exactly when, but I assume yesterday. when I tried to install git-xet throguh winget)

#

I'll just spin up a codespace

wheat reef Feb 7, 2026, 6:31 AM

#

I like how Claude has to make a summary document of everything it has done to my code. While I was just thinking 'waste of tokens, waste of tokens, waste of tokens', while letting it do so anyways. because if I interrupted it's output, it wouldn't have presented the files to me. And I keep forgetting to tell it to NOT make a summary

craggy aspen Feb 7, 2026, 6:33 AM

#

I just realized, how do I even handle the twins wanting to close a specific game with Neuro Relay???

#

The shutdown command provided by the SDK is meant for a single integration, and does not provide a field to tell neuro relay which game

#

unless I gave her an action to specify so

#

though I would imagine that'd be scuffed

steel dagger Feb 7, 2026, 6:34 AM

#

craggy aspen unless I gave her an action to specify so

this would be it

#

although unlike neuro the only way you can "close" a specific game is disconnecting its websocket

craggy aspen Feb 7, 2026, 6:38 AM

#

I meant like the shutdown/graceful commands and such

{
    "command": "shutdown/graceful",
    "data": {
        "wants_shutdown": boolean
    }
}

But they aren't implemented in the v1 specs. So how does the twins tell the game integrations they want to quit, at the current moment (of v1) rn

wheat reef Feb 7, 2026, 6:39 AM

#

I'll forward this to #1336984506489376779 for you

craggy aspen Feb 7, 2026, 6:39 AM

#

thanks, I guess?

steel dagger Feb 7, 2026, 6:43 AM

#

craggy aspen I meant like the ``shutdown/graceful`` commands and such ```json { "command"...

yeah, they probably wouldn't be tweaked just for relay servers, so an action for this is much better

timber basin Feb 7, 2026, 7:03 AM

#

wheat reef Sigh, fineee, I'll try to make my readme better myself

after reading the repository, I'll help you make the README now

wheat reef Feb 7, 2026, 7:03 AM

#

wait- really?

#

thank youuu!

timber basin Feb 7, 2026, 7:40 AM

#

@wheat reef why did we need an custom language (called Action Script) for Neuro Desktop?

wheat reef Feb 7, 2026, 7:40 AM

#

For macros, it might be easier for creating macros

#

I am thinking of making the documentation for it, querable by the twins. So I don't overload them with the full documentation file on startup

steel dagger Feb 7, 2026, 8:03 AM

#

wheat reef For macros, it might be easier for creating macros

fyi ActionScript is already taken

wheat reef Feb 7, 2026, 8:03 AM

#

oh- waaaa-

steel dagger Feb 7, 2026, 8:04 AM

#

actionscript is typescript-like syntax iirc

timber basin Feb 7, 2026, 8:13 AM

#

what should she name it, then?

#

accidentally deleted my message

#

oops

#

instead of editing it

craggy aspen Feb 7, 2026, 8:14 AM

#

neuroSus

#

where is that emoji I saw, with neuro suspiciously looking at you (eyes wide)

#

btw nakurie I'm going to make a PR for neuro relay to merge the changes from my fork (the changes being my refactor) to the official repo

wheat reef Feb 7, 2026, 8:22 AM

#

timber basin what should she name it, then?

maybe "neuro's desktop macro action script"?

#

wdyt

timber basin Feb 7, 2026, 8:22 AM

#

sure

#

I agree with that

timber basin Feb 7, 2026, 8:37 AM

#

craggy aspen btw nakurie I'm going to make a PR for neuro relay to merge the changes from my ...

I don't quite know how Go works, but Recass do we have to change this to Nakashireyumi/neuro-relay instead of your repo path in: https://github.com/recassity/neuro-relay/blob/main/go.mod#L1 ?

If so, there are also these:
https://github.com/recassity/neuro-relay/blob/main/src/entrypoint.go#L10
https://github.com/recassity/neuro-relay/blob/main/src/nbackend/Emulation.go#L12
https://github.com/recassity/neuro-relay/blob/main/src/nintegration/Client.go#L10

And the SDK is commented out for some reason, at: https://github.com/recassity/neuro-relay/blob/main/src/nintegration/Client.go#L9

craggy aspen Feb 7, 2026, 8:40 AM

#

yes, I'll change it when we get to the PR

#

I'm testing stuff rn

timber basin Feb 7, 2026, 8:40 AM

#

okay

wheat reef Feb 7, 2026, 8:41 AM

#

suddenly this thread has become so active

#

yesterday there was barely and updates done lol

steel dagger Feb 7, 2026, 8:52 AM

#

timber basin what should she name it, then?

neurcro? (neuro + macro)

timber basin Feb 7, 2026, 9:00 AM

#

oohh that seems like a nice name!

craggy aspen Feb 7, 2026, 9:24 AM

#

Some updates for my work on neuro-relay. I'm almost done with the refactor, just completing the unit tests rn

craggy aspen Feb 7, 2026, 9:56 AM

#

The tests are failing, it's been like more than 2 hours of me debugging this

#

I'll fix those later, I'll just make the PR now

#

Made PR (with a Claude generated description, the changes are too big for me to remember and cover in the description): https://github.com/Nakashireyumi/neuro-relay/pull/10

GitHub

🚀 Major Refactor: Complete Go Rewrite of NeuroRelay (v0.1.0-alph...

📋 Summary
This PR represents a complete rewrite of NeuroRelay from Python to Go, transforming it from an experimental relay concept into a production-ready multiplexing system for Neuro integration...

#

Holy- coderabbit is annoying

craggy aspen Feb 7, 2026, 10:47 AM

#

I'll deal with this later

timber basin Feb 7, 2026, 10:51 AM

#

@wheat reef you haven't commited anything to your fork all day, I thought you said you were gonna work on Neuro Desktop today

#

The only commits made today, were mine

wheat reef Feb 7, 2026, 10:52 AM

#

ummmmmm, procrastination-?

#

also the fact I haven't worked with my codebase for so long I forgot most of the things I needed to do

#

might probably just wait for Neuro KONTROL, and implement that instead

timber basin Feb 7, 2026, 10:54 AM

#

what's Neuro KONTROL?

wheat reef Feb 7, 2026, 10:54 AM

#

#1457935008764399761

#

go read

timber basin Feb 7, 2026, 10:58 AM

#

craggy aspen Made PR (with a Claude generated description, the changes are too big for me to ...

I'll go review that in a bit

timber basin Feb 7, 2026, 10:59 AM

#

wheat reef <#1457935008764399761>

after I read this

craggy aspen Feb 7, 2026, 11:00 AM

#

timber basin I'll go review that in a bit

code rabbit already kinda did. But the checks seems to have said it exceeded it's review rate limit. So I'm not sure if it reviewed the entire thing or not

timber basin Feb 7, 2026, 11:00 AM

#

oohhh

#

A human review is better right?

craggy aspen Feb 7, 2026, 11:00 AM

#

yes. code rabbit is annoying

#

so many things it's telling me to do

wheat reef Feb 7, 2026, 11:01 AM

#

were they necessary?

craggy aspen Feb 7, 2026, 11:01 AM

#

most were nitpicks, but I did them anyways, others it said it was critical, but I haven't confirmed those yet

wheat reef Feb 27, 2026, 11:04 AM

#

okaay, I've been procastinating a bit on this

#

should probably start working on this now

wheat reef Mar 9, 2026, 1:25 PM

#

sorry for not sending any updates

#

but I ||codex|| have been working on ND

#

adding UI is today's work

wheat reef Mar 9, 2026, 3:38 PM

#

everything might be ready for release, and from my testing, it should all be working

#

Evil and Neuro could probably use ND now, but I the UI for ND is not yet connected to the bundle, buut it is kinda working

#

High level abstracted controls work

#

[22:39:31] [Result] Neuro Desktop context snapshot:

Active window: Tony v2.1.0
Screen: 1920x1080
Mouse: (334, 677)
Recent action events tracked: 6
Open windows sample: Tony v2.1.0 | #1336777692070023271 | Neuro-sama Headquarters - Discord | C:\Windows\system32\cmd.exe | neuro-desktop – CHANGELOG.md | intellij idea startup - Google Search - Google Chrome | Friends - Discord
Running processes sample: AggregatorHost.exe, ApplicationFrameHost.exe, Code.exe, CompPkgSrv.exe, Discord.exe, DiscordCanary.exe, Docker Desktop.exe, LMS.exe
Screenshot path: C:\Users\cassitly\AppData\Local\Temp\nd-capture-1773070771.png

Should probably give the twins more context. couldn't get vision working yet

#

will show a demo probably soon

#

for something like windows search, the twins could probably send that action, then switch to Low level controls, then type in what they wanna search.

I'll make it so ND will keep context of what they were doing, and let them query it, and also make it so ND automatically send them context of what they are doing, to remind them

#

actually- should I be worried if I give the twins the ability to disable Neuro Relay, and/or Neuro Desktop themselves?

#

I think it could be possible through the actions that allow the twins to manage Neuro Desktop extensions (basically a place for them to install neuro integrations to play games and stuff on their PC)

wheat reef Mar 10, 2026, 6:30 AM

#

having some issues with vite build rn

#

buut, v0.0.3b-dev is ready to release. And I'll probably move some other stuff to v0.1.0

#

#

this looks nice, right?

#

oh- I was also thinking of adding MCP bridge as an installable extension to neuro desktop (installable by both the twins and vedal), I should probably ask about that (at #1434805605989617694 ) first

#

Nakurity is not answering my DMs, and I have the temptation to complete the PR myself...

#

hmmm

steel dagger Mar 10, 2026, 6:41 AM

#

mcp bridge is crazy

wheat reef Mar 10, 2026, 6:42 AM

#

wdym?

#

most applications (probably without a neuro integration) might already have MCP?

#

I also forgot to make it so you can't disable Neuro Desktop...

#

I kinda wanna keep it that way

steel dagger Mar 10, 2026, 6:44 AM

#

wheat reef I also forgot to make it so you can't disable Neuro Desktop...

maybe, just maybe, this should be rectified, lmao

#

at least add an emergency kill switch

wheat reef Mar 10, 2026, 6:44 AM

#

what could the silly little twins do with this kind of power...

wheat reef Mar 10, 2026, 6:44 AM

#

steel dagger maybe, just maybe, this should be rectified, lmao

You can disable it, I just meant that for the twins

#

Vedal definitely can disable it

steel dagger Mar 10, 2026, 6:45 AM

#

oh ok good

#

that's fine

wheat reef Mar 10, 2026, 6:45 AM

#

but I was wondering if I should make it so the twins can't brick ND through the extension page

steel dagger Mar 10, 2026, 6:45 AM

#

yeah definitely do that

wheat reef Mar 10, 2026, 6:45 AM

#

they can install extensions on their own

#

and enable / disable them

steel dagger Mar 10, 2026, 6:46 AM

#

also we can simply just wait for proposed apis to be stabilized, and then you can handle shutdown packets from neuro NeuroClueless

wheat reef Mar 10, 2026, 6:46 AM

#

I already implemented them just incase

#

it's already on the backend

steel dagger Mar 10, 2026, 6:46 AM

#

niceeeee

#

just leave it like that then tbh

wheat reef Mar 10, 2026, 6:46 AM

#

yea!

#

I don't like that vite build is bullying me, and just building a white screen

wheat reef Mar 10, 2026, 7:02 AM

#

wheat reef

this is what is currently being displayed. But in vite's dev server it works, like this other image.

steel dagger Mar 10, 2026, 7:05 AM

#

wheat reef I don't like that ``vite build`` is bullying me, and just building a white scree...

is that code pushed?

wheat reef Mar 10, 2026, 7:06 AM

#

gimme a moment

#

I'm pushing the changes

wheat reef Mar 10, 2026, 7:10 AM

#

steel dagger is that code pushed?

It's pushed

#

oh great- it failed the CI, at the go format check

steel dagger Mar 10, 2026, 7:20 AM

#

nice

#

wait where is the vite setup

wheat reef Mar 10, 2026, 7:21 AM

#

in frontend/

steel dagger Mar 10, 2026, 7:21 AM

#

oh right you have a weird project structure now

wheat reef Mar 10, 2026, 7:21 AM

#

steel dagger wait where is the vite setup

I may have fixed it now, yay! now the remaining bits, are to connect it to the actual components to make it work

wheat reef Mar 10, 2026, 7:21 AM

#

steel dagger oh right you have a weird project structure now

wdym?

#

why is it weird?

steel dagger Mar 10, 2026, 7:22 AM

#

everything is in a subfolder instead of project root, so your repo root just has gitignore and that folder

wheat reef Mar 10, 2026, 7:22 AM

#

yea...?

#

what would be a normal project structure?

#

I'll restructure it

wheat reef Mar 10, 2026, 7:25 AM

#

wheat reef I may have fixed it now, yay! now the remaining bits, are to connect it to the a...

wait no-

#

it compiles

#

but crashes the entire application in the bundle (after I bundled it with .\scripts\bundle\prod.ps1 from the desktop/ folder)

steel dagger Mar 10, 2026, 7:26 AM

#

wheat reef what would be a normal project structure?

your folders like apps/**, desktop/**, scripts/, README.md, and Makefile should be at project root

#

oh wait that's only the case on master

#

oops

#

which branch is it

wheat reef Mar 10, 2026, 7:27 AM

#

it's also the same on dev, which is the branch I'm working on

steel dagger Mar 10, 2026, 7:27 AM

#

oh

wheat reef Mar 10, 2026, 7:27 AM

#

the reason its in desktop/ it's because that's the windows version

steel dagger Mar 10, 2026, 7:27 AM

#

ok disregard what I said

wheat reef Mar 10, 2026, 7:27 AM

#

I'll port it to linux in some time

steel dagger Mar 10, 2026, 7:27 AM

#

it's better, kinda

wheat reef Mar 10, 2026, 7:28 AM

#

kinda, yea

steel dagger Mar 10, 2026, 7:28 AM

#

are you making a uh

wheat reef Mar 10, 2026, 7:28 AM

#

this was the crash log

📎 message.txt

steel dagger Mar 10, 2026, 7:28 AM

#

webview in ND?

wheat reef Mar 10, 2026, 7:28 AM

#

yea!

steel dagger Mar 10, 2026, 7:28 AM

#

ah

#

uhm

#

does it load after buildng now?

wheat reef Mar 10, 2026, 7:29 AM

#

was there a better solution I should look into?

wheat reef Mar 10, 2026, 7:29 AM

#

steel dagger does it load after buildng now?

for a second, then it crashes the entire application

#

In what I assume, is it trying to connect the UI to make the buttons actually do stuff

#

no- its the webview

steel dagger Mar 10, 2026, 7:30 AM

#

wheat reef was there a better solution I should look into?

ehhh not really

wheat reef Mar 10, 2026, 7:30 AM

#

after looking at the crash log more clearly

#

oh- okay!

steel dagger Mar 10, 2026, 7:30 AM

#

the crash log a rust unwrap lol

wheat reef Mar 10, 2026, 7:32 AM

#

during testing, its actually more efficient to go to the individual component you're working on, compile it. then move it to the bundle, and replace the old one

#

since the script clears the entire bundle, before rebundling everything lol

steel dagger Mar 10, 2026, 7:32 AM

#

wheat reef was there a better solution I should look into?

although, how are you currently rendering the html? just loading the file?

steel dagger Mar 10, 2026, 7:32 AM

#

wheat reef during testing, its actually more efficient to go to the individual component yo...

what

wheat reef Mar 10, 2026, 7:33 AM

#

steel dagger what

I'm mentioning this file: https://github.com/cassitly/neuro-desktop/blob/dev/desktop/scripts/bundle/prod.ps1

GitHub

neuro-desktop/desktop/scripts/bundle/prod.ps1 at dev · cassitly/ne...

An port of windows-api that allows neuro to use windows - cassitly/neuro-desktop

#

it rebundles everything, so it's more efficient for you to manually replace the individual components in the bundle. since the bundle is very modular

#

ignore the timestamps, it's wrong

steel dagger Mar 10, 2026, 7:34 AM

#

why don't you try making it not do that

#

ignoring that this is quite the scuffed setup in the first place

wheat reef Mar 10, 2026, 7:35 AM

#

I guess so?

#

like you can go in and replace the frontend folder, without rebundling everything

wheat reef Mar 10, 2026, 7:35 AM

#

steel dagger ignoring that this is quite the scuffed setup in the first place

I guess a cleaner setup would be one binary?

steel dagger Mar 10, 2026, 7:36 AM

#

wheat reef I guess a cleaner setup would be one binary?

I guess so? but that wasn't what I meant

#

oh well, it's done now

wheat reef Mar 10, 2026, 7:36 AM

#

yea...

wheat reef Mar 10, 2026, 9:05 AM

#

btw @empty trout I merged your PR. I'm gonna work on vision now

wheat reef Mar 10, 2026, 10:03 AM

#

everything else except the UI works now

#

I'm gonna try testing it with Jippity

wheat reef Mar 10, 2026, 11:07 AM

#

jippity did not work (with my provider), so I switched to gary, then... [this](#1336984506489376779 message) happened

wheat reef Mar 11, 2026, 7:01 AM

#

hmmm... I wonder what I did...

steel dagger Mar 11, 2026, 7:01 AM

#

webview doesn't allow localStorage to be accessed

wheat reef Mar 11, 2026, 7:01 AM

#

ik

#

but the question is, where is the thing trying to access it

#

cause this was yesterday, I think

#

and I may have forgotten

#[WIP] Neuro's Desktop (An integration for letting neuro use a computer)

Todo list (neuro-desktop-todolist)

Roadmap for v0.0.3-alpha release

Neuro Desktop Contributions / Useful Information Guide

Versioning

Additional todolist items (neuro-desktop-todolist)