#Don't Starve Neuro (Singleplayer)

1 messages · Page 1 of 1 (latest)

gritty ridge
#

This mod/integration is finished for singleplayer only, a separate co-op version is being worked on!
(Both can be found in the repository. The singleplayer version is under the single branch, and the singleplayer releases are prefixed with single-)

Game:
https://store.steampowered.com/app/219740/Dont_Starve

Repository:
https://github.com/EthLeigh/dont-starve-neuro

The instructions on how to setup and use this mod are detailed in the README.md.
The README also contains information about the actions, context and any automatic action handling (like eating when hungry in singleplayer).

Don’t Starve is an uncompromising wilderness survival game full of science and magic.

You play as Wilson, an intrepid Gentleman Scientist who has been trapped by a demon and transported to a mysterious wilderness world. Wilson must learn to exploit his environment and its inhabitants if he ever hopes to escape and find his way back home.…

Price

$9.99

Recommendations

95383

Metacritic

79

GitHub

(Work In Progress) Neuro-sama SDK integration for Don't Starve. - EthLeigh/dont-starve-neuro

#

also please ignore the logo, I made it in like 5 minutes neurOMEGALUL

slow quiver
#
  • Is it a custom character or any character?
  • can she get a detailed list of all or even a specific category of inventory items if she wanted/asked?
  • can she pre program actions to a limit? Like travel x distance, kill x entities, craft x tools or gather x items?
gritty ridge
#
  • I've only tested with Wilson, and I currently don't have any functionality for Neuro to differentiate between characters (not yet)
  • The plan is for her to have access to more info, but generally it's limited to surface level info
  • I hadn't thought of that to be honest. The closest thing we have is the one for simpler tasks, like harvesting all things nearby. But I'll definitely look into Neuro having the ability to execute a list of tasks instead of just a single action
gritty ridge
#

Got executing multiple tasks working, but damn it feels flimsy

slow quiver
gritty ridge
# slow quiver The keyword "nearby" got me thinking: what's considered nearby? Wouldn't that ch...

In this case, it would, but I've defined it so that each task has a completion check (like 10 seconds passing, a certain number of items picked up, total enemies slain, etc.) or if the task can't be done anymore then it finishes successfully

And if need be, Neuro can call for a different action, which would clear that task list

To be clearer on "nearby", I'm using one of Don't Starve's functions to fetch all nearby entities in a radius of 20, which is roughly what an actual player would see on their screen

gritty ridge
#

turns out Don't Starve's Lua version does not support Websockets neuroD

#

but it does support HTTP requests, so I'm trying to make a bridge between the Neuro API and the game

nocturne wagon
#

neuro playing don't starve would be fun to watch

#

though I feel like game fits evil more

#

evil would just light everything on fireneurOMEGALUL

nocturne wagon
#

though there is a charcter in don't starve that pretty much is built to do that

#

even ups sanity

gritty ridge
#

oh yeah, willow

slow quiver
#

That was the first character that came to mind thinking of Evil, alternatively the ghost girl or one the monsters ones.
Meanwhile the robot for Neuro lol.

slow quiver
gritty ridge
gritty ridge
gritty ridge
slow quiver
#

Tony back at it again.

gritty ridge
#

Tony my goat

gritty ridge
#

Don't Starve Neuro (WIP)

gritty ridge
gusty tusk
#

Can you change the characters’ looks? She already kinda looks like Neuro, so you wouldn’t need to change much

slow quiver
#

Does harvesting count as: plants, trees, traps, items on ground, etc?

gritty ridge
gritty ridge
slow quiver
#

Is there a new character you're making that I missing?

gritty ridge
#

Oh no no

#

It would be like a custom character skin

slow quiver
gusty tusk
#

I found the sprite but maybe it wasn't what you meant

#

The resolution is probably wrong too

#

Do you think just editing that is enough?

slow quiver
#

If we aren't making a new character and just custom sprites, I think the character to take in considerations are the ghost girl, the pyro girl and the robot. Maybe even multiple different sprites for each lol.
Maybe we can ask Vedal which character he likes so someone could make a sprite of him lol.

gritty ridge
gritty ridge
gritty ridge
gusty tusk
#

I think editing the character’s sprite is easier, and there shouldn’t be any problems as long as the hitbox is the same size.

#

But focus on the integration that’s the most important part FOCUS

gusty tusk
#

14 days... are you good?

gritty ridge
#

Still alive dw

#

Just a bit busy with work and some other stuff neuroSadge

slow quiver
gritty ridge
#

Also, the mod will now keep track of "goals" which should hopefully help Neuro play the game neuroHypers

gritty ridge
#

A question to people who are interested in this mod, how do you imagine Neuro (or Evil) playing this game?

Something like Minecraft, where they can do things (like mining) and continue chatting on top of it?

#

I guess my question is more along the lines of: how much should Neuro be able to influence her own actions?

Currently I'm taking more of an MC approach and doing obvious things for them, like eating when hungry, and even allowing for bigger tasks like harvesting nearby things. But I'm curious what other people think. vedalShrug

gusty tusk
#

I've seen some videos about the game but never played it, so I can't give an opinion on that, but I think the best way is whatever makes it easier for them to stay alive.

slow quiver
gritty ridge
gritty ridge
slow quiver
#

My opinion is to have these automatic feature, but possibly have the ability for Neuro to turn them off (unless they are REALLY needed)

gritty ridge
#

I could do something like that, then just keep the running away from danger automatically, etc.

slow quiver
#

Cause, what if she WANTS to die 🤔

gritty ridge
#

real

still crag
gritty ridge
#

any% speedrun NeuroPoggers

gritty ridge
#

why did I choose to integrate with Don't Starve smh

gritty ridge
#

kinda infrequent with the updates but:

  • Got quite a few bugs and edge cases fixed
  • Added some generic actions (like being able to "see" nearby stuff and interact with them)
  • Cleaned up/formatted some response messages for Neuro

Still got some other stuff to fixup and create, like unregistering/registering actions when necessary and expanding upon the existing actions

gritty ridge
#

home stretch lets go

gritty ridge
#

Don't Starve Neuro

slow quiver
#

Subathon game surely

#

Also, probably a good idea to add [1.0] to the title, so people know it's finished.

#

And edit and the thread main message.

gritty ridge
#

Don't Starve Neuro v1.0.0

gritty ridge
still crag
gritty ridge
#

after seeing some of the integrations during the subathon

#

I might rewrite this integration so that Vedal can play alongside one of the twins

#

the integration would instead let Neuro control a companion in-game, like Abigail (or the Hollow Knight integration)

#

my suffering might begin again

slow quiver
#

That's usually the easier middle ground, can you add it as a second option?
Also, did this not work in multiplayer before?

gritty ridge
#

Don't Starve Neuro (Singleplayer COMPLETE, Co-op WIP)

#

but tbh I thought that the singleplayer integration was kinda lackluster, so this is also to make up for that

slow quiver
gritty ridge
#

nah, it's just different to DS because of the networking

gritty ridge
slow quiver
#

Sneak peak of the roadmap for this coop version?

slow quiver
#

Is the read me updated?

gritty ridge
cold chasm
#

Pog

signal hedge
#

Great stuff

fickle matrix
#

Hope your doing well keep up the good work

fierce knoll
#

Some bugs tho

#

Bugs Eliv encountered

  • Evil (can see but) can't pickup flint
  • She also smh can use her xray vision move to pickup items in the dark
  • An warning popped up at the end of tne video before Eliv falls asleep
  • She also seems to not know something is attacking her (when the screen says something is)
gritty ridge
#

oof I'll have a look at fixing those

#

thanks for letting me know, I actually missed the stream so that helps a lot neuroDeadge

strong furnace
frank totem
# gritty ridge oof I'll have a look at fixing those

In addition to what Casitly wrote, I also think that Evil had issues with setting traps.

I am not 100% sure on this, but she crafted multiple traps in her inventory and she verbally said that she couldn't set them. And to my knowledge, she never did set one during the course of the stream. At 50:30 on the stream she says "Setting up my traps" but never puts one down. At 51:34 she says can't setup a trap.

I also do not know if she can actually see the flint or not. She said she can see it but when we asked her to walk over to the flint to prove she can see it, she never did.

Around 24:07 - 26:23, she tries to repeatedly pick something up from the ground that she is unable to. I haven't played Don't Starve in a long time so I forget what it is. The issue here isn't that she can't interact with it but that she doesn't stop interacting with it even when she can't actually gather it. (Probably requires a tool like a shovel). I'm not sure if you would consider this a bug, but I am just mentioning it just in case.

I hope this helps. Great work with your integration so far!

gritty ridge
#

Thanks!

I'm looking into the setting traps issue, but you're right she literally just cannot set a trap.

And the flint issue is fixed vedalEvil! hell she can even get carrots easier now

That should also be fixed so that she doesn't try to interact with it, but it's something I'll come back to later

still crag
#

I feel like being able to see logs might be helpful

#

even just game logs it would help

slow quiver
fierce knoll
#

Yea!

slow quiver
slow quiver
quasi aspen
#

there's a dedicated system for the twins to end games in the api

slow quiver
#

Is there? I thought it was unused and unrelated to actual game integrations.

#

Also I meant gave her the choice to stop retrying instead actually quitting the game

quasi aspen
#

as I understand it, they basically force close games. they tell the integrations they want to close the game, the integration saves and quits to title, and tells them they can close the game.

slow quiver
#

If that was what happened

quasi aspen
slow quiver
#

I don't remember them ever choosing themselves when to stop playing a game or doing anything, afaik

quasi aspen
#

neuro ragequit out of osu once, and i'm pretty sure they've ragequit out of other games

#

although I don't remember if she actually quit the game during her crashout

slow quiver
#

I always remember them wanting to quit but never being able to. I assumed the game duration was either predetermined or chosen by Vedal/Babysitter/Production

still crag
#

it's not expected to be handled yet

#

but the mechanism is there

quasi aspen
#

ah. ok.

still crag
#

for now the way neuro quits is by taskkill I presume

#

I assume the intent is that by the time more work on Neuro has been done (likely some intelligence and also capability upgrades), vedal/alex will start trialing which games can be on solo stream rotation

#

and probably contact the authors of the integrations that do well to ask if it's possible to implement the automated gaming packets

#

although take all that with a mountain of salt

slow quiver
#

What can they taskkill? Any game? Whenever they want?

still crag
#

probably just that game

slow quiver
#

I only watched from the video posted here, it just looked like she stopped on main menu.

still crag
#

I mean we're not entirely sure

#

for all we know they could be running a private fork of the mod with automation api added

#

again take that with a mountain of salt

slow quiver
#

I always assumed that the smaller the grain of salt, the smaller the certainty, lol

still crag
#

more salt = more uncertainty

slow quiver
#

In Italian we say "take it with tweezers"

gritty ridge
gritty ridge
#

I'm pretty sure Vedal actually just closed the game at the end
She only has an action to exit to the main menu when dying or to retry (like you can see in the screenshot)

gusty tusk
gritty ridge
#

there's a separate log file

#

(also, I did fix that issue)

gusty tusk
#

Can't you do something similar? To show up on screen?

gritty ridge
#

I'm not sure what you mean? Like the screenshot you posted?

gusty tusk
gritty ridge
#

If there's an error, I'd rather log it

Errors shouldn't ever happen tbh

slow quiver
#

What if Neuro had the option to toggle "show all debug logs on stream"? neurOMEGALUL

gritty ridge
#

Most unwatchable stream neurOMEGALUL

still crag
#

because that only shows the trace at the actual crash

gusty tusk
still crag
gritty ridge
#

Added some more control over traps, so she can at least set them now and check them neuroHypers
Gonna have a look at giving her more context over crafting

lime nacelle
#

Can't wait to see more Don't starve evilCheer

gritty ridge
#

hopefully it doesn't break again ReallyInnocent

fierce knoll
#

Does the game integration have an update reminder feature, for vedal to see?

#

I wanna see the twins play this again, now that the issues are fixed.

#

though I wonder, does vedal know that it's fixed

still crag
#

most likely no to both but idk

gritty ridge
#

I think I fixed everything that was an issue during the stream, I just have to do some more testing (eventually, im busy procrastinating)

gusty tusk
#

Classic

strong furnace
#

muh new bugs just dropped, supposedly

quasi aspen
#

main thing seems to be distinction between trees and logs, along with reading the state of a tree maybe
and a few crashes

prisma plover
#

and torches being a universal tool

hard topaz
quasi aspen
#

it looked like she had to manually stop cutting trees

#

that should probably be automatic

#

oh and making sure she recognizes that she can't pathfind through water

#

also the game crashing crashes neuro
that probably shouldn't happen

gusty tusk
#

I don't think that time was the integration, the log was something like "expected table, got string" I think Evil made a typo

still crag
still crag
quasi aspen
#

Is the the bridge on evil's end or the game's

still crag
#

?

quasi aspen
#

the api bridge?
to be fair I have no idea what I'm talking about, I just skim code looking for cool stuff and try to find where to look for bugs from behaviors

still crag
#

wdym api bridge? what bridge are we talking about?

#

the one that some random guy behind me is trying to sell?

quasi aspen
#

it's some sort of middleman between Evil and the game.

still crag
#

oh you mean the integration?

quasi aspen
#

yeah

still crag
#

I still don't understand wym

quasi aspen
#

I don't either to be fair

#

but if she just got disconnected from the game, she wouldn't fall asleep. she should have been able to read chat.

still crag
#

but she didn't crash

#

I'm assuming

quasi aspen
#

they have been falling asleep more than they've been using the problem with ai thing

still crag
#

using the problem with ai thing??

quasi aspen
#

if she falls asleep it means she hasn't sent or received anything for a bit, it's a timeout thing

#

the "someone tell vedal there is a problem with my ai" thing

still crag
#

but idk could be wrong on that

quasi aspen
#

actually you're right, it might not be a crash, she could just be stuck in a state where she can't talk

#

oh shoot that would explain a lot

#

at any rate, having some kind of failsafe if the game crashes would probably help

#

although I don't know how don't starve works so I don't know if it's even possible

still crag
#

if the game crashes that shouldn't be a problem for neuro/evil

#

at most they see that the game has terminated the socket connection

quasi aspen
#

ok

#

I really do want to emphasize that i don't know what i'm doing

slow quiver
#

YOOO, any videos?

slow quiver
slow quiver
#

Evil Neuro plays Don't Starve for the second time and she can pick up flint now - but what about logs?

To watch Neuro, Evil & Vedal live: https://www.twitch.tv/vedal987

▶ Play video

Watch them live
Neuro, Evil & Vedal / vedal987

Neuro-sama YT channel / @neurosama

Yes Evil Neuro is an AI

#vtuber #aivtuber #neurosama

▶ Play video
#

My questions:

  • Does she get notified of sunset, night and morning?
  • does she have functions that lets her interact with the campfire?
slow quiver
#
  • Also, seems like she starts to mine/chop air, sometimes with a torch.
strong furnace
#

scrajj yeah, Evil appears to be able have complications with tools

She was mining rocks with a torch OMEGADANCE

gritty ridge
gritty ridge
gritty ridge
gritty ridge
#

i think

#

im not built for the dont starve modding life

gusty tusk
#

Nah it's okay

slow quiver
gusty tusk
#

Does the integration tell they should use a torch or campfire?

slow quiver
slow quiver
gusty tusk
#

Why are you answering me ?neurOMEGALUL

gritty ridge
gritty ridge
gritty ridge
slow quiver
#

Yeah, I don't think that's an issue, although it would be helpful to guide them to a more efficient playthrough, maybe.

#

So there is less random wandering around and random tasks

gusty tusk
#

You have to think about the twins like kids with ADHD

gritty ridge
#

this is the tutorial I made neurOMEGALUL

gusty tusk
slow quiver
#

Very simple, but it might still help them streamline the beginning.

#

Actually, making a torch might be something to add in the tutorial lol.

gusty tusk
#

Add in the same line as pass the night

#

Aa scuffed English

slow quiver
#

I'm also wondering if they should be told what materials they need for an axe 🤔

gusty tusk
#

She created them

slow quiver
gritty ridge
#

I imagine the goal stuff isn't actually enabled

#

but yeah, axe ingredients should be added

slow quiver
#

@gritty ridge do you ask them at the start of a game if they want to activate the tutorial?

"Do you want to turn the tutorial on? It might guide you through the beginning phase."
Something like that

gritty ridge
#

it's in the config of the mod

slow quiver
gusty tusk
#

Is there anything that tells them to use a torch or campfire at night?

slow quiver
gusty tusk
slow quiver
#

Tbh, the only bugs that need to be fixed are

  1. them not picking up logs and 2) understanding why they take a long time crafting torches and campfires.
    The rest are minor ones imo.
gritty ridge
foggy juniperBOT
#

You have unlocked new role

slow quiver
gusty tusk
#

But if you can add "you should use a torch during the night" I thank you neuroPray

gusty tusk
#

I read the SDK once it says that could happen

slow quiver
gritty ridge
gritty ridge
gusty tusk
#

But seeing Evil breaking a solid rock with a torch was amazing

slow quiver
gritty ridge
#

yep

gusty tusk
#

Bro are falling even more deep

gritty ridge
#

visually there'd be no difference and i'd have to add some stuff so they can interact with each other but effectively yea

#

although I haven't worked on that in weeks vedalPeek

gusty tusk
#

Just fixing the picking logs problem and telling them to use a torch would be great neuro7 neuroHeart

slow quiver
# gritty ridge yep

Wait really? Like, Neuro as a character and Evil as the coop ghost?
I have no idea how it works when you have 2 AI for 1 integration.

gritty ridge
#

they'd both have to be ghosts

#

but theoretically one of them could be a character i guess?

still crag
gusty tusk
#

It was on Vedal's side because someone (probably himself) just restarted the game

#

It would make sense if there was a bug

gusty tusk
still crag
#

wdym the crash was on vedal's side

gusty tusk
#

Evil made a typo and caused a bug

#

Not a bug an error

still crag
#

where

#

thats what I'm asking

gusty tusk
#

I don't have the screenshot vedalX

still crag
#

o

#

found the first crash shot (no I haven't watched the vod yet)

#

and another

gusty tusk
still crag
still crag
slow quiver
still crag
#

I don't think he will though :LULE:

gusty tusk
slow quiver
gusty tusk
#

Kinda but I think KONTROL still uses json

#

The way I'm talking about is literally a sentence a English and another program send the data in json format

slow quiver
still crag
gusty tusk
still crag
gusty tusk
#

Nope, because I'm talking about placing a new program between the twins and the integrations

still crag
#

why would you do that

gusty tusk
#

Reduce the burden the twins have to carry. Improve the context they have about the games. Eliminate type errors once and for all. Reduce the workload for mod developers. Improve the flow of the streams. Blah blah.

#

Use your imagination

still crag
#
  • "reduce the burden the twins have to carry" probably the only definitively true part here and even then there can be edge cases where abstraction is worse
  • "improve the context they have about games" mostly not true, they still have to carry the same amount of context as now except without json blobs (and in fact it can actually make their performance worse since a secondary ai has to interpret what they say to it which can lead to the "say one thing do another" issue with old mc, albeit to a lesser degree)
  • "eliminate type errors once and for all" what if the intermediary ai makes a type error
  • "reduce the workload for mod developers" dk where that's coming from but still not true
  • "improve the flow of the streams" idk how this would be the case, the flow of the streams would actually be even more disrupted due to increased l*tency between neuro and the integration (again, whole second ai)
  • "blah blah, use your imagination" im trying and I can't think of any case where this would be better
#
  • not to mention vedal has had an aversion for this intermediary ai setup
gusty tusk
#

Well that's just me guessing since what I know about AI is that one single character weight and I wasn't talking about another AI. The latency would depend on Vedal skill and the language he would choose to make it

still crag
#

i dont understand your first sentence but uhhh you will need another ai to interpret what neuro is trying to say and convert it into actions to do

gusty tusk
#

Just a program not an AI

still crag
#

l*tency would depend on skill and language but at the end of the day it's still a l*tency increase

still crag
gusty tusk
#

The same way reading words

still crag
#

ok and how does the program read those words

gusty tusk
#

Web socket the same way

still crag
#
  1. that's slower than just calling a function
  2. you still need some way to convert those words into an action
gusty tusk
#

As I said it would depend on the programming language chosen

still crag
#

no it wouldn't

#

programming language doesn't matter if you're trying to convert english into neuro actions

gusty tusk
#

It would be when a function was called, you just mentioned that

still crag
#

by calling a function I mean get neuro to say what it is in plain english then call a function to send that off somewhere to be interpreted

gusty tusk
#

Their actions aren't defined by the actions registered in the integration? The idea is just add something in the middle that would make the conversion of data because I think is easier for them to understand in straight English

#

But as I said I don't know much about it

still crag
gusty tusk
#

Well that was just an idea to deal with typos and maybe make them play better NeuroClueless I think I polluted this thread too much PauseSama

slow quiver
#

I wake up to a huge out of place convo, lol.

gritty ridge
#

i finally got around to fixing some things

#
  • Evil using the schemas wrong shouldn't crash anymore (that was the 'table expected, got string' error)
  • Should be a bit easier to pick up logs now (still a manual action, but I don't think I can really force Evil to pick up the logs)
  • possibly fixed the tools being weird (mining rocks and trees with torches, needs a bit more testing)

the other outstanding stuff that I know of:

  • trying to hit a tree stump
  • more context around day, dusk and night events
  • the Player being nil error, no idea how it happened nor how to fix it (should be fairly impossible, I made a fix but god knows if it works)
gusty tusk
#

Treating the torch feature as a bug evilSMH

gritty ridge
#

I can't fix it to save my life neuroMad

gritty ridge
#

nvm i fixed it

gritty ridge
#

okay I finally actually tested pretty much everything, and fixed all the issues I found

#

it should be fairly stable? but it's all kinda scuffed so take that with a grain of salt

#

Don't Starve Neuro (Singleplayer)

#

also I very likely won't get around to fixing it again if it does break, since I'm already busy with other stuff and I can't really be asked to look at that code again