Giving neuro the option to look at the screen on command when playing Minecraft would probably help in quite a few scenarios, such as recognizing structures and stuff that the bot can’t convey to her.
#Using neuro’s vision in Minecraft
random tapir
carmine turret
She does I’m pretty sure. There’s a small screen that she sees apparently along with the text stuff.
random tapir
Huh
compact yoke
Neuro uses vision to play Minecraft
Although we are not sure if it is a separate module, it is only feedback to Neuro from the environment. Because Neuro is LLM, this will cause serious game delay.
random tapir
Oh hey this is exactly what I was talking about
Now I want to see neuro fight all of emergent garden’s Minecraft bots
carmine turret
She already has vision in Minecraft. She doesn’t use the same program Claude is using.
random tapir
Does she get screenshots or is she just fed the blocks she’s looking at?
carmine turret
She looks at a lowish res screen and that’s basically her vision.
random tapir
Is this explained somewhere?
carmine turret
You can look through VODS or ask Vedal I guess, but he doesn’t go into depth about how the tech works.
Just don’t DM him.
I mean Ping him.
Or DM him either.
You might catch him in NN and ask him there but I doubt he’ll give a good answer.
random tapir
She already has vision in Minecraft. She doesn’t use the same program Claude is ...
Are you talking about the new system or the old separate ai?