Minecraft AI

[modest crest]

Is the AI based of baritone?

Because Baritone is open-source last I checked. And if you want to improve Neuro-Sama in minecraft you could use that as a base and modify what for what you need 🤔
Not sure if this has been brought up before if it has feel free to just delete post or smth.

[rocky pasture]

no

the MC AI isn't baritone, and when i asked about about adding baritone before, it was a hard no.

[modest crest]

I see

[rocky pasture]

well, not a hard no from Vedal, but from others that is

in #questions or #suggestions idk which it was

[modest crest]

Could be wanting to do it homegrown code wise

[rocky pasture]

yeah basiclly

also consider that baritone's OSS license could require that other projects based on it also be open

[modest crest]

Also true

But isn't the among us AI semi-open?

[rocky pasture]

I know the interface with the game itself is open (including pathfinding), the AI might be too, but thats the newest one, and seems to be the exception, not the rule. Vedal has said many times that Neuro will be closed source basically until he isn't creating competition by releasing it

[modest crest]

Yeah I understand that

He has said that the game AI and the the everything else AI are separate

And don't usually communicate

But if he wants the game AI to communicate to the rest of the AIs it would make sense to keep that locked down

[rocky pasture]

yeah, so the architecture of Neuro is basically:
Chatbot can get some information from a game bot

[modest crest]

Probably via the gray scale

[rocky pasture]

in the AU case, he wants to integrate it more so she can actually know whats going on

[rocky pasture]

wdym

[modest crest]

The gray scale frames

The AI sees via taking a like 128x128p frame and analyzing it for path finding

Usually in gray scale ^

(You can watch code bullet to learn more)

[rocky pasture]

bro i have been watching him for 5 years

[modest crest]

I obviously don't know that ^

[rocky pasture]

but thats not what vedal is using for AU AFIK

[modest crest]

Talking minecraft

Not AU

Should of clarified

[rocky pasture]

the OSU sees a grayscale, idk about MC

but

[modest crest]

Probably does for MC

Since it would make sense to reuse some code

[rocky pasture]

it is vision i know, just not the size, and probably color

[modest crest]

I think baritone uses as well

128x128p no doubt

Minecraft you don't need high res since it's all 32x32 textures or something like that

[rocky pasture]

what the chatbot sees is basically only the "current game state" and how much of that is passed on depends

[modest crest]

Yeah

I remember seeing an interview during the ban about wanting her to react to dying in lava

I have been wondering what GPU he is using.

[rocky pasture]

some of this so far, including size of MC and the fact that it is color, and the GPU is in #1095956760763846701

for further AI talk thats not question related i recommend #programming (formally programming)

[modest crest]

Aight

[somber sluice]

Nvidia's minecraft model?

[grand flint]

i think you are looking for, actual A.I. (not bots) see MineRL https://minerl.io/

[somber sluice]

https://github.com/MineDojo/MineDojo

[lethal imp]

is the AI based [...]
yes

[raven plover]

When Neuro play mc again?

[grand flint]

DONT use MineDojo, Neuro will keep dying and its boring to see. Use this secret sauce bot instead :3 https://github.com/gaucho-matrero/altoclef

https://www.youtube.com/watch?v=q5OmcinQ2ck&t=387s

[pine viper]

@grand flint has leveled up! (8 ➜ 9)

[grand flint]

GPT4 can now play minecraft https://github.com/MineDojo/Voyager

[storm vigil]

Yeah, seen this one too this morning.

Its Open Source and made by Nvidia, might be good to test around with it

https://voyager.minedojo.org/assets/documents/voyager.pdf