Finally figured out how to make my bot move (part of ongoing project)

[opaque shore]

https://github.com/shasankp000/AI-Player

If you like my work so far, please consider starring the repository! :DD

Please view video in fullscreen for better quality.

[opaque shore]

Thank you!

[boreal tree]

How do you plan to have the bots detect the in-game environment? Screenshots and image analysis?

[opaque shore]

well I am still working on that, I have an idea of getting sound subtitles for block walking sounds for environment and entity detection nearby, but I am hooking this bot up to a language model so there will be a lot of reinforced learning involved

[boreal tree]

In the long term, I think the more interesting implementation of AI-players will be one where the bot have an I/O that is similar to an actual player, but doing image analysis every 2 second or something would be unfeasible right now.

So it sounds like you might want to implement the AI player in a way that is more similar to a mob than an actual player. For entity detection, maybe you can use the mechanic where mobs detect each other when they make eye contact? Like when a villager/iron golem sees a zombie. For environment detection, I think it’s probably easier to use Minecraft’s built-in mob pathfinding for navigation, and use some way of directly detecting exposed blocks in an area like villagers detecting workstations.

It depends on what your short term goal with the project is, I guess, being able to use the chat to tell an AI-player (or just any modded mob) where to go, what mob to attack/follow/avoid and what blocks to mine would be REALLY cool already, even if the I/O behaves more like a mob under the hood.

[opaque shore]

I've already implemented custom pathfinding for the bot

Using the efficient A* algorithm

Now I'm working on hooking it up to a a language model which I'm gonna feed the path data generated by the algorithm, then see how it goes