these guys did it better than me https://voyager.minedojo.org/ but here's a better UI and setup
A Minecraft bot that uses LLM to converts user's chat into actions for a Minecraft player entity.
1] install node
2] install setup file
{whilst [2] is running start step [3] as it takes a few mins}
3] google ai studio account {its NO LONGER free} and get api key
4] run AIminebot from desktop{or from the location where you saved the file during setup}
5] use it to spawn the bot in your world
1] place specified item and break blocks at specified coordinate.
2] goto specified coordinates.
3] locate specified entity in vicinity.
4] chat with the player.
5] drop specific item from inventory.
6] drop every item in inventory.
7] attack specified entity{including players} until it dies.
8] hold specified item in hand.
9] fill or make a wall around a cuboidal area with specified block and specified coordinates(two coordinates at extreme opposite).
10] able to view bot's perspective on web browser without being on the server via localhost:3000
11] auto eat when low on hunger
12] easy setup
1] interaction with chests and "chest like" gui.
2] better auto eat
3] rewrite fill {and maybe wall} to be faster
5] local LLM?