AI Learns to Speedrun Minecraft

These are three of the worlds most advanced AI's racing to beat Minecraft. The catch is that they are kinda really dumb and have to learn as they go. Who's going to win the race, Claude, Gemini or GPT? Time to find out

He's the one who developed the technology for these bots and has tutorials on how to use them as well as sick videos on his own channel. CHECK HIM OUT AND SUBSCRIBEEEE

Also thank you to my lovely voice actors
Claude: @CraftyMasterman
Gemini: @ParrotX2
GPT: @Kenadian

➤➤Links: I don't think I need any but maybe I forgot

This is a series called Minecraft VVSauce where I explore random features of Minecraft. Not Secret Minecraft things or Minecraft lore (like Game Theory) or Escape Rooms, but a research based series dedicated to over-answering questions you never asked.

🍍

[Wifies]

mfw I thought September had 31 days not 30 so I almost fumbled the sponsor deadline and had no video ready

also ARG video coming next don't worry

[EnCraft-mc]

>be Gemini
>be completely last
>suck
>have a main character moment
>gives the win to the others
>refuses to elaborate

[emilygordbort]

Gpt: Practice makes perfect!
Claude: Teamwork makes the dream work!
Gemini: The real treasure was the friends we made along the way!

[Hamburger....]

GPT:
>Hardwork, Dedication
Claude:
Persuasive speech
Gemini:
Sucks at the game but have a main character moment and gave the wins to the other ai

[Phantagorax]

16:58 Gemini casually placing a block mid-air ☠☠

[Trollend]

For those wondering, the video isn't fake but it lies about the models having the ability to learn and portrays the capabilities of the models deceptively. The video creators clearly don't have a background in AI or machine learning.

The 3 models shown are all large language models, or LLMs. They're purely text driven and do not have the ability to directly interact with a video game like Minecraft. However, a group of programmers have written a code base called "Mindcraft" to allow these models to work with a framework called "Mineflayer" which is what is really interacting with the game. So the models output data to Mineflayer which plays the game - all of the models are basically playing a text-driven adventure. They are able to "see" the world around them by querying things through Mineflayer (which queries Minecraft), meaning they only have a very basic understanding of their surroundings.

Now why do I say the video lies and is deceptive? Two reasons. First, none of these models are "learning" as said several times throughout the video and in the title. These models are all pre-trained over the course of weeks to months with an insane amount of computational compute power, and they all cost hundreds of millions to billions of dollars to train. They cannot get better at tasks because they can only "predict" now that training is over. The type of learning the video claims the AI are undergoing in this video, where they slowly get better at a task through attempting many actions and undergoing many iterations, is called reinforcement learning. But this requires a finite set of actions be defined and a clear reward be defined for the desired behavior, which is not what is going on here.

The second reason the video is deceptive is that these bots are nowhere near as advanced as the video would have you believe. None of them are self-driven and they are still in an extremely unstable state. For example, crashing often (that's when a bot logs off), getting stuck in infinite loops, abandoning tasks, ignoring direct commands, etc. They will do nothing on their own and constantly require being told what to do (and then inevitable corrections when they fail that task). The creators of "Mindcraft" show this in their own video, it's all been edited out and hidden here.

I'm also disappointed that credit was only briefly given to the authors of this code in the description instead of being mentioned at the start of the video. They released their code open source and you can find both "Mindcraft" and Mineflayer on GitHub. The original video showing of "Mindcraft" is called "Playing Minecraft with ChatGPT | Mindcraft" by Emergent Garden, linked in the description.

So not fake. But what was said about training was wrong and what is portrayed is highly deceptive about the capabilities of these models to play Minecraft.

[coconut]

Nobody:
Gemini: Aaa! A creeper! Aaa! A creeper! Aaa! A creeper! Aaa! A creeper! Aaa! A creeper!
*leaves*

[TheNacols]

Claude: the diplomat
Gemini: the "i didn't even want to be here"
GPT: the menace

[CraftyMasterman]

the true minecraft was the claudes we made along the way

[ronenth]

Gpt: the carry
Claude: that teammate thats kinda useful
Gemini: "I'm doing my best"

[EufemiaOki]

whatsinmy AI fixes this (AI Video Analysis) (AI Video Analysis). AI races to beat Minecraft.

[faisal-eohc]

Movies: ai will take over the world and over come humans

Ai: GiVe Me LeAtHeR tO cRaFt IrOn HeLmEt☝🏻

[VanjaMC_]

16:55 that mid air block clutch was the most impressive thing i've ever seen

[toadmanthest]

2:59 could not stop laughing. claude and his mono-logs of complete insanity

[spinteam]

21:07 Claude definitely deserves an honourable mention though. It's because of its teamwork that pulled him through and even convinced GPT to win.

[EmergentGarden]

Gpt won the competition but Gemini won our hearts ❤Love to see my bots having adventures.

A little tip! You can tell them to "set a goal to..." and they'll keep trying to do it forever and you don't have to /msg them all the time.





(also fyi they don't actually learn anything (yet))

[ShapeBuddysOfficial]

Its funny how all of them acts exactly like a new player 💀💀💀

[YourFriendJessie]

plot twist - none of these bots were actually bots and were just players pretending to not know how to play minecraft

[yalllouu]

I love the Claude continues to disobey and write entire paragraphs whenever he speaks.

[yuutoastro]

20:34 When Gemini looked to the ground and didn't celebrate, i felt that😢