I taught an A.I. to speedrun Minecraft. It made history.

Robots might be taking over the world, but it all starts with Minecraft.

[SOUNDTRACK]
Scoobadive - Electric
Lupus Nocte - Midnight Safari
C418 - Beton
ELFL - Alienated
Daniel Fridell - Motional Overload
Grieg - In the Hall of the Mountain King
Lofive - Lisboa
Oh the City - Ad Infinitum
Koji Kondo - Jolly Roger Bay
C418 - Sweden (Astrophysics Synthwave Remix)
Toru Minegishi - Hyrule Castle Town
David Wise - Kongo Jungle
Gavin Luke - Feeling Alright
AGST - Erupt

[CHAPTERS]
0:00 - Intro.
0:21 - Making AI graphics.
1:41 - Writing an AI storyline.
2:00 - Finding our speedrunner AI.
4:02 - The speedrun begins.
10:53 - Outro

bye love u

[mcbyt]

FAQ:
*Did you actually train the AI at all?* Yes - while I didn't create Alto Clef or Baritone, I did modify the gamer task (the one that speedruns Minecraft) to skip some things (e.g iron armor, extra eyes) that were there as a safety net. There's a reason this run is an hour faster than most of the others out there!
*Is this actually an AI?* Yeah! Baritone, and therefore Alto Clef, is based on Machine Learning (ML), which is a type of AI that takes data (for example, where a diamond is), applies an algorithm (the Baritone pathfinding code), and performs a task without being hard-coded (like mining that diamond). The other AI bots I mentioned in this video are based on Deep Learning, which uses neural networks (computer models of a brain) to "think" about how to accomplish a task; the only problem is, Minecraft deep learning bots aren't that smart yet.


Music credits and chapters in the description.

This is a very... different sort of video for me, but I think it turned out really well! Hopefully you'll feel the same :)

[TacoTechnica]

Original dev of the bot here, awesome work! This is an insanely high effort production. Not only is the whole video narrated and saturated with edits, but you've also gone out of your way to modify the bot's code to make it run faster (and anyone patient enough to sift through my code deserves a medal).

[SweetJP.]

here's an ai that speedruns minecraft. *Shows a total of 21 seconds of the ai in a 11 minute video*

[jajecznica]

Worth pointing out that it's not actually "AI" as in machine learning, it's just a bot that has a select list of tasks to accomplish and it does that by using baritone (again, not "machine learning" or AI, just a fancy A* pathfinding algorithm).
While you can call it an "AI", it's really just a fancy way of saying that it's a "NPC"

[Gamingi]

That skeleton thing was added in 1.10. They're called strays. They're skeletons that spawn in winter biomes and shoot slowness arrows.

[Rashaexe]

Regarding the bot not using a boat at around 7:03

Altoclef, or even Baritone for that matter, doesn't have the ability to ride entities and control them. You can ride a boat, or a horse, and execute any command that moves the bot, and (If I remember correctly) it would fail every time

[eliteknight]

You didn't train or taught ai anything. You just presented someone else's work and added poem with graphics created by ai

[Guiny]

I had this video idea but I sat on it for a while and gave up! You did a great job on this dude

[jtbfymo]

The title is completely misleading, considet changing it.

[Konkov]

Guarantee this video will blow up, AI is so popular, great idea MCBYT Well played.

[bedrock-chess]

Sees stray: What are those? I need to play 1.19 more.

Stray added in 1.10: "and i took that personally"

[oglothenerd]

It is sort of cringe that you said you trained it, yet you only just downloaded a pre-trained model. (I will ignore that though.)

[Choosiest]

This is criminally good content. Keep it up bro!

[dontwannaatellu]

This is actually a crazy use of ai most ai ran speed runs are very linear games but mine craft has so many paths you can take to speed run it

[moonyl]

those strays at 5:59 were added in 1.10

[DanielSeacrest]

6:00 that mob has been in the game since 2016, so for 7 years lol.

[ErrorNoInternet]

Nice! Small correction though, Baritone is not an AI. Everything it does is programmed manually. The other projects are actually real AIs that have full control over the game (mouse, keyboard, etc) and have been trained on TONS of real gameplay.

[BaccaDeww]

next videos gonna be about ai predicting the future of minecraft

[wescube-ligma]

first of all that function in the thumbnail had many syntax errors second of all you did not teach the ai anything someone else did, you just used it

[earlessaxolotl]

I am definitely not an expert, but from what I read, MineDojo did not make it to the End by itself. The AI was artificially placed there by the developers. Currently, all it can do is perform basic instructions like "shoot at the dragon". What is impressive though is that all the information the AI receives is the screen itself. It is not given any additional data like where the blocks are. This is different from baritone, where it is fed entire chunks to process. This AI just looks at the screen and does stuff like humans do. I think that is what is the most impressive about MineDojo.