Training an unbeatable AI in Trackmania

I trained an AI in Trackmania with reinforcement learning, until I couldn't beat it.

I just opened a Patreon page, where you can support this YouTube channel with a donation (link below). Between research, programming and editing, these videos take a long time to produce. Any support will help me to spend more time on that in the future ! This one in particular took up most of my time over the last six months. I hope you like the result, and I'm open to any feedback to improve the quality of these videos :) I'll post more details on the Patreon page to explain what I plan to do next.

If you want to try these maps, you first need to have both Trackmania Nations Forever (TMNF) and TMInfinity installed. Then, you can download the maps on Trackmania Exchange (TMX). Everything is free, and you can use the links below.

Contact
• Discord : yosh_tm

Special thanks to Donadigo, for TMInterface !

[culleng.]

Showing the AI's multiple training runs simultaneously and color coded is one of the most gorgeous and elegant depictions of machine learning I've ever seen. Thank you for this video!!

[One_Stale_Donut]

Insane production value, the editing that went into this, and the time it must have taken.

[florrex]

That drift-overtraining and then training off the excess is a really interesting approach to let the Ai discover new mechanics👍🏻

[cliftonsargent]

This was amazing, like watching a child start to walk then slowly just full sprint. I’m subbed from this video alone

[darkranger]

I always love these training AI videos. Its like the "wizard knows his apprentice will be more powerful than him one day, but only if he is guided there" vibe

[PaulOsbornesChannel]

The way you taught it to drift, then taught it to use drifting to go faster was brilliant

[Bassalicious]

This is nuts. The sheer amount of work involved boggles the mind. Such a well paced and chill presentation too, love it!

[GreekTheZorba]

Wunderschöne Aufbereitung deiner Mühe und Zeit. Danke.

[johnbrooks]

Watching your own creation grown and outperform you has such a paternal feeling its amazing.

[RacetasClub]

What a magnificent video and what an incredible journey. This got me excited all over again. You sir took quality to a whole new level, you & the AI should both be very proud :)

[BBweed]

I absolutely love the part where it becomes the drift king for optimal rewards. Just styling by doing micro drifts constantly.

[UnrivaledPiercer]

This is fascinating... I loved how you taught the AI to drift and then once it learned how it kept doing it without the rewards applied to the action. It shows that it was still focused on the end goal but using skills it was taught when they would help it achieve a faster time. Really amazing to watch.

[plebiain]

I would unironically watch hours of you facing off against this AI on different maps to see what it does, please make more!

[rafaelnubile]

Now we want a race between programmers to see who makes the fastest AI!

[kevineina]

This project is still (I followed it for a long time) one of the most interesting projects of YouTube. It is indeed fascinating what a smart guy with a laptop can do at home… I’m an engineer and passionate about gaming, I couldn’t even think of how to accomplish such thing. Congrats to the author! 👏🏻

[shifteryk]

Seeing this project come to fruition after three years is incredible to me. I watched from the very beginning and thought it was amazing how you could teach an AI to be the human, and now that we actually get to see it put into play is amazing. Love your work so much, and I guarantee that it will only improve itself from here! I have tried to beat the AI myself and it really has progressed so much. I cant wait to see pro players actually holding a challenge to this AI after such a long dream. ❤

[benslater]

16:19 I love how the Ai found a way to abuse the crap out of the reward system 😂

[brigbrizz]

This was so much fun to watch! Thank you for putting it together, and posting it for us to enjoy!

[Spingus_Rongong_III]

The sheer work and talent this must have taken is insane. Good job, and congratulations!

[StundZowShorts]

Exceptional video! Congratulations to you, this is surely the best video I've seen on an ai train!👑