DeepMind’s AI Trained For 5 Years... But Why?

📝 The paper "From Motor Control to Team Play in Simulated Humanoid Football" is available here:

My latest paper on simulations that look almost like reality is available for free here:

Or this is the orig. Nature Physics link with clickable citations:

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bryan Learn, B Shang, Christian Ahlin, Edward Unthank, Eric Martel, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Jonas, Jonathan, Kenneth Davis, Klaus Busse, Kyle Davis, Lorin Atzberger, Lukas Biewald, Matthew Allen Fisher, Matthew Valle, Michael Albrecht, Michael Tedder, Nevin Spoljaric, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.

Károly Zsolnai-Fehér's links:

[TEMPLERTV]

A few years ago you helped ignite my passion of machine learning. Since then I’ve learned to code, have educated myself vastly in machine learning. I’m currently building my own small NN. Thanks for opening my eyes to something amazing

[Makmarian]

It would be cool if there were simulated sport competitions where teams used their own AI model against each other

[anthonybernstein]

To get a feeling of how difficult this is: imagine QWOP with 56 keys instead of 4, and you don't just have to run but to play football, in 3D instead of 2.

[jordyp]

they should do this with real rules (throw ins and cornershots etc), and with 11v11, run it for weeks on different computers, see if they come up with some kind of great strategy, see what formation and stuff they pick.

[miladragon]

I notice that they still seem to move really unnaturally -- their upper bodies seem very flail-y. I wonder if that would get ironed out if they were given some cost to excess movement (just like humans get tired).

[Quazlyy]

I think the pre-training behaviour pretty much captures the behaviour of actual football players

[rogueyun]

Honestly the first one where all the players are writhing on the ground looks pretty accurate to me.

[jhunt]

It's crazy how the AI just iterates and comes up with through passes, lobs and cruyff turns.

[suki]

Even after all these years, you still amaze me with how understandable you make these papers for people like me. Thanks for really spending time in digesting this information to someone who's not in the field or can't allocate enough time to dive deep.

[SP-nyfk]

Imagine training an AI to do a task for 100 years in 10 minutes, then exporting it and importing it into a robot to achieve the task perfectly in the real world

What a time to be alive!

[JakeHaugen]

This actually could be a really cool esports team. Like imagine if madden had AI agents to play the team. It was actually pretty entertaining to watch.

[manofsan]

*Imagine a Zombie movie/show where the zombies first start out writhing on the ground, and then quickly they learn to get up and walk, and then run, etc, etc*

[monocore]

I see some serious meme potential in this

[BryceRogers]

It would be cool to watch the 50 days AI vs the 3 days just to really show the improvement.

[zodywoolsey]

I would absolutely watch videos of a bunch of ai players fumble around like this for hours.

[DudeWatIsThis]

8:22 **gets lightly tripped over, falls down and has pain seizures**

The most realisting thing in the entire video.

[surajvkothari]

If this simulation gets more accurate, it could influence how football is played in real life. Imagine when the richest clubs can afford to create such simulations and optimise their players.

[Plafintarr]

My heart desires a whole tournament with these little AI's. Crazy ragdoll physics and wild flailing bodyparts included. They are so fun to watch! Can you upload more footage?

[xAgentVFX]

I want more Ai Football!!! I wanna watch a full match! Looks so fun. Imagine what they might do years from now??

[usmle]

realistic human movement that follows the laws of gravity and moves on its own has always been fascinating to me