How to get better at video games, according to babies - Brian Christian

Explore what happened when the AI system Deep Q Networks (DQN) attempted to beat the Atari game Montezuma’s Revenge.

--

In 2013, a group of researchers wanted to create an AI system that could beat every Atari game. They developed a system called Deep Q Networks (DQN) and less than two years later, it was superhuman. But there was one notable exception. When playing Montezuma’s Revenge, DQN couldn’t score a single point. What was it that made this game so vexingly difficult for AI? Brian Christian investigates.

Lesson by Brian Christian, directed by Gavin Edwards, Movult.

Support Our Non-Profit Mission
----------------------------------------------
----------------------------------------------

Connect With Us
----------------------------------------------
----------------------------------------------

Keep Learning
----------------------------------------------

----------------------------------------------

Thank you so much to our patrons for your support! Without you this video would not be possible! JY Kang, Abhishek Goel, Heidi Stolt, Christina Salvatore, Karlee Finch, Michael Goldberg, Denise A Pitts, Doug Henry, Keven Webb, Mihai Sandu, Deepak Iyer, Javid Gozalov, Kyanta Yap, Rebecca Reineke, William Biersdorf, Patricia Alves Panagides, Yvette Mocete, Cyrus Garay, Samuel Barbas, Brighteagle, LadyGeek, Curtis Light, Dianne Palomar, Marin Kovachev, Fahad Nasser Chowdhury, Penelope Misquitta, Hans Peng, Gaurav Mathur, Erik Biemans, Tony, Michelle, Katie and Josh Pedretti, Sunny Patel, Hoai Nam Tran, Stina Boberg, Kack-Kyun Kim, Michael Braun-Boghos, zjweele13, Jurjen Geleijn, Anna-Pitschna Kunz, Edla Paniguel, Thomas Mungavan, Jaron Blackburn, Venkat Venkatakrishnan, ReuniteKorea, Aaron Henson, Rohan Gupta, Begum Tutuncu, Mikhail Shkirev, Brian Richards, Cindy O. and Jørgen Østerpart.

[Thoran]

The idea for the AI to chase novelty instead of just points is really cool and probably the first step towards creating a depressed Robot. :D

[sharonsabu]

"If it's seen it all, why go anywhere?"

AI having an existential crisis, makes it more human, and a lot more scarier...

[mildlifeisatrisk]

"A novelty seeking system will eventually lose motivation"

*Me, stuck in college, feels attacked*

[zius]

"Bro just get good" - Sun Tzu, the art of war

[AKS-zlbe]

"Mute the Voice chat" - Tun Szu, The War of Art.

[FaultyTwo]

"He who quit mid-game, quit winning for the rest of his life."
- Albert Einstein, Expert Gamer.

[OmerTheGreatOne]

"Stop using my quotes" Sun Tzu, The art of War.

[isAif]

"Novelty seeking system will loose motivation"
Basically AI having mid life crisis and becoming a nihilist.

[abdullaH_alasmy]

Mom: Boy, stop playing games and do something beneficial. Watch Ted Ed for example
TedEd:☺

[techbot]

So even AI doesn't like games that involve backtracking.

[Acucido]

I am glad someone finally found a use for babies.

[note]

"Give a man tutorials, you give him fun"
"Give a man challenges, you give him skills and annoying teammates"
-Drip Szu

[joe]

I never thought I’d be watching a Ted Ed video to get better at video games

[nathanrocks]

"Babies look at new things longer than they do at something they have seen before."

That is an amazing tidbit of information.

[thatscrub]

Honestly a robot getting distracted by a tv is one of the funniest things I’ve heard in a while. Great video!

[Cheesypotato]

"If it encounters, say, a television, it will freeze. The constant novel images are, essentially, paralysing."

Probably the most human-like behaviour of them all.

[SoaringFlame]

“Go touch some grass” - Sun Tzu, The Art of War

[Ragzzy-R]

OMG so basically it did what a gamer would do. First run, you just goof around trying to see every piece of the world, try to do all side quests and whatnot and once you are comfortable enough to speedrun the game, you lose interest and throw it away. This just blew my mind

[Ahsankhan_yt]

"A novelty seeking system will eventually lose motivation."

So that's why EA is not adding any kind of novelty to their FIFA games released every year, and that's also why the players are not losing their motivation to purchase the same game over and over.

[aeis]

Im humbled to see even TED appreciating us Sweaty tryhards