AIs Are Getting Too Smart - Time For A New 'IQ Test” 🎓

📝 The paper "SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems" is available here:

Our earlier video, "DeepMind's AI Takes An IQ Test":

Our earlier video on the OpenAI Retro Contest is available here:

🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Haro, Anastasia Marchenkova, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Brian Gilman, Bryan Learn, Christian Ahlin, Claudio Fernandes, Daniel Hasegan, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, John De Witt, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Matthias Jost,, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil.

Károly Zsolnai-Fehér's links:

[Armuotas]

I can guarantee that when those cheeky engineers named it GLUE they knew absolutely well that it will become outdated and then they get a chance to name it Super GLUE. You can bet your papers on this!

[ShaulKedem]

I must have missed the previous episode about IQ with those great results. I suggest you add them to the description

[zachdurocher]

This just in: Humans found to have been rigging tests against robots in order to prove their superiority

[peterdao]

“The police aimed their weapons at the fugitive”

Bot: option 2! 98.4% certainty!

Human: smh, you naïve robot, in this reality, option one is what actually results.

[Juttutin]

Let's take a regular 'human' IQ test given to a 13yr old with NO prior exposure to an IQ test. Putting aside eurocentric and other concerns, the AI that will really scare and excite me, is when it's clear that the AI is succeeding at 'generalised knowledge' without specific pre-training on the generalised test nature.

[zdar]

Are there any deep learning AI's being developed for theoretical physics?

[davidwuhrer]

I never thought that a high school exam was something an AI could ever solve with only high school text books as training data.
But I guess these AIs had a wider corpus to draw from.

[GoelWCS]

Just imagining:
"Human: why 1+1=2 ?
Machine: _uses Peano algebra_ "

[hampusnyberg]

"5. Solve 2x^2+9x+7", I really hope there weren't too many questions like this, makes me think that the result might not be too trustworthy.

[captivatingcurios]

To be honest I’m still a fan of the Turing test as a general heuristic for intelligence? Humans can respond sensibly to a potentially infinite number of sentences (bc recursion, and also bc language is flexible and we use it creatively), and one can engage with nearly any field or topic through language. Because the set of potential problems/sentences to respond to is nearly infinite, any AI we deem generally intelligent should be around/exceeding? human performance in nearly every scenario. So, I’ve always thought it’s a good goal.

[Taterzz]

The sentient AI raised their weapon at the human rebel. What is the most likely outcome?


1. The AI quell the rebellion.
2. The rebellion defeats the AI.


every AI simulation picks option 1.

[ei]

Why don't we just show AIs Rick and Morty and see if they understand it? -_-

[impolitevegan]

This is probably the most promising research area, because when it gets really clever, we can start asking real questions we don't know answers for

[agentsmithyearsagoedited]

When do you think ai can play a 3d rpg game

[chochona]

I love this videos, how do you find papers this cool?

[planetsharks]

The new papers you show everyday are so innovative!

[cosmiclounge]

I feel as though we're crossing the Rubicon here.

[Jkr]

*nervous chuckle*
we're in danger

[Kram]

Some serious context understanding necessary in this. I'm not sure I could actually beat all parts of this quiz all that well myself.

[AJGamer]

AI and quantum computing = the scary shit Elon musk said