More GPT-2, the 'writer' of Unicorn AI - Computerphile

More examples of how GPT-2 pays attention to things. Rob Miles

This video was filmed and edited by Sean Riley.

[truppelito]

That TL;DR trick was actually kinda mindboggingly smart

[Matyniov]

Input:
"TL;DR"
Output:
*theory of everything*

[TechyBen]

"If you just learn the statistical relation between words..." How I feel 99% of my conversations are going with other people... at least it proves they understand statistics.

[andreaaristokrates]

Plot twist, GPT-2 wrote the entire paper.
I think I would try to use it go generate a frame to edit in my contents, so they might have done the same...

[BooBaddyBig]

The thing about AI or intelligence in general, is that learning or working out how to do something takes a LOT of intelligence/computing power/genius, but actually doing it, is usually RELATIVELY trivial.

[tommykarrick]

Can this thing do subtle dialect stuff? Like for example, if the prompt says “torch” or “lift” instead of “flashlight” or “elevator, ” will it tend to use more British terms for things?

[dm]

Very interesting revisiting this video 5 years later when now it seems we are on the cusp of AGI possibly by 2030. If the basic prediction is right, that would have meant we went from gpt2 a "stochastic parrot" to AGI in 10 years.... let me know mister/miss 2030 if we are there in 5 years!

[endofthelinejoel]

Journalism has long stopped been a noble profession. It is slanted muck-raking these days, so it is unsurprising that AI can mimic their lowest common denominator prose.

[Treblaine]

So there isn't a specific "onion on my belt" protocol, that's just something that statistically emerges.

[zenithparsec]

The chicken didn't cross the road because it was too 'why-ed'. (All the questions it kept getting had made it too scared to even leave the house.)

[BTheBlindRef]

no white onions though... because of the war...

[curtiswfranks]

I figured out the "tl;dr" trick just before he revealed the answer. Man, is that brilliant!

[gravity]

Determining fraud in writing term papers just got ridiculously difficult

[ivanhoeivanhoe]

Why did the egg cross the road?
Because it had an inclination.

[IBoyan]

"Roads are fearless" nice :)

[evanjohnston]

jojos are trader joes brand oreos and peppermint jojos are the ones whith peppermint in the cream

[puskajussi]

It'll be fun when we have to train computers to go along with human weirdness when translating something with completely unfamiliar worldview. Something like religious text or propaganda.

[cyclerical]

The question is, how much of creativity is actually derived from mimicry? A lot, I bet...

[KuraIthys]

Funny. You point out it doesn't make sense, but given the nature of the question being asked, my innate interpretation of a sentence like 'the chicken didn't cross the road because it was too wide' is indeed that it's saying that the chicken is too wide to cross the road.
Even though that's not sensible, nothing is saying a statement HAS to be sensible.
And the structure of the sentence does tend to lead to the conclusion that 'it' is the chicken, more often than not.
Obviously taken without anything akin to 'intuition' this sentence is fundamentally ambiguous, which is, I suppose the point.
But still...

[von_nobody]

Probably one thing missing, AI can beat human in chess, AI can beat human in SC2, AI can beat human in writing text, but same AI can do all this do at once?
I was train doing do A but I can do easy B, AI can be train to do A but can't do B in any way. This is big difference.