AI Reading List (by Ilya Sutskever) - Part 3

In the third part of the AI reading list series, we continue with the next 5 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".

*References*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Reading List*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Related Videos*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Contents*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:21 - Item 1: Dilated Convolutions
01:10 - Item 2: Neural Message Passing for Quantum Chemistry
01:35 - Item 3: Attention Is All You Need
02:42 - Item 4: NMT by Jointly Learning to Align and Translate
03:12 - Item 5: Identity Mappings in Deep Residual Networks
04:30 - Outro

*Follow Me*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Channel Support*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

#seq2seq #attentionmechanism #dilatedconvolutions #identitymappings #messagepassing

[datamlistic]

Important note: As some of you pointed out that Ilya never confirmed this list, and I would like to apologize to those of you whom I misinformed by saying this is the official list. I was under the impression that he did confirm it. I'm very sorry for that! I promise I will do a better job researching the topics I present.

[karolbaginski]

Great series! Can't wait for more :)

[amanpandey]

Thanks for doing this! I would really appreciate it if you could provide a similar list for RL.