AI Reading List (by Ilya Sutskever) - Part 1

In this video, we start a new series where we explore the first 5 items in the reading that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".

*References*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Reading List*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Related Videos*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Contents*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:59 - Item 1: The Annotated Transformer
01:29 - Item 2: The First Law of Complexodynamics
02:21 - Item 3: The Unreasonable Effectiveness of Recurrent Neural Networks
03:05 - Item 4: Understanding LSTM Networks
03:36 - Item 5: Recurrent Neural Networks Regularization
04:11 - Outro

*Follow Me*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Channel Support*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

#transformer #lstm #rnn #complexodynamic #aireadinglist

[datamlistic]

Important note: As some of you pointed out that Ilya never confirmed this list, and I would like to apologize to those of you whom I misinformed by saying this is the official list. I was under the impression that he did confirm it. I'm very sorry for that! I promise I will do a better job researching the topics I present.

[unclecode]

Incredible job! I can't thank you enough for building this series. I just subscribed to your channel. This is a fantastic resource for those looking to delve into the theoretical aspects of AI and understand it properly.

I have a suggestion: it would be great if you could organize the content into a structured format, listing which papers should be read first and which should come later. Also, for papers that require background knowledge, you could create an appendix section for basic concepts. For instance, if there's a paper about LSTMs, and the reader doesn't know RNNs, it will be hard to understand. You could introduce a source or link to one of your previous videos for those basic concepts.

If you put all this together, it would be like an AI research degree, helping many people. I'd be happy to contribute and help you build this resource. Thank you again for the excellent work!

[ericli]

Thanks for making these videos. They are really helpful. I look forward to next videos in this series.

[TheEarlVix]

I'd like to join with others here in thanking you for making these videos. Invaluable!

[AIWorks]

Thank you for making this. Not many people share this kind of real knowledge they instead just try to draw attentions and telling people AI will take your job kind of things... Thank you and thank god I found this

[MrVbarroso]

I really love your channel, it's so good!