AI Reading List (by Ilya Sutskever) - Part 4

In the fourth part of the AI reading list series, we continue with the next 5 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".

*References*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Reading List*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Related Videos*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Contents*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:20 - Item 1: NN Module for Relational Reasoning
01:25 - Item 2: Variational Lossy Autoencoder
02:06 - Item 3: Relational RNNs
02:48 - Item 4: The Coffee Automaton
03:21 - Item 5: Neural Turing Machines
04:07 - Outro

*Follow Me*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Channel Support*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

#relationalreasoning #vae #turingmachine #complexodynamics

[datamlistic]

Important note: As some of you pointed out that Ilya never confirmed this list, and I would like to apologize to those of you whom I misinformed by saying this is the official list. I was under the impression that he did confirm it. I'm very sorry for that! I promise I will do a better job researching the topics I present.

[unclecode]

Waiting for the fourth part, and this part's papers are a hell of a papers haha. To me, "Neural Turing Machines" is the top in your series. Back in 2021, during the COVID lockdown, I worked on defining a "finite-state automata" using a transformer—essentially, an autoregressive model where the next token is the next state of the machine. It was an extremely fun experience, and the results were amazing. I intended to publish a paper but got caught up with other things. I actually built a library called ASM This video has motivated me to revisit it and publish it! If I do, I will ask you to review it :)) Anyway Turing machine is the everything of computation, and if it can be redefined in such a manner, then we might have a hope for AGI. Sometimes, I feel that if we are going to have AGI, that needs such a state machine, then the everything else will follow inevitably. Anyway Kudos, looking for the rest of this series and reviewing recent papers.

[adammobile]

Bit advanced stuff, but it gives some overview of what's going on in the field 👍