Chris Lattner: Compilers, LLVM, Swift, TPU, and ML Accelerators | Lex Fridman Podcast #21

[lexfridman]

I really enjoyed this conversation with Chris. We could've easily talked for many more hours. Compiling code down across levels of abstraction is one of the most fundamental and fascinating aspects of what computers do, and he is one of the top experts in the world in this process, its rigorous science and it's messy beautiful art. Here's the high-level outline:
0:00 - Introduction
1:30 - First program, BASIC, Pascal, C
4:20 - Compilers, LLVM, CLang
37:30 - Apple - LLVM, Objective-C, Swift
45:30 - Google - Swift, Swift for TensorFlow, compilers, Colab
57:32 - TPU & TensorFlow, hardware/software co-design
1:00:30 - MLIR (Multi-Level Intermediate Representation) framework
1:02:40 - Open sourcing of TensorFlow
1:05:10 - Tesla - transition from HW1 to HW2
1:07:24 - Elon Musk and time at Tesla
1:08:45 - Working hard
1:10:40 - Dragons

[AlpGuneysel]

wow, i wouldn't expect Chris to be such humble, down-to-earth and loveable person. I could watch this all day. Thanks Lex.

[ubeai]

This is gold. Miss those good old days when Lex simply and happily talked about tech with these great minds.

[domaincontroller]

01:29 first program basic, pascal, turbopascal...02:28 C/C++ 02:48 straight to the machine 03:02 C 04:45 what is even a compiler used for ? 06:57 C parser, front-end, clang 07:06 middle part, the optimizer 07:09 a late part, hardware specific 07:17 LLVM trying to standarsize these middle and last parts 15:57 C++ is a very complicated programming language, 1400 pages in the specs 16:53 gcc 17:20 clang, push forward on better user interface, compile time better, want to make new tools available 18:04 C++ and the front-end piece is complicated, syntax trees 18:46 AST, control flow graph

[AnitShrestha]

I can literally feel the love for code from Chris. Really good conversation on compiler and other hidden/hard subjects. Thank you Lex and Chris.

[shengxu]

I wish I had a professor like Chris Lattner in all my CS courses. If Chris finds some time in the future he really should open an online course in Compilers or Language design.

[whiteFx]

Lex is becoming a professional in introductions 👏👏👏

[BiancaAguglia]

Chris Lattner has a gift for taking complex concepts and **compiling** them down to something non-geeks like me can understand. 😊 Another great interview, Lex.

[KonflictYT]

I enjoy how thorough chris is when defining the concepts he brings up. He is clearly someone who cares to have a deep understanding of the things he knows.

[muneshchauhan]

A great talk on compilers by Chris. Thanks Lex for bringing this talk accessible to all. Would be interested to know if someone can define a learning path for LLVM compilers from a beginner level to advanced.

[fortifyyourdata]

This is the kind of content the internet needs more of. Thanks Lex!

[sai]

Lex, thanks for all the hard work needed to deliver podcasts of top-notch quality. You have helped see a glimmer into the minds of these amazing researchers and engineers. Your questions are very enjoyable, not diluted showing the level of research you have undertaken before the interview.
In the Goodfellow podcast, I learnt abstract view of how some new areas like differential privacy is evolving, or challenges are currently, which I wouldn't have with the rate of current research paper publications. Maybe you can continue this series (or create a new one) into exploring various areas machine learning ?

For someone who lacks direct access to good mentors in ml, podcasts like yours are heaven sent.

[jknight]

Lex, thank you so much for starting this podcast. These are real amazing people and their inner lives are not well documented in the collective human archive.

[kestergascoyne]

Amazing Lex!!! Your podcast is INCREDIBLE!!! You are truly doing a service for the world!!!!

[smartwolf]

I hope you'll never stop posting podcasts as it's a fantastic resource

[charlesbisbee]

I can't think of a more engaging podcast to listen to. This was absolutely awesome!

[AkshayAradhya]

47:35 Progressive Disclosure of Complexity.

My favorite new term. I love this concept and now there is a phrase for it that I can use.

[bini--christ]

Bow to the Master of swift. I just started a class on mobile app dev. The professor showed us this episode... a good way to start

[mohitgarg]

Just amazing. Thank you so much for all these amazing interviews Lex! As a computer engineer and tech enthusiast, they really help me understand how these cutting-edge technologies were developed by these amazing people.

[OkiemPiotra]

Great convo. I wish Chris divulged more on how Tesla is approaching ML and what are the specific benefits of the vertically integrated hardware/software stack for self driving ;)