Explaining Andrej: Tesla AI uses Pytorch for Full Self Driving! (FSD part 3)

Wherein Dr. Know-it-all examines and expands upon a a video of Andrej Karpathy, Telsa's senior director of Artificial Intelligence, at a Pytorch summit in November of 2019. In his talk, Dr. Karpathy describes how Tesla uses the Pytorch deep neural network training framework, how they construct their hydranet network, how training is conducted on ultra-massive data sets, how the Tesla inference engine works, and even hints at how Dojo will improve the training speed by an order of magnitude.

You can help support this channel with one click! We have an Amazon Affiliate link in several countries. If you click the link for your country, anything you buy from Amazon in the next several hours gives us a small commission, and costs you nothing. Thank you very much for helping support the channel by clicking our link and shopping on Amazon! (If you live in a country not listed here, please let us know and we will add it!)

If you use the coupon code DRKNOW on your order, it will automatically take off the price of the 64GB MicroSD card, which is very nice!

Twitter: @jkundert
Instagram: @johnthekg

[obedespinoza]

You're on to something! Finally someone on YouTube explaining FSD to us investors

[Mark.Brindle]

Love the video. I would love a deep dive into Python and pytorch/tensor flow.

[jkev]

I really enjoyed watching your analyses here. I already watched karpathys videos several times, but your background helped understanding a lot more. Danke! ✌️

[adrianternouth]

Well done. This was a standout episode discussing really key issues for future neural net training systems.

[Carlos-qfsd]

Thank you for linking the original video.

[robcoll]

Tesla Owners in general should be watching your episodes...so much unknown info about the FSD. "know I won't complain no more". there is a lot going on when I place my model 3 in selfdriving.. Wow...!!!!mind blowing...

[johnmellas]

Funny that even though I don't understand everything you talk about, I stay listening, lol! Thanks for your (often not understood:) insights.

[pebre]

I really enjoy this explainer series. Even though I watched Andrej's talks, you break it down into simpler to understand terms for non ML experts! Cheers!

[yashdes]

Would LOVE a deep dive into tensorflow and pytorch. Love the videos!

[folabiayonrinde]

Great video man, would love that video on an introduction to PyTorch

[salessiteboost]

Good job mate. You have a clear and demonstrated understanding of all the layers of this system. Well done. PS Most guys on Youtube kinda make things up. But it's clear you have experience and knowledge in these areas! :)

[warrenhall]

Absolutely wonderful. Thank you very much.

[dancobb]

Good job, I enjoyed learning about this. Even though I'll never fully understand AI, this all makes sense to me.

[xXxIMMORTALxXx]

Waiting for your NPU Chip breakdown video!

[florenciovela]

I love SpaceX & all Tesla cars & Trucks..Solar, Battery systems, StarLink & Self driving system, & lots more to come. STARSHIPS TO MARS!!!buy the dips

[pooglechen]

If Tesla ever wants to license their FSD hardware/tech to other companies, I wonder how difficult it would be to readjust the NN given that the other vehicles would have cameras at different locations. This question applies to the Tesla-semi as well

[JohnBoen]

I had to look up what 70, 000 GPU hours meant.
By scale - from a foot note:

"Reproducing these experiments requires approximately 6.85 GPU years (NVIDIA P100)"

That's some GPU...

[silberlinie]

2:26,
would be good to know how many Mbyte each
such an update is.

And how long the download takes.

And whether it can also be received where
there is no wifi.

And in which time intervals a new update
usually comes.

[mikecarr]

Thank you for your interesting works! I would be interested in a spoon feeding of Python for Windows to include setup and basic use.

[francretief]

Great video, thanks. Question: in your opinion, is HW3 powerful enough for FSD? Or is there a chance that Tesla will have to replace all HW3 with HW4 before full FSD becomes a reality?