Introduction to Coding Neural Networks with PyTorch and Lightning

Although we've seen how to code a simple neural network with PyTorch, we can make our lives a lot easier if we add Lightning to the mix. It makes writing the code easier, makes it portable to different computing environments and can even find the learning rate for us! TRIPLE BAM!!!!

Spanish

Portuguese

For a complete index of all the StatQuest videos, check out...
...or...

If you'd like to support StatQuest, please consider...
...or...

...a cool StatQuest t-shirt or sweatshirt:

...buying one or two of my songs (or go large and get a whole album!)

...or just donating to StatQuest!

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:

0:00 Awesome song and introduction
1:04 Review of basic PyTorch
2:34 Coding a pretrained neural network with PyTorch + Lightning
7:52 Training a neural network with PyTorch + Lightning
14:05 Using Lightning to find a good Learning Rate
17:25 Taking advantage of GPU acceleration with Lightning

#StatQuest #DubbedWithAloud #PyTorch #Lightning

[airpeguiV]

Hi Josh, I am trying to get my PhD in EEE and as such, my background is in electrical and electronic engineering, not in machine learning or data science. Somehow, in my PhD I've ended up doing more ML and DS than EEE, and I can only infinitely thank you for these resources that you post on the internet for free, for the effort you put on them, and for your dedication. You are a marvel and you have helped me understand and apply concepts and models to my research, which hopefully will one day help society and the environment through a more efficient power grid, capable of accommodating more renewable energy sources and electrical machines. Thank you ∞!

[rizkykiky]

this channel is evolving from statistics and math to coding! didn't expect that and I absolutely love it!

[wcdev]

How are you not mainstream? This is best DX I've seen on ML so far... So focused on the important parts that need to be coded, is like the fastapi for deep learning.

[CHERKE_JEMA]

On my way to finishing your book...I would definitely recommend it to everyone! Love from Ethiopia, Africa

[massimoc]

I thought I had finished watching your videos after I passed my statistics exam, and here we go again!

[macknightxu]

This NN sery is tremendously amazing, easy to understand while teaching a lot of concepts, processes.
The best thing I find is the rhythm they keeps by using bam, double bam, triple bam, tiny bam because normally, learners will lose their mind when learning for a long time with the puzzles like where I am, what I know, where to go. Good job!

BR

[protovici]

The comic approach and extremely good content makes this the best Lightning video I've ever scene.

[zainabkhan]

Thanks for all your videos they are all precious

[nadavnesher]

Totally awesome!! Great explanations! I love your channel🚀
Thanks so much for your videos 🦾

[AslEroglu]

Love your content, it helps me a lot! Very clear explanations, thank you. If anyone struggling to import lightning package, I wrote "import pytorch_lightning" instead "import lightning" and problem solved.

[jonahturner]

This video will really blow up in just a few months I think. The newest scene text recognition model I'm trying to implement uses Lightning extensively, more and more people will pick it up soon. Thank you for making such a clear explanation

[exxzxxe]

Josh, you are a math genius in addition to being an outstanding singer!

[shaktishivalingam]

You are amazing, Thank you for helping us out with your videos it has helped me a lot

[Luxcium]

Wow 😮 I didn't knew I had to watch *The StatQuest Introduction To PyTorch* before I can watch the *Introduction to coding neural networks with PyTorch and Lightning* 🌩️ (it’s something related to the cloud I understand)

I am genuinely so happy to learn about that stuff with you Josh I will go watch the other videos first and then I will back propagate to this video...

[ruchiraina]

Finally I understood the basic code structure of Neural Networks Using PyTorch. Thanks for that. There is a request - Would you please create the same model using Tensorflow? That would be very helpful to compare these frameworks.

[fizipcfx]

Thank you for this video, i would love to see more videos from pytorch ecosystem

[AndyMyers]

I'm hoping the next in the series shows us an example of optimising all the things and not just the final bias.

[Celbe]

Hi Josh, first of all I would like to express my gratitude for the excellent material you have made available.

I have a question: what is the criteria for some classes to have the audio track in another language? I love it when they exist in Portuguese.😊😊😊

Greetings from Brazil!!! 👋

[mahammadodj]

Thank you very much but how do we initialize those weights and biases?

[divelix]

Great video, as always. Thank you, Josh, for your hard work!
Btw, while following video instructions I found out some things, that should be clarified:
- 3:11 - instead of `lightning` there should be `pytorch_lightning` (I installed it with `conda install pytorch_lightning -c conda-forge`)
- 15:10 - after we change lr from 0.1 to 0.00214, we need much more than 34 epochs to get desired -16 (more than 1000 epochs, so I can't understand how this lr can be considered better than initial 0.1)