The Chain Rule

The Chain Rule is a method for finding complex derivatives and is used all the time in Statistics and Machine Learning. This video breaks it down into its two simple pieces and shows you how they easily come together. We then use the Chain Rule to solve a common Machine Learning problem - optimizing the Residual Squared Loss Function.

English

Spanish

Portuguese

For a complete index of all the StatQuest videos, check out:

If you'd like to support StatQuest, please consider...

Buying my book, The StatQuest Illustrated Guide to Machine Learning:

...or...

...a cool StatQuest t-shirt or sweatshirt:

...buying one or two of my songs (or go large and get a whole album!)

...or just donating to StatQuest!

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:

0:00 Awesome song and introduction
2:02 A super simple example
6:32 A slightly more complicated example
9:16 The Chain Rule when the relationship is not obvious
11:47 The Chain Rule for the Residual Sum of Squares

Corrections:
13:05 When the residual is negative, the pink circle should be on the left side of the y-axis. And when the residual is positive, the pink circle should be on the right side.

#StatQuest #TheChainRule #DubbedWithAloud

[statquest]

Corrections:
13:05 When the residual is negative, the pink circle should be on the left side of the y-axis. And when the residual is positive, the pink circle should be on the right side.

[moetasimrady]

I have started my machine learning journey a month ago and I stumbled onto a myriad of resources that explain linear models using the RSS function but no one, and I mean no one, managed to explain it with as much clarity and elegance as you have in just under 20 minutes. You sir are a boon to the world.

[pperez]

Amazing pedagogy. Slow pace, short setences, visuals consistent with the talk. great job ;-) Thanks

[revolutionN]

Man you are amazing. You should get a Nobel prize!

[diyanair]

Did I just UNDERSTAND the CHAIN RULE ? SURREAL, thank you!

[ayushbatra]

Over the past three years, I have been studying neural networks and delving into the world of coding. However, despite my best efforts, I struggled to grasp the true essence of this complex subject. That is until I stumbled upon your enlightening video.

I cannot emphasize enough how much your video has helped me. It has shed light on the intricate aspects of neural networks, allowing me to comprehend the subject matter with greater clarity and depth. The way you presented the material was truly remarkable, and it made a profound impact on my understanding.

What astounds me even more is that you provide such valuable content for free. It is a testament to your passion for educating and empowering individuals like myself. Your dedication to spreading knowledge and fostering learning is truly commendable.

Thanks to your channel, I have been able to unlock the true essence of mathematics and its relationship with neural networks. The confidence and clarity I now have in this subject are invaluable to my personal and professional growth.

Your video has been a game-changer for me, and I am grateful beyond words. Please continue your fantastic work and know that your efforts are deeply appreciated.

[TheGreatFilterPodcast]

BY FAR the best explanation of the chain rule I have ever seen (and trust me - I've seen A LOT)
You, sir, just earned yourself yet another well-deserved subscriber.
F'n brilliant!!!

[Ruostesieni]

As someone who is doing medical research and needs to learn little-by-little about statistics, neural networks and machine learning as my project goes on, your channel is a literal life-saver! It has been so hard to try to keep my M.D. stuff together with my PhD research all the while learning statistics, programming and neural network structures and machine learning. Trying to arrange courses from my uni to fit in with all the other stuff is simply impossible, so I've been left to my own devices and find a way to gain knowledge about said subjects and your channel has done just that.

Your teaching is great and down-to-earth enough to be easily grasped, but you also delve deep into the subject after the initial baby steps, so the person watching isn't just left with "nice to know"-infobits. Love it! Keep up the great work!

[dc_amp]

The way you link equations to visuals and show how everything is working along with the math at the SAME time. Beautiful, elegant, easy to follow.

[Alchemist]

Awesome!! None of my math teachers in high school or collage never explained to me WHY chain rule works this way. but you explained it with a very simple example. I'm certain that from now on I'll never forget the chain rule formula. Thanks a million. 👌✔

[varunparuchuri]

dear @stat quest you must have come from heaven to save students from suffering's
just unbeliable explanation

[vnaveenkumar]

Take my words Josh you are the best teacher on the internet who teaches and the chain rule made me by your explanation.

[ivanferreira]

Nobody:
The demon in my room at 3am: 7:56

[putririzqiyah]

this channel was suggested by my professor, and i always watch the videos while doing a machine learning tasks. Big appreciate to you :D

[Maskedlapis]

I’ve watched videos like this for work, yours is the best, I fully grasp what a derivative is!

[jbboyne]

Your videos are fantastic, even without the sound effects... but the sound effects really bring them over the top.

[ulmwfue]

Best chain rule explanation i have ever seen.

[amanrastogi]

I am Biostatistician, proclaiming that you are really a good teacher.

[rigobertomartell]

Josh you are a master in teaching, you make difficult topics so easy to understand which is really amazing. My mother language is not English but you explain so well and clear that I can understand everything. Congratulations Sir, please keep doing this job.

[mr.shroom]

Bro your the only tutorial that actually helped me grasp this concept, thank you so much.