3.5: Mathematics of Gradient Descent - Intelligence and Learning

My videos on calculus:

Contact:

Links discussed in this video:

[stevenrhodes]

OMG! Thank you! My power went out and I figured I would try to learn gradient descent on my phone.. This is the first time it's made sense.. All those experienced mathmaticians suck at being teachers, making it sound all crazy complicated and shit. You sir are amazing.

[JulietNovember]

Going through Andrew Ng's Coursera... got stuck on how the Cost Function derivatives/partial derivatives are obtained.... 11:00 and on... Oh... MY... GOSH... this is Thank you so much!

[vcrmartinez]

Hey, I'm a Brazilian student/software engineer studying Rec Systems and ML. Tons of articles, papers and videos did not do what you've just done. Now everything is crystal clear, thanks for the explanation.

[iamgrinhausgases]

Just wanted to say that this is easily the best and clearest explanation of gradient descent I've come across, on the web and in the books I've read. Thank you, sir.

[nikitachoudhary]

after read 20-30 articles, after watched 20+ videos, i watched best video ever of Gradient Descent.
i falling love with you.
best explanation.

[alishaaluu]

Usually, math makes me cry but while watching this I am learning and laughing at the same time. How cool is that? Lol. All thanks to you, bro! Keep the good work on. Cheers!!

[SaurabhSinghAus]

Coming here from Andrew Ng's ML course. Got confused with Gradient Descent. This is Gold. You explained Linear regression so well.

[TheSocialDrone]

I had searched on this subject and watched several other videos before I could find this amazing video on the topic; I am more than happy that I am now able to explain this concept to anyone - now it is so much clear, thank you sir!

[CamdenBloke]

I'm studying up for an interview to transfer to the Machine Learning department Wednesday. This is enormously helpful in providing an actual mathematical (not just conceptual) understanding of gradient descent. Thanks!

[ajitkumar]

Thank you so much.After failing my exam on Machine learning I was searching videos on Gradient Descent topic.After watching so many videos I landed on this page.By far this is the best video.You are simple great teacher because you have understood the topic very well that is why you are able to explain in really simple way.. Thanks a million

[via_domus]

you're a very good teacher, a bit crazy though lol

[umessi]

Thank you so much for this. One of the best explanation of gradient descent on youtube. So far I'm loving your Intelligence and Learning series. Think I'm gonna binge watch the entire series now.

[shivamkaushik]

It was teacher's day yesterday, here in India. And today I have got this amazing teacher. Thank You

[TimHulse]

You nailed it sir! I was confused when partial dJ/dm = 2*Error at one moment then suddenly had partial dError/dm glued onto it, but your clarification at point 19:15 clarified it. Please keep making videos!

[badcode]

I have seen some of your videos to get some concepts that I didn't get the first time on my ML class and I'm truly convinced that these are the best tutorials on YouTube about ML, you make every concept so simple to understand and funny, at the same time. Thanks a lot!!! Keep doing this great content!!!

[boemioofworld]

amazing explanation! One of the best explanation in the whole youtube IMO

[r.d.machinery]

This is a clearer explanation than Professor Ng's explanation in his machine learning video series. Ng denotes m and b as theta0 and theta1. He also reverses the terms in his line equation which confuses the Hell out of everybody. In addition, he doesn't take you through how the partial derivative is worked out and he doesn't show the code. A great explanation in only 22 minutes.

[rupambanerjee]

This is the best gradient descent video I have ever seen! Great work!

[TheWeepingCorpse]

thank you for everything you do. I'm a c++ guy but your videos are very interesting.

[BinuVADAT]

You went in to details and explained the concept. Loved the way of your fun-filled teaching. Thank you !