Gradient Descent in 3 minutes

Visual and intuitive overview of the Gradient Descent algorithm. This simple algorithm is the backbone of most machine learning applications.

-------------------

References:

------------------
Timestamps:
- 0:00 Intro
- 0:18 Problem Formulation
- 1:10 Gradient Descent
- 2:12 Flavors of Gradient Descent

-------------------

This video would not have been possible without the help of Gökçe Dayanıklı.

[sbos]

This animation is really great for a small channel like this

[kitzelnsiebert]

Great job! I like that you were even able to talk about some of the different types of gradient decent algorithms, tall task for 3 minutes.

[Leo-vvjd]

I really liked the video and the visuals, but I think it would be better without the "generic music" in the background.

[vivekpujaravp]

Best explanation and visualization I've seen. You have incredible talent. Please keep making more.

[billyin]

Very comprehensive and short, love it! Quick and concise!

[myelinsheathxd]

That's appealing to see these visual explanations after learning the the concept !

[hrishikeshsrivatsa]

First video, where I got clear and precise understanding of the topic

[snowcamo]

Honestly didn't really help with my questions, but I didn't expect a 3 minute video to answer them. This was very well done, the visualization was great, and everything it touched on (while brief) was concise and accurate. Subbed. <3

[_Violate]

wow. you have such a talent for explaining things so well compared to the rest of the youtube sphere. i hope you will continue to bless us with your talents.

[amirhossein.roodaki]

Hello. Thanks for this great video.
Just I believe at 2:20, this variant of Gradient Descent that you explained is called the Mini-Batch Gradient Descent which uses a random subset of the training dataset.
Stochastic Gradient Descent is the one that uses just one training record in each iteration.

[prakhargupta]

just a correction, 2:30 is mini-batch stochastic gradient descent since we are iterating over batches

[Hateusernamearentu]

very smart. But I still need another video presenting differential to help understand the slope, opposite direction thing in 2D. But this is clear. Also I like the small step demonstration.

[juanete]

It mixes very well the theory and a practical example.

[AG]

i when the background music stops. it tells you to open your eye and focus your ear, a really important revelation is coming ....

[MrWater]

funcking incredible explanation in just 3 minutes..wow!

[unplandsitch]

Wow this is so well, intuitivly explained

[AKfire]

Could you please make a video explaining how you made this video.. That would be very VERY helpful.. I've always wanted to use blender to make such animations as you've made, but couldn't make head or tails of it in blender. Most tutorials(and I've seen more than 100 videos) on blender showcase heavyduty animations which have nothing to do with mathematical explanations, as in how to make animations for maths related videos.. Your's is the first video in which I've seen such a thing. Please consider my request and kindly make a video tutorial about it(for the Blender part).

[bilalb]

Thanks for the amazing explanation and visualization

[MARCELSOCORÓGARRIGOSA-lh]

I have only seen one video and it is helping me a lot! Keep going!

[World_Admiror]

Keep up the good work! This viedeo and the whole chanel are amazing!
Bravo 👏🏻