Gradient Descent with Momentum - 3D Visualization

preview_player
Показать описание
Brief 3D visualization of the impact of using momentum on gradient descent.
  1. Diego Inácio
  2. machine learning
  3. deep learning
  4. computer graphics
  5. visualization
  6. 3D
Рекомендации по теме
Accelerate Gradient Descent 0:03:18

Accelerate Gradient Descent with Momentum (in 3 minutes)

Gradient Descent With 0:09:21

Gradient Descent With Momentum (C2W2L06)

Optimization for Deep 0:15:52

Optimization for Deep Learning (Momentum, RMSprop, AdaGrad, Adam)

23. Accelerating Gradient 0:49:02

23. Accelerating Gradient Descent (Use Momentum)

Tutorial 14- Stochastic 0:13:15

Tutorial 14- Stochastic Gradient Descent with Momentum

Gradient Descent With 0:08:28

Gradient Descent With Momentum| Complete Intuition & Mathematics|

Applying the Momentum 0:07:10

Applying the Momentum Optimizer to Gradient Descent

Gradient Descent with 0:00:44

Gradient Descent with Momentum - 3D Visualization

Gradient Descent in 0:03:06

Gradient Descent in 3 minutes

Accelerating Gradient Descent 0:05:28

Accelerating Gradient Descent with Momentum

Momentum Optimizer in 0:11:17

Momentum Optimizer in Deep Learning | Explained in Detail

Deep Learning(CS7015): Lec 0:18:45

Deep Learning(CS7015): Lec 5.4 Momentum based Gradient Descent

Gradient Descent with 0:00:16

Gradient Descent with Momentum

Optimizers - EXPLAINED! 0:07:23

Optimizers - EXPLAINED!

Momentum in SGD|Understanding 0:08:21

Momentum in SGD|Understanding Momentum in stochastic gradient descent

Gradient descent with 0:00:56

Gradient descent with momentum

Who's Adam and 0:23:20

Who's Adam and What's He Optimizing? | Deep Dive into Optimizers for Machine Learning!

66 Gradient Descent 0:05:39

66 Gradient Descent with Momentum Optimization

Gradient Descent with 0:22:10

Gradient Descent with momentum and Steepest Descent

Gradient Descent with 0:00:42

Gradient Descent with Momentum

L12.3 SGD with 0:09:05

L12.3 SGD with Momentum

SGD with Momentum 0:38:25

SGD with Momentum Explained in Detail with Animations | Optimizers in Deep Learning Part 2

Gradient Descent with 0:00:27

Gradient Descent with Momentum Illustration

Gradient Descent with 0:00:44

Gradient Descent with Nesterov Momentum

Комментарии
Автор

this is dope!!! Would you please tell me what software you use to make this plot ?

leonzhang
Автор

Ummmm the simulation itself is nice, but I think there's a conceptually mistake between the Gradient Descent without momentum and the GD with momentum, because according to papers and the theory of Machine Learning, the GD without momentum takes more time to converge to the minimum and can get stuck in saddle points or local minimums for a long time, and the GD with momentum takes less time, is faster, and it avoids to get stuck in saddle points or local minimums because of its property of "momentum", so the graphical representation seems incorrect, can you please fix this issue? Because visually leads to confusion for the new learners of ML and GD's theory ;)

giostechnologygiovannyv.ri