Exploding and Vanishing Gradient Problem | Deep Learning | Machine Learning #artificialintelligence

In this video we are going to discuss Exploding and Vanishing Gradient Problem in Deep Learning.
It is due to the Activation function and very large Neural Networks.
The vanishing gradient problem describes a situation encountered in the training of neural networks where the gradients used to update the weights shrink exponentially. As a consequence, the weights are not updated anymore, and learning stalls.

The exploding gradient problem describes a situation in the training of neural networks where the gradients used to update the weights grow exponentially. This prevents the backpropagation algorithm from making reasonable updates to the weights, and learning becomes unstable.

you can refer this article:-

#deeplearning #datascience #datasciencejobs #datasciencecourse #datascientist #dataanalyst
#gradientdescent #datasciencetraining #machinelearning #datascienceprojects #analytics #artificialintelligence #artificialneuralnetwork