Vanishing Gradient Problem in ANN | Exploding Gradient Problem | Code Example

Learn about the Vanishing and Exploding Gradient Problems in Artificial Neural Networks (ANNs) with practical code examples. Understand the challenges and solutions for training deep networks effectively. Improve your grasp on these important concepts in neural network training.

============================
Do you want to learn from me?
============================

📱 Grow with us:

👍If you find this video helpful, consider giving it a thumbs up and subscribing for more educational videos on data science!

💭Share your thoughts, experiences, or questions in the comments below. I love hearing from you!

✨ Hashtags✨
#GradientProblems #NeuralNetworks #codeexamples

⌚Time Stamps⌚

00:00 - Intro
01:11 - Vanishing Gradient Problem
12:20 - Code Demo
18:00 - How to handle VG problem
20:17 - Code Demo
23:18 - RELU Activation function
25:27 - Code Demo
27:28 - Weight Initialization Techniques
28:11 - Batch Normalization
28:34 - Residual Network
31:51 - Outro

[rahilafiroz]

awesome explanation for each and every step. Thank you very much Sir..

[pravinshende.DataScientist]

hi sir you are playing a big role to make me a good data scientist ... thank you vert much!!!

[nikhiliyer]

Please cover EXPLODING GRADIENT also with examples

[aadilkhan]

Sir after DL please make video on open cv tutorial using DL.

[rafibasha]

Hi, Sigmoid derivative lies between 0 and .25

[rafibasha]

@11:50, pls let us kniw know when are you covering tensorboard and callbacks

[AkashBhandwalkar]

Sir please make a video on Hypothesis testing. Tried searching in your channel but did not find it. Love to learn it from you.

If anyone else can help me find it.. Okay let me know and send the links in the thread.

[ali]

11:55 Badshaho, tensor board and call backs bi rehte.

[MrChudhi]

Very nice talk. A lot of my questions are answered. Thanks a lot.

[vanshshah]

Sir approx how much time would it take to complete this course?

[amLife]

Thank you sir for another amazing lecture!! 😃

[kshitiztiwari]

Bhai I have a confusion and it might be very trivial. But in Pipelines with Columntransformers whenever I am using OrdinalEncoding on certain columsn and then OHE on some other column...OHE fails. it gives an error like ValueError: could not convert string to float: 'AllPub'. This is Housing kaggle competition dataset. Is there something i am missing here. I am using ordinal encoder before OHE and providing categories in that. Anyone else can help too..

[lnstagrarm]

What if we keep sigmoid as activation function and increase learning rate.. eventually it will make 5hose values higher ..so will it helpful by keeping layers same and just increase learning rate. ?

[vanshshah]

Sir please upload next videos! I am waiting from last 10 days regularly checking your playlist.. please sir

[zkhan]

Sir best of best explanation and thanks

[aakiffpanjwani]

how about we use the learning rate to avoid VGP? like we can use lr = 10 or 100 or 1000 so when it multiplies with the derivatives, the value is again higher, to counter the deep multiplication of 0.1s in a NN. correct me if im wrong
thanks

[paragbharadia]

its a very grateful feeling: to be able to learn Deep Learning: so easefully in hindi! Big big thanks for making such great thing happen.!

[SS-ybqd]

Sir if u want more views and likes then start some bollywood channel. Is channel ke subscribers intelligent hai jo kuch constructive build karenge. If u want to earn money from this channel we are ready to donate money or launch some course like krish naik.

[ahmadtalhaansari]

Revising my concepts.
August 12, 2023😅