filmov
tv
Neural Networks From Scratch - Lec 15 - GeLU Activation Function
Показать описание
Building Neural Networks from scratch in python.
This is the fifteenth video of the course - "Neural Networks From Scratch". This video covers the GeLU activation function and its intuition in detail. We look at the derivative of GeLU and discuss the advantages and disadvantages of using the GeLU activation function. We looked at the performance comparisons of mish against relu and elu activation functions and finally, we saw the python implementation
Neural Networks From Scratch Playlist:
Activation Functions Playlist:
GeLU Activation:
Please like and subscribe to the channel for more videos. This will help me in assessing your interests and creating more content. Thank you!
Chapter:
0:00 Introduction
0:14 Motivation
1:18 Intuition & Deriving GeLU
5:35 Definition of GeLU
6:30 Derivative of GeLU
7:04 Performance comparison
7:38 Python Implementation
#geluactivationfunction, #geluactivationfunction, #geluactivationfunctioninneuralnetwork, #reluactivationfunction, #activationfunctioninneuralnetwork, #vanishinggradient, #selfgatedactivationfunction, #dropout
This is the fifteenth video of the course - "Neural Networks From Scratch". This video covers the GeLU activation function and its intuition in detail. We look at the derivative of GeLU and discuss the advantages and disadvantages of using the GeLU activation function. We looked at the performance comparisons of mish against relu and elu activation functions and finally, we saw the python implementation
Neural Networks From Scratch Playlist:
Activation Functions Playlist:
GeLU Activation:
Please like and subscribe to the channel for more videos. This will help me in assessing your interests and creating more content. Thank you!
Chapter:
0:00 Introduction
0:14 Motivation
1:18 Intuition & Deriving GeLU
5:35 Definition of GeLU
6:30 Derivative of GeLU
7:04 Performance comparison
7:38 Python Implementation
#geluactivationfunction, #geluactivationfunction, #geluactivationfunctioninneuralnetwork, #reluactivationfunction, #activationfunctioninneuralnetwork, #vanishinggradient, #selfgatedactivationfunction, #dropout
0:09:15
I Built a Neural Network from Scratch
0:31:28
Building a neural network FROM SCRATCH (no Tensorflow/Pytorch, just numpy & math)
0:18:40
But what is a neural network? | Chapter 1, Deep learning
0:54:51
How to Create a Neural Network (and Train it to Identify Doodles)
0:32:32
Neural Network from Scratch | Mathematics & Python Code
0:16:59
Neural Networks from Scratch - P.1 Intro and Neuron Code
3:44:18
Understanding AI from Scratch – Neural Networks Course
0:17:38
Neural Networks Explained from Scratch using Python
0:17:57
Building a Perceptron From Scratch - Beginner Friendly Neural Network Tutorial | Neural Networks
0:14:15
Create a Simple Neural Network in Python from Scratch
1:13:07
Neural Network From Scratch In Python
0:40:06
Neural Networks from Scratch - P.5 Hidden Layer Activation Functions
5:00:53
The Complete Mathematics of Neural Networks and Deep Learning
0:12:59
How to train simple AIs
0:33:47
Neural Networks from Scratch - P.4 Batches, Layers, and Objects
1:39:10
Neural Network from scratch using Only NUMPY
0:33:23
Convolutional Neural Network from Scratch | Mathematics & Python Code
0:18:08
Transformer Neural Networks Derived from Scratch
0:14:13
Neural Networks from Scratch - P.9 Introducing Optimization and derivatives
0:13:29
Running a NEURAL NETWORK in SCRATCH (Block-Based Coding)
0:09:12
Neural Networks From Scratch in Rust
0:34:01
Neural Networks from Scratch - P.6 Softmax Activation
2:25:52
The spelled-out intro to neural networks and backpropagation: building micrograd
0:11:35
Neural Networks from Scratch announcement
Комментарии