ReLU Activation Function Variants Explained

preview_player
Показать описание
In this video we explain the various ReLU activation function variants including: Leaky ReLU (LReLU), Parametric ReLU (PReLU), Gaussian Error Linear Unit (GELU), Sigmoid Linear Unit (SILU), Softplus and Exponential Linear Unit (ELU).

*Related Videos*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Contents*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:10 - Leaky ReLU (LReLU)
01:06 - Parametric ReLU (PReLU)
02:14 - Gaussian Error Linear Unit (GELU)
03:44 - Sigmoid Linear Unit (SILU)
05:22 - Softplus
07:01 - Exponential Linear Unit (ELU)
08:21 - Discussion
08:52 - Outro

*Follow Me*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

*Channel Support*
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Special thanks to Arka Mitra for the video idea!

#relu #prelu #leakyrelu #prelu #gelu #elu #softplus #silu
  1. DataMListic
  2. relu
  3. leaky relu
  4. lrelu
  5. parametric relu
  6. prelu
Рекомендации по теме
ReLU Activation Function 0:09:04

ReLU Activation Function Variants Explained

Relu Variants Explained 0:33:25

Relu Variants Explained | Leaky Relu | Parametric Relu | Elu | Selu | Activation Functions Part 2

Neural Networks From 0:06:06

Neural Networks From Scratch - Lec 10 - ReLU & Its Variants

Which Activation Function 0:08:59

Which Activation Function Should I Use?

ReLU Activation Function 0:02:48

ReLU Activation Function

NN - 24 0:13:57

NN - 24 - Activations - Part 2: ReLU Variants

ReLU vs Sigmoid 0:07:13

ReLU vs Sigmoid vs Tanh: Activation Function Performance

ReLU Leaky ReLU 0:08:29

ReLU Leaky ReLU Parametric ReLU Activation Functions Solved Example Machine Learning Mahesh Huddar

A Review of 0:15:59

A Review of 10 Most Popular Activation Functions in Neural Networks

All-in-one Activation Functions 0:13:04

All-in-one Activation Functions | Sigmoid, tanh, ReLU, Leaky ReLU, ELU, Swish | Deep Learning basics

Neural Networks From 0:09:34

Neural Networks From Scratch - Lec 9 - ReLU Activation Function

Activation Functions | 0:16:29

Activation Functions | Deep Learning Tutorial 8 (Tensorflow Tutorial, Keras & Python)

Choosing an Activation 0:10:51

Choosing an Activation Function for Deep Learning

A Brilliant explanation 0:08:59

A Brilliant explanation of Activation Functions in Deep Learning | Machine Learning tutorial

Advantages of GELU 0:00:56

Advantages of GELU (Gaussian Error Linear Units) activation function | Data Science Interview

3. Rectified Linear 0:07:57

3. Rectified Linear Unit Activation Function RELU | ACTIVATION FUNCTION

Deep Learning-Activation Functions-Elu, 0:38:48

Deep Learning-Activation Functions-Elu, PRelu,Softmax,Swish And Softplus

A simple explanation 0:01:58

A simple explanation on ReLU(Rectified Linear Unit)

ReLU Variants #machinelearning 0:00:30

ReLU Variants #machinelearning #datascience #deeplearning #neuralnetworks #artificialintelligence

Why ReLU Is 0:09:01

Why ReLU Is Better Than Other Activation Functions | Tanh Saturating Gradients

Parametric Rectified Linear 0:01:00

Parametric Rectified Linear Unit Activation || activation functions

Activation Functions in 0:44:52

Activation Functions in Deep Learning | Sigmoid, Tanh and Relu Activation Function

Dying ReLU Problem 0:00:56

Dying ReLU Problem in Deep Neural Network | Data Science Interview Questions | Machine Learning

Introduction to Deep 0:08:57

Introduction to Deep Learning - Module 1 - Video 10: Rectified Linear Units (ReLU)

Комментарии
Автор

Which ReLU activation function do you think is the best one?

datamlistic
Автор

Nice video! Could you make a video about activation functions that are used at the output of a nn?

iacobsorina