Activation Functions (C1W3L06)

Показать описание

DeepLearningAI

Рекомендации по теме

Комментарии

I use always Leaky Relu, it gives good results while doing the model building.

thepresistence

At 4:12 downsides of sigmoid and tanh:
how does gradient descent slow down when slope of sigmoid or tan-h becomes very small? I understand gradient descent takes smaller steps on graph of J(w) v/s w, as it approaches the minimum, but what does the slope of gradient descent have to do with slope of these functions?

SiddharthDesai

The tanh definition is not correct at 9:01. The denominator should be exp(z) + exp(-z). So the whole function should be tanh = (exp(z) - exp(-z)) / (exp(z) + exp(-z))

abekang

At 9:01 coordinates of tanh graph should be Z not X ????

saanvisharma

But ReLU or even Leaky ReLU still are linear functions(but more complex ofc) which means they cant fit some complex classification problems, isn't it?

rpimxoimxo

Clarification: Activation Function

From 7:58, this visual comparison of 4 activation functions. All 4 should have "z" as the horizontal axis. The top right chart in the slide shows "x", which should be "z".

manuel

So I finally understand why certain activation functions are chosen, it's because we usually use them..

prismaticspace

Can't we reassign the 0 labels to -1, and then use tanh() for the output layer?

pivasmilos

Can we make the parameter we apply at Relu function a part of hidden learning parameters like the weights and bias?

Jaspinik

Do we need an activation function when in case of regression problems where output is continuous values????

sreemantokesh

A sigmoid function is one that have a "S" curve, is not a synonym of logístic regression, in fact tanh func is a type of a a sigmoid function, so min 2:58 is kind of incorrect the explaining. Apart of that nice vid.

hectorgarces

Why we need an activation function in hidden layers?

সমুদ্রসন্তান

what about Softmax ? is it better than RELU?

xerocool

I am beginning to see math notation is simply just really poorly named variables in programming. Its too bad that the "one letter" variable naming in math notation has such deep roots. In programming we would call it "sigmoid()" but in math even when you run out of letters of the alphabet, we go to different alphabets...

videosmydad

Activation Functions (C1W3L06)

Activation Functions (C1W3L06)

Activation Functions In Neural Networks Explained | Deep Learning Tutorial

Activation Functions - EXPLAINED!

Neural Network Activation Functions - M4S41 [2019-06-18]

Terms: Activation Functions

Activation Functions in a Neural Network explained

20 Activation Functions in Python for Deep Neural Network | ELU, ReLU, Leaky-ReLU, Sigmoid, Cosine

Neural Networks From Scratch - Lec 14 - Mish Activation Function

Activation functions (Sigmoid, Leaky ReLU, Tanh) for Machine Learning with python

Neural Networks Pt. 3: ReLU In Action!!!

Why Non-linear Activation Functions (C1W3L07)

Neural Nets 6: Activation Functions

How to Choose an Activation Function for Neural Networks

Layers and Activation Functions in Artificial Neural Networks

Activation Functions MADE EASY [3/11]

Softplus as a Neural Networks Activation Function

Deep Learning with Tensorflow - Activation Functions

132 - What are Activation functions in deep learning (Keras & Tensorflow)?

A Brilliant explanation of Activation Functions in Deep Learning | Machine Learning tutorial

Python Tutorial : Activation functions

Derivatives Of Activation Functions (C1W3L08)

Tutorial 94 - Deep Learning terminology explained - Activation Function

Why are activation functions important for Neural Networks?

Almost everything about Activation Functions !