Long Short-Term Memory (LSTM), Clearly Explained

Показать описание

Basic recurrent neural networks are great, because they can handle different amounts of sequential data, but even relatively small sequences of data can make them difficult to train. This is where Long Short-Term Memory (LSTM) saves the day. Long Short-Term Memory is a type of recurrent neural network that can handle much larger sequences of data without those pesky exploding/vanishing gradient problems that plague basic recurrent neural networks.

Spanish

Portuguese

For a complete index of all the StatQuest videos, check out...
...or...

If you'd like to support StatQuest, please consider...
...or...

...a cool StatQuest t-shirt or sweatshirt:

...buying one or two of my songs (or go large and get a whole album!)

...or just donating to StatQuest!

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:

0:00 Awesome song, introduction and main ideas
4:19 The sigmoid and tanh activation functions
5:58 LSTM Stage 1: The percent to remember
9:25 LSTM Stage 2: Update the long-term memory
12:42 LSTM Stage 3:Update the short-term memory
14:33 LSTM in action with real data

#StatQuest #LSTM #Dubbedwithaloud

Рекомендации по теме

Комментарии

ALSO NOTE: A lot of people ask why the predictions the LSTM makes for days other than day 5 are bad. The reason is that in order to illustrate how, exactly, an LSTM works, I had to use a simple example, and this simple example only works if it is trained to predict day 5 and only day 5.

statquest

"At first I was scared of how complicated the LSTM was, but now I understand."

"TRIPLE BAM!!!"

Thanks Dr. Starmer for teaching in a way I could follow. I am placing an order for your book today.

drranjitha

2 years into Data science, many paid an unpaid courses, never understood the underlying functionality of LSTM but today, Thank you Mr. Josh Starmer for being in my life.

muhammadzakiahmad

As someone who has watched a ton of videos on these topics, I can say that you probably do the best job of explaining the underlying functionality in a simple to follow way. So many other educators put up the standard flowchart for a model and then talk about it. Having the visual examples of data going in and changing throughout really helps hammer the concept home.

kylek

Some rare teachers have instant cred. The moment they start talking you are convinced they really understand the subject and are qualified to teach it. As an experienced teacher of extremely challenging tech myself, I confess that I've never seen more complete and polished preparation. You are changing people's lives at just the moment when this is so critical. Best of everything to you.

robertpolevoi

I have been working in ML industry of 5 years now. But I never had this clear understanding. Not only have you explained this clearly but also sparked a curiosity to understand everything with this much clarity. Thanks Josh!!

SY-jhtg

The ease with which you explain these topics has inspired me to pursue a masters in data science. Thank you for helping me unveil my passion.

gabrielplzdks

I have been waiting for your LSTM video for so long! No other videos can explain ML concepts as good as you do, you sir deserve a thousand BAMs!!

PuroCyanHQ

For a beginner, your videos make me feel easy to follow and understand. I love the way that you use the visual example with different colors so that it easier to follow. And the curiosity to learn more is the thing that makes your videos really impressive to me. Thank you, Josh!

khoile

Mad respect for putting in the hours to prepare the material for the course. These topics are some of complicated ones and yet your illustration + explanation + awesome songs make it easy and enjoyable.

hemesh

the first stage of LSTM unit determines what percentage of long term memory is remembered ... you are absolutely amazing!

crystalcleargirl

I have never fully understood the working of LSTM and tried many blogs and videos on it until I watched your video. This is by far the best explanation on LSTM I have seen on internet. Thank you so much for putting so much of hard work in creating these types of videos.

dikshantgupta

Man the timing! I just saw your RNN video yesterday and was waiting for your LSTM video. Your timing is just impeccable

sayakbhattacharya

I read and watched various articles and videos about LSTM, but none of them explained as well and simply as you. I learned a lot from your video and I am indebted to you. Thank you for taking the time to make this video. I hope you are always healthy and happy. BAM :)

bvjdxzs

A huge thanks for all the effort that you put on this series of videos. You are changing the course of people’s life.

TodoProcesos

"Simplicity is the ultimate sophistication". Wonder how many hours go in to make the explanation so simple and smooth.
Great work!! Thank you!!

Lokendrasingh-gqxp

Damn, these are very well explained. The somewhat silly humor isn't quite for me, but with these high quality explanations I couldn't care less about that. Great job!

be_cracked

This weekend I'll try going to church to thank god for your existence Josh, seriously

felipeazank

Watched a lot of videos on LSTM, but BAM…this was the one. I really liked the part where you put in real numbers and showed the calculations taking place. This really helped me get in the perspective of the inner workings. Kudos for putting in the hard work in making this amazing video.

deathstalkr_

This is the best tutorial so far. Thank you for your clearly explanation! I watched every episode of your NN series. I am a CS student and building a voice cloning app for my honour project. Your tutorials are truly helpful!!!

yyyzzz-kr

Long Short-Term Memory (LSTM), Clearly Explained

Long Short-Term Memory (LSTM), Clearly Explained

What is LSTM (Long Short Term Memory)?

Deep Learning: Long Short-Term Memory Networks (LSTMs)

How LSTM Networks Work? | Deep Learning | Simple Explanation

Machine Learning: Introduction to Long-Short Term Memory (LSTM)

A Brilliant Explanation of LSTM Model | Long Short-Term Memory Model | Deep Learning Tutorial

Long Short-Term Memory (LSTM) Equations Explained

Recurrent Neural Networks (RNNs), Clearly Explained!!!

Simple Explanation of LSTM | Deep Learning Tutorial 36 (Tensorflow, Keras & Python)

Data Science | (LSTM) Long Short-Term Memory Clearly Explained

Long Short-Term Memory with PyTorch + Lightning

LSTM Recurrent Neural Network (RNN) | Explained in Detail

LSTM Long Short Term Memory | Architecture and Calculation | Whiteboard explanation | Formula

Long Short Term Memory(LSTM) explained with Example

Intro to Long Short Term Memory LSTM

Deep Learning | Long Short Term Memory (LSTM)

What is LSTM ?| Long Short Term Memory Explained with Example | Deep Learning Tutorial | Simplilearn

18. LSTM Explained (Long Short Term Memory)

Recurrent Neural Network: Long Short-term Memory (LSTM) architecture

xLSTM: Extended Long Short-Term Memory

LSTM explained simply | LSTM explained | LSTM explained with example.

LSTM Networks: Explained Step by Step!

MACHINE LEARNING: RETI NEURALI - Long-Short Term Memory (LSTM)

Time Series Forecasting With RNN(LSTM)| Complete Python Tutorial|