Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 7 – Vanishing Gradients, Fancy RNNs

Показать описание

Professor Christopher Manning & PhD Candidate Abigail See, Stanford University

Professor Christopher Manning
Thomas M. Siebel Professor in Machine Learning, Professor of Linguistics and of Computer Science
Director, Stanford Artificial Intelligence Laboratory (SAIL)

0:00 Introduction
0:34 Announcements
3:06 Overview
3:40 Today's lecture
4:36 Vanishing gradient intuition
6:22 Vanishing gradient proof sketch
14:42 Why is vanishing gradient a problem?
16:11 Effect of vanishing gradient on RNN-LM
20:28 Why is exploding gradient a problem?
22:13 Gradient clipping: solution for exploding gradient
28:18 How to fix vanishing gradient problem?
29:41 Long Short-Term Memory (LSTM)
40:26 How does LSTM solve vanishing gradients?
44:37 LSTMs: real-world success
46:26 Gated Recurrent Units (GRU)
52:36 Is vanishing/exploding gradient just a RNN problem?
57:55 Recap
59:00 Bidirectional RNNs: motivation

Рекомендации по теме

Комментарии

it seems like the order of the videos have been shuffle

yashiroisana

Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 7 – Vanishing Gradients, Fancy RNNs

Stanford CS224N: NLP with Deep Learning | Winter 2021 | Lecture 1 - Intro & Word Vectors

Stanford CS224N NLP with Deep Learning | 2023 | PyTorch Tutorial, Drew Kaul

Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 1 – Introduction and Word Vectors

Stanford CS224N NLP with Deep Learning | 2023 | Lecture 9 - Pretraining

Stanford CS224N NLP with Deep Learning | 2023 | Python Tutorial, Manasi Sharma

Stanford CS224N: NLP with Deep Learning | Winter 2020 | BERT and Other Pre-trained Language Models

Stanford CS224N NLP with Deep Learning | 2023 | Lecture 8 - Self-Attention and Transformers

Stanford CS224N NLP with Deep Learning | 2023 | Hugging Face Tutorial, Eric Frankel

Stanford CS224N NLP with Deep Learning | Spring 2022 | Guest Lecture: Scaling Language Models

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 6 - Simple and LSTM RNNs

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 2 - Neural Classifiers

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 7 - Translation, Seq2Seq, Attention

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 14 - T5 and Large Language Models

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 9 - Self- Attention and Transformers

Stanford CS224N I NLP with Deep Learning | Spring 2022 | Socially Intelligent NLP Systems

Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 15 – Natural Language Generation

Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 11 – Convolutional Networks for NLP...

Stanford CS224N - NLP w/ DL | Winter 2021 | Lecture 5 - Recurrent Neural networks (RNNs)

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 15 - Add Knowledge to Language Models

Stanford CS224N: NLP with Deep Learning | Winter 2020 | Low Resource Machine Translation

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 12 - Question Answering

Stanford CS224N NLP with Deep Learning |Spring 2022|Guest Lecture: Building Knowledge Representation

Stanford CS224N: NLP with Deep Learning | Winter 2019 | Lecture 9 – Practical Tips for Projects

Stanford CS224N NLP with Deep Learning | Winter 2021 | Lecture 18 - Future of NLP + Deep Learning