CMU Neural Nets for NLP 2021 (7): Attention

preview_player
Показать описание
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Spring 2021) covers:

* Attention
* A Case Study: "Attention is All You Need"
* Improvements to Attention
* Specialized Attention Varieties
* What do We Attend To?

  1. Graham Neubig
Рекомендации по теме
CMU Neural Nets 1:22:40

CMU Neural Nets for NLP 2021 (1): Introduction

CMU Neural Nets 1:11:39

CMU Neural Nets for NLP 2020 (1): Introduction

CMU Neural Nets 1:09:00

CMU Neural Nets for NLP 2019 (1): Intro/Why Neural Nets for NLP

CMU Neural Nets 0:34:43

CMU Neural Nets for NLP 2021 (3): Building A Neural Network Toolkit for NLP, minnn

CMU Neural Nets 1:18:40

CMU Neural Nets for NLP 2020 (22): Neural Nets + Knowledge Bases

CMU Neural Nets 0:44:19

CMU Neural Nets for NLP 2021 (17): Neural Nets + Knowledge Bases

CMU Neural Nets 0:43:08

CMU Neural Nets for NLP 2021 (16): Machine Reading w/ Neural Nets

CMU Neural Nets 0:28:53

CMU Neural Nets for NLP 2021 (12): Model Interpretation

CMU Neural Nets 0:47:59

CMU Neural Nets for NLP 2021 (18): Advanced Search Algorithms

CMU Neural Nets 1:11:29

CMU Neural Nets for NLP 2020 (4): Recurrent Neural Networks

CMU Neural Nets 0:38:24

CMU Neural Nets for NLP 2021 (7): Attention

CMU Neural Nets 0:40:04

CMU Neural Nets for NLP 2021 (23): Document-level Models

CMU Neural Nets 0:42:44

CMU Neural Nets for NLP 2021 (8): Distributional Semantics and Word Vectors

CMU Neural Nets 0:50:59

CMU Neural Nets for NLP 2019 (20): Document Level Models

CMU Neural Nets 0:45:06

CMU Neural Nets for NLP 2021 (6): Conditioned Generation

CMU Neural Nets 0:52:04

CMU Neural Nets for NLP 2020 (21): Document Level Models

CMU Neural Nets 1:07:38

CMU Neural Nets for NLP 2019 (18): Unsupervised and Semi-supervised Learning of Structure

CMU Neural Nets 1:14:56

CMU Neural Nets for NLP 2020 (17): Adversarial Methods

CMU Neural Nets 0:57:59

CMU Neural Nets for NLP 2018 (19): Unsupervised and Semi-supervised Learning of Structure

CMU Neural Nets 0:33:11

CMU Neural Nets for NLP 2021 (21): Multilingual Learning

CMU Neural Nets 1:05:14

CMU Neural Nets for NLP 2019 (21): Learning from/for Knowledge Graphs

CMU Neural Nets 0:38:50

CMU Neural Nets for NLP 2021 (5): Recurrent Neural Networks

CMU Neural Nets 1:03:02

CMU Neural Nets for NLP 2020 (16): Advanced Search Algorithms

CMU Neural Nets 0:59:13

CMU Neural Nets for NLP 2018 (10): Debugging Neural Nets for NLP

Комментарии
Автор

You know there are fast transform based neural networks where you swap what is adjusted. You use fixed dot products (statistical summary measures and filters) and adjustable (parametric) activation functions that modulate the responses of the dot products. AI462 neural networks.

hoaxuan