filmov
tv
11-785 Spring 2023 - Recitation 11 - Transformers
Показать описание
Resources:
Errata:
00:38 At the beginning, I ask students to refer to lectures 16-17, when it should be 18-19. Please refer to lectures 18 and 19 by Bhiksha and Abu.
01:16:33 - It should be a lower triangular matrix of ones (not left? My brain is muddled, sorry lol). It is not an upper triangular matrix because we use a comparison of mask == 0 in the attention block. It would be upper triangular if that was inverted.
Errata:
00:38 At the beginning, I ask students to refer to lectures 16-17, when it should be 18-19. Please refer to lectures 18 and 19 by Bhiksha and Abu.
01:16:33 - It should be a lower triangular matrix of ones (not left? My brain is muddled, sorry lol). It is not an upper triangular matrix because we use a comparison of mask == 0 in the attention block. It would be upper triangular if that was inverted.
1:15:14
11-785 Spring 2023 Recitation 1: Your First MLP
0:18:19
11-785 Spring 2023 Recitation 0J: Data Preprocessing
0:14:52
11-785 Spring 2023 - Recitation 14 - Deep Reinforcement Learning (Part 1/2)
0:10:10
11-785 Spring 2023 Recitation 0L: Workflow of a Deep Learning HW
0:18:13
11-785 Spring 2023 Recitation 0C: Introduction to PyTorch
0:51:32
11-785 Spring 2023 Recitation 10: Attention, MT, LAS
1:31:55
11-785 Spring 2023 - Recitation 11 - Transformers
0:11:12
11-785 Spring 2023 Recitation 0F: AWS Fundamentals (Part 1/4)
0:12:23
11-785 Spring 2023 Recitation 0I: What to do if you're struggling
0:10:41
11-785 Spring 2023 Recitation 0E: Introduction to Google Colab
0:50:49
11-785 Spring 2023 - Recitation 12 - GNNs
0:08:13
11-785 Spring 2023 Recitation 0H: Basics of GIT
0:21:13
11-785 Spring 2023 Recitation 0D: Dataset & DataLoaders
1:01:54
11-785 Spring 2023 Recitation 5: CNN Basics & Backprop
0:47:26
11-785 Spring 2023 Recitation 0A: Python & OOP Fundamentals (Part 1/2)
0:06:24
11-785 Spring 2023 Recitation 0G: Debugging and Visualisation (Part 3/3)
0:17:49
11-785 Spring 2023 Recitation 0F: AWS Fundamentals (Part 2/4)
0:15:51
11-785 Spring 2023 Recitation 0G: Debugging and Visualisation (Part 1/3)
0:17:51
11-785 Spring 2023 Recitation 0F: AWS Fundamentals (Part 3/4)
0:24:16
11-785 Spring 2023 - Recitation 14 - Deep Reinforcement Learning (Part 2/2)
0:30:56
11-785 Spring 2023 Recitation 7: CNNs: Verification, Code
1:07:36
11-785 Spring 2023 Recitation 3: Autodiff and backprop
0:13:26
11-785 Spring 2023 Recitation 0G: Debugging and Visualisation (Part 2/3)
1:11:59
11-785 Spring 2023 Recitation 2: Network Optimization, Hyperparameter Tuning
Комментарии