Self-Damaging Contrastive Learning Explained!

preview_player
Показать описание
What do compressed neural networks forget? This paper shows how to utilize these lessons to improve contrastive self-supervised learning and representation learning of minority examples in unlabeled datasets!

Paper Links:

Chapters
0:00 Paper Title
0:03 What Do Compressed Networks Forget?
2:04 Long-Tail of Unlabeled Data
2:43 SDCLR Algorithm Overview
4:40 Experiments
9:00 Interesting Improvement
9:25 Forgetting through Contrastive Learning
11:07 Improved Saliency Maps
11:34 The Simplicity Bias

Thanks for watching! Please Subscribe!
  1. Connor Shorten
Рекомендации по теме
Self-Damaging Contrastive Learning 0:13:31

Self-Damaging Contrastive Learning Explained!

Contrastive learning explained 0:04:24

Contrastive learning explained | Ishan Misra and Lex Fridman

Can Contrastive Learning 0:09:35

Can Contrastive Learning Work? -  SimCLR Explained

Alvin Tan De 0:11:23

Alvin Tan De Jun Self - Supervised and Supervised Contrastive Learning

Divide and Contrast 0:16:30

Divide and Contrast Explained!

Understanding self supervised 0:17:08

Understanding self supervised learning dynamics without contrastive | Outstanding Paper | ICML 2021

Graph Contrastive Learning 0:16:07

Graph Contrastive Learning with Adaptive Augmentation

Hyperbolic Contrastive Learning 0:08:06

Hyperbolic Contrastive Learning CVPR 2023

Improving Transfer and 0:56:53

Improving Transfer and Robustness of Supervised Contrastive Learning - Dan Fu | Stanford MLSys #62

ECCV2022, Relative Contrastive 0:04:25

ECCV2022, Relative Contrastive Loss for Self-supervised Learning

Unsupervised Contrastive Learning 0:14:59

Unsupervised Contrastive Learning Of Sound Event Representations

AI Weekly Update 0:53:40

AI Weekly Update - June 16th, 2021 (#35!)

An Introduction to 0:32:41

An Introduction to Contrastive Learning for Visual Representations

Advances in Contrastive 0:19:57

Advances in Contrastive Learning

Contrastive Self-Supervised Learning 0:55:12

Contrastive Self-Supervised Learning and Potential Limitations - Dr Ting Chen from Google Brain

When Does Contrastive 0:04:17

When Does Contrastive Visual Representation Learning Work? - CVPR 2022

TCLR: Temporal contrastive 0:09:49

TCLR: Temporal contrastive learning for video representation

Webinar | Self 1:11:56

Webinar | Self Supervised learning : Approaches and Applications

CoRL 2020, Spotlight 0:05:05

CoRL 2020, Spotlight Talk 74: CLOUD: Contrastive Learning of Unsupervised Dynamics

Contrastive Learning of 0:38:37

Contrastive Learning of Global & Local Features | NeurIPS | Krishna Chaitanya

TUM AI Lecture 1:16:30

TUM AI Lecture Series - On Removing Supervision from Contrastive Self-Supervised... (Alexei Efros)

Contrastive learning, multi-view 0:11:03

Contrastive learning, multi-view redundancy, and linear models

Negative Data Augmentation 0:14:51

Negative Data Augmentation

A Simple and 0:19:19

A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection(AAAI2021)

Комментарии
Автор

Love your videos. So minimal yet gives you a full walkthrough of all important pieces. It's much easier to go through a paper after watching your videos. Your presentation is also superb always.

Wish you all the best. Keep up the good work.

SaquibAhmad
Автор

Enjoyed your previous videos on contrastive learning, but didn't like this one. The explanation is too fast and hard to follow. Seems like you are reading some text without expression instead of explaining ideas and results.

ezhickezhovsky