Reading ViT (Vision Transformer) PyTorch source code

preview_player
Показать описание
Vision Transformer is one of the two most popular transformer-based, huge models for image recognition (second one being Swin). It is considered a heavy-weight replacement for cnn-based models like ResNet.
ViT has 2 main implementations: the original one, from Google, written in Flax, and the one from PyTorch team. PyTorch one opensourced training code as well as inference/finetuning, so this is the one I will go over in the video.
Important links:

00:00 - Intro
02:09 - Lineage and Model Versions
06:22 - Installation and Debugging Setup
19:00 - Data Loading and Augmentations
26:31 - Model Inference Code
38:45 - Training Code
42:12 - Next Up
  1. Mak Gaiduk
Рекомендации по теме
Reading ViT (Vision 0:44:10

Reading ViT (Vision Transformer) PyTorch source code

Vision Transformers (ViT) 0:30:27

Vision Transformers (ViT) Explained + Fine-tuning in Python

Implement and Train 1:15:34

Implement and Train ViT From Scratch for Image Recognition - PyTorch

PyTorch Paper Replicating 2:32:18

PyTorch Paper Replicating (building a vision transformer with PyTorch)

Vision Transformer (ViT) 0:24:57

Vision Transformer (ViT) - An image is worth 16x16 words | Paper Explained

An Image is 0:29:56

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Paper Explained)

PyTorch ViT: The 0:22:24

PyTorch ViT: The Ultimate Guide to Fine-Tuning for Object Identification (COLAB)

Vision Transformer Basics 0:30:49

Vision Transformer Basics

UNETR Implementation for 0:42:41

UNETR Implementation for 2D Segmentation in PyTorch | UNTER = Vision Transformer + CNN Decoder

Vision Transformers (VIT) 0:54:04

Vision Transformers (VIT) - Human Emotions Detection

Reading SWIN transformer 0:56:07

Reading SWIN transformer source code - Image Recognition with Transformers

Vision Transformer (ViT) 0:07:37

Vision Transformer (ViT) - Using Transformers for Image Classification | HuggingFace

Vision Transformer from 2:00:30

Vision Transformer from Scratch and Training Implementation

EfficientML.ai Lecture 14 1:14:19

EfficientML.ai Lecture 14 - Vision Transformer (MIT 6.5940, Fall 2023)

Robust Perception with 0:02:36

Robust Perception with Vision Transformer SegFormer

vision transformer and 0:30:14

vision transformer and Deit using PyTorch Lightning

Attention in transformers, 0:26:10

Attention in transformers, visually explained | Chapter 6, Deep Learning

DINO in PyTorch 0:44:34

DINO in PyTorch

Deep Dive into 0:29:39

Deep Dive into Vision Transformer : From concepts to code from scratch using Pytorch

12 Vision Transformers 0:18:39

12 Vision Transformers - Computer Vision - Winter Term 21/22 - Freie Universität Berlin

Transformers: The best 0:08:38

Transformers: The best idea in AI | Andrej Karpathy and Lex Fridman

Vision Transformer Explained 0:18:56

Vision Transformer Explained

Swin Transformer paper 0:11:10

Swin Transformer paper animated and explained

Vision Transformer(ViT) - 0:44:01

Vision Transformer(ViT) - Image is worth 16x16 words | Paper Explained

Комментарии
Автор

keep pushing brother! Young students and researchers will need these kind of content

anhduy
Автор

Mak, you are awesome, please keep up and you'll acquire the community you deserve. Your videos are awesome, well explained and you explore subjects that no one has before. Hope to see you channel grow !!

AntoineHouet
Автор

how do u download from kaggle to ubuntu instance?
The download link will only download to the local computer....

eliaweiss