filmov
tv
DETR: End-to-End Object Detection with Transformers (Paper Explained)
Показать описание
Object detection in images is a notoriously hard task! Objects can be of a wide variety of classes, can be numerous or absent, they can occlude each other or be out of frame. All of this makes it even more surprising that the architecture in this paper is so simple. Thanks to a clever loss function, a single Transformer stacked on a CNN is enough to handle the entire task!
OUTLINE:
0:00 - Intro & High-Level Overview
0:50 - Problem Formulation
2:30 - Architecture Overview
6:20 - Bipartite Match Loss Function
15:55 - Architecture in Detail
25:00 - Object Queries
31:00 - Transformer Properties
35:40 - Results
ERRATA:
When I introduce bounding boxes, I say they consist of x and y, but you also need the width and height.
Abstract:
We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression procedure or anchor generation that explicitly encode our prior knowledge about the task. The main ingredients of the new framework, called DEtection TRansformer or DETR, are a set-based global loss that forces unique predictions via bipartite matching, and a transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. The new model is conceptually simple and does not require a specialized library, unlike many other modern detectors. DETR demonstrates accuracy and run-time performance on par with the well-established and highly-optimized Faster RCNN baseline on the challenging COCO object detection dataset. Moreover, DETR can be easily generalized to produce panoptic segmentation in a unified manner. We show that it significantly outperforms competitive baselines. Training code and pretrained models are available at this https URL.
Authors: Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, Sergey Zagoruyko
Links:
OUTLINE:
0:00 - Intro & High-Level Overview
0:50 - Problem Formulation
2:30 - Architecture Overview
6:20 - Bipartite Match Loss Function
15:55 - Architecture in Detail
25:00 - Object Queries
31:00 - Transformer Properties
35:40 - Results
ERRATA:
When I introduce bounding boxes, I say they consist of x and y, but you also need the width and height.
Abstract:
We present a new method that views object detection as a direct set prediction problem. Our approach streamlines the detection pipeline, effectively removing the need for many hand-designed components like a non-maximum suppression procedure or anchor generation that explicitly encode our prior knowledge about the task. The main ingredients of the new framework, called DEtection TRansformer or DETR, are a set-based global loss that forces unique predictions via bipartite matching, and a transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. The new model is conceptually simple and does not require a specialized library, unlike many other modern detectors. DETR demonstrates accuracy and run-time performance on par with the well-established and highly-optimized Faster RCNN baseline on the challenging COCO object detection dataset. Moreover, DETR can be easily generalized to produce panoptic segmentation in a unified manner. We show that it significantly outperforms competitive baselines. Training code and pretrained models are available at this https URL.
Authors: Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, Sergey Zagoruyko
Links:
0:40:57
DETR: End-to-End Object Detection with Transformers (Paper Explained)
0:09:35
DETR - End to end object detection with transformers (ECCV2020)
0:31:19
DETR: End-to-End Object Detection with Transformers | Paper Explained
0:34:56
PR-284: End-to-End Object Detection with Transformers(DETR)
0:06:14
DETR: End-to-End Object Detection with Transformers
0:15:08
DETR (DEtection TRansformer) | Lecture 38 (Part 2) | Applied Deep Learning (Supplementary)
![[Paper Review] DETR:](https://i.ytimg.com/vi/U7FlIvorkR0/hqdefault.jpg)
0:15:36
[Paper Review] DETR: End-to-End Object Detection with Transformer
0:04:28
Object Detection Part 7: Detection Transformers (DETR), Object Queries
0:18:21
Object detection Using Detection Transformer (Detr) on custom dataset
0:02:02
DETR - End-to-End Object Detection with Transformers - DEMO
0:26:55
DETR End to End Object Detection with Transformers
0:01:07
Reimplementation Showcase DETR: End-to-End Object Detection with Transformers | CVDL Final Project
1:42:52
Facebook DETR | ML Coding Series | End to end object detection with transformers
0:24:09
End to end Object Detection with Transformers 😲🚀
0:02:53
DETR - End-to-End Object Detection with Transformers - DEMO
![[Tutorial] Training End-to-end](https://i.ytimg.com/vi/RkhXoj_Vvr4/hqdefault.jpg)
0:25:16
[Tutorial] Training End-to-end Object Detection with Transformer(DETR) model on custom dataset
0:01:52
ELI5: DETR
1:08:51
Decoding DETR
0:45:24
How I Read a Paper: Facebook's DETR (Video Tutorial)
0:41:10
DINO - DETR with Improved DeNoising AnchorBoxes for End-to-End Object Detection
0:03:21
DETR: End to End Object Detection and Panoptic Segmentation
![[Paper Review] End-to-End](https://i.ytimg.com/vi/q1wSykClIMk/hqdefault.jpg)
0:40:18
[Paper Review] End-to-End Object Detection with Transformers (DETR)
0:24:04
VPS-01: DETR: End-to-End Object Detection with Transformers paper review
0:17:44
L-7 | DETR | Object detection Using Detection Transformer on custom dataset
Комментарии