Keypoints Detection on Custom Dataset Using Detectron2 | Detectron2 Keypoint Detection

Detectron2 - Key Point Detection with PyTorch
In this video, I will show you Key point Detection On Custom Dataset using Detectron2.

Facebook AI Research (FAIR) came up with this advanced library,It supports multiple tasks such as bounding box detection, instance segmentation, keypoint detection, densepose detection, and so on. It provides pre-trained models which you can easily load and use it on new images.

With a keypoint detection model it is possible to detect interest points in an image which allows to estimate pose, angles and dimensions of humans and objects.Most popular applications of artificial intelligence and machine learning in computer vision include image classification, object detection and segmentation, However, if you are interested in detecting keypoints or points of interest in an image or video, keypoint detection models are your choice.

#Detectron2 #KeypointDetection #Customkeypointdetector #AI #ArtificialIntelligence #ComputerVision #DeepLearning #ML #MAchineLearning #NeuralNetworks #PifordTechnologies #AarohiSingla #Akminder

[owen]

great tutorial, I am having trouble getting the correct annotations for the json file, can you share an example of your?

[derickjohn]

Hi, nice tutorial. Can you help me where I've two classes each having separate keypoints. How should I change the code to accommodate these?

[PoojaKumari-iczh]

Hey, How to draw line between two custom keypoints ?

[ramkumar-oiye]

Wow, nice .
You literally solved my last two weeks problem.
Thank you very much, Madam.

Shall I know what annotator Tool you utilized to create keypoints?
Please let me know, It'll be very helpful for me, madam. 😊

[guillermoalejandrobastianf]

miss, thanks for the video. Only want to know, how did you deal with the different sizes of the images? I saw this code's 
lines obj = detectron2.structures.Instances(image_size=(480, 640)) 

but if an image is resized, then the annotations are not going to fit, or how it works?

thanks

[karthik-pillai]

Amazing video!
How do you annotate the data?

[PoojaKumari-iczh]

Hey there Aarohi, great work!!...You solved so many doubts in my head....I have one question to ask...Can we train detectron2 with video files(.mp4)? If yes how? I am having tough time finding solution for human action recognition and I want to use detectron2 for that. I have videos of human actions and I annotated them and result is custom .json file, giving frames information, not the let me know..thank you so much for nice videos

[umangpurwar]

hey can you suggest how to do annotation for keypoints

[hamidrezaie]

Thanks for this good video!

I have a question. I have a big dataset of cardboard boxes (Stacked Carton Dataset). My Problem is that I actually needd only the four verticies of the front side of the cardboard box. Yolo or MaskRcnn delivers me the whole box.

The datset is already annotated in coco format. Is there a way to extend this dataset just with keypoints?

[kavakkaracalar]

Any chance you can share your dataset? I want to try and learn

[宜庭蔡-ib]

Is there an instructional video for panoptic segmentation on Custom Dataset Using Detectron2. Thank you!

[emmanuelkoupoh]

Did you fine-tune the keypoint model on your custom dataset?
Did you try to initialize a test dataset for fine-tuning?
what was the annotation tool you used?

[christianpritz]

Hi Aarohi.Great work many thanks. Could you per chance share all the config files for the cutsom training on your github account that would be such a help. Cheers

[otavioaugustomedolaconquis]

Hi there, Aarohi! Excelent explanation, you helped me a lot. I have one question, though: what tool did you use to make your keypoint annotations? I`ve been strugling for days to find such tool and not succeeding... I`d lappreciate some light on this subject, can you help me? Greetings from Brazil!

[furkankaragoz]

Hey thanks for video. Could you please suggest a free keypoint annotator tool which i can use ?

[adityasprojects]

I have 1robot with 9 points: ['head', 'c1', 'c2', 'c3', 'c4', 'w1', 'w2', 'w3', 'w4'] so 1 class and 9 keypoints. In parameter when i set the value {1:0}, it throws an error saying the value has to be {8:0}. After setting this, it runs pretty smoothly. But at time of visualization, I get IndexError: list index out of range. I am not sure where I have gone wrong. Could you please help

[andihaki]

could you make tutorial for making custom model for detection facial keypoint using tensorflow?
*or at least some reference so I can follow along

thank you

[faraazmohammed]

Very useful.can detectron 2 detect multiple person. ? I.e. key points of multiple person present in same frame.?

[zxcqweasd]

First of all, thank you for this explanation. Could you please share the dataset in the video so we can see an example dataset?

[aniketsharma]

Mam your company provide training or intern in python language ???