YOLO-NAS + SAM : Image Segmentation Using YOLO-NAS and Segment Anything Model

preview_player
Показать описание
Learn How to build your custom Image Segmentation model using YOLO-NAS and Segment Anything Model (SAM).

YOLO-NAS is a new real-time state-of-the-art object detection model that outperforms both YOLOv6 & YOLOv8 models in terms of mAP (mean average precision) and inference latency.

The “NAS” stands for “Neural Architecture Search,” a technique used to automate the design process of neural network architectures. Instead of relying on manual design and human intuition, NAS employs optimization algorithms to discover the most suitable architecture for a given task.

Training with SuperGradients, Deci's open-source, PyTorch-based computer vision library, enables advanced techniques like Distributed Data Parallel, Exponential Moving Average, Automatic mixed precision, and Quantization Aware Training.
SuperGradients is fully compatible with PyTorch Datasets and Dataloaders, so you can use your dataloaders as is.

Segment Anything Model (SAM): a new AI model from Meta AI that can "cut out" any object, in any image, with a single click.

SAM is a promptable segmentation system with zero-shot generalization to unfamiliar objects and images, without the need for additional training.

Meta the parent company of Social Media giant Facebook has launched a Image Segmentation model yesterday known as the "Segment Anything" Model, capable of identifying and extracting individual objects within an image or video.

This model can help us perform segmentation task very easily.
They built the largest segmentation dataset with over 1 billion masks on 11M images.
Meta said they evaluated the model’s capabilities on various tasks and find that its zero-shot performance is impressive (test model on new and unseen scenarios without additional training.) even if it hasn't been specifically trained to recognize them.
Simply we can say: SAM can identify objects that were not a part of its training.

There are different kind of tasks which you can do with this new Segment Anything Model:
You can cut-out the objects from Images.
You can put masks on Objects

#objectdetection #imagesegmentation #yolo-nas #computervision #sam #segmentanythingmodel
Рекомендации по теме
Комментарии
Автор

Would be nice if you could link the source code in the description

DinitoThompson
Автор

excellent explanation mam.. can you please show me how to save the segmented image (not the mask i want only segmented image to be saved in the other folder

nandiniloku
Автор

Thanks, good video! it's possible to run the YOLO-NAS + SAM in a Jetson Nano?

sebaarr
Автор

Thanks for your videos! Do you think YOLO-NAS + SAM is suitable for realtime applications? Have you ever checked FPS? I'm curious about your thoughts.

ZeynepC
Автор

what are the benefits of using yolo nas instead of just conditioning sam with a text prompt "person" ? I am newbie in computer vision but not deep learning

cocon
Автор

Maam can you also make a model which convert hindi text or sentence to image. If possible pls give your tips.

meg
Автор

how can i use this code to perform instance segmentation in real time using a laptop's webcam?

silyvbj
Автор

Hello. Thank you for the good video. I'm leaving a message because I have one question. Is it possible to segment objects that have a hole in the middle, like a donut? And if you can, what labeling tool do you use for things like donuts? Most labeling is in polygon format, but I don't know what to do in cases like donuts, so I'm asking.

mfgvqvt
Автор

I have different folders for different classes of images with it's mask images in the same folder. I want to perform segmentation with YOLO+SAM. Please suggest other advance possible approaches and codes.

priyanshupandey
Автор

could you provide the notebook of this video?

junioraguilar
Автор

I dont know why the detection_pred= model.predict(image_path, is not print the results. I want to extract the use the image feature vectors, bounding box for another neural network. I have tried the code but not get the rsults

jeffreyeiyike
Автор

How to train this on 8 GPUs on DGX A100?

helloansuman
Автор

I don't understand how do you select just the person class to be the "zero class" on coco dataset.

Andre_Villela
Автор

what if there is some other things inside that person bounding box, will the SAM model segmented those things as well? thanks

jasonl
Автор

what if I have multiple person in the image, YOLO-NAS will detect all the persons and will those all person will get SAM segmentation?

buzhrmj
Автор

Is it possible that the background does not get a mask? It is currently displayed in purple

philipplagrange
Автор

Can't we use SAM alone to get the bbox instead of using 2 DL models? by getting the min rectangle for the segmented part alone.

jyothir
Автор

hi mam, which Yolo model is better for small object detection ( like grains ) now I am using Yolo v7 can I switch to V8 or NAS

deepakts
Автор

Hi Aarohi, would it be possible to download your sample code used in the video? Thank you

robertocenci
Автор

Thanks for your videos. Can you consider sharing your code please.

assiachahidi