Dwell Time Analysis with Computer Vision | Real-Time Stream Processing

Learn how to use computer vision to analyze wait times and optimize processes. This tutorial covers object detection, tracking, and calculating time spent in designated zones. Use these techniques to improve customer experience in retail, traffic management, or other scenarios.

Chapters:

- 00:00 Intro
- 00:41 Static File Processing vs. Stream Processing: Time Calculation Explained
- 04:29 Time Calculation Methods: FPS vs. ClockTime
- 06:54 Project Setup
- 08:39 Object Detection and Tracking
- 12:57 Defining Zones: How to Filter Objects
- 16:33 Measuring Time
- 17:44 Why Naive Stream Processing Fails
- 21:02 Efficient Stream Processing
- 24:19 Important Considerations
- 26:07 Outro

Resources:

[tobieabel]

Another great tutorial. I'm glad you've covered the issues of latency and frames accumulating in the buffer causing crashes, I've been having trouble with that when trying to run CV applications for long periods.

[tomii]

The system is amazing, thanks a lot for the tutorial :)

[paulelliotco]

Thank you for the tutorial. Could you do one on shoplifting? Interesting use case.

[RamphyRojas]

amazing tutorial, thank you for your time!

[ItayHilel]

@Roboflow, what was done in the video is great! I loved it!!! . But it's a workaround; you took a video and turned it into an RTSP link. However, there are many challenges that occur when pulling footage from a stream.

I would love to see that part done as well. Let's say you get permission for a few cameras from an office/gym or elsewhere and do an example project. It would be fascinating to see the process of pulling footage from these cameras, training a model, thinking of a use case that solves a real-world problem, coding it, and finally giving the result to the client (showing us thats the average time of a customer in checkout 6 is 50 sec on a given day) .

Currently, most CV i see is done on 15-second videos and from one camera, and there isn't much value in that. real value is in solving real problems with multiple cameras models/logic that works together.

I'm aware that what I'm talking about is a huge project and not an easy task, but if anyone can do it, it's @Roboflow and Piotr.

I believe that a tutorial/series like I'm imagining would open the door for millions of CV applications to be built in the future.

[sanchaythalnerkar]

Great Video as always!
How did you create the intro explanation on white board with the text and diagrams?

[Mesenqe]

Thank you for the great Tutorial. I always enjoy your tutorials. If you have time, I wish you could make tutorial of Camera Calibration 💙.

Great video. What happen when the frames dropping are iframes?

[tiktak]

Where does the processed video get saved? also seems to be running really slow on the detection running a m1 mac. Great tutorial!

[와드남-yl]

Can we proceed with the vehicle speed estimation in real-time, which is a whole project?

[_ABDULGHANI]

Thank you for this amazing tutorial, can I use these examples with other versions of YOLO algorithm like v7 or v6, or does this work on YOLOv8 only?

[baotrangia]

Hello, is there anyway for me to custom for keeping the quality of frame more clearly, I have test and see the quality of frame stream is too bad

[hosseinhaghjoo]

I can't find link for the code you wrote

[romellfudi]

is possible to run it into a mps device? such as M3

[nestorjavierhurtado]

Se puede ejecutar en una jetson nano de 4GB?

[PlottingMath]

is there a way to process high resolution stream in realtime to detect / track small objects in the stream?
I have tried SAHI, but its not possible to run in real time if the images are 5000x576.

[chiragharish]

Which architecture is used internalliy in
Roboflow 3.0 Object Detection (Fast)????

[unholytsar]

Hi, thanks for the really great and easy to understand tutorial. Here, you implemented a clock based timer approach to calculate elapsed time from a real time stream. I am assuming that similar approach can be used to estimate the speed of an object (like car) from a real time stream as well. Is it correct? Would appreciate your valuable feedback.

[SebastianVargas-yjdh]

Is ther any way i can set my model project to run with my gpu? currently it only runs over the processor

[marwanahmed]

Thank you for this amazing tutorial, i just have a problem I'm working with project that detect and tracking people but in my model when people change thier position the model record it's another track so how i can enhance it