Jetson Xavier NX Lesson 10: Tracking Multiple Objects of Interest with Servos in OpenCV

You guys can help me out over at Patreon, and that will help me keep my gear updated, and help me keep this quality content coming:

In this video lesson we learn how to track two objects of interest in OpenCV using two servo controlled pan tilt brackets with Raspberry Pi cameras attached. We track based on the HSV color space, and run a simple PID controller to move the servos such that the object of interest stays in the center of the field of view.

Here is the bracket/servo system, I suggest two sets.

Also I am suggesting two raspberry pi camera, version 2. I like the units below because they include the long cable.

This camera also has a cool little acrylic case, which is nice.

This is the other NVIDIA Jetson Xavier gear I am using.

Jetson Xavier NX Development kit:

You need a GOOD SD card:

Raspberry Pi Camera

Extra Long Cable for Raspberry Pi

Small plastic case/stand for Rpi Camera

Wireless Keyboard and Mouse

Western Digital SSD For the Jetson Xavier NX

Get the code and other useful resources at my WEB site HERE:

If you are not ready for the Jetson Xavier NX, you can follow these lessons using a Jetson Nano, Available below:

Jetson Nano

You need a GOOD power supply:

You need a GOOD SD card:

I love this cool Acrylic case with fan:

Wireless Keyboard and Mouse that works with Jetson Nano:

I like to run with minimum wires, so I am running this wifi card, which works very well. If your budget is tight just use an Ethernet cable, as all my lessons will work with just an ethernet cable.

Finally, you can use either a Logitech C920 WEB cam or the Pi Cam. I am using both, but you need at least one camera working with the nano:

Find more details at our WEB site HERE:

#JetsonXavierNX
#piCamera
#OpenCV

[pralaymajumdar]

Great... Outstanding lesson.. U r the best teacher in YouTube.. Thank u sir.

[leonhardeuler]

Can we do object tracking with new raspberry pi 4 ?

[agrimechatronic]

Hello Paul, first of all thanks for these great lessons.I am doing object detection and what if 2 objects are in same window.I mean 2 blue things are in same window. In which one will motors go? Can we do a filter for them for ex: go at the nearest one, wait x seconds and go to the second one.I asked these because i will burn detected objects and I need any filter.Can you help me? Thanks a lot.

[rushman]

Me, a Jetson Nano guy finding my way over here
Prof. McWhorter, "I hope some of you Jetson Nano guys have found your way over here"
Me :)

[kekocan]

Paul, you won't believe it, but Deepstream 5 comes with some Python samples :))

[thomascoyle]

Hi Paul, did you happen to notice that you left off the second print "tilt out of range" for when the tilt value is less than (<) 0 for both servos assemblies. It is also missing from the python code in the "Jetson Xavier NX Lesson 10" over at toptecboy.com
Also I recommend positioning the CSI cables over the top of the servo assemblies so that the CSI cables will not try to wrap themselves around the base of the pan servos and you can use the FLIP command to bring the picture back to right side up.

[CodingScientist]

Great stuff Paul, how to create a bounding box on a detected object using the nvidia inference ?

[onyangoabuor]

I am one hour late but at least here I am.