Building an Augmented Reality Application with ArUco Marker Pose Estimation in OpenCV

You will also get access to all the technical courses inside the program, also the ones I plan to make in the future! Check out the technical courses below 👇

_____________________________________________________________

In this video 📝 we are going to take a look at how to do pose estimation of ArUco Markers with OpenCV in Python. We will go over the code line by line and see how to set up the detector and do pose estimation of the detected ArUco markers in OpenCV. This can be used for some cool computer vision and augmented reality projects.

If you enjoyed this video, be sure to press the 👍 button so that I know what content you guys like to see.

_____________________________________________________________

_____________________________________________________________

_____________________________________________________________

📞 Connect with Me:

_____________________________________________________________

🎮 My Gear (Affiliate links):
🖥️ Desktop PC:

_____________________________________________________________

Tags:
#ArUco #OpenCV #ComputerVision

[NicolaiAI]

Join My AI Career Program
Enroll in My School and Technical Courses

[soumildev]

need help!
during aruco detection it gives wrong rvec values. the marker has 0, 0, 0 (roll pitch yaw) whereas the output of the rvec value after detection gives -1.9, -1.9, -0.5.
rvecs, tvecs, _ = aruco.estimatePoseSingleMarkers(corners, marker_size, k, distortion_coefficients)

[bennguyen]

Any thoughts on how difficult it would be to create a BINGO-like AR app that overlays a coin on a specific square in a grid?

For example, if A4 is said/entered, the app would use some marker/fiducial on the page to know how far into the grid it needs to place a coin.. scaling the coin size depending on the angle and how close the camera is to the paper?

And is Flet/Flutter something that could be used for such an Android app?

[tobiassandner]

Hi Nicolai,

thank you for your great videos!
do you know how I could determine my camera position depending on the aruco (coordinates and pose) ?

[muhammadarsalan]

Hello Nicolai Nielsen, Thank you for the amazing video. I have been following your content since long ago. I was wondering if you are planning to upload any camera calibration using the CharUco board (The same pattern used in this video). Previously, you uploaded the video of camera calibration using the Checkerboard pattern, which was very helpful. However, camera calibration using the CharUco board isn't that straightforward as compared to Checkerboard. It would be super helpful if you would do that.

[inshaandrabi]

where can I find the parameters of intrinsic camera and matrix coefficient and other input parameters for the pose estimation function?

[inshaandrabi]

the code doesn't work, and I've tried everything to make it work! please give some valuable feedback. I await a response. Thanks!

[mariosalamanca]

Hey man cool video!
I wonder if you have to pass the camera matrix and dist coefficient to the detectMarkers function?

[IdeaByte]

Hi nicolai
I need to do pose estimation of aruco from a image topics
Please help me in getting out

[QuarktaschemitSenf]

copy pastaed your github code for pose estimation but i get an error:

cv2.error: OpenCV(4.6.0) :-1: error: (-5:Bad argument) in function 'detectMarkers'
> Overload resolution failed:
> - 'cameraMatrix' is an invalid keyword argument for detectMarkers()
> - 'cameraMatrix' is an invalid keyword argument for detectMarkers()

[Rei-vmbd]

Hi, thank you for making this video! It's really helpful. I tried running the code and get this error:
cv2.error: OpenCV(4.6.0) :-1: error: (-5:Bad argument) in function 'detectMarkers'
> Overload resolution failed:
> - 'cameraMatrix' is an invalid keyword argument for detectMarkers()
> - 'cameraMatrix' is an invalid keyword argument for detectMarkers()
it occurs at:
File "aruco_pose_est.py", line 118, in <module>
output = pose_estimation(img, ARUCO_DICT[aruco_type], intrinsic_camera, distortion)
File "aruco_pose_est.py", line 73, in pose_estimation

and this happens both when using my own camera parameters and using the original numbers. I'd really appreciate any help with this issue. Thank you:)

[inshaandrabi]

module 'cv2.aruco' has no attribute 'estimatePoseSingleMarkers'