Custom Depth Map from Kinect & RealSense Point Clouds in TouchDesigner - Tutorial

It can be difficult to create visual effects with a sensor's depth map when it's full of walls, floors, and ceilings. With many of the new operators in TouchDesigner focused on working with point clouds, there are effective new techniques we can use with only a handful of operators. Using Point Transform TOPs, Math TOPs, a little bit of GLSL, and new instancing setups, we can clean up and process our point cloud before rendering it back into a new custom depth map.

[rolandomotta]

incredible tutorial! What I'm trying to do is maintain the colorization ratio of the depth map even if the body moves one meter forward or backward. That it is not in a specific place. but rather render the depth map wherever the person is standing.

[--]

This is awesome! I have been looking for this info for a while. Thanks for sharing!
BTW - Azure rhymes with measure…

[deimovprojects]

Hello. excelent tutorial! in this video you use GLSL to crop with the depth.. but how can you crop with Player Index?

[Sosigarets]

love this tutorial, thank you so much!!
i would love to make a point cloud map with data from two cameras. do you have any sources on this, or could consider making a tutorial on it?

[RusticRaver]

If we needed to create a dense pointcloud of a static building, sculpture using kinect azure plugged in laptop(mobile scanner), coud you show us how to scan with several passes and accumulate points for next level 3d mapping. Or maybe that would not work in TD due to limit of points, I have no idea. thx

[AKMD]

Hi hope you are really great, I have a inquiry this is useful when you want to use the kinect for some interactive floor installation I mean the distance between the persona and the sensor, appreciate your reply

[borjonx]

Any tips on putting the Kinectv2 color data back on the point cloud pixels? I have it working, but the pt cloud doesn't match up perfectly with the color image.

[CllinsWrth.]

Does this use the azure? I have a Kinect 2 and didn't know if it would work as well

[Sosigarets]

This was a great ttutorial and helped me out a lot. Do you know if it is possible to program this with several cameras? I know kinect v1 has that possibility, does it work with Azure?

[mateafriend]

Thank you for this tutorial! I was wondering if it would be possible to use this custom depth map to 3D projection map instead of re creating the model inside of Cinema4d so that you could 3D projection map in real time?