Hand Gesture Detection with Unity XR Hand Tracking

Hand tracking lacks input but we can fix this problem by using Hand Pose detection to detect a particular gesture and turn it into a custom behaviour. Let's learn howto make that with the Unity XR Toolkit.

····················································································

❗❗❗ WISHLIST MY FIRST VR GAME ON STEAM ❗❗❗

····················································································

📝Best VR Assets ( These links are Affiliate links which means it costs the same to you and I get a small commission. Thanks for your support!)

VR Interaction Framework

Hexabody (Physics VR Player)

Mirror and Reflection for VR

Auto Hand (automatic hand grab pose)

Hurricane VR (vr physics interaction)

3d Hand Model for VR

····················································································

····················································································

If you enjoyed this video, here are some other really good channel you should appreciate :

⌨️ Game Dev

👨‍🎓 Vr Dev

····················································································

#vr #vrdev #madewithunity

[billkeane]

Perfect tutorial. Complete concept from start to finish, efficient and fast. Very, VERY useful. Thank you.

[Nick]

Thanks for the tutorial, I couldn't find the hand gestures sample scene because I didn't have experimental packages enabled. Its amazing how Unity has made absolutely complex logic like pose detection so accessible.

[De-Panther]

Thanks! Great tutorial!
It works on WebXR as well🤩

[ivanaguilar]

Great tutorial on inputs via hand gestures.

Will you create a tutorial on how to use Meta's new inside-out body tracking (IOBT), for instance, to detect if the user is leaning forward (rotated their torso) instead of walking forward? This will be useful to not have the character move forward and just lean forward (i.e., leaning forward to grab something on a desk and not have the character's body move forward and collide with it).

[dopinkus]

Would love a tutorial on how to make good quality UI in VR / on Quest! I think you go through it another - but I believe it’s outdated

[peterschreuderr]

Yess!! Just what I needed since i dont work with the Oculus package anymore

[semihyildiz]

Hi Valem I have a probelm it always tells me NullReferenceException: Object refernce not set to an instance of an object - when I try to use the displaying with the text. Do you have any tips for me?

[roguestargun]

Damn just when I thought I was done adding features to Rogue Stargun (cough, coming February 1st to Applab). Thanks for the tutorial Valem!

[Besttechnology]

Hi valem can u made a video of how to navigate using hand

[VirtualWorldDE]

Finally I can make my VR Rock Paper Scissors game without having to do the handtracking myself

[mathivaananvedaraj]

Hi, wonderful video. Could make a video on teleporting using hand tracking please? Thanks alot.

[teawa_]

I had no idea you could change the value of a text through an event

[Thesomeonevr]

can you do a tutorial on how to add fishing to unity vr project

[daryladhityahenry]

Hi Valem! I have a question... Why do you choose unity over unreal engine? I am really curious... I like unity of course, I never even touch the unreal engine. But, wherever I see, unreal engine seems to have massive advantage if we're going to do realistic VR graphics.. Is there any specific thought on that? I really think a lot wether I should learn unreal or not at this point...

Thanks.

[XaviDevSama]

XR HANDS work fine on Unity Editor but in the build it doesn't detect my hands its this normal, or I have to make some changes in the configuration?

[WarrenEBB]

can you (or anyone here?) note what replaced TrackedPoseDriver component - for sticking a mesh onto your hand anchor?
(say I wanted to put a custom mesh prop onto my wrist).

+ and can this mesh stay: in same spot when you put controllers down and switch to gestures?
( InteractionSdk suggests HandJoint component, but this doesn't keep mesh in same spot when you cross over between controller and raw hand input.)
(... i'm debating joining everyone in XR Toolkit usage world, after watching this video, but still not clear how to best stick props onto my custom VR hands. Want to support switching between controller and controller free usage at will. Guessing i need to have 2 setups and switch what is active when I detect change. curious what more experienced folks would suggest. mostly curious if there is an established "this has officially replaced Tracked Pose Driver. everyone should use it."

[capolean]

can i use a $300 laptop from amazon to do these?