Real Time Pose Estimation with Tensorflow.Js and Javascript

Been trying to perfect your golf swing?

Maybe, you've been working on the perfect salsa steps.

What ever pose you're trying to strike, real time pose estimation can help! Pose estimation uses deep learning to detect different joints within your body from an image and pieces them together to determine a human pose. This video walks through how to use Posenet with Tensorflow.Js and React.JS to exactly that in REAL TIME!

In this video you'll learn how to:
2. Setting up a real-time webcam feed using React-Webcam
3. And, last but not least display it all inside a web app using React

Want to learn more about it all:

Oh, and don't forget to connect with me!

Happy coding!
Nick

P.s. Let me know how you go and drop a comment if you need a hand!

Music by Lakey Inspired

[jessicapalomares]

4:05 install dependencies
4:41 Import dependencies
6:44 Setup webcam and canvas
8:51 Load posenet
10:16 Detect function
14:48 Drawing utilities from tensorflow

[ChristineSawyerDance]

Hi Nick! This video is super helpful! I am planning a project using Tensorflow.Js and Javascript for fitness and dance. I am checking out your other videos too!

[maryamghorbani]

That was great . I need to get help from your video for the mvp of a project . Thank you

[pranavikedari]

where can I find the drawing utilities code? It says file not found in master branch when I click the link.

[spencergarth]

This was super helpful Nick! Thanks for breaking down the different steps, it makes it much easier for me to follow along. Nice job!

[rodky]

Thanks a lot Nick. This is my first app in JS. Very clear instructions and excellent tutorial.

[kailikespenguins]

This is awesome! Thank you for this great tutorial :D

[aseem]

Super thanks for this. However, this runs slowly (infact hangs after sometime) in my browser (using Macbook Air 2017 model), but on the other hand the official TF demo for posenet runs smooth and fine. Do you know of any reasons? Thanks

[bashirulagoke]

Hello Nicholas, I have a question, "I'd like to know if you have a tensor flow course start to finish"? I'm trying to build a fitness application that marks exercise positions, could you please point me in the right direction?
Thank you.

[mahmudanajnin]

hey nick, can we detect human activity like walking, running, sitting from post estimation using this code?

[josemouche.]

Hi, amazing video I love it, could you make a video on calculating these joint angles?

[ssaniljainn]

is it possible to track the movements of any particular joint and print them? Could be the path to creating a good application

[shivamsuri]

Great Work Man!
Could you please tell minimum pc requirements that are required to make this run? Thanks in advance.

[borscsa]

Hi, if we replace the react webcam with a react-nativ solution, will it work smoothly in react-nativ?

[mother_chucker]

Hey, nice video. Do you think the detection can be done by uploading a image/video from pc? Like adding an option in the app

[sehulviras]

Hi Nicholas. Quick question... I have a Windows 10 with NVIDIA 2080 GPU, and yet I am experiencing latency... any idea how make this pose model run without latency? Thank you in advance.

[facttv]

Please Help ( I am also ready to pay ): I am making smart gym android app whichh works as a gym trainer to do correct exercise, i used this (tensor flow pose estimation). it detecting my body as shown in this video. Now what i have to is to train it to tell me either i am doing correct exercise or not ? How is this possible please some one help.

[young_]

Thanks Nick! How can I use the results of PoseNet for pose classification? I had tried ml5 on p5 but fail with some bugs after watching the code train's video.

[pankajbhatt]

Can you make a video with pose estimation feature on react native mobile application. Please, thank you.

[Mewlovesyou]

Hello Nick! Just want to ask how do you extract keypoints from PoseNet model in React?