How to train a new model for gesture recognition - ML on Android with MediaPipe

Learn how to train a new model for gesture recognition based on new data using MediaPipe Model Maker. This tutorial covers a Python sample to train a model for the game Rock, Paper, Scissors in Google's Colab tool, which allows you to build Python and MediaPipe programs directly from your browser.

Resources:

#Android #ML

[mahimanzum]

Is there any resources for actually implementing the android codes to deploy this model in an app?

[ahsanweb]

To create the training data, do I have to take photos of people with different hand sizes and colors while they doing gestures? Is there a way to generate the hand gesture images or use stick drawing figures?

[gCOVERChannel]

Can the MediaPipe model be trained on videos in order to get dynamic gesture recognition instead of static ones?

[smyThegmc]

thanks for the tutorial. I trained my new model to recognize asl alphabet with one hand and the results are really good when i try it uploading to web demo you provided. But I couldnt replace it with the model inside android studio project. I think its because that model has 8 classes and mine has 25 but I couldnt figure out how I can customize the android studio project so it uses my own model can you help me?

[zamanbhatti]

cool we get rid from object detection model for Sign Langauge Detection and it's errors

[ramanandr]

Instead of training with image dataset can we do it using video dataset?

[zaidahmed]

Hello !
I'm looking to finetune one of the mediapipe solutions on my custom dataset. My end goal is to identify the landmarks of cows and extract x, y, z coordinates of keypoints respectively. Please guide me through that how to make a custom dataset for it ? which tool to use? which format of dataset is supported with mediapipe especially when dealing with keypoints extraction.
Thank you so much for your time and consideration.

[yeungsophia]

dependency error for installation... colab error in numpy, mac m1 error in mediapipe version... the latest mediapipe 0.10.0 installed but dependency on former 0.9 version