Building a Real Time Sign Language Detection App with React.JS and Tensorflow.JS | Deep Learning

Tired of just using your Python Tensorflow Object Detection model in OpenCV?

Want to showcase your work in a standalone app?

Maybe, you want to do exactly this and help solve the sign language barrier!

Well you can!

In this video you’ll learn how to do exactly that in 45 minutes. You’ll convert an existing Python Tensorflow model and leverage it in a standalone app with real time detections. You’ll be able to see the results in real time! But what’s even better is that you can take this and apply to to your very own use cases, whatever they might be!

This video covers:
1. Converting a Tensorflow Object Detection API model to Tensorflow.JS Graph Model format
2. Hosting a trained Tensorflow deep learning model for applications
3. Downloading the React and Tensorflow.JS Computer Vision Template
4. Making real time detections using a deployed Tensorflow.JS model
5. Visualising detections within the HTML canvas

Completed Code:

Other Links

Oh, and don't forget to connect with me!

Happy coding!
Nick

P.s. Let me know how you go and drop a comment if you need a hand!

[monome]

So thankful that someone on youtube named Nicholas is making amazing tutorials for free about ML

[ypm]

The best tutorials in Youtube, Thank you very much

[xyliusdominicibayan]

Good watch! I learned a lot. I've been waiting for your Real Time Face Detection in Mobile Application with React.JS and Tensorflow. JS :D

[bushansy]

Awesome and great tutorial Nick!!! Loved it and thanks for educating us. Also your recording style is great without any distractions. I just love it. By the way, could you please share how you record these sessions and what tools do you use and steps you follow? Would greatly appreciate if you can share the details.

[slowedReverbJunction]

Thank you soooo much Sir 🔥🔥🔥 I just cant express how happy I am
God bless you with more success💖💖

Plss bring more tutorials for us like these

[priyanjali]

OMG thank you so much for teaching stuff cause of your projects I don't find machine learning taught in my uni boring

[diegocaumont]

I'd imagine it takes ages to make these long tutorials.Thanks you so much for this :D

[jerrylee]

It is fantastic and informative! Thanks for the tutorials!

[MaxPrimeAY]

After several days I decided to continue teaching of my model. I was waiting for 7k steps. After training I generated new json file and it had another indexes for boxes, classes and scores. Previous time it was 0, 1, 6. Now it's 4, 0, 1. No idea how does it work but it works.

[anishaudayakumar]

Thanks a million for all the mind blowing videos!! Much appreciated :) My 70% of Tensorflow knowledge were built through your tutorials... Looking forward to learn more <3
One quick question, is there a way to count the number of detections for each class in a frame?

[sagarksahoo]

But this will run on the PC where I am building this project, how can I open the camera for the client side ?

[ndwdesigners]

It was very helpful my friend, but I would greatly appreciate it if you could explain how to translate an entire sentence in addition to a word using this method.

[vikashchand.]

Yooo 🔥

Still waiting for the mustache detection video by the way 🤔 haha jokes! 😂

Super cool video man!

Can you do a video on how to deploy this app? Seems tricky ...

[suvinaysawant]

All Working Good but the webcam is not working when npm start it just shows a Blank page...I am using laptop and chrome having the default laptop webcam...Help

[hiroshiken]

Why am I getting error like TensorList shape mismatch: Shapes -1 and 3 must match

[ypm]

Anthony you are so good at explaining, could you do a video about R-CNN hand gesture detection with Keras, TensorFlow, and Deep Learning.

[rohitmalakar]

Hi, is it possible to host our model to Azure Cloud? If it is possible then can please tell me how could host my model to the cloud? I already try it but it is giving me error ( Unhandled Rejection (TypeError): Failed to fetch). By the here I have used Azure Blob. please help me with this

[peaceful]

Hello, i didn't understand where I can download "Custom object detection App" folder, help me please! And is there difference when u do this project on mac os?

[calebprenger]

I'm trying to run this. but this is the problem with modern programming. This library relies on this library and this library relies on this and it's a never ending rabbit hole. one thing breaks and everything breaks.

[dwikiahmamaulana]

Great tutorial sir.
Ask sir... How to put voice into tensorflow? I mean there is voice output when the object is detected.