Kinect and sign language translation

See how Kinect's sign language translation capabilities help the hearing and the deaf communicate.

[MikeDownes]

What a phenomenal use of Kinect, video shows practical uses in a doctor's surgery and at an airport, keyword is collaboration, once again this a magic that will one day transform lives ..

[theRNIN]

In addition, this project is working towards people from different languages being able to communicate with each other-- even when one of them is deaf! It's pretty amazing!

[StephJoke]

It's worthy to the extent Deaf people are employed and gain recognition, and also to continue to demonstrate the amazing capacity of sign languages for deep, serious, real and meaningful communication.

[wyliekat]

I'm disabled, so I so much love stuff like this. I used to work at Blockbuster when DVD's first came out, and I thought subs were an amazing thing. Stuff like this creates inclusion for people who are otherwise segregated I absolutely love this..

[reginaannmarie]

also to to reply to the gentleman who said they are already doing it w/paper and pen. NOT TRUE. not all deaf read and write. some only know ASL so this will expand their horizons and is truly needed. thank you for inventing it this technology is way overdue!! blessings~

[Team]

Amazing! My boyfriend's parents are deaf; having something like this in the house would be a HUGE boon for us!

[ArCahyadiIndra]

actually have seen this video the first day it came out. but I can't help to come back again. this is very helpful. awesome!

[tidalkingv]

Doing good Microsoft, doing good.

The one person who dislike this? Heartless.

[whitejonty]

Awesome! The communication begins brighter.

[reginaannmarie]

Excellent, promotes inclusion between deaf and hearing and builds a bridge as it takes years to learn asl and that is the deaf's native language and they are most comfy with it. This will be great as long as it it totally portable so that the deaf person can take it with them wherever they go say in an App....to the movies, doctors, various appointments, stores, talking to neighbors etc you can't hire a terp all the time. if you make it fully portable for them then it will increase spontaneity and quality of life for the day to day tasks, I've been pushing for something like this as I have a deaf friend...I want to speak in it and it automatically captions and signs...YEA!!! I will still learn ASL but as I said...it takes time and practice which is not always possible so this would be GREAT!!! God bless your efforts :) the time is right and the time is NOW!!!

[Haaklong]

I hope they'll eventually implement this into Windows Phone's Bing Vision and Bing Translator and Windows' Bing Translator.

[SoundJudgment]

Hey, don't get me wrong, this is a great project... but I just wanted to point out that the Voice-overs heard throughout this video are 'out of phase.' In other words, the voices are not in the 'center' of the stereo-field and seem to float to the left and right speakers, leaving a hole-in-the-middle effect. A small problem, I know... but pass it on, MS. :)

[joodnhd]

Is the kinect used here kinect for windows v1 ? or kinect xbox .. ????

[GianlucaSquicquaro]

Great job !! Why do they still use the old Kinect ? It's already so obsolete!! The new one is waaay better, faster and more accurate :)

[theRNIN]

A Chinese speaker and a Chinese deaf person typing to each other, would be about the same as a Spanish speaker and a Portuguese speaker typing to each other. Sign Language is different than a spoken language. For example, English and American Sign Language each use different grammar than the other.

Also, deaf people may not be able to spell very well (I'd say this is often the case).

So, typing isn't really the answer.

[sarademil]

how good is kinect for finger movement recognition?

[maridubresil]

But how is it going to translate the meaning of facil expressions and role play within sign languages? This will be very restricted... only human interpreters can really translate sign languages in all their complexity.

[Brantoc]

Would be a great education tool as well..

[atlyrichords]

Please notice my comment. :( Hi! My team and I are college students and we are in our thesis right now, our project is quite similar to yours and we our lacking on our data source. Please reply it will be a huge help. :(

[arturofernandez]

No termino de ver los posibles usos, porque si alguien puede hacer los movimientos del lenguaje de signos, también puede escribir en un teclado. Y si puede escribir en un teclado, un programa de sintesis de voz puede leer lo que escribe. Por otra parte, la cámara del kinect (y cualquier webcam) puede enviar vídeo por la red hacia otra persona sorda, sin necesidad de transcribir el mensaje. No termino de verlo...