Rokoko Unity Plugin - mocap livestreaming workflow w Smartgloves, Smartsuit Pro, and Face Capture

Learn how to stream full performance capture including body, face, and hands to Unity in real-time using the Rokoko Unity Plugin.

---

Learn more about Rokoko and stay updated:

[corex]

What the hell is this, this is rad, I can think of a hundred ways to use this.

[joebagtas]

We're interested in capturing a bunch of moves for cinematics and 3D series. We were wondering how well Rokoko mocap would integrate into Unity for making a 3D game.

This video uploaded and blew my mind. So happy to see this, need to get this suit.

[netwar]

If I were to hit Start Recording within the Command API in the top left, where does the output go/what does it output? Does it record all the positions, blend shape values, etc. and put it in a .anim or .fbx file that I can inspect with the Unity animation window (i.e. see the keyframes/curves)?

[antikz]

Is there a Linux native version of the studio or will I need to depend on wine

[ronaldlee]

If my character's bones have rotation value after import to unity, is it work for rokoko mocap? thanks

[atyy]

can facetracking combined with some dancing animation?

[pennaverdeful]

There is a lot of sliding in the streamed character in Unity, can you make a tutorial on how to fix this please? Thanks

[melohugs]

i just saw your other video on the workflow from daz3d to maya to cinema4d, i wish if you make a video on that but to unity instead of cinema4d, it would be useful.

[pipke]

"command API is turn off" any help, please?

[katyschildmeyerksapparelde]

How much deformation does a humanoid have when using this?

[rafaelskiarteportfolio]

Great! Can I stream this data through internet wi-fi? I saw you are using the localhost IP address, but can I use a different IP address and access it through the internet on a different PC, in a different spot? (using a high-speed internet connection)

[kakoru]

Is it possible to live stream after you have already built the project to your computer? Or is this only possible in the editor?

[michaelong]

I don't see how holding a phone just to capture the face to be convenient when you want to capture both arms. how would one record it without the phone?

[ioda]

Pretty cool! What's the purpose of streaming into Unity though? Can you record the animation segments directly in Unity?

[homestar]

How much does the equipment cost and where can you buy it? Link please?!

[XanthanGumOfficial]

Do I even need to do the Maya step for this or can I simply upload to Mixamo and bring it into Unity for use with this plugin?