AI Mocap to custom character. Plask + Ready Player Me + Blender = 100% free workflow!

#motioncapture #plask #retargeting

This video couldn't be possible without DaDaJu's awesome choreography! Please show your support by following her YouTube Channel!

I discovered her work thanks to a student of mine, Tommaso. He is a K-Pop fan and for middle school final exam he decided to do a motion capture of a ballet.

To start he needed a choreography and DaDaJu's interpretation of Blackpink's Pretty Savage was just perfect!

The capture was made with the free version of Plask and it worked really well. But this was only the half of the project. The final goal was to make a full 3d animated K-Pop dance!

Tommaso made his own avatar with Ready Player Me. The problems began when he tried to retargeting the animation to his character. I did some research and discovered one possible workflow to achieve the desired result. It helped Tommaso for his exam, so I thought to share here my 'findings'. Hope it can help others too!

---
Plask
---
Ready Player Me
---
Blender
---
Blender 3d: Retarget Helper addon
---
Rokoko addon for Blender

Rokoko website

Rokoko Github

--- Contents
00:00 - Dancing intro
00:13 - Step 1 From video to animation (Plask)
00:47 - Step 2 Download the Animation (Plask)
01:03 - Step 3 Download the Rest Pose (Plask)
01:19 - Step 4 Make your own character (Ready Player Me)
01:37 - Step 5 Download the Retarget Helper Addon
01:46 - Step 6 Download the Rokoko Addon
02:15 - Step 7 Download the Rokoko Addon
03:11 - Step 8 Import Plask Animation (Blender)
04:42 - Step 9 Retargeting to Rest Pose Armature (Blender)
06:29 - Step 10 From A-Pose to T-Pose (Blender)
09:14 - Step 11 Activate the Rokoko Addon
09:54 - Step 12 Retargeting to Ready Player Me character (Blender)
10:33 - Step 13 Mission accomplished!
11:05 - Dancing outro (feat. MrGenma)

CREDITS

Music

BLACKPINK - Pretty Savage
Instrumental Created by Fauzi

Gonne by ELPHNT
YouTube Audio Library

BLACKPINK PLAYING WITH FIRE
FL Studio Remake Created by Fauzi

LISA - MONEY
Instrumental Created by Fauzi

BLACKPINK - SO HOT
FL Studio Remake Created by Fauzi

Sounds
Flash and a Bang by fredzed

[AatxeUrrutia-phty]

1st retargeting vid I have seen in a while that was useful for me as I took this and what I have learned before to accurately retarget some flight type motions for dragon models of mine, I followed the same steps and just added a tail on the plask skel in edit mode then was able to retarget easily thanks!

[tommyyyyy]

Stunning video! Feeling like I'm famous! ⭐⭐⭐👑
Oh by the way, I wasn't expecting this so soon!
Oltre che mi congratulo del fatto che abbia anche cercato delle canzoni! Non sono fra le mie preferite ma comunque mi piacciono! Grande Prof!

[canndask]

Is there a good solition for hands animations?

[MiMEDesignStudio]

If you save the plask animation as an action strip you could probably just apply it to the model with the T pose. Could save you a lot of time.

[cardramanew]

that's awesome, by the way after we create avatar and rigging it, it's possible make footage and publish for microstock?

[recepaslannn]

I'm getting an error while loading the Rokoko plugin, "unable to load plugin", how can I edit it?

[АлександрКиселев-уж]

wow amazing thanks bro this informatione awesome'

[sadworldwide]

Step 10 seems pointless. Whats the reason behind it, I can't even get it to work.

[twinstars]

Plask isn't free for me, when I try to extract a 10 sec clip, it asks for credit.