Facial Mocap - Unreal Engine Metahuman Performance With Any Video for Free!! No Iphone or HMC

Metahuman performance with any video? Yees it is possible...
This is not an AI model don't worry initially I started to make it an AI but ended up with simple scripts :(
You can follow the instructions on the repo to create your own depth frames.
The process is manual, but you can watch the plugin video if you're interested in trying it out!

[xlipdev]

A fresh, updated video guide on using the repository with new features is coming soon... stay tuned!

[amirhasani]

Bro, I usually don't comment or like on YouTube, but you are really a genius
If I could, I would personally find your location and thank you
Good Luck

[rklehm]

I use a similar pipeline than yours... I never really understood why Unreal don't do this as default, it is so simple and just works.

[JantzenProduktions]

You Changed my live! Thank you much! I wanted to do this for so long!

[squeezypixels]

Thanks for the video. As I see this gives the best results for non iPhone videos.

[adomyip]

Thanks for sharing this great method and the scripts!

[cjytber]

Bro, after following your instructions, I finally made it! You’re a genius! Thank you very much! I’d like to ask if you plan to develop a feature that allows Android phones to use Live Link as well?

[PaulGriswold]

Is there anything different/special unusual about the depth maps? Could I literally use Davinci Resolve's depth map extractor with video to do the same thing?

[madzorojuro]

Good video you have earned yourself a subscriber

[ivonmorales]

And of course you should create the plugin, many of us would buy it!

[lemn]

Hi, in minute 6:22 I cant find the metahuman animator capture data thing, please help

[caiyinke]

This is a very, very, very good tutorial!! By the way, I have one question: How is the head rotation animation capture performance?

[MarchantFilms-efdq]

Amazing, thanks for sharing this process! I was wondering, can we use a depth map generated from other sources? Davinci Resolve can generate a depth map, and there are AIs even for free than can generate depth maps from image or video, do we need to convert this depth maps or can we use them directly with this process?

[mukeshbabu]

Hi, I'm having some trouble. The Metahumun Identity panel is blank when I open it, even though I followed all the steps, but it doesn't function. Is there a specific issue? If so, please let me know how to fix it.

[ivonmorales]

From the moment I saw the first second of the video, I was hooked. I will apply what you have shown. And since it's proven that you have the talent, do you think this could be done for full-body animations? Microsoft published something similar. I leave you the links in case you are interested. Thanks for your contribution... Youtube won't let me put the links but I'll give you the title, Look Ma, no markers
Holistic performance capture without the hassle

ACM Transactions on Graphics

[eightrice]

what about including body animation from a separate camera so that we could have a full-body performance?

[ShinjiKeiVRBetaUSA-st]

You are amazing! I am making a 3D animation movie using my Metahuman. Someday I need your help.

[salmanbasir]

hi

The terminal part comes with this error and does not run

ModuleNotFoundError: No module named 'cv2'

[matttgaminghd]

Is there a way that if during processing the depth maps it crashes that I can simply restart where it left off instead of restart from the beginning? I'm processing something with a lot of frames, also how do i stop it crashing mid conversion, it seems to be gradually using more memory as it goes until it crashes and happens even if i have nothing open, it happens after about 2, 500 frames

[satyaa]

unable to drag and drop mhaical calibration file into unreal engine, it is giving unknown file extension error, does anyone have solution for this?