How To Use iFacialMocap in UE5 Tutorial (Webcam Face Tracking)

🔴 Watch this mess live

🤖 Join my Discord Server for UE stuff and ice cream 🍨

Get iFacialMocap here

#UE5 #Gamedev #VTuber

[My Socials]

Welcome to my channel, where I specialize in creating short, informative videos dedicated to helping you learn Unreal Engine 5! Whether you're a beginner or an experienced developer, these videos are designed to equip you with the knowledge and skills to unleash your creativity and build amazing experiences with this powerful game development engine.

In this quick tutorial, I will show you how to set up iFacialMocap inside Unreal Engine 5 so you can track your face with any cheap webcam and don't need to use an iPhone. This setup uses Nvidia's AR SDK (Nvidia Broadcast) as well as ARKit blendshapes.

Join me as we explore various aspects of Unreal Engine 5, including its robust features, tools, and techniques. From creating stunning visuals to implementing gameplay mechanics, each video is packed with concise yet valuable information to accelerate your learning process.

Discover a wealth of tips and tricks that will enhance your workflow and efficiency, saving you time and effort. Dive into topics such as level design, blueprints, lighting, materials, animations, and more, as we unlock the full potential of Unreal Engine 5 together.

Whether you aspire to develop games, create virtual reality experiences, or bring your architectural visions to life, this channel aims to provide you with the guidance and expertise to succeed in your projects. Don't miss out on these bite-sized tutorials that will empower you to create the epic worlds you've always imagined.

Subscribe to my channel and join the community of Unreal Engine enthusiasts. Together, let's dive into the exciting world of Unreal Engine 5 and transform your game development skills!

[vedranmaric]

Hi, does this work with regular USB PC webcam or with mid-range Android phone? I saw there is only IOS download for the app and not the Android download.

[Tenchinu]

the legend returns! always love ur tinny tips
saw it in the Epic Store for free as well. Downloading and installing into engine through there would make any difference?

[JoshTrevisiol]

I got it working, however there are occasional single-frame jitters of the affected bone locations. These happen at any frame rate and last for a single frame. They also occur in shipping builds. The blend shapes work just fine. You wouldn't happen to know what is causing this, would you?
The skeleton I'm using is the UE5 default one I extracted from Manny.

[billyboyer]

Looks amazing! Is there a way to make this work in a compiled video game?

[DeadsunPrime]

very cool. So you can have this running on a separate computer and stream to the unreal PC?

[lucienbrandt]

The tracking only shows in anim blueprint. But nowhere else?
And ...
How do u record the face tracking in sequence?
Advice?

[christophermcsomething]

When using with Unreal Engine 5 Metahuman, only the head tilt data is being interpreted. Is there a mismatch in bone names perhaps, if so is there a way to correct this?

[martinmenso]

Would it be possible to get the tracked webcam head location from the Evaluate LiveLink node (or any other way to get the data) to track the head location 2d to world location in Unreal Engine.

What I am trying to achieve is to have a virtual avatar to always look towards the person on the webcam.

[Spookydigy]

IFacial Mocap 8 months later cost money and has less features, like why? also it sticks you in T-Pose

[drollord]

Hey, tell me you have an answer for this. I want to buy a camera with infrared to use for tracking, like they do with iPhones, but every forum says it's not possible. Do you know if there's any way to do this?"

[jennnital]

Hey Rikku! For some reason when I open the application it flashes webcam on for a second and the app shuts down. Any pointers? Thanks so much !!

[sentalogic]

how are you using an alpha background so I can live stream with mine on youtube?

[rodolfouc]

Good tool, but, Is the cost 5 dollars or 5 thousand dollars? Because 5 thousand dollars, in my country, is more than 4 million pesos.

[AceLive_]

I wasted my money for an iphone when I could do this. Damn