The Basics of Face Tracking – FaceTracker for Blender Tutorial

In this video, you’ll learn how to track faces with the new KeenTools add-on in order to enhance them with 3D visual effects and simulations without quitting Blender. We’ll uncover each step from creating a custom 3D head mesh based on snapshots of video frames with the built-in FaceBuilder module, and then using it to capture facial performance as well as head motion, to applying a simple уet elegant visual effect and comping it to the background video.

Timecodes:
0:00 – Intro & examples
0:19 – Download and install
0:35 – How to add a visual effect to actor’s face
0:56 – FaceTracker inputs
2:09 – Generate custom face mesh
2:38 – Built-in FaceBuilder module
3:03 – Line up face mesh with FaceBuilder tools
3:45 – Custom 3D head from a single snapshot
4:14 – Improve face geometry with additional images
5:06 – Face building result
5:28 – Line up face mesh in initial frame
6:36 – Automatic focal length estimation
7:20 – Track and refine
8:39 – See face track in 3D
9:18 – Position and scale your scene
9:52 – Export options
10:07 – Create texture blended from selected frames
10:55 – Animated texture map
11:06 – Add visual effect and light
12:21 – Compositing
12:38 – Final Result

Our social networks:

[ihassan]

Wow! This is amazing....I am already paying for geotracker and facebuilder...i wish all of these came under one bundle with a reasonable price....amazing job by the way!

[bit-studios]

This is outstanding!!! Most definitely going to get this addon as well as facebuilder. Excellent job Keentools. ❤️👏🏾👏🏾👏🏾👏🏾🙌🏾

[wdkpwr]

This is the best addon for blender ever cannot wait to get on PC and test it out

[tyleradams]

Yes! You guys rock! I’ve been anticipating this!

[CGFUN]

amazing, looking forward for full body tracking

[SteveErnst]

I love your plugins! I also echo the anti-subscription sentiments here. We'd love to see a permanent license option!

[KAGARAKIS]

Awesome plug in! but...subscription? no thanks....

[kinggraphicsfx]

You are awesome. One day you I'll be make mocap softwere or plugin for small studios 😊. Am i right

[MarvelousMediaEngine]

I think this tool has a lot of potential. I wish I had the option to keep the texture within the mouth. When I bake an image sequence of the whole video texture, it creates an alpha for the inside of the mouth, but I want to see teeth.

[abdullahgun]

Is it possible to change someones teeth with this workflow? (Asking as a dentist, sorry if it is a rookie question for 3d professionals)

[hamid.s.zolfagari]

is this plugin works only for head and face, or people can use it on other parts of body ? (for ex: hands)

[modelworkzseo]

Annual subscription for $500?! You guys are looney.

[bzikarius]

Nice but tracked face is so far from real, esp when she smiling.
Is there ability to micromanage wrinkles or sculpt em?
1:23 vs 8:47 Heavy difference.

[reek]

is it only possible with FaceBuilder, or can you use a generic head like in GeoTracker? My FaceBuilder trial expires in two days, so the workflow won't be free for me, but that's fine.

[woritsez]

exampling a single texture applied to whole mesh leaves me wondering why. would it be very problematic for instance to do the part android, like face panel removed thing, or whatever tattoo style ?

[gergelytoth]

If I turn on Maxface, it makes the aspect ratio 1:1 and ruins the texture. Not Maxface is the problem. Even if I go to edit and go back it falls apart. I see, you must choose a video frame in the edit mode, the PNG photoes has a different ratio which makes the software transform the footage.

[ukmonk]

Which is better for tracking helmets etc, this or geotracker please? I presume face tracker is more for tattoos, skin blemishes, scars etc, but good for hats, helmets or geotracker the better option please?

[nickdowner]

For some reason it really likes to import footage upside down. Not sure why

[reek]

great but how do you bring in the shading nodes at 11:10

[franzsaijem]

Is this face-tracking tool suitable for capturing my speaking facial movements and then applying the tracking data to animate a creature's face, so it looks like the creature is talking? 😂 😂