Setting Up Real Time Facial Tracking in VSeeFace (Waidayo to VSeeFace)

Check me out on Patreon!

Links:

Phone Boom Arm (Get this):

Other videos:

Waidayo Video:

$1500 iPhone mount:

Blender tips to create iPhone Face tracking:

DIY your own VTuber application like Codemiko, Ai Angel, & Projekt Melody

Converting Avatars to VRM for Vtubing~

How to set up this application on your stream:

12 hour VOD creation iPhone ARKit Tracking for GMA:

VSeeFace Revisit:

Face Tracking iPhone App:

--Fofamit's Recommended VR Computer for Streaming--
A computer parts list recommendation for something that will be quiet and cool, but also be able to run stream and vr at the same time. I picked parts based on what I currently use or would want to use in the future... also picked parts that would look nice together.~

Motherboard - Gigabyte B550:

CPU - AMD Ryzen 5600X:

GPU - RTX 2070 Super:

RAM - 16-32GB DDR4 3200:

Power Supply - Corsair 850W 80+ Gold:

SSD - Crucial M500 1TB:

Hard Drive - Seagate 4TB:

CPU Cooler - Noctua D15:

Computer Case - Fractal Define R7:

For Real-Time Face/Body Capture:

#howto #vtuber #mocap

[itskiggu]

Do you happen to know if there's noticable performance differences between different iphone models? Like does the 11 capture better than the X, XS, XR, etc?

[WigWoo]

yeah my PC is on the same network as my iPhone. Even wired connection, and still no go. The model tracks in Waidayo, but it won't send to PC. Not only that, but it won't use any of my ARKit 52 blendshapes so I can't get any lip or eyebrow tracking whatsoever. it only tracks my eye blinks

[TenshiKisai]

A thing that many users struggle with (same with VTS) is that their phone or pc changes IP addresses, with Windows PC's sometimes operating on WiFi on Private which blocks everything by default. So what they need to do ideally is set static IP addresses for their PC so that if the IP changes they don't need to change the settings every time they use it.

[panourva]

The first 20 seconds of this video CAUGHT my attention. Great video!

[Hermiona]

Thank you so much for that video, Fofa! ♥ Are you going to cover other apps too, like iFacialMocap? That would help many of us ;u;

[sblook]

On Waidayo my model can open her mouth and blink, but she has no expression like on VSeeFace. I'm not sure what the issue is...Her expression were created in VSeeFace using the experimental method

[Khontadhondato]

so exciting!!! I NEED AN IPHONEEE, THANK YOU A LOT FOR THE TUTORIAL!!

[NonymDub]

You already had a video on the topic but this one is pretty fast and straightforward and might be useful ~ thank you for making this content 💖

[bastardofyangs]

Great coverage Fofamit! I love how informative all your videos are and appreciate it so much! Since this is a facial tracking video, what is your opinion on another iPhone tracker called MocapX?

[RitualNeoDanceVR]

can this work with the VSF format? or only vrm?

I use VSF cause we have some particular shaders and animations that don't really work with VRM

[ToyDemonORU]

so im dyslexic- and this is something i think alot of ppl miss; but you need to use OSC/VMC receiver, not OSC/VMC protocol . OTL

[luxinadu]

Seriously you have helped me so much with your videos thank you so much!

[joyjoytheartnerd]

How long did that intro take- oh and GREAT VIDEOOOO

[victorimoss]

Quick question for you! When I set up Waidayo, tracking seems to work great; however, my blinking and winking now are pretty excessive where my eyelashes/eyeliner shoot halfway down my face. What's the fix for that?

[KarasuRae]

Avatar isnt on my Waidayo App but its still tracking fine on Vseeface- another issue i have is when i check all the same things you have my avatar is very stiff and ony moves the eyes and mouth.
and shes at the bottom of the screen- how do i fix that?

[joekyu]

i tried doing this with my iphone x but for some reason frowns and jaw movements dont really work for me (i used ur test avatar), is that just something to do with my face or is my phone not tracking correctly?

[frostspar]

@2:03 it shows you have Track face features off. When I do that my mouth and eyes stop tracking. I did also installed Tifa. Did I change something while getting Tifa to work to stop making Waidayo work?

[keiyakins]

So how do you do this with a non-crippled phone? I refuse to buy apple until they stop forcing you to buy *all* apple if you want to develop, and also allow sideloading globally.

[brimwulf]

For some reason I can see that my phone is tracking my eyes but it isn't translating to my computer. Anyone know how to fix?

[allenchan]

Do I download Waidayo on my phone or pc?