The PROBLEM with my vtuber model

In order to get the best tracking on your vtuber model, you must pay tribute to the Apple shrine

#shorts #vtuber #twitch #streamer #clips #anime

[Limealicious]

Don't forget to follow my other socials!

[TheHigherFury]

I love how this short perfectly captures how accurate the mouth tracking is

[geeguy]

That “send help” really solidified how well rigged your model is, fantastic work

[SRVZephyr]

being beholden to a spare iPhone is a horror I would not wish on my worst enemy

[Kyanoxia]

Okay so here's the thing...
Apple ARKit uses LiDAR, which basically shoots a bunch of small infrared dots at your face to get real-time depth data. That combined with the IR camera gives a fairly accurate 3D rendition of your face that Apple then creates a skeleton of tracking points on top of, no doubt with a little bit of smoothing.

Let's say that we were to create a device specific to VTubing/Facial Tracking. We'd need a few things, those things being:
- A close-range LiDAR scanner (Fairly expensive on their own unfortunately)
- An Infrared Camera (Somewhat affordable)
- A NORMAL Camera (optional, 1080p webcam would work)
- A Microcontroller/Microcomputer to control the thing and send data.
- A Driver/Software to interpret the data into usable data for current vtubing software.

Now I'm no tech professional or anything, but this seems like a pretty fun DIY project if you have the time and resources.
We'd need 2 pieces of software - Piece #1 being that on the microcomputer to compile the data from the 2 or 3 sensors into an array of points on a 2/3D coordinate plane. Piece #2 being that on your own PC to interpret that data into your VTubing Software's format of choice. Piece #2 would have options for smoothing and sensitivity, just as an extra step before your VTubing software to really dial it in. I can see this as a package about the same size as an iPhone, although twice, or maybe 3 times the thickness, and much more stable, considering you're not sourcing your software to a larger tech giant.

**TL;DR**
It's very possible to make a software/hardware combo like this. we just need lots of time and money to do it.

[Haunted_Hunter]

"And then don't update or break it ever." Was spot on. A perfect statement and visual example of why this is needed.

[Xanek]

That contingency plan though, wouldn't even have thought that you'd need a 2nd device that is never updated just incase.

[muddledwhitemage]

Ok, but that panic bit at the end is aPRIME example at how good your rig is, that's great!

[Bandit__]

Apple ignores their customers... no way!

[liralen]

As an actual 2D cartoon tv rigger... I can't express just how much I love your Vtuber avatar. It is GORGEOUS and the FIRST one I actually find pleasing to watch. Instant subscription!

[jmiller]

That last part is really relatable as someone who works in tech. There's a reason I like working in the terminal so much, it doesn't change out from under me every few years

[justsomeitweeb]

As someone in IT, tech companies not breaking things with updates is my wish too.

[sirdmz]

let me be VERY clear, you have reached the status of IT professional.

you’ve acknowledged the vendors are shocking and have a backup device with all potential change options disabled.

THIS is how to have proper redundancy in IT

[TheActualMrLink]

Moral of the story: it is perfectly excusable to commit IP theft from Apple specifically!

[teamwolfyta]

The rigging is just chef's kiss, The last part was the most adorable thing to happen in existence partly because of the rigging.

[idqau]

im actually so impressed with your tracking and rigging and ur model overall it flows so well and i love how well made it is

[erynflynn]

I know given the whole issue of face reveal is a thing, but I'd love to see someone do a split-screen video with one side being a vtuber model, and the other side the actual person and how they move to make the model move. I know Shylily has talked about how she moves very differently to how you would regularly to have the model be as vibrant as she is

[undead_corsair]

I know nothing about rigging but it makes me respect the model artists and riggers all the more knowing how difficult the tech must be to work with. There really should be better support seeing as how big vtubing has become.
You've defeinitely got some of the best in the business Limu. Here's hoping that set up can become a bit more secure and stable in the future.

[SolaireIntensifies]

ayo can we get the meme gods on getting a "send help" gif circulating around the internet. It's too damn good

[johnj.spurgin]

You have my condolences for being at the mercy of Apple.