I Coded VTubing Software the DUMB Way

I released most of the code used for this project here:

My Projects:

Discord:

Patreon:

Potato Tier Patrons:
Keill
NingNangNongy
eivl

Timestamps:
0:00 - what
0:11 - why
1:36 - choosing the software
2:13 - exposing the data
3:20 - interpreting the data
5:26 - rendering the avatar

The streamer shown at 1:12 is Tim Beaudet:

#python #pygame #nodejs

[DaFluffyPotato]

I am no longer using face-api.js. I switched to mediapipe. It's much better.

[blomgus]

"Short answer: I don't have those
Long answer: I d o n ' t h a v e t h o s e"
Awesome stuff, can't wait to see more of your new stuff :D

[eboatwright_]

Wow! You're getting alot more complex in these videos lately, and the editing quality is skyrocketing! :D

[GuilhermeHenrique-tzmn]

I'm quite impressed with the final result. Awesome job!

[TimBeaudet]

Hey that streamer looks familiar! Oh wait, it's me!

Great video @DaFluffyPotato! This looks like it was a fun project with some hurdles, and the math you used for projection brought me back to my old wireframe cube projects in QBasic that were oh so magical - but achieved only from following magic tutorials!

[crispycrafter]

20k is very little compared to the level of entertainment I got form this video.Even though I am learning java, and you use python your videos are still entertaining to watch.

[saurabhkumar-khoz]

Hey, love the experimental approach you took to building this. The final results looks amazing.

One suggestion, Instead of writing the face landmarks to a file and reading it, it would be better to setup a messaging queue like RabbitMQ where you publish the latest landmark data.
Writing and Reading from file is a very slow process which can bottleneck your performance. Using a message queue will allow you to publish at a rapid speed and then listen to the data in batches which could significantly improve performance.

[kimzap]

This was genuinely entertaining and educational, thank you!

[elevenone]

Finally I can achieve my dream of becoming a math monster!

[vachila]

Honestly this is really awesome!
And the way you were just talking about 3D projection like it's nothing, lol
I code in JS and yeah, just games smh (and yeah, platformers as well xD), But I'm fairly new, being only 2 yrs in and this is the kind of stuff that makes me want to learn a lot more and expand my skillser! Really enjoyed the video! Had my full attention throughout! ^_^

Was wondering what the avatar was the first time I saw it in an earlier live stream, To learn that it was a silent self project! 0_0!!

[jfklittle]

Your videos are improving so much in terms of quality!

[Skeffles]

Fun video! I'd be terrified of mixing JS and python like that.

[landen]

Yo when the hell did you get so good. This is really cool stuff keep it up

[FlooferLand]

0:26 "If i'm ever gonna get into a FNaF company"
O h n o
DaFluffyPotato is joining the Afton family

[projectvibe]

Aye I remeber the stream in the background

[sir_stims_a_lot]

could you get the angle from your nose to the sides of the face for a more linear scale on the X rotation axis? just messin around, awesome work!

edit: trying out soon your video was an awesome reference

[EsportCat]

For Some reason i find it looking almost better then FaceRig, It's alot more simple and "low poly" I guess and i find that fits you alot (Not that Face Rig is bad)

[Soul]

Amazing!!! can you share box example please.

[vamakshi]

Which is better ide or engines ??
I nean for big games so pygame would not be able to render so much or will it ?
This question been on my mind since 5 days . I would be glad if you answer it.

[metgaming]

*man switched from mumble mumble to memeble memeble*