Making Viggle Motion Capture Movies

While Viggle is mainly used for dance videos and memes, it can be used for so much more. Using generative AI images mixed with acting performances on video can be used to create some cool animated films.

Inspired by this video

Original how-to video by John Taiwo on LinkedIn

[nitromusik]

The first one to incorporate this into a streamlined tool together with storyboarding is going to be the king of AAA preproduction and used to level up pitching scripts by a lot

[Steger]

It looks like a ps4 gme. Pretty good but i say in about 2 years it's going to be crazy easy to make a realistic ai film at home. Cant wait!

[FrankEBailey]

I really need to see General Spade having his face eaten off by one of the creatures, and our main character looking over with an "I told you so" look on his face.

[brawlmaster]

very cool!! :D excellent tutorial too! hahah, great work!

[FilmSpook]

Very cool, thanks Bro! Just subscribed. Cheers

[markdkberry]

this is great. eager for AI open source movie making. I'm guessing 1.5 hour vids arent possible yet.

[tunbimideoluyede]

Hey this video is amazing, I was just wondering what prompt you used to get the specific style of character you got?

[danielschweig]

I really like the workflow. Have you tried further editing the finished scene with Runway vid2vid? Maybe there is a way to create consistent runway vid2vid. It should actually work.

[IkeWaghSF]

I'm definitely on the Viggle train! I made this a few months back using Viggle for live performances. I tried my best to include it within a coherent story (character, violence, action, plot, etc.). Viggle wrote a blog about it. Hope you like it:

[EllisJonesDeath]

What site did you use for your character, I have tried Kling and Bing but it always creates characters with shadows on the face, I have tried prompting no shadows etc, but it always adds them.

[LeonGustin]

Have you had the chance to check out Runway Gen3 video-to-video yet? Be cool to get ayour thoughts on it.

[bhsmith]

What do you do about the generated image taking on the physical characteristics of the human model. I like Viggle but I have noticed that the image will take on the facial characteristics of the human model.

[sundayreview]

can you do a review of runway 3 video to video?

[knicement]

How did you slice the 2 minutes into 10 seconds each?

[gwart]

What program did you use to alter the voices?

[kleber]

Is wiggle free? Or is there a open source alternative?

[wrillywonka]

Can you use a 3d mesh in place of the 2d image?

[LFPAnimations]

On the one hand it's impressive how far this tech has gone. On the other hand I don't like anything about your final result. It is sloppy, inconsistent, uninspired, and inhuman. I'd rather watch the raw webcam performance of you delivering the lines than the AI version.

[giuliomarunti]

It all looks like shit... But considering the ease and time necessary to do everything it's pretty impressive!

[realhamza]

I know this is unrelated but give the Quran a read