Turn your AI images into CG movies [Workflow Video]

This workflow explores how to use various AI tools to create compelling character animations and "render" them using AI.


Tools used in this video:

Other resources:

Chapters:
00:00 Intro
00:32 Creating the characters
02:16 Generating the 3D model
04:03 Voice
04:26 Facial Animation
05:58 Body Animation
07:51 Patreon
08:25 "Re-Rendering" with GEN-1
11:44 "Re-Rendering" with DEFORUM
14:12 Results

[shadowdemonaer]

You can use a still shot of the character's face with EbSynth and make it so the style doesn't change at all while they're talking.

[millthor]

That’s amazing!
It’s interesting that we learn the tools, but there’s always something new on the way you use them that’s completely different and does more than we expected. I am definitely becoming a patron today!
Thanks a lot for sharing!

[orangesunlabs]

Holy moly, that intro trailer is just incredible! Fantastic work.

[Suniverse]

nice to see you keep watching new workflows all along mix em and then share it with us

[WitaTV]

I have an idea to make it better. When you create character's 3d model Focus on detail of characters head and face . Put it into unreal engine 5.2 and Resolve Metahumen identity. After that Use your iphone to best facial capture. And use mixamo to body animation. I think you will love that workflow .

[the_RCB_films]

The lip sync idea for the texture was fucking smart!!!!

[georgemedina]

This is insane! AND it will only continue to improve

[TonyStark-ikem]

It's really refreshing seeing someone diving deep with all the current tools and go through workflows on a good speed. No Mumpitz here, your channel is a little gem, very inspiring! Runway ML is really milking it hard, thanks for not only sharing all the commercial solutions like most others.

[MrToddTech]

thanks so much for sharing. your description is easy to follow and your edits are entertaining to watch. great job.

[MariusBLid]

I am amazed by how consistent you got Deforum. If it wasn't for some of the left over flickering, I would prefer it over Gen 1. If you combined it with Tokyojab's workflow for Ebsynth with Stable Diffusion, I think you would have knocked it right out of the park (for free, but a lot of work though). Thank you for all the work you're putting in and how well you document everything. Always look forward to your videos. Amazing quality! Keep it up bro!

[FrudTV]

Great job man! Thanks for all the hard work of creating these videos.😊

[cedricjouarie]

Man, your videos are truly amazing. I'm just dipping my toe into AI video, animation, and editing, as I'm working on a proof of concept for an 80s-style creature feature. I will definitely track your successes as an inspiration/method for this project. Thanks 🙏

[sonjeow]

This is all happening so fast. Excellent videos!

[SimplyAlteringMaterials]

Brilliant work!! I totally love watching your videos, thank you for sharing and can't wait to see what else you have coming!!!💯🔥🔥🔥

[allenwu]

amazing tutorial! thanks for sharing your expertise!

[TecnoBato]

You are crazy! This is awesome and what I've been looking for! Very impressed here and thankful

[PolycultureArt]

Yeah wow. I think this is the future too, and it's awesome to see your prototyping at this super early stage of the game. I imagine "in the future" there will be programs dedicated entirely to this process that are as ubiquitous as photoshop. It is your tinkering now, that paves the way to that future. I am going to sub to your patreon to get you a new graphics card! Poor thing must be melting! Thanks for doing what you do.. I am on the same journey and have basically been devising the same workflows as you, but thanks to your work, I don't have to test them all out. Its awesome and I can't wait to see the film. Much Love from the land down under :)

[ohheyvoid]

Great stuff! Your workflow videos are clear and also relaxing. Thanks for exploring these processes and sharing withe the void.

Definitely agree that animation and even filmmaking will eventually include an "AI pass" at the end. Similar to color correction and sound mastering. So cool.

[TeluguNarrativeHub]

thanks friend. i always wait for your videos

[ValueSelectTV]

Incredible display; what an exciting time for independent creators!