AI Dance Animation Experiment: Before & After (AnimateDiff)

Source and result for my AI-generated animation! This experiment combines video of a dance performance by @Erica_Klein and @hokutokonishi and a text prompt to stylize it.

More specifically, this was made using AnimateDiff and the ComfyUI frontend for Stable Diffusion.

There is so much to explore here and I can't wait to start training custom motion and image models. More explorations coming soon!

[Crisisdarkness]

wow, this is impressive, well done bro

[MrSanyapanda]

Can you show how you do it? Or explain!!! Its realy cool!

[exnexe]

This is awesome! I'm doing something similar, removing background, wondering how you got it to animate the blank background with stuff, was it random or intentionally prompted?

[likemagic]

OMG!!)) Can you show how you do it? Or explain!!!

[Vestu]

Models need to be trained to show back of heads more. It's often that the body is facing away but the face is not.

[edoardoottone]

That looks really great!!! May I ask you how you can bypass/avoid the frame limit on animatediff models

[coreyhughes]

Are you rendering animatediff at a high resolution or just doing additional upscaling steps afterwards?

[Sparkette]

Imagine when this can be done in real time.

[Andro-Meta]

Removing the background is such a smart move

[Neldot]

It looks great but It's sad that we have gone so far and still the stupid AI still doesn't understand correct human body anatomy...