Stable Diffusion ComfyUI Create AI Influencer Dance Video With Mimic Motion (2024 Guide)

ComfyUI Create AI Influencer Dance Video With Mimic Motion

We are diving into the fascinating world of ComfyUI and exploring how to create AI influencer dance videos using their Mimic Motion framework. If you want to take your dance videos to the next level and achieve that perfect synchronization with your favorite anime characters or any other source videos, then this video is for you.

Videos About AI Animation With Stable Diffusion And ComfyUI

Throughout this tutorial, I'll guide you through the installation process of the ComfyUI Minimic Motion wrapper and its dependencies. We'll also download the necessary files, including the Minimic Motion package and SVD models.

I'll demonstrate the basic workflow for creating Mimic Motion, showcasing how it generates realistic movements by utilizing DW pose control net models. We'll explore the various steps involved, such as getting the pose, combining the skeleton motion, and generating the final dance video presentation.

Using examples from Naruto and Artlist, I'll show you how to work with different aspect ratios and dimensions to achieve the best results. We'll discuss the importance of consistency and avoiding deformations by using the same aspect ratios for your loaded videos and images.

Additionally, I'll provide a sneak peek into more advanced workflows, including segmentations for DW pose and restyling videos using static AI images. These advanced techniques will be exclusively available to my Patreon supporters, so make sure to join our community for access to exclusive content and detailed tutorials.

If you're ready to create stunning AI influencer dance videos with ComfyUI's Mimic Motion, then don't miss this tutorial. Hit that subscribe button and turn on the notification bell, so you never miss any future videos on AI technology, video editing, and more.

Timestamps:
00:00 Introduction
00:50 What Is Mimic Motion
02:50 Ways To Use Mimic Motion
04:00 Mimic Motion in ComfyUI Installation
04:30 Run The Basic Example Of Mimic Motion Workflow
06:00 AI Dance Motion Generation Example Result
06:34 Input Reference Date Need To Be Aware Of
08:38 Tuned Workflow For Everyone
09:05 Additional Content For Patreon Members
09:26 AI Influnencer Dance Examples

If You Like tutorial like this, You Can Support Our Work In Patreon:

[AsiaFreeTVNet]

😄 我來了！Ben
嘩, 見到真係 Youtube 好多白痴留言。D人係咪真係咁L蠢 問D問題...好心佢哋啦, 認真了解就明白架啦👍

[crazyleafdesignweb]

This is very cool framework. Really game changer.

[kalakala]

Just tested it. Looks good, I created with anime and 3D characters.

[kalakala]

🎉🎉nice, I think I can move on from AnimateDiff to this 😂😂😂

[fsamobby]

just cut the model/backgrounf out of the scene using tracking feature in davinci or your preferred video editor then use AI to modify model then export it again in davinci so your background would be fine and sharp with minimum aberrations

[technoprincess]

Is it possible for it to look as realistic as a real person if combined with the most realistic model possible, rather than semi-realistic like this? I want to adapt it to create AI girls dancing ?^^

[giorgosbitsounis]

the installer guide should be step by step. It has been very difficult for me and I can't install it😶😶

[QuarkDoge]

On this video progress takes ~1 sec for a step. On my 8gb GPU - 1 min (!) for a step.
How much VRAM do you have?

[nadershalash]

I use run comfyai how to make it make all video lent my inputs is 10 sec he oly make first 2 sec and stop any solution for this, thanks in advanced

[MrPerillo]

Nice. How long does it take to generate a 5 sec video?

[Vashthareaper]

for anyone struggling with this, install Kijai mimicmotion wrapper instead, its easy on gpu

[SeaHuang-wj]

Only when patreon is unlocked can workflow be download?

[RoshanYadav-vz]

Sir i getting this error.

Error occurred when executing

Error no file named config.json found in directory

[Hackinside]

What about a fighting scene where there are two characters?

[pixelwizardai]

What is gpu requirements for this to run as I have 8gb vram only.

[technoprincess]

How long for the 10sec clips to be made ?

[singhsgurpreet]

it gives error as :-
Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate`

any idea?

[UnsolvedMystery]

Can this ai model handle multiple characters?

[bgmspot]

Anyone please tell im new to this,
Is it better than animate anyone and viggle ai ?

[reaperhammer]

This is cool, but the vram requirements are insane lol, V100 for 16 frames according to github... 😢