AnimateDiff + Instant Lora: ultimate method for video animations ComfyUI (img2img, vid2vid, txt2vid)

Combine AnimateDiff and the Instant Lora method for stunning results in ComfyUI. Easy to learn and try.

#animatediff #comfyui #stablediffusion
============================================================

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️

============================================================

In this video I will show you how to install all the nodes and models required for AnimateDiff and the Instant Lora method with IP Adapters, in ComfyUI. Below the complete list of requirements.

In the video you will learn how to use the method with a simple example. With the addition of ControlNet, this method is AMAZING! Use you creativity to make something amazing!

Please, support this channel with a ko-fi!

Run Comfyui with:

This video is inspired by many videos being recommended about AnimateDiff and Instant Lora. However, I was not able to find a video which combines these two approaches, so I decided to make this one. However, the recognition should go to the original creators of the separated methods:

Basic requirements:

Aloe Vera's Instant Lora (no training) requirements

AnimateDiff (Evolved)

Tracklist:
00:00 Intro
00:11 Requirements (basic, Instant Lora and AnimateDiff)
00:33 AnimateDiff and Instant Lora [ no training] methods
00:50 Base images and models
01:31 Installation of Custom Nodes needed (via Manager)
02:52 Installation of models for AnimateDiff and Instant Lora (IP Adapter) and ControlNet (OpenPose)
04:07 Using AnimateDiff + OpenPose template in your workflow
04:34 AnimateDiff workflow setup and testing
06:54 Implementing the Instant Lora method [no training] with IP Adapters in the AnimateDiff workflow
08:33 Adding FaceDetailer to improve the face resolution
09:57 Running all the frames/poses of the ComfyUI workflow
10:27 The final result
10:47 Outro

My other tutorials:

Videos: Pexels
Music: Youtube Music Library

© 2023 Koala Nation
#comfyui #animatediff #sd

[Kisuke]

I'm never amazed by the name of tool being COMFYui while being anything but comfy to use.

[proyectodigital]

Great, thanks, I'm going to follow this as soon as get my vacations. God bless

[boratsk]

HI
I cannot find node Image batch to image list
pls help me

[AlexanderVinogradov-ndxx]

Cool!!! Such simple and logical !!! Man you my hero!!!))))

[NatWF]

Hello! How to prevent the face from flickering?

[nufh]

I saw the Jupyter interface, which platform you're using? If want to use locally, what is the spec for PC?

[Dave]

Is there a way just to take posses so they can be used in a 3d software? You know like Mixamo?

[aitutor.]

Hi may I ask if you are using AI voice in this tutorial?

[ehsankholghi]

how can i load video instead of pose? i mean video to video in this workflow

[ANGEL-fghv]

What if I already have animate diff from auto1111

[rubenrodenburg]

I dont know how to get the GeminixMix file into the program, i dont know in wich file im supposed to put it in.

[senkodan]

Ksampler is so fast for you! Mine is like 50 sec per it. How to opimise it?

[rtberbary]

hey! im pretty new to comfyui and this video is epic! is there a chance that we can get the file to load it directly? i found it to be the best way for me to understand what is missing, and what is not working and so on

[bgjqvro]

'image list to image batch' can not find this node,

[TeamPhlegmatisch]

Can you also do something without running? Or are you bound to that posing model. What if I want to make a full animated video including different objects and scenarios which do not run?

[ybesqmk]

In node Load lmages (Upload), image load cap, why can only fill in 1, fill in 4 or 16 will report an error

[Go_Siry]

Hello, thank you very much for the video! I only have one problem and it is that it takes me about 2houers to make a normal video, I am using it in stableswarm, I have 32GBRAM, and a 6GB 1060GTX, is that why?

[mehradbayat]

Can you explain what you mean when you mention to copy the files inside input folder of comfy ui @ 1:03? Where exactly am I pasting the files that I downloaded?

[jiananlin]

i got the error 'ClipVisionModel' object has no attribute 'processor' from ipadapter node.

[IntiArtDesigns]

Amazing. Can i download the completed workflow?