Stable Diffusion ComfyUI Animations - Easy with ControlNet and TemporalNet

#animatediff #comfyui #stablediffusion
============================================================

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️

============================================================

In this tutorial I show you how to make an animation using the node interface. After preparing the video for the use of the frames in ComfyUI, the workflow consists basically in making a img2img batch of the frames, with a sketch controlnet (e.g. LineArt), an openpose/DWPose controlnet and using TemporalNet.

Please, support this channel with a ko-fi!

00:00 Intro
00:10 Production process steps
01:01 Basic workflow and batch load image for test
03:01 Adding ControlNet models to the workflow
04:55 Adding TemporalNet
05:34 Preparing batch img2img for all the frames
06:30 Running the batch
07:25 Postprocessing and outro

Resources:

Workflow:

Music (Youtube Music Library):
Tropic Fuse - French Fuse
Depth Fuse - French Fuse
Island Dream - Chris Haugen
Follow Me - Andrew Langdon
Blurry Vision - Corbyn Kites

Make sure to subscribe to Koala Nation Channel:

© 2023 Koala Nation
#comfyui #stablediffussion #animation

[Disco_Tek]

Your stuff is amazing. You do a great job of moving through the workflow. I got some decent results with this throwing a character lora in front of the controlnets.

[Radiance_AI]

Underrated channel! This needs more views 🔥

[arcangeel]

What a great channel I just discovered!! Daaamn🔥🔥

[erdbeerbus]

nice clever and amazing workflow, good explained :) but another video with crazy music in da bg ...

[Designer_Learning_AI]

Great video, it solved a big problem for me！🥰

[uohnvrr]

great tuto ! is it possible to use the lcm smapler with the lcm lora for increase speed ? Or is it possible to just choose a sdxl ckp instead of the one you choose without changing the workflow ? i am new and i love to learn, thanks for your work

[dkamhaji]

Very cool.
I have used the temporal net controlnet with A1111 and deforum. But I want to know, in your opinion, what is it doing for you right here in this set up.
Is in interpolating between frames?
Also does the order of controlnets matter in this flow?

[itsjaysenofficial]

Awesome video thanks for sharing your knowledge! Can i achieve this using a macbook pro m1 16gbram

[smbd]

This is really cool! I'm having a slight issue with getting my queue to start at frame 1. It seems like whenever I manually run the queue prompt for a single image, it increments the image index, but I can't figure out how to force it to start on the first image when I run the batch. It's like it's always starting on the last image it left off at no matter what. If I cancel the queue at 156, then it will start at 157. I've saved and reloaded, stopped and started the server. I've check the .json file for the save and I can't find anywhere where this value is stored, but it seems to magically come from somewhere.

[graylife_]

I used your workflow and the same settings from the video, but the batch doesn't work. It will just generate one image. Is there a setting I need to change?

[StableMindAI]

controlnet lineart 1, 5SD. not SDXL. I got error in this step. it won't let it continue. How can't fix ?

[StableMindAI]

What is the name of the software that separates people at the beginning of the video you made?

[mick]

Nice but, definitely not interested in renting GPU power. Tried numerous times but temporalnet refuses to work properly. Thankfully it's not really necessary.

[ImAlecPonce]

It gets to VAE Encode then stops.... I've tried changing image types and names.

[StableMindAI]

I cannot save files in bulk. it only runs 1 initial image