Stable Diffusion ComfyUI And Diffutoon Create AI Videos - Domo AI Alternative?

Stable Diffusion Animation - ComfyUI And Diffutoon Create Deflickering Videos - Domo AI Alternative?

We're diving into the world of Stable Diffusion's animation and exploring a fascinating new project called Diffutoon. This project takes video-to-video transformations to a whole new level by turning dance videos into anime or cartoon-style videos.

Related Video:

Resources :

Throughout this video, I'll be explaining how Diffutoon functions as a pipeline, linking up various diffusion models like ControlNet and AnimateDiff Motion model. We'll also discuss the integration of ComfyUI extensions, which allow for smooth video generation and rebranding of images.

I'll guide you through the process of setting up and running Diffutoon in Google Colab, highlighting the required diffusion models, line art, depth maps, and soft edges. We'll also explore the benefits of using ComfyUI's custom nodes like "smooth videos" and "My OpenPose" for creating stunning animations with low VRAM consumption.

Moreover, I'll showcase the DiffSynth pipeline, which transforms original videos into alternative styles using diffusion models. We'll delve into the concept of image-to-image techniques and how they can be utilized in the Diffutoon project.

To provide you with a comprehensive understanding, I'll break down the workflow steps and demonstrate the differences between using the smooth video JSON file and the smooth video with batch size JSON file. We'll also touch upon the significance of ControlNet and K-sampler in achieving desired results.

So, if you're interested in exploring the world of video-to-video transformations and creating captivating anime or cartoon-style videos, this video is a must-watch for you! Don't forget to hit that subscribe button and turn on the notification bell, so you never miss an update on all things AI-related.

If You Like tutorial like this, You Can Support Our Work In Patreon:

[MrJgrez]

I get error at realistic line art for some reason? Do you know how to resolve this? Thanks

[crazyleafdesignweb]

This is fun, 1 code can do anime video. I will try it.

[ysy]

This is wonderful. I assume this is not SXDL ready yet, right?

[SFzip]

This is incredible! What is the input-video resolution size limit and length? Is there any point in capturing my videos in 4K?

[peacetoall]

Cool stuff. Would have been good for dance videos but sadly will get a copyright strike on Youtube.

[ehvzdeq]

I watched the video and tried to follow along.
I saw this error message on the video combine node side.

Error occurred when executing VHS_VideoCombine:

Cannot handle this data type: (1, 1, 512, 3), |u1

The only thing I changed the settings to is
The SD1.5 version checkpoint I have and
This is about the size of a sample video.
The rest of the settings were the same, but an error occurred.

[digitalflick]

thanks! where was the comfyui node/workflow?

[CyberPhonkMusic]

Is it possible to make it up to 30 seconds?

[MaghrabyANO]

does Google Colab approve usage of stable diffusion notes?

[huichan]

will get blurry result if the stylize image pattern (edges, contrast) is different from the original image due to the blending algorithm; Need extra steps to deblur

[Vashthareaper]

2 hours and smooth video node has not moved an inch, with vid 2 vid, 60 frames cap, lcm cp and lora, tried again and again

[Suresh-brzz]

tried diffutoon, it is not that good & very slow