STABLE VIDEO DIFFUSION | COMFYUI

Stable Video Diffusion is finally compatible with ComfyUI

HOW TO SUPPORT MY CHANNEL
_________________________________________________________________________
SOCIAL MEDIA
________________________________________________________________________
My PC Specs
GPU: RTX 4090
CPU: 13th Gen Intel(R) Core(TM) i9-13900KF
MEMORY: CORSAIR VENGEANCE 64 GB

Stable Video Diffusion Models:

Workflow:

Water Lora by joachim:

[JaimeAndresMedia]

It’s insane how much progress ai art has made in the last 6 months alone…

[drimscape]

Some explanations for the parameters:
video_frames: The number of video frames to generate.

motion_bucket_id: The higher the number the more motion will be in the video.

fps: The higher the fps the less choppy the video will be.

augmentation level: The amount of noise added to the init image, the higher it is the less the video will look like the init image. Increase it for more motion.

VideoLinearCFGGuidance: This node improves sampling for these video models a bit, what it does is linearly scale the cfg across the different frames. In the above example the first frame will be cfg 1.0 (the min_cfg in the node) the middle frame 1.75 and the last frame 2.5. (the cfg set in the sampler). This way frames further away from the init frame get a gradually higher cfg.

[falconbmstutorials]

Strangely it always never works, because of conflicts, not able to install the missing nodes, not able to install missing libraries, etc

[kurozeitsuki]

I have a problem finding where and how to install the RIFE VFI node. Could you tell us where we can find it? Otherwise thanks for the video!

[SBaldo]

Omg the advancements in video/animation are crazy lately 🤯. I think i still like having control on the animation with motion loras more but hey this setup is so easy. I can also imagine it being used in conjunction with other methods

[AIPixelFusion]

this thanksgiving I'm grateful for enigmatic_e's tutorials! 🙌🙌

shouts outs to Kijai as well!

[mohammedrashid]

super cool. cant wait to see what this does in a month. longer videos would be amazing.

[MarylandDevin]

I didn't know this was a thing. Thank you!

[daroniousmaximus]

Thanks. Just starting to fiddle around with this.

[haki_]

Always getting:

Error occurred when executing KSampler:

Conv3D is not supported on MPS

on M2 :/

[quietlyworking]

👏MASSIVE thanks. glad I found your channel! You've got a new sub.👊

[PumaFronAfk]

you can conneect the output from VAE decoder to SVD, and make promp to video

[kpr]

Interesting. Curious to see if you can combine this with text prompt conditioning to guide the video output. I'll certainly be doing some mad science experiments. Thanks!

[ancientpsychictandemwarele]

i get this error in in the rife node "Prompt outputs failed validation
RIFE VFI:
- Value not in list: ckpt_name: not in ['rife40.pth', 'rife41.pth', 'rife42.pth', 'rife43.pth', 'rife44.pth', 'rife45.pth', 'rife46.pth', 'rife47.pth', 'rife48.pth', 'rife49.pth']"

[amkkart]

I followed your steps to install comfy but whenever I want to let it run.. it says request to download models and I have to wait for a while.. how can I solve that ?

[blockchaindomain]

Im getting Boring animations! It always happens to me when I use animatediff with comfy or automatic...but... I LOVE CLI with animate diff! Ill keep at this and tweaking my settings! THANK YOU FOR YOUR HELP!!!

[paulverge]

Wow, this is a game changer my brother! Is there a frame cap similar to AnimateDiff? Thank you so much for putting this awesome tutorial out there!

[JimboSkinner]

So great that you set this up. Thank you so much! It’s working great, but I do see this error after the job is run “exception in callback Proactor lost” at asyncio\events.py line 80 in run… and then “an existing connection was forcibly closed by the remote host”… I think there are processes hanging around after the run than need to be cleaned up

[digital_magic]

sweet, thanx for sharing :-) Cool stuff!!!

[chanchanchan]

I am getting a lot of help from your video. I have one question. Among rife VFI ckpts, which repo contains files such as rife40.pth, No matter how much I searched, I couldn't find it. I'm looking forward to your smart answer to my stupid question.