Comfyui AnimateDiff v3 + LCM Video to Video

AnimateDiffv3 released, here is one comfyui workflow integrating LCM (latent consistency model) + controlnet + IPadapter + Face Detailer + auto folder name parser, with animation and realistic demo.

00:00 Introduction & Demo comparison
00:09 Workflow walkthrough
03:31 Realistic model results

#comfyui #animatediff #animatediffv3 #lcm #controlnet #openpose #stablediffusion #ipadapter #animation #realistic #repaint #facedetailer #Adetailer #consistency #consistent

[JKG-]

Thank you for the video. I really like the way you parsed the strings to control the locations of content. Very cool idea.

[oumuamuamua]

I was having problems setting it up but then I restarted the process from start and it worked, thanks a lot for the video!

[epelfeld]

Thank you it works great, just something wrong with colors. They are too bright and the image is overexposed. Have you an idea what's wrong?

[FusionDraw]

Thank you for sharing. Great workflow. Setting up the workflow is really hard.

[RaymondGuo-cz]

fantastic work!, the only problem is that I found that after running this workflow, the background is always pure color, even if I have added some background info in prompt, it does not work, could you share some fix method?

[caoonghoang]

When loading the graph, the following node types were not found:
IPAdapterApply
I have fully installed the nodes and still get this error

[risewithgrace]

For some reason, even though I've successfully downloaded Comfyui Impact Pack, Comfyui will still say it's missing. So the node above SAMLoader in the Face Detailer section is red. Have you run into this issue?

[jimjium]

Thank you for the video.but i have the problem :Error occurred when executing VHS_LoadImagesPath:

directory is not valid: E:\Ai_video\ComfyUI_windows_portable\ComfyUI\output\ADiff\OpenPose, I followed the instructions and created the folders.thanks for help.

[samon]

Error occurred when executing KSampler:
'NoneType' object has no attribute 'shape'

[hitmanehsan]

thansk so much for ur great tutorials.is there any render time limit in comfyui? i wanna use a 32seconds video.its 30 frame (1000 png) for video2video but i got this error on my 3090ti: Unable to allocate 6.43 GiB for an array with shape (976, 1024, 576, 3) and data type float32

[hitmanehsan]

i upgraded to 3090ti 24gig.how much cpu ram i need to do video to video SD? I have 32gig

[cycsu]

Thank you for the workflow, but when i run the workflow, the load images node will get error, turn red, can you tell me how to solve it

[aipamagica]

Thanks for this vid and great resource. For whatever reason, it is not loading an image into the load image portion of the ipadapter. Everything else prior to that step seems to be working fine. Do you have any ideas what might cause that? Comfy is not throwing any errors.

[raulenriquesilva]

To Run is need:
(In group node 'workflow/Dimensions')
workflow/DimensionsRemove from workflow
CR Prompt Text
Image Save
Text Multiline
CR Split String
Display Int (rgthree)
ColorMatch
CR Seed

¿where is there?

[keepitshort]

Great video
I have a question, Can you tell me the location for the *IPAdapter model* in comfy ui file

[zagzagel]

Is there any way to make mouth move as in original video clip? Any advice or setting i could tinker with? Or is this just good with movement and dances.

[HyperGalaxyEntertainment]

how long does it take for render, and can we render a full dance video?

[cinematic_monkey]

This is too hard to follow. You should build it from scratch with every step shown.

[typhon]

Error occurred when executing VHS_LoadImagesPath:

directory is not valid: D:/Program

File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 155, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 85, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 78, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "D:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite\videohelpersuite\load_images_nodes.py", line 143, in load_images
raise Exception("directory is not valid: " + directory)



I've tried many times but I really don't know how to modify

[tamiltrivia]

Thank you for the video. Please help me to download the clip vision model ViT-H.safetensors.