COMFYUI Morphing workflow: the beginnings.

Face Morphing Effect Animation using Stable Diffusion

This ComfyUI workflow is a combination of AnimateDiff, ControlNet, IP Adapter, masking and Frame Interpolation. To be able to use SDXL models, the workflow needs to use the HotShotXL motion module. The workflow is partly based in the HotShot XL method by Inner Reflections.

#animatediff #comfyui #stablediffusion
============================================================

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
===========================================================

The final workflow:

For the rest of the models, the easiest is to use ComfyUI Manager:
- SDXL VAE
- SDXL BASE (checkpoint)
- OpenPoseXL2 (SDXL ControlNet)
- ControlNet Depth SDXL 1.0
- ClipVision SD1.5 (for IP adapter)
- IP Adapter plus SDXL VIT-H

Tracklist:
00:00 Intro
00:10 Assets for the tutorial (Civit.AI)
01:32 Workflow and ComfyUI Manager Install custom Nodes
01:48 Workflow Overview
03:02 Bypassing nodes to start demo
03:17 Inputs and Models (incl. AnimateDiff)
04:13 Prompt and ControlNets
05:00 Testing the AnimateDiff workflow (HotShotXL) without masks and morphing
05:31 Activating IP Adapter with 1 reference image
06:30 Test with IP Adapter (no masking and morphing)
06:47 Activating the face mask
08:58 Results when the face mask is applied (consistent background)
09:07 Morphing effect (Frame Interpolation)
09:44 Short Test quick morphing effect
09:54 Complete Morphing Effect and complete Animation render
10:25 Final results - Animation Face Morphing
10:46 Upscale Video activation and comparison Face Morphing animation with original video
11:07 Outro

My other tutorials:

Make sure to subscribe to Koala Nation Channel:

Videos: Pexels
Music: Youtube Music Library
Edited with Canva, and ClipChamp. I record the stuff in powerpoint.

© 2023 Koala Nation
#comfyui #animatediff #stablediffusion #lcm

[AB-wfek]

Pretty amazing process, thank you for sharing!

[baseerfarooqui]

Hi tutorial is very informative, but when i tried to run simple with only controlnet not IPadapter or mask i am getting this error The specific error message "mat1 and mat2 shapes cannot be multiplied (616x2048 and 768x320)"

[mehradbayat]

How much VRAM and RAM do you recommend/use for quick output generation?

[DopalearnEN]

Did you see my comment with the email address on the other video? It seems to have disappeared.