How to FACE-SWAP with Stable Diffusion and ControlNet. Simple and flexible.

We use Stable Diffusion Automatic1111 to swap some very different faces. Learn about ControlNet IP-Adapter Plus-Face and its use cases. This solution requires two additional ControlNet models only, and no large installation packages like other tools for swapping faces.

ControlNet:

IP-Adapter models including plus-face:

Open-pose-models for ControlNet:

--

My Video about Upscaling and ControlNet:

[kdzvocalcovers]

You the free lesson...pleasantly mixed audio and a relaxing...enjoyable presentation..Bravo!..and Thank you*

[Chonky_Nerd]

I love your videos, thank you for your help so far You have helped me install and learn to use SDXL, Upscalers and ControlNet!

[RobertWildling]

Excellent! Really great tutorial! Thank you very much! Subscribed and looking forward to learn from your other videos! 🙂

[faredit-cqxl]

thank's .
did you know how can i use this method in Forge UI ? in Forge Preprocessor is `InsightFace+CLIP-H` and Model is `ip-adapter-plus-face_sd15`, i Don't know how to use `ip-adapter-clip_sd15` as preprocessor !

[pilotdawn]

Very helpful. Liked and Subscribed. Thanks!

[dustinpoissant]

Yeah my faces end up looking VERY abstract, like completely wrong

[trashmike]

Great video, thank you for sharing! Is this possible or even advised on Mac OS?

[marcusmeins]

Do you have a tutorial about training loRAs models on stable diffusion with dreambooth? i tried it with other tutorials but the interface they had was different and mine is different too and it is hard to follow their steps.

[amarissimus]

RuntimeError: 'addmm_impl_cpu_' not implemented for 'Half' Still trying to work this one out... Seems to be working fine until the final output. Then error. I wonder if I've got something in the wrong folder. That happens often.

[siewertw]

I tried your instructions and copied the settings. I can't get it right. When i set denoising strength to 1 the face is replaced by a random generated image and not the controlnet image. I think i'm missing a setting that i may not see in your video?

[KotleKettle]

When I select IP-adapter, ip-adapter_clip_sd15 disappears from Preprocessor, and only xl is available. What do I do wrong?

[Azmortsu]

I followed every step but I get just the original image with no face, like if I've deleted it with paint where I drew the mask, and a pose image.

[zaselimgamingvideos]

I don't know, for me nothing beats reactor, ip adapter sucks even with plus 2 version. The best way i get the desired result is with using reactor (txt2img) with any model with their specific cfg/steps etc and then img2img with my trained model with its cfg/steps/method settings without reactor with 0.17 denoiser with 2x size.
After img2img the face gets the same style as the rest of the picture without changing its appearance.
But with ip adapter, the face doesn't even come close to 50%. And i tried with single to 20 pictures for the face so that ip adapter can get it right but still fails. I am waiting for instant id, it only works with sdxl at the moment and i use sd1.5.

[mhacksunknown]

i testing every step but it never worked..

[QuackCow]

Mine doesn't have "DPM++ 2M SDE Karras" for the sampling method. Mine has "DPM++ 2M SDE" and "DPM++ 2M SDE Heun". Which one of these should I use?

[bigdeutsch]

Unfortunately I ran into a similar issue as others described in the comments. My preprocessor will not update to show the same ones available for you, I'm not sure which preprocessor I should use so every time I run this it looks horrible. I have tried updating control net, using different models, including the base 1.5 model. I'm not sure what else I can try. I'm sure I've followed the video's instructions to the letter.

Any ideas? My model shows up correctly, but not the preprocessor.

[Oxes]

very very well explained every step, subbed, can you make some controlnet for sdxl? of course inside in automatic1111

[milosbijanic]

Thank you very much!
Has anyone tried to do this with diffusers?

[juliensorel]

Is this process done entirely on the computer? Or does it upload/download to and from a website or the cloud? I have very bad IN connection, and the apps I have tried all end up using a website.

[arnaudcaplier]

Very well done ! The accuracy and explanations / « whys » are highly valuable. May be the German way!
I definitely subscribe to your channel and activate the notification mode ;) 👏 👏 👏
Looking forward