MULTIPLE CHARACTERS In ONE IMAGE WITH CONTROLNET & LATENT COUPLE! THIS IS SO FUN!

Recently a brand new extension for Stable Diffusion was released called Latent Couple, which allows you to determine specific zones of an image and attribute it a prompt, making it possible to generate multiple characters in different styles in 1 style generation, no Inpainting required at all! And when combining the extension to ControlNET and the Composable LoRA extension you can generate multiple different characters in different styles and in different positions in one single image generation! This is so cool and so powerful! So in this video, I will show you how to install and use the Couple Latent extension and how to use it in combination with ControlNet and LatentCoupleHelper to get the best results possible! So let's go!

Did you manage to generate multiple characters in 1 image? Let me know in the comments!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SOCIAL MEDIA LINKS!
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

divisions=1:1,1:3,1:3,1:3 positions=0:0,0:0,0:1,0:2 weights=0.2,0.8,0.8,0.8 end at step=50

Special thanks to Royal Emperor:
- Merlin Kauffman
- Totoro

Thank you so much for your support on Patreon! You are truly a glory to behold! Your generosity is immense, and it means the world to me. Thank you for helping me keep the lights on and the content flowing. Thank you very much!

#stablediffusion #controlnet #aiart #stablediffusiontutorial
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
WATCH MY MOST POPULAR VIDEOS:
RECOMMENDED WATCHING - My "Stable Diffusion" Playlist:

RECOMMENDED WATCHING - My "Tutorial" Playlist:

Disclosure: Bear in mind that some of the links in this post are affiliate links and if you go through them to make a purchase I will earn a commission. Keep in mind that I link these companies and their products because of their quality and not because of the commission I receive from your purchases. The decision is yours, and whether or not you decide to buy something is completely up to you.

[sinceredeku]

Its crazy how fast Stable DIffusion outscales all Paid services. Thats the power of the people

[depthbyvfx]

Literally every day I master one aspect of controlnet and another appears. This space ceases to amaze me with the daily advances

[SoCalGuitarist]

Wow, this is really fantastic! You could essentially create comic book panels with ease this way, with a separate prompt for each panel. Thanks for yet another great video!

[shaman_ns]

It’s scary how fast this entire space is improving

[SpikyRoss]

This is just insane, each day there is something new, when is this even gonna stop 😳Thanks as always for the tutorials!

[professorpenne]

it's actually nuts how far SD has come from the time this video was made, along with the extentions.

[thanksfernuthin]

HOLY CRAP!!! Another HUGE advance. Now I can say a character has blue eyes without everything else being blue. Plus ALL the other things I can do. Fantastic!!!

[someguycalledcerberus]

OK, so I just spent like two hours getting this to work only to produce horrible abominations, and here are two very important tips:

1) *If you are generating monsters fusing together:* The first subprompt (before the first AND) will be applied to the whole image (if you use divisions like in this video). This means that if you leave the settings like they are in this video and enter "a man AND a woman", you will smear the man over the whole image and then denoise the woman into the left side of the image, and do nothing for the right side (you entered only 2 subprompts). _You need as many subprompts as there are divisions. And you need to pay attention to the ratios of the divisions._

2) *If you are generating a person who is cut in half and generating the other person on their other half:* Increase the width of the image. None of the models I tested were able to properly generate two full persons like this with the default 512 width. I assume that's because the models were trained on 512 images, meaning they try to adjust the size of a person to 512. If you halve this 512 width, you are not letting the model complete a full human.

+1: You can leverage latent coupling with img2img and controlnets to better guide generation to what you are trying to achieve.

[Snafu]

The Stable Diffusion space is evolving faster than I can keep up with it. Or so fast that I can't learn the previous new features and get good at them before something else comes out.
Thing is once something comes out, and I watch an older video of it to catch up, there's been another video that has updated the previous feature. I kind of wish it would slow down a little bit, I still got to go to work in a few hours. 😆

[TheSchwarzKater]

Finally got this to work. Some checkpoints really don't like to render more than one person without face issues (that not even higres nor fix faces will fix), amplified by using loras.
Different checkpoint model and reduced lora strength, fixed it. Good video :)
I hope in future it will respect the reduced height more. Especially people will just be cut off or have their heads cut off, lol. Somehow SD still tries to put a full person in there, instead of shrinking it. to respect the area.

[nio]

There's a pull request on the repo that allows you to draw masks (with multiple colours) instead of messing around with calculating partitions.

I tried it. It basically solves composition problems almost entirely.

[richardgreaney]

This was such a good explanation of how this works. I've seen other tutorials on this before but none that actually explained it like yours did. I am going to have a lot of fun with this now.

[bigal]

Wow ... my mind continues to get blown with how fast powerful tools are being created. Makes me really curious about there we will be by the end of the year!

[ImNotQualifiedToSayThisBut]

Tried around with this a few days ago and was surprised by how well it worked. Did not know about the Latent Couple Helper though. Makes things a lot easier.

[mkhernandez]

I think the tools are advancing but getting quite complex in a way so hope some people can streamline controll net and coupls soon, but this is barely year 1! so there is alot of progress ahead

[NaThattitude]

The possibilities are insane ! Thx for the tutorial.

[JohnDoe-hdde]

unfortunately the installation doesn't work for me. Compsable Lora tab is there, latent couple is not. latent couple is also no longer selectable in the extentions, via URL installation I get an error message that it already exists. everything is up to date. the folder is in extention folder as it should. I restarted the web ui and also in the browser. any ideas?

[morizanova]

Thanks !!! I can see those extension will be helpful for doing Comic panel, more precise t- shirt - merch and even book cover mockup direct inside SD and A1111. Awesome !

[MrStatistx]

Edit: Turns out the regional prompt extension (which i installed but haven't used and don't know how to set up properly right) was enabled.
Looks like it works now (to varying success at least)
Edit 2: Nah, was coincidence it seems. Still get horrible results 90% of the time. the 10% are at least showing SOMETHING on both sides, but most often it does closeups of 1 or ignores it completely.


Doesn't work for me. like I write Beach AND man AND woman (simplified example), so i get a beach background and then a horrible mishmash of a manwoman monster, merged in the middle.

Same settings as in the video and taking into account what the comment with the 2 tips said

[Braulio_Cyberyisus]

Thanks for this video.
This + Composable LoRA could make really great images.