ControlNet in Stable Diffusion Automatic 1111 (Tutorial)

In this video, I explain what ControlNet is and how to use it with Stable Diffusion Automatic 1111. I go into detail with examples and show you ControlNet using models like Open Pose (Simple and Complex), Canny, MSLD, Line Art, Soft Edge, and Multi-Mode. I also cover ControlNet usage across a variety of its usage in Body Postures and Hand Gestures, Landscapes, Architecture, and Mixing multiple Subjects in a single Image.

------------------------

Relevant Links / Commands:

------------------------

TimeStamps:

0:00 Intro.
0:26 ControlNet Extension Install.
2:03 ControlNet Models Install.
2:52 ControlNet Basics.
4:47 Batman Open Pose Simple.
6:21 Batman Pose 1.
8:17 Batman Pose 2.
8:59 Batman Pose 3.
9:25 Batman Fist Pose.
10:31 3D Anime Open Pose Complex, Canny.
11:42 3D Anime Open Pose Hand.
13:40 3D Anime Sitting, Multi Scene, Open Pose.
15:28 3D Anime Open Pose Full.
16:51 3D Anime Canny, Change Clothes.
18:17 Castle Landscape, Line Art, Soft Edge, Control Mode.
19:52 Castle Landscape Line Art, Control Mode.
21:58 Castle Landscape, Soft Edge, Control Mode.
23:37 Living Room, MSLD.
25:49 Birds, Line Art, Multi Mode.
30:41 Conclusion.
31:20 End Credits.

[Gothdir]

This was probably the best tutorial on AI related content I have come across so far! Definitely got a new subscriber in me. I love the extra length of the video and detailed examples! Good stuff!

[Archomir]

damn what a time to be alive

amazing tutorial thank you

[coroscristianosineditos]

thanks man, nice tutorial on how to use controlNet =)..

[elifmiami]

Thank you for sharing your experience! I was wondering which control net model is good for vehicles ?

[lakislambrianides]

Thanks for the tutorial, when download the T2I I place it in the same folder as controlnet models ?

[eddiecampelo]

It's possible to animate this joints?

[CerisCinderwolf]

When installing via the URL, I run into:

stderr: ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied:
Check the permissions.


ControlNet init warning: Unable to install insightface automatically.

However the message in Automatic1111 gui says "Installed into Use Installed tab to restart."
I've done what digging I could on this and a few people have reported but but there's never a consensus on what to do to fix this. Any thoughts/ideas?
There's only one user account on this pc (mine and it has full admin priviledges). I don't run SD (Automatic1111) in admin mode as that can cause issues down the road. I've installed other extensions just fine from within Automatic1111 using the URL functionality.

[JarppaGuru]

you not need download preprosessor ui download them models u need, but it mean it would work just without model lol

[JarppaGuru]

8:08 yes yes seed is different. now use same seed without openpose vola. you could just ask better promt and get that same LOL
if training data on used model have poses like that, but if not you will sure see open pose try do it xD mean programmed to do AI.
and only do what was trained nothing new is generated. it just mix trained data

[gomezabel]

I installed automatic 1111 yesterday for the first time ever and today I managed to installed several extensions, except I was unable to install controlnet. I followed your tutorial and several other channels on stable diffusion, which provided identical installation but each time I get a "JSONDecodeError: Expecting value: line 8 column 1 (char 7)" Please give it a try based on your tutorial. What's going on?? Thank you in advance.

[ianwilmoth]

I will be sad when this tutorial becomes obsolete.