ComfyUI - Prompt Engineering with CFG, Sampler Steps and Clip Skipping - for Stable Diffusion Users

This video explores some little explored but extremely important ideas in working with Stable Diffusion - at the end of the lecture you will understand the relationship between CFG, Sampler steps and Clip skipping and the negative and positive implications. But take your time with this one, it goes into _*professional level*_ detail on the subject.

These are core ideas in helping you to refine your prompts and understanding the methods currently used in Stable Diffusion.

The previous lectures mentioned in the video can be found in the beginner's guide to ComfyUI
Course Discounts
BEGINNER'S Stable Diffusion COMFYUI and SDXL Guide
ADVANCED Stable Diffusion COMFYUI and SDXL
Mastery Course for Stable Diffusion (commences with this tutorial)

This lecture also looks at how core techniques previously examined on the course can be applied holistically to improve overall workflow.

Join 🏆 this channel to get access to exclusive content and perks:

00:00 Printing as a Metaphor for Stable Diffusion
02:50 Understanding Latent Space, Clip Networks, Diffusers and VAEs
04:55 Sampler Steps, CFG and Clip Skips
05:33 The relationship between sampler steps and the checkpoint
12:40 The relationship between CFG and the Text Prompt
18:35 The relationship between color, contrast and CFG
29:00 The CFG is broken
30:09 High steps number and the relationship with the prompt
32:56 Clip Skip and the Clip Neural Network
35:20 The CFG is completely broken
36:00 Putting this analysis of the neural networks together
39:40 Possible solutions to fix the broken CFG

[Pixovert]

The previous lectures mentioned in the video can be found in the beginner's guide to ComfyUI
Take. Your. Time. With This One, it goes into *_professional level_* detail on the subject.
Course Discounts
BEGINNER'S Stable Diffusion COMFYUI and SDXL Guide
ADVANCED Stable Diffusion COMFYUI and SDXL

[jaredbeiswenger]

Wonderful to listen to. Would love more content like this with other values that we tweak without really knowing what they do. I do a lot of this experimentation on my own, but to be able to watch a summarized version of someone else doing it while I'm working.... that let's me focus the little time I have for my hobbies.

[OutOfWards]

Thank you for taking the time to make these super helpful videos! You are a God send!

[edenorion]

One of the most important explanation that I've heard. Thank you very much

[Mehdimontahw]

Your way of explaining is wonderful, with details that I have not seen in any video, and the elegant sequence is beautiful, and there is no doubt that you deserve to press subscribe and like.

[Aamir]

Thank you.
Really liked efficiency nodes but it's loader (best part of it) is not using lowvram and xformers and resulting in slower generations in low end machines.

[lioncrud]

thank you very much, do you have any resources on advance prompting, like wildcard prompts {|} etc, i'm trying to figure out if ComfyUI has a version of alternating "to" and "from" prompts like Auto1111's [man:dog:0.5].

[artsbybrian_]

Great video! Mind if I ask for the workflow? Wanna test it.

[spiralofhope]

how do I clip skip without the efficiency loader? I like to work without custom nodes.

[lioncrud]

is there a reason you didn't use the Clip output?

[mithrandir]

From a camera perspective. Cfg is the ISO. Steps is shutter speed, and Clip skip is the Aperture

[maxpaynestory]

"beautfil scenery nature glass bottle landscape, ROUND." Not an actual requirements of any scene. We don't need examples of random prompts generating random images. All we could find on youtube is Comfy UI generating random pictures and videos using random prompts. But infact this tech is not mature enough to be used for creating any scene.

Try create a scene containing 5 teenage kids playing Call of Duty 2 on their computers, they are happy and cheering up.