SDXL in ComfyUI!

Finally, Stable Diffusion XL 0.9 (SD XL) is out (research-only)! #stablediffusion #sd
SD XL 0.9 is the new Stability AI model, which outperforms the previous SD 1.5 and SD 2.0. More realistic pictures, although still some limitations...

In this tutorial, we are going to build together the ComfyUI workflow to run the new SD XL Base & Refiner! We are going to download the new model from Hugging Face, ComfyUI for Windows, Mac, and Colab, build the workflows, check for outputs, and save&reopen created workflows!

🤙🏻 Follow me on Medium to get my Newsletter:

📰Article:

📌 Links:

00:14 SD XL model briefly explained
01:37 Limitations of the new model
03:27 ComfyUI
04:14 What to expect from this tutorial
05:18 ComfyUI performance for Windows users
05:18 ComfyUI performance for Mac users
06:29 ComfyUI performance on Colab
07:00 ComfyUI is available on RunPod
07:20 Download ComfyUI on Windows
10:44 Download the SD XL models from Hugging Face
14:03 Load the default ComfUI workflow
14:40 Download ComfyUI on Mac
19:31 Run ComfyUI on Colab
20:03 Different ways of using Colab
20:07 Connect to Google Drive
20:46 Connect to an external computer
21:42 Set Runtime Type to GPU in Colab
22:39 Download any model with Colab
24:07 Download SD XL models with Colab
25:29 Create an access token in Hugging Face
28:03 How to use ComfyUI
29:31 Create nodes and links
30:34 Build the workflow to run SD XL Base
30:41 Personalize nodes
31:38 What is CLIP?
33:10 Add the VAE loader (for external VAE)
34:30 Update prefix when saving images
35:31 Build the workflow to run SD XL Refiner
37:08 Collapse nodes
38:40 Latent image for the refiner model
40:37 Denoise in the Refiner KSampler
41:45 Compare outputs base vs. refiner
42:35 Save the workflow
42:53 Load a saved workflow
43:52 Where to find the output
44:05 Re-initialize ComfyUI with Colab
44:37 Re-initialize ComfyUI with Mac
44:42 Re-initialize ComfyUI with Windows

#aiart #stablediffusion #generativeart #stabilityai #stablediffusiontutorial
#sdxl

[Superficialgallery]

You are getting better and better all the time. Seriously good stuff.

[edsonjr-dev]

Thank you for this incredible tutorial, my like and watchtime 100% 💜💜💜

[jejakpotret]

This is what most I'm waiting for, thanks a lot, you are the best !

[magnoalm]

Thanks Laura, I finally understood how the ComfyUI interface works

[jokosalsa]

Laura, great channel. Great explanations. Subscribed

[avinashu]

10:25 u can edit the "extra _model _path.yaml.example" file name to "extra_model_path.yaml" file in `comfy and inside the file, under checkpoints u can copy the path name from the automatic 1111 model folders, it will automatically load the models files when u run comfy ui, so there is no need to copy the checkpoint again inside the models folder in comfy ui, it saves u a lots of space
great video btw!

[Luxcium]

_I wanted to learn how to use ComfyUI with a LoRA_ but *I am happy to be learning how to use ComfyUI with Laura 🎉🎉🎉🎉*

[DanielBlumberg]

Really liked this walk through. I was able to finally figure out comfy on windows... Mac did not get it to install. Could you do a review of Warp since you used it instead of terminal?

[macgee]

nice walk through thanks laura - reason your first render didn't look good is because this model performs best at 102x1024.
i got decent results with 768 as well but the refiner didn't do it's job nicely
1024 is exceptional on a simple prompt
this UI is incredible to learn ins and outs SD but also to build you own custom routings
many video compositing applications are node based, it's so flexible

[sitgesstudio]

a computer geek with a nice tan, thank you grazie mille

[lakislambrianides]

Great video. I don't see any cancel button for cancelling rendering

[agustinpelliza]

Hey Laura. The manager doesn´t appear in my interface. I have the "ComfyUI-Manager" folder added to the costom_nodes one. Any fix?

[WildWorldTravelers]

when I try to copy the link on SSH appears a message that says: You don't have any public SSH keys in your GitHub account. You can add a new public key, or try cloning this repository via HTTPS. Im a little confuse im new in this, please help!

[RSV]

Hello, is there a possibility to install and run Stable Diffusion SDXL 1.0 on a mac mini m2 pro with A1111 ?
I can't use it on Windows because my graphics card only has 4 GB.

[orfeaus]

When I try to run ComfyUI on M2 Mac I get the error AttributeError: module 'torch' has no attribute 'mps'. I have PyTorch installed so I'm confused as to what's triggering this error.

[WildWorldTravelers]

anyone can tell me if I can install this for Mac M1 32gb? and if i can do video2video? thank you!!

[GB--]

Good evening Laura, how are you? Could you please make a new installation video of "stable diffusion sdxl 1.0" on Macbook M1, please? T-T

[AliKhan-vtuk]

How to get consistent character in all images?

[manunoyonify]

Eh, un altro PS: maybe u can join Rivolt ? (change la première lettre par la quatrième de l'alphabet ou YT ne consent point....)

[wynard]

Not sure I like this UI so I'm going to wait. SD XL is a preview for now anyway...