ComfyUI Tutorial Series: Ep14 - How to Use Flux ControlNet Union Pro

Welcome to Episode 14 of our ComfyUI tutorial series! In this video, I’ll guide you through how to use ControlNet with Flux to control your image generations. You'll learn how to manage elements like pose and depth, using the Flux Dev ControlNet Union Pro model. I’ll walk you through installing custom nodes, configuring ControlNet in your workflow, and troubleshooting common errors, ensuring you can fine-tune your creations with ease.

Be sure to follow along, and don’t forget to leave a like and comment if you find this helpful! Thanks to all the Legend Members for your amazing support. See you on Discord!

Get the workflows and instructions from discord

rename it to something like flux-dev-controlnet-union for easier identification,
and place it in the ControlNet folder, for example: ..ComfyUI\models\controlnet

Get one of the Flux Dev Models (recommended to use Q5_K_M or larger for the best results, Q4 for 12gb VRAM) - My favorite is Q8
Place it in the unet folder ..ComfyUI/models/unet

Update ComfyUI

Make sure you have the following custom nodes installed. (If you've followed my episodes, you should already have them.)
Go to the Manager, then Custom Nodes Manager:

Install: ComfyUI's ControlNet Auxiliary Preprocessors
Install: ComfyUI-GGUF
Install: rgthree's ComfyUI Nodes
Install: ControlAltAI Nodes
Install: ComfyUI Easy Use

Unlock exclusive perks by joining our channel:

[pixaroma]

You can now support the channel and unlock exclusive perks by becoming a member:

[makadi]

When I watch one of your episodes, I still feel the same excitement I had when I first started learning, as if I haven't learned anything at all

[FiXANoNada]

literally the best guide ever. You have no idea how I had to self learn all this months ago and now seeing you who carefully puts all the pieces together exactly how it should be. Wish I watched this sooner haha. But maybe because I had to learn it alone first, I get to know that you are doing it correctly. Thanks and keep up the good work.

With the updates and changes of these tools and nodes though, what we learn today is already outdated the next day.

This guide is very comfyUI-new-comer-friendly for someone who wants a decent step-by-step explanation and the right tool for the right job without a bunch of pointless talking and messy instructions.

[nahlene]

You are an amazing teacher! I always find ComfyUI confusing, but after binge-watched your tutorials now everything makes sense, even other tutorials that were collecting dust in my playlist now suddenly makes sense. Can't thank you enough!

[tapirko]

Thank you! Very useful, easy to follow and practical tutorial as always. I would still hate ComfyUI if it weren't for your channel! I feel very comfy working in it now :)

[jmagick]

Your videos always add to my growing knowledge of AI art. Thanks!

[jigneshparmar]

You are doing great man 💯 Teaching and giving the knowledge to others 👏🏻

[SvenMurmann]

Thank you very much for the great and detailed tutorials. Great job.

[GenoG]

Another excellent video... and as always, you throw in extra helpful tidbits about ComfyUI to boot! Well done! I'll be a Legend now!! 😀 I struggled a little with the Error that you mentioned, but your Discord is super helpful and I found the Windows "Long Path" solution there and BAM, it's working fine! Again, thanks!!

[pedrosm]

Results are amazing! Thanks for sharing!

[Marcel]

Thank you for this well explained tutorial and for your discord channel that has so many knowledgeable and helpful members.

[aitechwitht]

Pixaroma you are an incredible teacher! I've learned so much from you about comfy UI! THANK YOU!

[rmeta]

Thanks for the tip on Flux Resolution Calculator, I was using Comfyroll's Aspect Ratio which has not been updated but worked. Always learn something from your EP's.

[ByFlerk]

Thanks for the explanation - What extension/plugins are you using for the monitoring of CPU/GPU and for the saving of .json with an image

I found this video helpful. Like button was pressed. Comment written. :)

[whimsydraws]

amazing!! AI is getting better day by day

[egerdrawings]

Hello, thank you for your guides, they are easy to follow. Tho i have one question. I already have a depth image, so I don't need the preprocessor. How do I use that ?

[nibtreak]

Great video. It works great!... But it is so slow compare to just using just using Flux. Any parameters I can play with to help? It the full ControlNet 6GB end up in VRAM?

[SebAnt]

WOW - This is what I was waiting for! Thanks!

[burskyozbekov]

So how do we add extra Lora's? Thanks for your work. It helped lot.