How to Run Flux ControlNet from Shakker labs and Mistoline on ComfyUI with Just 8GB VRAM.

Boost ControlNet performance on low-end PCs with this easy guide.

Apologies for not including the Mistoline installation instructions.

Let me know if anything else is not working.

Workflow:

Model list.

Flux Dev:

T5 GGUF Model:

Clip VIT:

Flux hyper model Lora:

Flux dev add detail lora:

Controlnet Depth:

Contorlnet Canny:

Mistoline Controlnet:

Mistoline:

[TheSneakyRobot]

Model list.

Flux Dev:




T5 GGUF Model:




Clip VIT:




Flux hyper model Lora:




Flux dev add detail lora:




Controlnet Depth:




Contorlnet Canny:




Mistoline Controlnet:




mistoline:

[ocplan_dbo]

Thanks a lot, good workflow. I've been wanting to use flux for it prompt adherence, but it's been painfully slow. So i just accepted sticking to sdxl, but this might make me reconsider.
On a side note for your guide:
- VAE is not referenced, so i just used the regular ae for flux.
- The custom upscaler switch was broken when i opened your workflow, had to rewire, but then all good.
- Upscaler not referenced in list.

I ran some test, where i just changed som stuff in a flux rigging i had, i added the loras and the splitup controlnets, compared to using the union model. I run a double controlnet (canny and depth). Still testing wheather or not this is needed when using flux.
I run a A2000, 2, 5 slot 12 gb, and 96 ram.
RESULTS:
4 steps, non produced pretty stuff (low settings, and steps). But adherent to individual promts based on masks.
OWN COMPONENT RIGGING, split up controlnet + GGUF + lora + quantized packages, 105, 5 second
OWN COMPONENT RIGGING, union controlnet + GGUF + lora + quantized packages, 438 second

[aifid]

how to install the custom sampler? ComfyUI manager didnt detect it missing :(

[victorestomo]

Misto nodes can't be downloaded using comfyui manager. It doesn't appear on the list of missing nodes.

[linnkoln]

By the end how long does your generation takes?