How To Run Flux Dev & Schnell GGUF Image Models With LoRAs Using ComfyUI - Workflow Included

Discover the latest in open-source image generation with our deep dive into the new GGUF quantization method for image generation models! In this video, we explore how GGUF is revolutionizing the efficiency of Flux models, allowing for lightning-fast image processing even on less powerful hardware. Watch as we demonstrate the impressive speed improvements—cutting processing times dramatically while maintaining exceptional quality. Plus, learn how to set up these advanced models in ComfyUI and integrate your favorite Loras from Civitai. Don't miss out—links for models and workflows are in the description!

🔗 Links

Flux Models -

Clip Models -

Flux Vae -

(TO USE LORA: Connect the GGUF model loader node to the Lora node, then connect the Lora node to the Ksampler node. Be advised that you will need to also make sure there's always Lora loaded to use the workflow. If you no longer want to use the Lora revert back to the default workflow.)

Flux ComfyUI GGUF Workflow:

#fluxai #comfyui #stablediffusion #fluxgguf #aiart

[zoo]

After updating ComfyUI, lora worked! I have gtx 960 4gb.
Model schnell Q8_0.gguf. Results.
512x512 4 steps. Generated in 2 minutes!
768x768 4 steps. Generated in 2.40 minutes!
1024x1024 4 steps. Generated in 4.20 minutes!
If only on the processor (2x 2630v2), it would be 16 minutes, now 12.
I didn't think that it would work on such an old video card.

[cyanideshep]

THANK YOU!!!! This is the first tutorial that worked after searching for so long. Very clear and well put together :)

[lennoyl]

Thanks for the video. I didn't try yet (still downloading... ^^ ) those GGUF models but to be able to choose the models that suits with your PC config and your will is very nice.
PS: the GGUF nodes are now available in the comfyUI manager. there's no more need to use the git clone command in powershell.

[weilinliang]

exactly what I'm looking for. You're the best!👍This is super helpful.

[DarioToledo]

Thank you for the guide. Have actually experienced an improvement on Schnell from about 20s/it to 15s/it with GGUF on my 3050 ti 4gb.

[Huang-ujrt]

Because of my professional needs and the high learning threshold of flux, I've been using mimicpc to run flux before, it can load the workflow directly, I just want to download the flux model, and it handles the details wonderfully, but after watching your video, I'm using mimicpc to run flux again finally have a different experience, it's like I'm starting to get started! I feel like I'm starting to get the hang of it.

[kirubeladamu]

Fixes for the issues not mentioned in the video
- remove the string on line 143 of the workflow json file
- rename the file you downloaded to 'flux_vae' before adding it to the vae folder

[TrevorSullivan]

Which Text-to-Speech model are you using to generate these videos? Sounds really similar to some others I've heard.

[vhuplxv]

Thanks a lot!! This video really save me. I fuzz this question for a few days! Thank you very much!

[DaniDani-zbwd]

I wanna see a comparison…… what is the drop in quality between versions?

[Vanityk]

Hi, mine's just doing a black screen on the output.. I have a 4080. Has anyone had this issue?

[falconbmstutorials]

Would love to see a list of WGET instead of a list of websites ... for a beginner this is too confusing

[casper]

Can't get past this error. I've got all requirements installed correctly.

Error occurred when executing UnetLoaderGGUF:

module 'comfy.sd' has no attribute

File "/content/drive/MyDrive/AI/ComfyUI/execution.py", line 152, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
File "/content/drive/MyDrive/AI/ComfyUI/execution.py", line 82, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
File "/content/drive/MyDrive/AI/ComfyUI/execution.py", line 75, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
File "/content/drive/MyDrive/AI/ComfyUI/custom_nodes/ComfyUI-GGUF/nodes.py", line 130, in load_unet
model =

[KITFC]

Thanks but I got an error:

Warning: Missing Node Types
When loading the graph, the following node types were not found:



Do you know how to fix this?

[JamesPound]

The fp8 t5xx model gives less coherence and details. Try on a fixed seed with fp16.

[Kapharnaum]

Hi, thanks a lot for your video. Very clear.
However, when I start ComfyUI, i have the following error: Missing Node Types >
Any idea how to solve this?

[newreleaseproductions]

Can you make a tutorial for training Your own models using Ai tool kit.

[AcamBash]

There is a pretty important error in your workflow. You have to manually link the "Load Lora" Node to the "KSampler" via the model-link. Otherwise the Lora won't be applied.

[rogersnelson]

What type of loras can you use for GGUF workflow. The flux loras I tried from Civit AI (Flux1 D) have have no effect even when the trigger words are used.

[schuss]

Thank you for the video.. Does anyone know what is the best way to use 155h with integrated 8gb, 16gb 7600mhz ram, NPU, very fast hard drive.. It's the zenbook 14th gen.. Than you for any info