How To Run Flux On A 12GB VRAM GPU Or Less In ComfyUI

Flux is the latest open source model causing a stir amidst the open source community but the big file sizes are a hinderance for us with lower end GPU's. However, there is a workflow that I will show you in this video that will run on even a GPU with only 8GB of VRAM. Note this only works for Nvidia GPU's, I'm not sure about AMD.

⏲Time Stamps
0:00 Flux workflow, settings and some suggestions
2:34 Where to get the files needed
5:10 Various Examples

**Disclaimer Affiliate Links Below**

📸 Gear I use

🔦 Find us on:

[MonzonMedia]

I'd love to hear you generation times if you have a 12GB VRAM GPU or less! Let me know in the comments!

[Jensemann]

dude you have the most chilled voice in the ai yt world. its a pleasure to listen to you.

Thank you for this precise, accurate, step-by-step tutorial, exactly what I needed (again).

[RamonGuthrie]

What amazes me most about this model are the details on the first pass. Normally, you will get these details in a second pass or on an upscale.

[droidJV]

Thanks for the video, tried it on a gtx1060 6gb (16gb ram / i7 5700G) and it took 4:27 to generate a 600x600 image with 5 steps and 7:26 for a 600x600 image with 10 steps. Can't imagine how much longer would it take for a bigger image but it works.

[alienandroid]

thanks what i needed to know for 8 gb cards.

[gameswithoutfrontears]

Looking good, will be watching flux closely

[korvine]

great job, i`ve 0 skill in genegation and everything works perfect!

Faster then forge UI somehow (~x2 speed same parameters)

[worldofgames]

Thank you for info! I have 4070 -12 gb and generate in around 40 sec, usual workflow...

[danwe]

LOOOOL! I managed to kick it on RTX 3050 with 8 gigs of VRAM and with another 32 gigs of CPU RAM

[alifrahman]

just deleted after generation an image in 8 mint in 2060 12 gb and now you came up with this🙂🙂

[spaceandstuff]

Thanks for the video. This is great for us the poors.

[matten_zero]

You can always face swap for celebrities. The magic of ComfyUI is ability to modularize and mix and match different models and workflows.

[LewGiDi]

Thank you very much 🙏 I'm able to run flux in a laptop with 6gbvram a pic with 1344×768 takes 2 minutes to gen as you said when comfy its loading all takes more time 4 minutes then time reduces. Are you planning to make an updated? It's been released N4 model from the creator of forge It's faster than f8 and schenll models

[LX]

what extension or option are u using for the straight connections? They look awesome!

[pokerandphilosophy]

I have a RXT 2060 Super with 8GB VRAM (and 64GB RAM). I used to generate one 1024x1024 image in four steps (Flux Schnell) in three minutes. With your workflow, it's down to 75 seconds! (Have you tried the DemonFlux model posted on CivitAI? It's a pruned model that merges Schell with Dev, and also the two clip models and the VAE file in one single 16GB checkpoint. It achieves close to Dev quality with just 3 steps. I was wondering if their approach could be combined with yours.)

[hleet]

Do you see a real difference in image quality (or prompt behaviour) between the two ? (schnell vs dev) ? By the way I don't use split sigma to try on flux. You can make it with SampleCustom, the sigmas is connected to a basicScheduler (simple). But yeah load diffusion model flux-fp8. I found out that if you put the weight_dtype to something else then default, the graphic card will go back and forth, just leaving at default is ok.
I really like flux, it is very coherent to the prompt. I hope that ipadapter will port his custom node on this one :D

[ОлегГ-юф]

Hi. Thanks for the guide. Could you please tell me how you made the lines connecting the nodes flat? I'm very frustrated that there are a lot of them and they are like a bunch of wires :) Thanks.

[motopaediatheview]

I run Flux-Dev full on 6GB 1060 GTX - it takes time, but works...

[Ryographix]

im using RTX3060 16GB RAM, will do po ba sa actual download sa github idol, salamat po