NEW Flux NF4 for ComfyUI. FASTEST FLUX!

[captainamsterdam]

For anyone having issues - to get the NF4 Loader to show up, I had to change the config.ini file for the Comfyui-Manager to have weak security. (Do so at your own risk!) Then change the channel to dev. It should then be searchable in the custom nodes section. I then installed and restarted...now working fine, so that could work for others.

[auzland]

What specs are on your computer? Does dev flux take around a minute for you usually?

[Steamrick]

This is great for anyone who can't run fp16.
In comparison to fp8 it's supposed to be similar or even better quality because NF4 is a much better format than fp8. Ilyasviel explained why on Forge discussion thread #981. It's also the most lightweight variety yet by far for anyone with a GPU new enough to support NF4. (Which mostly means RTX 3000 or 4000 series.)

[pedroj.fernandez]

For those that have the error of 'ForgeParams4bits' object has no attribute 'module', follow these instructuions:

In manager custom node folder, change the security leverl to weak in config.ini file.
Restart comfyui, go to manager, in the install PIP packages option (a button on the left), type exactly the following: bitsandbytes>=0.43
In my case, the package has been updated from 0.43.2 to 0.43.3. This minimal update does the trick. Then restart and it will work!
Change the config.ini security level to normal again. ;-)

[CMDRRustyDog]

There are so many issues not mentioned here. Firstly, installing ComfyUI via the Windows portable method, means the NF4 loader will install but not function. Installing ComfyUI manually will do it, but leads to errors elsewhere. It not as straightforward as it's made out to be.

[aaronallen]

Hello and thank you for all the tutorials! I must admit I watched your videos extensively last year, I've taken a break from image generation since last summer with A1111 and SD 1.5. Question: Should it take 30 minutes to generate an image with this ComfyUI and NF4 setup? Or am I doing something wrong? The only thing I can think is maybe I need more RAM? I'm using Nvidia 4080 but I only have 32g RAM? I have ComfyUI and models installed on a Samsung 860 EVO SSD. Thank you and keep up the good work!

[MrHugomesquita]

Thanks for this Sebastian. Great content!

[philality]

Damn really good! But needed something else from another video because i just could not get the nf4 node. But it is so much faster, insane!

Btw how do you get the preview from the rendering in the "samplerCustomAdvanced" thing? Kinda new to comfyui :x

[vikashchauhan]

Those who are getting CheckpointloaderNF4 error

-First follow all the instructions of the video.

- after that edit the config.ini, edit "security_level = normal" to "security_level = weak" and then Open comfyUI manager and on the left side Set Channel : default to dev, then restart your comfyUI and open COmfyUI manager then select install custom nodes then search "checkpointloader" there you can Find the NF4 press "try fix" button and it will turn your red NF4 to normal

[J.striker]

Thank you its not working the first time but your indication had helped, but there is a difference between the nf4-v2 and the normal ?

[Drazzzy]

When loading the graph, the following node types were not found:
CheckpointLoaderNF4
Nodes that have failed to load will show as red on the graph.

[mattmunroe]

As a Automatic1111 user, ComfyUI confused the heck out of me. I found Forge which is almost the same as Automatic1111 but works with Flux models.

[LvZ]

You didn't explain that the comfy manager must be installed first and that we need another comfy node..

[malarkey]

ive updated everything but still no NF4 coming up

when i do it via git, (This action is not allowed with this security level configuration.)

[thorntonhough]

Really enjoying the videos each day trying to do one video but I am stuck? Have got to 4:10 in the video and pip command

>pip install -r requirements.txt
'pip' is not recognized as an internal or external command,
operable program or batch file.

Please can you help or I cannot go any further to install nf4. Can I run install requirements any other way? It also says this has been super-seeded by gguf which I have seen you use in your other videos? Thanks

[basemmgtow]

it Requires installing bitsandbytes.

Make sure your ComfyUI is updated.

[TomiTom]

Thank you!
But how do you open the Search window, to search for the NF4 Loader ?
EDIT: I got it, just double-clicking on the board opens this search window

[DanielScofano]

Correct me if I'm wrong, but nf4 was replaced by GGUF tech.

[Heldn]

thanks for mention the forge the recreate all of ui and make it so much better and flexible and they work on it even now, every hour you find new update.

i have a question what is different between nf4 and bnb nf4 ?

[Radarhacke]

It works, but I have questions. If it seems possible that the flux 1 dev model can be slimmed down so that it now runs on a smaller GPU, why didn't the developers from the Black Forest include such a model? To what extent do the licenses change for the now increasingly modded flux variants?