March 2024 - Stable Diffusion with AMD on windows -- use zluda ;)

SD is so much better now using Zluda!

Here is how to run automatic1111 with zluda on windows, and get all the features you were missing before!

** Only GPU's that are fully supported or partially supported with ROCm can run this, check if yours is fully or partially supported before starting! **

check if your gpu is fully supported on windows here:

Links to files and things:

Add PATH for HIP SDK and wherever you copies Zluda files to
%HIP_PATH%bin
C:\path\to\zluda\folder

Start Automatic 1111 webui

copy zluda cublas and cusparse to
...\stable-diffusion-webui-directml\venv\Lib\site-packages\torch\lib

delete cublas64_11 and cusparse64_11

rename zluda files

back in terminal run webui

If you have issues with cudnn

Add this after def initialize

If you have a GPU that is not fully supported in hip SDK follow these instructions

[taffyware]

Performance better, worse or equal to Linux ROCm?

[swietypiotrprzykurwiciel]

I just bought a new card and once again I am back to your tutorials. Your videos helped me before, your tutorials are extremely up to date and easy to follow. Thanks man, you're doing a great job here!

[FormalPluto]

Very nice tutorial. I've moved onto the NVidia side, but your tutorials were extremely helpful with setting up SD with Olive when I was still using my RX 7800XT.
Thank you for making it easier for AMD users stuck in windows who are curious about trying SD.

[LeshaKhaletskiy]

You are the only person who have workable SD XL AMD guide, also whole other stuff like torch, torch-cu, tensor work well, and this rare

[shefu]

THANKS A LOT MATE! This is so awesome. I have played with directML and its settings before like hell. My command webui-user.bat argument lines were almost one A4 page.

i noticed that you need to restart your PC to get new PATH directions to work on WIN11. Without restart you end up getting "failed to load zluda path automatically" and "use skip-cuda-torch-test" info. Also first install will download cublas64_12 and cusparse64_12 instead of 64_11 without using --use-zluda argument with user.bat.Idk why.

My 6750XT results:
1.
1.5 SD models: txt2img 1024x1024: 3.75s/it /average and 1:05min generation time.
SDXL models: txt2img 1024x1024: 3.50s/it average and 1:10 minutes.
NOTE: without zluda this was impossible task because instant memory error. and SDXL models generated over 2 minutes with 512x512 resolution.

2. Memoryusage is now calibrated. With zluda SD using only 10.2gb/12Gb memory and it will free up memory after generation. 15min 1024x1024 -> 2048 upscaling did not encounter memory error. With directML you cant use more than 1.5x upscale and controlnet. No you dont need a control net with zluda. This is awesome.

3. ControlNet works just fine

4. Ultimate Upscaler works normally

5. Inpaint works normally

AMD pro drivers are slight faster than adrealine version. There is sligh 5-15s delay with adrealine when press "generate" and no delay with ProDrivers. IDK what cause this.

[horrid]

OMG! Thank you so much for this one! I tried for so long to get this running... All the text tutorials were just too complicated.

[krizo]

You're a blessing upon this world.

[matthew]

I “sidegraded” from an RTX 3070 to an RX 6800. Mainly did it because I wanted that extra VRAM and I found a really good deal. Thank you for this tutorial! Very well put together

[jinxPad]

great stuff! Great tutorial as always, thank you.

[MathieuCruzel]

Thanks a lot for the tutorial. I could not for the life of me get it to work on Fedora and finally this works really well. I moved from a RTX 2060 to anew 7900XT recently and I was getting 1.5x 2x performance on Comfyui but with this I get at last x5 x6 speed when generating with XL Models.

[TrackmaniaKaiser]

Thaaanks a lot for your video! After I spend about 24h bricking everything I finally stumbled across your channel! You helped me get my SD to run so much better than before! I'am looking forwared to your next video with some more SD otpmizations for windows users :)
Up to that point? Is there a paypal or something where I can buy you a coffee? You safed me from insanity!

[koxu]

can't even imagine how tough was that to work it out. Thanks!

[Klaster_]

Thank you for the video, took me a while to figure it out, but I finally managed to get a decent generation improvement on my setup - to about 11 it/s in SD1.5 on 7900XTX. If others read this, try out the "--use-zluda" flag in and SD.next do the patching for you and install the correct torch version - much easier this way.

[Gawdzend]

I started with one of your other videos, but this one got me officially up and running (on a 6600XT). Much appreciated!

[jk-zebo]

This was a lifesaver! Fiddled 2 days to get Olive ONNX etc working at at least useable level, and after installing zluda using this tutorial (almost) all works out of box without constant tinkering.
Inpaint sketch does not work proper (renders whole image instead mask area) but it is prob -directml fork issue

[OfficialJohnnyHartmann]

You are the best, sir. I have been struggling with getting my 7900 XTX to work with anything. Only one I got to work with Windows was Amuse, which is very lackluster, and it seems like it's dead at this point, and SD.Next with a workaround, which is not great. With the workaround it lacks the ability to run bigger batches, upscaling, inpainting, the pics look choppy, and a lot more. Not great, tbh. And with Linux, that was just a mess. Most wont open, and the few that works will only work of my cpu.
But with your help, I can finally generate pictures with all the features.
All hail the king! <3

[bernardy]

Finally, after days of trying, i found your video...really good explanation, and i was finally able to make it run

[MortisDG]

I was really getting frustrated with all that shit.. Thank you so much for this video! Finally I can use SD properly again 🙏

[PSYCHOPATHiO]

Excuse my language... HOLY SHIT, This is good. I gave up on Windows & been on Linux for a while but now after testing ths on Windows... oooh i love u. I can finally utilize my 7900 XT to its potential. Thank you for the easy tutorial

[darkenblade]

thanks you so much for this tutorial. this worked for me and i have an unsupported 6700xt. first time i got inpaints and sdxl working properly. you do a good job explaining things but the best is how u put the links to everything in the description. makes my life so much easier.