How To Run Stable Diffusion WebUI on AMD Radeon RX 7000 Series Graphics

Did you know you can enable Stable Diffusion with Microsoft Olive under Automatic1111 to get a significant speedup via Microsoft DirectML on Windows? Microsoft and AMD have been working together to optimize the Olive path on AMD hardware, accelerated via the Microsoft DirectML platform API and the AMD User Mode Driver’s ML (Machine Learning) software layer allowing users access to the power of the AMD GPU’s AI (Artificial Intelligence) capabilities.

***

©2023 Advanced Micro Devices, Inc. AMD, the AMD Arrow Logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and other jurisdictions. Other names are for informational purposes only and may be trademarks of their respective owners.

[ry]

It is really cool that the official AMD channel posted this! I think it shows that they have some focus on making it easy to use their consumer GPUs for AI workloads. The more hobbyists and developers they can get using AMD cards the better, because that is what those devs will want to use in production. I hope they keep improving ROCm and making easier to use! 😛

[planetorca]

Thank you AMD! I just got stable diffusion on my PC today and the videos from third-parties explaining how to use AMD are easily 10x more difficult

[berunto]

Trying to install it this way caused error after error. --onnx doesn´t seem to work.

[livb]

I get RuntimeError: Torch is not able to use GPU

[artymusoke]

when i run webui bat i get the same error

RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check
if i add this command line then stable diffusion uses CPU which im trying to avoid

[melvinooi]

Hi, do i need to reinstall AUTOMATIC1111 if I change to AMD from a Nvidia GPU? Or its a automatic detection? Thanks.

Does this work with a RX 6750xt? or only 7000 series

[thicccrusade]

Had some problems, error saying I didn't have Torch, I had to delete "venv" folder and after that it loaded some packages again. Anyways, ran with --use-directml and now it started to generate images at least. Will see how it goes.

[Richardowmaaiin]

what url? I don't a step just got skipped after installing the repos

[RexTorres]

I tried to follow your tutorial for setting up SDXL, but I can't get it to work. It fails to optimize. I also get some error messages about the program not being able to detect a GPU. I have a a 7800 XT.

[nienienie]

Does it mean i always have to run my .bat through Anaconda?

[jinxPad]

Wonderful performance, but a lot of A1111 features don't work, 77 token limit (biggest issue for me personally), in painting doesnt work, different set of samplers amongst other things. But it's a start.

[Daniel-jhpl]

neither one of the guides (neiter original nor updated) is working for me...i dont know where i made the mistake :(

[macielele]

I have an AMD RADEON Rx 6600 card and every time this error pops up: RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check.

+ Despite adding --skip-torch-cuda-test SD runs only on CPU.


Is it possible to do something about this?

[tiexiaowang]

Looks like this tutorial broke exactly 4 days ago. Hoping for an updated tutorial soon

[salukage]

I am running SD on my ryzen ipu 4600g with 8.9gb gpu memory it takes about 4mins to generate image

[mosquito_vermelho]

this maybe fix the torch is not able to use GPU: well on your root directory of stable diffusion you will find a file named "requirements_versions", open on notepad and you will search for a line with a word torch, add a directml there like this " torch-directml, save the file, edit the webui -user on notepad and put that "set COMMANDLINE_ARGS= --medvram --no-half --precision full --opt-sub-quad-attention --use-directml"...this will work

[CoderTronics]

This is useful, but potentially obsolete as SDXL on ComyfyUI is the next step in OpenSource image generation, I have it running on an RX 7800 XT but woefully slow compared to 3 year old Nvidia cards like RTX3060. Would be great to see further support here as well as support for the RX 7800 XT and 7700 with ROCm?

[kendjinone]

do i need to do that every single time i open stable diffusion webui.bat? Edit: this is bad we need rocm support on windows, my rx 6600m don't handle that thanks you.

[evetevet]

I get some error messages about the program not being able to detect a GPU. I have a a 6900 XT Sapphire.