Stable Diffusion on AMD RX 6700XT with ROCM: Everything You Need to Know

Below I'll post the commands I used in the video.
sudo apt-get update
sudo amdgpu-install --usecase=rocm
sudo usermod -a -G video $USER
sudo usermod -a -G render $USER
reboot
python
import torch
exit()
sudo apt install git
export HSA_OVERRIDE_GFX_VERSION=10.3.0
sudo apt install libstdc++-12-dev
cd stable-diffusion-webui

to watch gpu usage you can use
watch -n .1 rocm-smi
that should do it for you.

Affiliate links
-------------------------------------------------------------------
Each Amazon link is linked to my Amazon Associate's account and a small percentage of your purchase will support the channel at no extra cost to you.

[dmoneyballa]

I tried this on an amd rx 6600xt on rocm 5.7.1 and it works so if you were wondering about that, it does work.

[BrockSuire]

I work for AMD. Love your video on ROCm!

[adrianbaranowicz]

I used your tutorial as a reference and installed all the components, but I chose the latest ones, like rocm 5.6, nightly version of pytorch for rocm 5.6, etc. I managed to achieve ~7.5-8 iterations/s in stable diffusion with Radeon 6800. It's a really great upgrade when compared to running it on Windows with like ~1.5 iterations/s. I will look forward for any way possible to speed it up even more. Thanks man.

[sajson_]

I was so mad after my 6800XT purchase when I realized I don't have CUDA, xformers and it is slow on Windows. But I realized I have an extra drive so why not dual boot linux and try my luck with ROCM there. It is so sick how fast is it now! Thanks for the video, I need to be super sure I correctly install webui after I jumped from other video about ROCm installation. Thank you!

[TABandiTA]

it was a pain, but i get it worked with 6.2 rocm. nice and helpful video!

[the-real-shoguna]

My savior! I've trying to get it running for hours. The HSA_OVERRIDE was what I was missing. Big thanks

[johannmuller]

Thank you for this guide. I just completed the steps to get my 6800XT running under a fresh Ubuntu. You may want to include a short section or link to getting python set up for users new to Linux. It is my first Linux for anything but a minecraft server in years. And I had to fiddle a little to get that and pip up and running nicely. The speed difference between the machineML version I played with in Windows and the rocm version can only be described by imagining the difference between Impulse drive and Warp drive in star trek. Great Scot, it runs like a demon now.

[plg]

Bro you are the man!!! Thank you so much for the video dude, I was struggling with this shit for hours and finally I managed to use my gpu with SD. Thank you.

[BrockSuire]

I want to put out something about AMD GPU s. AMD is not leaving the high end market. As some have seen all over the internet about AMD to stop making high end GPU s. This is 1000% false. AMD has next Gen cards being validating as we speak. I have a few engineering samples I'm evaluating. Keep dreaming, never let anyone stop you!
😘

[ChAzR]

great video. Any Ideas how much its/s you can get with a 6800xt? There was a benchmark site which I'm apparently to stupid to find again

[jakeblargh]

I heard ROCM is now on Windows. Does this mean we can run Automatic1111 at full speed now on Windows?

[JuanSanchez-rbqu]

Good guide, so how it compares with an nvidia card of similar passmark score like the 3060ti? I know the 12GB is a good extra but most AI apps seem to be made for nvidia hardware.

[muzamilsarfraz]

can u recommend getting RX6800 and 6800xt over 3070 or 3080 for machine learning?

[pixelpirate]

Can you help me. Today I installed linux and i get this error when installing rocm: Errors were encountered while processing:
amdgpu-dkms
E: Sub-process /usr/bin/dpkg returned an error code (1)

[IV-K]

hope you can cover for the training loras in amd as well. thanks

[Niack_silver]

Hi, i followed your guide but got this error :
RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check

If i try to by pass it by using --skip-torch-cuda-test it work but is super slow, looks like it using the cpu instead of GPU ... don't know what to do...

[cheg]

Is there not an equivalent for arch? I can't seem to get amdgpu-install.

[cristhianmartin]

Hello. How did you like that card for these uses? I'm thinking of buying that 6700xt or a 3060 ti to start with but I'm afraid that it won't work very well for these uses. 😅

[Lght]

Hey man 👋, i am honestly not sure about RocM much but is there any way of cuda acceleration being implemented in 6700 XT according to amd its only 6800 and above.

[gohan]

Any idea when AMD cards will run in A1111/vlads in Windows?