harishanand95

Stable Diffusion optimized for AMD RDNA2 GPUs using IREE->Vulkan

This guide is meant for developers who want to experiment with the IREE/MLIR toolchain to compile Vulkan code. A more streamlined installation procedure (that uses precompiled .vmfb files optimized for various GPUs) would be possible, but in the interest of time, we’re sharing here instructions meant for developers.

Install the latest AMD Drivers

AMD Software: Adrenalin Edition 22.11.1 for MLIR/IREE Driver Version 22.20.29.09 for Windows® 10 and Windows® 11 (Windows Driver Store Version 31.0.12029.9003)

https://www.amd.com/en/support/kb/release-notes/rn-rad-win-22-11-1-mril-iree

averad

🤗 Stable Diffusion for AMD GPUs on Windows using DirectML

• Requirements
• Installation
• Scripts / Examples
• Convert Stable Diffusion Model(s) to ONNX format
• Additional Tools (Optional)
• FAQs

Requirements

harishanand95

Stable Diffusion for AMD GPUs on Windows using DirectML

UPDATE: A faster (20x) approach for running Stable Diffusion using MLIR/Vulkan/IREE is available on Windows:

https://github.com/nod-ai/SHARK/blob/main/shark/examples/shark_inference/stable_diffusion/stable_diffusion_amd.md

Install 🤗 diffusers

conda create --name sd39 python=3.9 -y