Easy Stable Diffusion Unity Integration package

A basic but functional Unity Editor package for image generation using Stable Diffusion Automatic 1111 WebUI from within the Unity Editor.

Stable Diffusion Unity Integration:

If you like the tool, buy me a coffee!

Install Stable Diffusion Automatic 1111:
How to install quick guide:

Download popular Stable Diffusion Models:

Note: Tested with Unity versions 2019, 2020, and 2021. Works with Built-in renderer and URP only. No HDRP support yet. Feel free to contribute on github.

Please let me know how you are using it in your own project.

Happy diffusing!

[salartahrirchi]

this is amazing man! keep up the good work 👌

[web._metaverse_XR]

Can you create similar tutorial for image2image?

[rlhdizc]

The plugin works, but for some reason after generating the image in A1111, in Unity (2021.3.16) the "generation in progress" window hangs for a very long time (about 30-40 seconds) with 0.01% before disappearing and replacing the image in the scene.
Everything is fine in 2020.

[hamazing]

are there ways to include extensions of A1111 in unity? I want to use agent scheduler by ArtVenture in unity for a project

[kathrintarneva]

Hi, awesome video but i wanted to ask if you changed any of the settings when you were installing the automatic1111 because i get 404 error that the server returned.. any idea how i can fix it? thank you in advance!

[thFaust]

i had to add the unity package for newtonsoft json manually, but works for me using 2022.2.11. :-)

[chucktobbes]

hi, why do i have to skip a frame manually (unity editor) in runtime when the model is loaded and the image is generated on my web UI?

[matebarkoczi]

thanks for the video! what kind of graphic card are u using? I have gtx 1660 and it's critically slow, basically the unity cannot wait for the import :(

[mozl]

Hi there, great video! the links in the description dont seem to work tho

[RCZY_OFFICIAL]

Is it possible to change this in game??? I get it will be slow but it is possible???