Projection mapping - Diffusion Tools for Unreal

An progress report on an experimental projection mapping feature I'm adding to my Stable Diffusion tools for Unreal Engine plugin.

The scene geometry is used to create an AI-generated image using Stable Diffusion and ControlNet, and the resulting texture is then baked back onto the scene geometry. I'm using baked textures instead of decal projectors as the end goal of this feature is to fill in the occluded parts of the texture that would normally be hidden with more images generated from different angles. The texture seams created from multiple images can then potentially be "healed" using img2img and inpainting.