PsyGan AR | World Scale AI Projection Mapping with Spark AR

In this weekend experiment, I explored projection mapping #AI generated imagery in my apartment through #AR.

The process involved first using an #iPhone12 to #LiDAR the room, and then using the scan as a dimensional guide to 3D model the low-poly proxy geometry.

I then created an #arfilter inside of #SparkARStudio which I could use to align the geometry over the real world.

I used #Cinema4D to bake out 9 different camera angles of the AO pass, processed them through #VQGAN #CLIP, and reprojected them back at their original location.

To translate these projections into AR, I baked them all on the same UV set. In Spark, I created proximity logic to ensure the textures would interpolate as the user approached one of the locations. To maintain quality with Spark’s 1024x texture resolution limit, I divided the UVs into 2 groups - the walls and the room props.

I’m excited to see what the future holds as AR and Text-to-Image AI becomes increasingly powerful.

#sparkar #vqganclip #aiart #neuralnetwork #filter #facebook #instagram #igfilter #experimental #rnd #gallery #psygan