Combining the Depth API and Stable Diffusion @grae_n
Combining the Depth API and Stable Diffusion  @grae_n
Uploaded November 2022 | Updated September 2026, 3 weeks ago
Here we are using websockets to use stable diffusion live while in an AR scene. This ends up being a little challenging because camera access is limited while in webxr.

Timestamps
0:00 Intro
1:05 Steampunk
1:59 Summer and Gothic
2:50 Code Discussion
4:13 Trying yourself

Code*:
stable diffusion websocket script (this code is a little buggy):
github.com/graemeniedermayer/ArExperiments/blob/main/python/websocket-client/stableDiffusionClient.py
webxr JavaScript:
github.com/graemeniedermayer/ArExperiments/blob/main/javascript/websockets/stableClient.js
django channel routing
github.com/graemeniedermayer/ArExperiments/tree/main/python/django/stableDiffusion

* There are some very big issues with this code notably sending images through json and the websocket-client code is questionable.
Combining the Depth API and Stable DiffusionInpainting in Augmented RealityUsing AI art to create game environments.3d to 3d ai art with stable diffusion and NeRFs.Re-texturing Photogrammetry with Stable DiffusionDepth Occlusion in Augmented Reality (Javascript Tutorial)A floating hydrogen atom.Light Estimation in Augmented Reality
Grae n |

Combining the Depth API and Stable Diffusion

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER