Tutorial: Controlling Stable Diffusion With Houdini and Automatic1111 WebUI @Entagma

Uploaded March 2023 | Updated September 2026, 2 weeks ago

Support us on Patreon: patreon.com/entagma

Of course Mo could take the high road and build a stable diffusion pipeline using Huggingface’s Diffusers library… But let’s not kid ourselves. Thanks to Automatic1111’s API Mo can duct tape together Houdini and WebUI to use both of these awe inspiring powerful tools to generate… dog images. Welcome to the brave new world that is design!

Download Project File: entagma.com/downloads/SD_txt2img_003a.hip

00:00 - Intro
00:50 - Setting up Automatic1111 WebUI's API
01:49 - Houdini Basic Scene Setup
03:10 - Python Imports & Writing Images To Volumes
08:07 - Main Routine: Controlling WebUI With Python
13:25 - Extracting Our Data From WebUI
15:38 - Moving The Data To Compositing

Tutorial: Controlling Stable Diffusion With Houdini and Automatic1111 WebUI

Smooth your animations with this simple trick!

$Procedural refracting & reflecting Lasers$

Free Houdini Tutorial: Melting Complex Objects Part 2: Rendering in Karma

Vellum 201: Ep 02 - Mastering Substeps, Constraint-, Smoothing- & Collision-Iterations

Free Blender Tutorial: Playing with Geometry Nodes - Alien Worm

$KarmaXPU Quickstart Pt.4: Excursion - Visualizing Lipid Membranes Download Scene File: https://www.entagma.com/downloads/membrane_lipids_01.zip Notes: - Instead of using the pointVOP/quaternion method to rotate lipids, you could also use the scatter & align method described here: https://youtu.be/tCijuuNIRrs - Im recommending to stay away from refractive materials in rendering. This is due to the fact of this particular group of students having limited rendering resources. If however you have those resources, go wild! Mo had the pleasure of joining Dr. Jeroen Claus of http://www.phospho.co.uk, teaching a visualization workshop to students at university of Maastricht. The topics covered were protein and lipid membrane rendering in Houdini using KarmaXPU. Also check out our Protein rendering in KarmaXPU tutorial here: https://youtu.be/_UTWthfQOmk For more visualization goodness, have a look at our other protein viz tutorial here: https://www.youtube.com/watch?v=M3ldQBVb-ZA 00:00 - Intro 00:32 - Creating Lipid Pair 04:50 - Creating Undulating Points 11:34 - Copying Lipid Pairs Onto Surface 15:37 - Adding Pores 16:25 - Geometry Tweaks 17:09 - Rendering: Building Scene Tree 18:11 - Camera & Light Setup 19:00 - Lipid Tweaks 19:50 - Setting Up Lipid Material 21:37 - Setting Up Pores Material 22:27 - Karma Settings & Light Adjustments 23:15 - Setting Up Depth of Field 24:23 - Final Karma Tweaks & Rendering 25:20 - Infamous Last Words$