Uploaded July 2026 | Updated September 2026, 1 day ago
In this Griptape Experiments showcase, we explore an AI-driven workflow designed for rapid lighting iteration—allowing artists to test and review new lighting setups in motion without needing to build them in a DCC or wait for full sequence renders.
The iterative loop begins with a single rendered frame and a target lighting reference image. By passing these into an image generation model, the frame is dynamically relit while strictly preserving the character, clothing, and environment. To push accuracy even further, a Describe Image node extracts text descriptions from the lighting references, merging them into the prompt for greater control.
Once the new lighting style is dialed in on the still frame, it is fed into the Kling Omni video model alongside a 3D playblast. This translates the relit frame into a full-motion shot, using the playblast to guide character animation and facial expressions. Finally, a custom Python side-by-side node is used to compare the generated video against the original animation—creating a lightning-fast pipeline to review creative lighting decisions before committing to final pixel renders.
00:00 - Generating shots with Kling Omni
00:40 - Prompting for facial expression accuracy
01:31 - Building a custom side-by-side comparison node
02:07 - Relighting frames using image generation models
03:11 - Generating the relit video sequence
03:57 - Using the Describe Image node for lighting accuracy
04:56 - Rapid lighting iteration and review use cases
🔗 Helpful Links:
▶️ Installing Griptape Nodes: youtube.com/watch?v=riPqmSokTGo
⚙️ How to Install Additional Node Libraries: youtube.com/watch?v=29gJpg4LFN8
🤔 Why Griptape? Learn more here: foundry.com/products/griptape
💬 Join the Griptape Discord Community: discord.com/invite/griptape
Follow Foundry:
instagram.com/foundryteam
linkedin.com/company/foundryteam
Go behind the scenes with the artists, studios, and tech shaping the future of VFX and animation: foundry.com/insights
About Us:
Foundry creates award-winning creative software so global studios can turn incredible ideas into reality.
Subscribe to our channel and get the latest news, tutorials, webinars and updates from the Foundry team.
In this Griptape Experiments showcase, we explore an AI-driven workflow designed for rapid lighting iteration—allowing artists to test and review new lighting setups in motion without needing to build them in a DCC or wait for full sequence renders.
The iterative loop begins with a single rendered frame and a target lighting reference image. By passing these into an image generation model, the frame is dynamically relit while strictly preserving the character, clothing, and environment. To push accuracy even further, a Describe Image node extracts text descriptions from the lighting references, merging them into the prompt for greater control.
Once the new lighting style is dialed in on the still frame, it is fed into the Kling Omni video model alongside a 3D playblast. This translates the relit frame into a full-motion shot, using the playblast to guide character animation and facial expressions. Finally, a custom Python side-by-side node is used to compare the generated video against the original animation—creating a lightning-fast pipeline to review creative lighting decisions before committing to final pixel renders.
00:00 - Generating shots with Kling Omni
00:40 - Prompting for facial expression accuracy
01:31 - Building a custom side-by-side comparison node
02:07 - Relighting frames using image generation models
03:11 - Generating the relit video sequence
03:57 - Using the Describe Image node for lighting accuracy
04:56 - Rapid lighting iteration and review use cases
🔗 Helpful Links:
▶️ Installing Griptape Nodes: youtube.com/watch?v=riPqmSokTGo
⚙️ How to Install Additional Node Libraries: youtube.com/watch?v=29gJpg4LFN8
🤔 Why Griptape? Learn more here: foundry.com/products/griptape
💬 Join the Griptape Discord Community: discord.com/invite/griptape
Follow Foundry:
instagram.com/foundryteam
linkedin.com/company/foundryteam
Go behind the scenes with the artists, studios, and tech shaping the future of VFX and animation: foundry.com/insights
About Us:
Foundry creates award-winning creative software so global studios can turn incredible ideas into reality.
Subscribe to our channel and get the latest news, tutorials, webinars and updates from the Foundry team.
