Uploaded May 2026 | Updated November 2026, 9 hours ago
Sam explores using Rokoko motion capture playblasts as reference footage for generative AI video tools like SeeDance 2.0, Kling, and Nano Banana 2, tested through aggregators Flashboards and Luma AI.
This is the second video in our AI series, where we combine recorded Rokoko motion capture with generative AI to see how much creative control is actually possible over the final result.
In this video, Sam walks through the exact workflow, both good and bad examples, and the lessons learned along the way, especially when it comes to early prototyping and iterating on creative ideas:
1. Using motion capture as reference footage
Recording a performance lets you render out camera moves and shots that would be difficult or impossible to capture on film, then feed that playblast into generative AI to guide the final result.
2. Testing Flashboards
Sam breaks down the Flashboards workflow, generating reference images and videos from motion capture playblasts, and runs into the limits of prompt engineering: identical prompts can produce wildly different, often unpredictable results.
3. Testing Luma AI
Sam compares Luma AI's chatbot-guided workflow to Flashboards, finding it easier to work with even with less direct control, and shows how natural language feedback can be used to steer regenerations closer to the original motion and camera framing.
4. Key lessons learned
Generation takes time and money, results are inherently unpredictable, and this workflow is best suited for early concept art and pitch iteration rather than final, commercial quality output.
In this video:
00:00 - Intro
01:12 - GenAI and Mocap
02:45 - Digging into the Tools
07:06 - Pitfalls & Limitations of Prompt Engineering
15:06 - Increasing Detail & Trying Prompt-Only Video
19:14 - Testing Alternative Aggregators: Runway vs. Luma AI
30:35 - Final Verdict & Key Lessons Learned
Learn more about Rokoko and stay updated: rokoko.co/4hZ0KRY
Reach us at hi@rokoko.com or the chat on rokoko.com
Join our Discord: discord.gg/XumuGXZ7hs
Official Facebook Page: facebook.com/hellorokoko
IG: instagram.com/hellorokoko
Twitter: twitter.com/hellorokoko
LinkedIn: linkedin.com/company/rokoko
#Rokoko #MotionCapture #GenerativeAI #AIVideo #Mocap #ConceptArt #FlashboardsAI #LumaAI
Sam explores using Rokoko motion capture playblasts as reference footage for generative AI video tools like SeeDance 2.0, Kling, and Nano Banana 2, tested through aggregators Flashboards and Luma AI.
This is the second video in our AI series, where we combine recorded Rokoko motion capture with generative AI to see how much creative control is actually possible over the final result.
In this video, Sam walks through the exact workflow, both good and bad examples, and the lessons learned along the way, especially when it comes to early prototyping and iterating on creative ideas:
1. Using motion capture as reference footage
Recording a performance lets you render out camera moves and shots that would be difficult or impossible to capture on film, then feed that playblast into generative AI to guide the final result.
2. Testing Flashboards
Sam breaks down the Flashboards workflow, generating reference images and videos from motion capture playblasts, and runs into the limits of prompt engineering: identical prompts can produce wildly different, often unpredictable results.
3. Testing Luma AI
Sam compares Luma AI's chatbot-guided workflow to Flashboards, finding it easier to work with even with less direct control, and shows how natural language feedback can be used to steer regenerations closer to the original motion and camera framing.
4. Key lessons learned
Generation takes time and money, results are inherently unpredictable, and this workflow is best suited for early concept art and pitch iteration rather than final, commercial quality output.
In this video:
00:00 - Intro
01:12 - GenAI and Mocap
02:45 - Digging into the Tools
07:06 - Pitfalls & Limitations of Prompt Engineering
15:06 - Increasing Detail & Trying Prompt-Only Video
19:14 - Testing Alternative Aggregators: Runway vs. Luma AI
30:35 - Final Verdict & Key Lessons Learned
Learn more about Rokoko and stay updated: rokoko.co/4hZ0KRY
Reach us at hi@rokoko.com or the chat on rokoko.com
Join our Discord: discord.gg/XumuGXZ7hs
Official Facebook Page: facebook.com/hellorokoko
IG: instagram.com/hellorokoko
Twitter: twitter.com/hellorokoko
LinkedIn: linkedin.com/company/rokoko
#Rokoko #MotionCapture #GenerativeAI #AIVideo #Mocap #ConceptArt #FlashboardsAI #LumaAI










