Claude directs a live TV show (it writes its own rules and logs every cut) @SoftwareMansion
Claude directs a live TV show (it writes its own rules and logs every cut)  @SoftwareMansion
Uploaded October 2026 | Updated November 2026, 4 days ago
An AI director that decides, live, what goes on air, built on Smelter. It sees every camera ~3 s before air, rules give it reflexes, and Claude sits on top.

What's inside:
• AI panel: ask out loud, and Claude Opus and GPT answer in turn as live, lip-synced puppets
• Football from one unmanned panoramic camera in Tromsø, Norway: a virtual camera follows the ball, with replays and a YOLO minimap
• Manhunt: describe the host in plain words and a vision model finds them and follows them from camera to camera
• Hand gestures fire GPU shaders, and if you frame a shot with your fingers it turns grayscale
• Brief Claude like a freelancer: it writes the rules, and every decision is logged in WHY
• Everything composited and broadcast live over WebRTC with Smelter

🔗 Smelter: https://smelter.dev
🔗 Live Demo: https://workshop.smelter.dev
🔗 Project repo: github.com/smelter-labs/smeltest

🎬 Inspired by Dan Jenkins' live AI-directed show at RTC.ON: rtcon.swmansion.com

⚽ Football footage: Alfheim dataset, Simula Research Laboratory (Alfheim Stadium, Tromsø), non-commercial research use: https://datasets.simula.no/alfheim/
Claude directs a live TV show (it writes its own rules and logs every cut)My Webcam is Rendered Inside the Pong ball, and its All One Shader | Smelter Workshop #2Shared Elements Transitions - coming soon #reactnative #reanimatedIgor Furgała & Mikołaj Szydłowski - React Native Enriched - Truly Native Rich Text Editor | RNCK #17Meet KMP Sharing – a Universal Sharing Function for Compose MultiplatformSaúl Ibarra Corretgé | Razvan Purdel - AI assisted transcriptions in Jitsi Meet: our journeyLorenzo Miniero – WebRTC and QUIC: how hard can it be? | RTC.ON 2024React Native Multiplatform: Bringing Apple & Google Photos Clone to TVs & WebBuilding a React Native App for Huawei’s HarmonyOS? 👀Elixirs Membrane framework can now generate your starter code for youOn-Device Image Semantic Search in React Native: Recreating Apple Photos App | SWM React Native LabsApp.js Conf 2026 – Live stream from Day 2
Software Mansion |

Claude directs a live TV show (it writes its own rules and logs every cut)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER