Uploaded October 2026 | Updated November 2026, 4 days ago
An AI director that decides, live, what goes on air, built on Smelter. It sees every camera ~3 s before air, rules give it reflexes, and Claude sits on top.
What's inside:
• AI panel: ask out loud, and Claude Opus and GPT answer in turn as live, lip-synced puppets
• Football from one unmanned panoramic camera in Tromsø, Norway: a virtual camera follows the ball, with replays and a YOLO minimap
• Manhunt: describe the host in plain words and a vision model finds them and follows them from camera to camera
• Hand gestures fire GPU shaders, and if you frame a shot with your fingers it turns grayscale
• Brief Claude like a freelancer: it writes the rules, and every decision is logged in WHY
• Everything composited and broadcast live over WebRTC with Smelter
🔗 Smelter: https://smelter.dev
🔗 Live Demo: https://workshop.smelter.dev
🔗 Project repo: github.com/smelter-labs/smeltest
🎬 Inspired by Dan Jenkins' live AI-directed show at RTC.ON: rtcon.swmansion.com
⚽ Football footage: Alfheim dataset, Simula Research Laboratory (Alfheim Stadium, Tromsø), non-commercial research use: https://datasets.simula.no/alfheim/
An AI director that decides, live, what goes on air, built on Smelter. It sees every camera ~3 s before air, rules give it reflexes, and Claude sits on top.
What's inside:
• AI panel: ask out loud, and Claude Opus and GPT answer in turn as live, lip-synced puppets
• Football from one unmanned panoramic camera in Tromsø, Norway: a virtual camera follows the ball, with replays and a YOLO minimap
• Manhunt: describe the host in plain words and a vision model finds them and follows them from camera to camera
• Hand gestures fire GPU shaders, and if you frame a shot with your fingers it turns grayscale
• Brief Claude like a freelancer: it writes the rules, and every decision is logged in WHY
• Everything composited and broadcast live over WebRTC with Smelter
🔗 Smelter: https://smelter.dev
🔗 Live Demo: https://workshop.smelter.dev
🔗 Project repo: github.com/smelter-labs/smeltest
🎬 Inspired by Dan Jenkins' live AI-directed show at RTC.ON: rtcon.swmansion.com
⚽ Football footage: Alfheim dataset, Simula Research Laboratory (Alfheim Stadium, Tromsø), non-commercial research use: https://datasets.simula.no/alfheim/










