Uploaded April 2021 | Updated November 2026, 9 hours ago
Videos are so much cooler when they're synced up to music! And if you really wanna blow some minds you can use AI to generate the source video! 🤯
In this hands-on workshop, you'll learn how to make AI-generated videos in RunwayML https://runwayml.com, and also how to bring them into TouchDesigner derivative.ca to make them audio-reactive.
At the end of this workshop, you'll have:
* made your own AI-generated video that is synced up to a music track of your choice.
* learned how to build your own beat detector from scratch in TouchDesigner. This way, you can sync up any video to any audio track.
* learned a bit of machine learning in RunwayML along the way.
No prior experience necessary.
Make an account on RunwayML https://runwayml.com., and bring an .mp3 if you want to follow along!
Lia Coleman is an AI artist and educator. She makes art with AI and teaches others how to do it. You can find her on the internet at liacoleman.com
Workshop notes:
babycastles.github.io/Babycastles-Academy/workshops/audio_reactive_AI.html
Slides: docs.google.com/presentation/d/1cV0wFDm6t47Cgh37UO5u_nWuwvRmf6DQkmJxLdmZvd4/edit?usp=sharing -- Watch live at twitch.tv/babycastles
This program is supported, in part, by public funds from the New York City Department of Cultural Affairs in partnership with the City Council. And by Babycastles members. Thank you.
Videos are so much cooler when they're synced up to music! And if you really wanna blow some minds you can use AI to generate the source video! 🤯
In this hands-on workshop, you'll learn how to make AI-generated videos in RunwayML https://runwayml.com, and also how to bring them into TouchDesigner derivative.ca to make them audio-reactive.
At the end of this workshop, you'll have:
* made your own AI-generated video that is synced up to a music track of your choice.
* learned how to build your own beat detector from scratch in TouchDesigner. This way, you can sync up any video to any audio track.
* learned a bit of machine learning in RunwayML along the way.
No prior experience necessary.
Make an account on RunwayML https://runwayml.com., and bring an .mp3 if you want to follow along!
Lia Coleman is an AI artist and educator. She makes art with AI and teaches others how to do it. You can find her on the internet at liacoleman.com
Workshop notes:
babycastles.github.io/Babycastles-Academy/workshops/audio_reactive_AI.html
Slides: docs.google.com/presentation/d/1cV0wFDm6t47Cgh37UO5u_nWuwvRmf6DQkmJxLdmZvd4/edit?usp=sharing -- Watch live at twitch.tv/babycastles
This program is supported, in part, by public funds from the New York City Department of Cultural Affairs in partnership with the City Council. And by Babycastles members. Thank you.










