AI attempts to make pop music based on speech-to-text audio @zachwhalen
AI attempts to make pop music based on speech-to-text audio  @zachwhalen
Uploaded October 2020 | Updated November 2026, 3 hours ago
I trained OpenAI's "Jukebox" model on a 2-second clip of speech-to-text audio counting to 5, and I asked for 60 seconds of pop music based on that clip.This video contains 8 attempts.


Some highlights:
0:37 - demon voice
0:45 - the gates open leaking darkness from the void
2:24 - a haunting ballad plays softly in the distance
2:30 - drum fill
3:27 - power pop chorus
3:50 - guitar solo
5:12 - mirror universe dream pop bossa nova
5:59 - recorder solo
6:19 - "HI!"
6:42 - demon voice returns
7:39 - applause
7:40 - shouty folk rock in a crowded room
AI attempts to make pop music based on speech-to-text audioDGST 101. Week 5, Day 1How to Talk About Electronic Literature (Electronic Literature Class, 1/29/21)Introductions (Applied Digital Studies, Section 1, 1/24/21)Digital Studies 101: Practicing Digital MethodologiesJust Testing Multi StreamingThe 2023 Republican Presidential Debate But None of the WordsApplied Digital Studies, Section 1, Artificial Intelligences, (9/14/20)Games and Play (Games and Culture, 1/19/21)Graphic Novel Class, Introducing Watchmen (9/21/20)Reporting and Mapping the Time in p5.js (DGST 302: Week 3, Day 4)Graphic Novel Class, Watchmen Chapter V (9/28/20)
zach whalen |

AI attempts to make "pop" music based on speech-to-text audio

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER