Uploaded June 2026 | Updated September 2026, 2 weeks ago
In collaboration with @MontereyBayAquarium we built a generative music experiment where moon jellies controlled music made by Lyria 3, serving as the opening act at Google I/O!
The jellies were live streamed from their home at the Monterey Bay Aquarium. They were then tracked by a lightweight object detection model, running on Google’s tiny, low powered Coral NPU housed on a Synaptics Coralboard.
The Coralboard sent the jellies’ coordinates to our music generation engine. Each quadrant of the screen represented an instrument: drums, bass, chords or melody. The number of jellies in each quadrant determined the weighting of the Lyria 3 Pro generated music.
While it was technology that translated the jellies' movement into sound, the real magic came from the animals themselves.
#Lyria3 #GoogleIO #GoogleGemini
In collaboration with @MontereyBayAquarium we built a generative music experiment where moon jellies controlled music made by Lyria 3, serving as the opening act at Google I/O!
The jellies were live streamed from their home at the Monterey Bay Aquarium. They were then tracked by a lightweight object detection model, running on Google’s tiny, low powered Coral NPU housed on a Synaptics Coralboard.
The Coralboard sent the jellies’ coordinates to our music generation engine. Each quadrant of the screen represented an instrument: drums, bass, chords or melody. The number of jellies in each quadrant determined the weighting of the Lyria 3 Pro generated music.
While it was technology that translated the jellies' movement into sound, the real magic came from the animals themselves.
#Lyria3 #GoogleIO #GoogleGemini
