Uploaded August 2023 | Updated November 2026, 2 hours ago
I'm using #Musikraken app here running on my iPhone to track both color and speed of the marbles. Each color is set to play a different range of octaves (e.g. blue marble is playing C3-C5, orange one C2-C4), while the speed determines the pitch of the triggered note. The note trigger happens when a certain speed threshold is passed, both in positive and negative direction. So a note gets triggered both when a marble accelerates AND stops quickly. When no or little movement is recognized, no notes are played. The nature of camera tracking is that it's always a bit tricky to set up and get a clear separation of events. So there's also a certain fuzziness going on here, for example I overlooked that my hand and shirt color could trigger the orange trigger ;) But ultimately, I like this bit of unpredictability in the game, which can spark some surprising events.
All notes are sent to a nearby iPad over BLE and plays Zeeon synth and Pure Piano, while the notes are also live quantized to a 1/4 grid with a mozaic script, resulting in a bit more structured outcome..
.
.
.
MORE:
INSTAGRAM: instagram.com/perplex_on
FACEBOOK: facebook.com/perplexon
SOUNDCLOUD: soundcloud.com/perplex-on
X: https://x.com/PerplexOn
I'm using #Musikraken app here running on my iPhone to track both color and speed of the marbles. Each color is set to play a different range of octaves (e.g. blue marble is playing C3-C5, orange one C2-C4), while the speed determines the pitch of the triggered note. The note trigger happens when a certain speed threshold is passed, both in positive and negative direction. So a note gets triggered both when a marble accelerates AND stops quickly. When no or little movement is recognized, no notes are played. The nature of camera tracking is that it's always a bit tricky to set up and get a clear separation of events. So there's also a certain fuzziness going on here, for example I overlooked that my hand and shirt color could trigger the orange trigger ;) But ultimately, I like this bit of unpredictability in the game, which can spark some surprising events.
All notes are sent to a nearby iPad over BLE and plays Zeeon synth and Pure Piano, while the notes are also live quantized to a 1/4 grid with a mozaic script, resulting in a bit more structured outcome..
.
.
.
MORE:
INSTAGRAM: instagram.com/perplex_on
FACEBOOK: facebook.com/perplexon
SOUNDCLOUD: soundcloud.com/perplex-on
X: https://x.com/PerplexOn










