Uploaded October 2024 | Updated September 2026, 2 weeks ago
I've built an interactive experience based on a real drums tab.
Recently I started doing drums lessons, so I decided to integrate my new hobby with my professional work.
I connected my @rolandglobal TD-07 DMK electric drums into @UnrealEngine 5.5 Preview with the help of MIDI plugins.
I'm also experimenting the new MegaLights feature. My scene has 258 Ray Traced lights.
It's running in real-time with a @nvidiabrasil RTX 3090 24GB + @NVIDIA-Studio driver.
About two years ago I saw a MIDI tutorial from @JonathanWinbush so it opened my head to new possibilities. I immediately started playing with my MIDI controller keyboard and exchanged some messages and videos with Winbush.
So now I wanted to give it a try with my drums.
Thank you so much Winbush, you are a truly inspiration!
Creative process:
I created multiple Pawns and Triggers in UE5.
We can use a Pawn to start a specific action when it hits a Trigger.
Imagine your character is walking from point A to point B. When he arrives at point B, a magical portal appears.
So for example, when I hit the Snare, a Pawn "walks" into a Trigger and then a level sequence starts playing some niagara particles.
I also mapped all MIDI channel IDs, so a new neon note appears on every hit.
I used @MoisesAI to extract all instruments and voice, so I could isolate the original drums and play on top of it.
To my teacher Astor Rocha, my girlfriend Josi Goetze and my parents Mariza and Roque, thank you for all the support and encouragement.
I had so much fun and learned a lot with this project!
Music: Enter Sandman by Metallica
#interactivedrums #megalights #ue5 #urealengine5 #realtime #roland #electronicdrums #td07 #midi #ai #moisesai
I've built an interactive experience based on a real drums tab.
Recently I started doing drums lessons, so I decided to integrate my new hobby with my professional work.
I connected my @rolandglobal TD-07 DMK electric drums into @UnrealEngine 5.5 Preview with the help of MIDI plugins.
I'm also experimenting the new MegaLights feature. My scene has 258 Ray Traced lights.
It's running in real-time with a @nvidiabrasil RTX 3090 24GB + @NVIDIA-Studio driver.
About two years ago I saw a MIDI tutorial from @JonathanWinbush so it opened my head to new possibilities. I immediately started playing with my MIDI controller keyboard and exchanged some messages and videos with Winbush.
So now I wanted to give it a try with my drums.
Thank you so much Winbush, you are a truly inspiration!
Creative process:
I created multiple Pawns and Triggers in UE5.
We can use a Pawn to start a specific action when it hits a Trigger.
Imagine your character is walking from point A to point B. When he arrives at point B, a magical portal appears.
So for example, when I hit the Snare, a Pawn "walks" into a Trigger and then a level sequence starts playing some niagara particles.
I also mapped all MIDI channel IDs, so a new neon note appears on every hit.
I used @MoisesAI to extract all instruments and voice, so I could isolate the original drums and play on top of it.
To my teacher Astor Rocha, my girlfriend Josi Goetze and my parents Mariza and Roque, thank you for all the support and encouragement.
I had so much fun and learned a lot with this project!
Music: Enter Sandman by Metallica
#interactivedrums #megalights #ue5 #urealengine5 #realtime #roland #electronicdrums #td07 #midi #ai #moisesai
