Uploaded March 2020 | Updated November 2026, 2 days ago
Fully voice (pitch) control Super Mario Bros. , a complete new challenge (extremely hard).
Inspired by Kosmic, who played SMB with his feet, I attempt to go further, playing SMB with no hand nor foot, but with my voice only.
The method I use it through pitch detection with Waves Tune Real-Time, and using AutoHotKey to read note information from the screen.
I set 13 notes, from A2 to G4, combining them with key inputs, listed on the screen. For example, when I sing B3, corresponding → + B, Mario runs to the right.
It's difficult in mostly two ways:
1. Not being intuitive. It's easy to sing the wrong note. This can be improved through practice. It's better to have perfect pitch or excellent musical skills.
2. Input delay. The PixelGetColor function in AutoHotKey is slow. The delay between me singing and key inputs makes gaming uncomfortable, and it also makes it incredibly hard to do precise jumps.
This first episode is a demo. Not much practice beforehand. I left some death montage uncut to show you how hard it is.
To beat World 8, I really have to practice a lot, and come up with safer strats.
Please like and comment if you like this idea. Hopefully I'll beat SMB with my voice one day.
Sorry for the bad audio quality. It will be improved next time.
Please contact me if you know how to use any advanced technique to reduce the delay. Thanks.
Fully voice (pitch) control Super Mario Bros. , a complete new challenge (extremely hard).
Inspired by Kosmic, who played SMB with his feet, I attempt to go further, playing SMB with no hand nor foot, but with my voice only.
The method I use it through pitch detection with Waves Tune Real-Time, and using AutoHotKey to read note information from the screen.
I set 13 notes, from A2 to G4, combining them with key inputs, listed on the screen. For example, when I sing B3, corresponding → + B, Mario runs to the right.
It's difficult in mostly two ways:
1. Not being intuitive. It's easy to sing the wrong note. This can be improved through practice. It's better to have perfect pitch or excellent musical skills.
2. Input delay. The PixelGetColor function in AutoHotKey is slow. The delay between me singing and key inputs makes gaming uncomfortable, and it also makes it incredibly hard to do precise jumps.
This first episode is a demo. Not much practice beforehand. I left some death montage uncut to show you how hard it is.
To beat World 8, I really have to practice a lot, and come up with safer strats.
Please like and comment if you like this idea. Hopefully I'll beat SMB with my voice one day.
Sorry for the bad audio quality. It will be improved next time.
Please contact me if you know how to use any advanced technique to reduce the delay. Thanks.










