Machine Learning Audio Plug-ins with iPlug2 and ONNX Runtime | Oli Larkin (Ableton) @TheAudioProgrammer
Machine Learning Audio Plug-ins with iPlug2 and ONNX Runtime | Oli Larkin (Ableton)  @TheAudioProgrammer
Uploaded April 2023 | Updated September 2026, 3 weeks ago
"Oli Larkin is the lead developer of the iPlug2 plug-in framework and a software engineer at Ableton. Oli will introduce the latest iPlug2 developments and show how it can be used with Microsoft’s Onnx runtime to perform inference on models exported from ML frameworks such as Tensorflow or PyTorch."

- Oli's Abstract

——

Links:

iPlug2 ONNX GitHub: github.com/olilarkin/iPlug2OnnxRuntime
iPlug2 GitHub: iplug2.github.io
ONNX: onnx.ai + onnxruntime.ai
Twitter: twitter.com/olilarkin

Plug-in examples:
e-phonic.com/invader.html#
youlean.co
fullbucket.de/music/vst.html
hornetplugins.com
github.com/AlexHarker/HISSTools_Granular

Neural Amp Modeler:
github.com/sdatkinson/neural-amp-modeler
github.com/sdatkinson/NeuralAmpModelerPlugin
github.com/pelennor2170/NAM_models
github.com/GuitarML

Miscellaneous:
github.com/jatinchowdhury18/RTNeural
github.com/Dobiasd/frugally-deep
github.com/serizba/cppflow
pytorch.org/cppdocs/installing.html
tensorflow.org/install/lang_c
tensorflow.org/lite

——

0:00 Intro
1:57 Overview of iPlug
5:38 Example plugins
12:55 Machine learning workflow
15:30 Inference engine
22:38 iPlug ONNX runtime
31:11 End of presentation
32:32 Q&A
43:38 Outro

——

Inclusion is at the core of our meetups, and we follow the Berlin Code of Conduct. For more information, please read more here berlincodeofconduct.org

Join the Audio Programmer Discord Group: theaudioprogrammer.com/community

See our past meetups here:
youtube.com/watch?v=JCNyd1KGjMk&list=PLLgJJsrdwhPzp0yWZNMu4-VHktZr3a1KP

Support the channel: patreon.com/theaudioprogrammer

Website: theaudioprogrammer.com
Instagram: instagram.com/theaudioprogrammer
Facebook: facebook.com/theaudioprogrammer
Twitter: twitter.com/theaudioprogrammer
Machine Learning Audio Plug-ins with iPlug2 and ONNX Runtime | Oli Larkin (Ableton)Audio Programmer Virtual Meetup - Aug 8 at 1830 UKThe problem with half-band filters in audioBook Walkthrough!  Creating Synth Plug-Ins with C++ and JUCE (Matthijs Hollemans)Neural Audio Plugin Competition | Livestream #5 | March 24th @ 17:00 UKThe Audio Programmer Virtual Meetup (Nov 7, 2023 at 18:30 UK)ChowDSP Coding Livestream #7 (Hot Cakes!)36 - Inside Google & Samsungs Open Source Spatial Audio Project || Eclipsa AudioHow are plugin companies cutting through the market?How to Make Your First VST Plugin | #04: Making Your First Sound in JUCE!Musics relationship with DSP35 - How to Sell Your Audio Plugins || Tobias Madsen (Moonbase)
The Audio Programmer |

Machine Learning Audio Plug-ins with iPlug2 and ONNX Runtime | Oli Larkin (Ableton)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER