Qualcomm AI Hub Tutorial 4: Target a specific runtime @QualcommDeveloper
Qualcomm AI Hub Tutorial 4: Target a specific runtime  @QualcommDeveloper
Uploaded October 2024 | Updated November 2026, 3 hours ago
n this tutorial, we'll guide you through targeting a specific runtime for compiling your ML model and submitting a compile job on Qualcomm AI Hub. Let's dive right in!

Targeting a Specific Runtime:

Runtime Options:

Review the three runtime options available: Qualcomm AI Engine Direct, TensorFlow Lite, and ONNX Runtime.

Qualcomm AI Hub allows you to specify a target runtime for deploying your model. By default, it uses the target runtime based on the source model.

Specify Runtime in Compile Options:

Pass one of these runtime options as a compile option when submitting your job to Qualcomm AI Hub.

Set Up Your Environment:

Open your Google Colab notebook, which is already set up to launch jobs to Qualcomm AI Hub.

For this example, we'll use MobileNet, pre-trained by torchvision and available on our getting started page.

Load and Trace the Model:

Load the pre-trained MobileNet model and trace it.

Specify the input shapes and name it mobile_net_pt_model.

Submit the Compilation Job:

For the first job, don't specify the runtime but target a device, such as the Samsung Galaxy S24 powered by Snapdragon.

Submit the compilation job.

Specify Runtime for the Next Job:

Use the same model and select Qualcomm AI Engine Direct as the runtime for the next compilation job.

Add the target runtime function as an option.

View Compilation Job:

Check the compilation job with the runtime option added.

Go to Qualcomm AI Hub to see your jobs.

Verify that the option for Qualcomm AI Engine Direct as the runtime is displayed and that you have a .so file ready to run on Qualcomm AI Engine Direct.

That's it! Specifying a specific runtime on Qualcomm AI Hub using compile options is straightforward. Try this out on your own, and if you encounter any issues or have questions, join our Qualcomm AI Hub Community on Slack: join.slack.com/t/qualcomm-ai-hub/shared_invite/zt-2qv4i2g2c-2gOlnYJVJk_5Z~lGAcVFqg

Stay tuned for more videos in this series!

Subscribe: More QDN videos: tinyurl.com/2p8xmcw6

Join our developer community at Discord: discord.gg/THUPBtskgs

ABOUT Qualcomm Developer Network (QDN) is a comprehensive program designed to equip the next generation of mobile pioneers to develop what’s next. Our collection of software and hardware tools and resources is designed so you can build upon our foundational technologies in new and innovative ways, creating the power to build products, enrich lives and even transform entire industries. At Qualcomm Developer Network, we aim to help you kickstart your development by being the catalyst for your vision, today, tomorrow, and in the future.

#QualcommAIHub #OnDeviceAI #DeveloperTips #AIModelDeployment
Qualcomm AI Hub Tutorial 4: Target a specific runtimeConstellation with Sascha Segan: Snapdragon Summit unpackedQualcomm AI Hub demo at Microsoft Build 2024AI Model Efficiency Toolkit (AIMET) AdaRound DemoBuild a smart doorbell with UNO Q 🔔Real-Time American Sign Language Translation demo with Sigma Connectivity at Embedded World 2025Hello World AI application Quick Start guide with Qualcomm Intelligent Media SDKWhats New: Qualcomm Linux 2.0: A Unified Platform for Dragonwing IoTUE5 on Mobile at Scale: Turbocharging Neverness to Everness on SnapdragonOn‑Device AI Speech Recognition for Games: Honor of Kings on SnapdragonMeet and Greet: developer evangelist Rajan Mistry and RB3 Gen 2 demoNative vs Emulated Performance on Windows on Snapdragon: Kingdom Come: Deliverance II
Qualcomm Developer |

Qualcomm AI Hub Tutorial 4: Target a specific runtime

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER