Uploaded August 2024 | Updated November 2026, 2 days ago
Join Devang Aggarwal, Senior Product Manager at Qualcomm, as he introduces AI Engine Direct SDK demo.
In this video, Devang showcases how the Qualcomm AI Engine Direct SDK optimizes the Llama 2, a 7 billion parameter model from Hugging Face, to deliver exceptional performance fully on the Qualcomm Hexagon NPU. Watch as he walks us through an end-to-end user interface demo where developers can input text prompts to discover top travel destinations, with real-time, efficient processing powered by the NPU.
For developers eager to dive deeper and use these technologies, Devang also highlights how to access resources through the Windows on Snapdragon portal.
The Qualcomm AI Engine Direct SDK is available for download now: qualcomm.com/developer/software/qualcomm-ai-engine-direct-sdk
See how you can use its unified API and core-specific libraries for running full-stack AI solutions on Snapdragon® processors. And find out more about the entire Qualcomm® AI Stack: qualcomm.com/developer/artificial-intelligence/overview
Learn more about Linaro: linaro.org
Subscribe: More QDN videos: tinyurl.com/2p8xmcw6
Do you have technical questions? Join our developer community at Discord: discord.gg/THUPBtskgs
ABOUT Qualcomm Developer Network (QDN) is a comprehensive program designed to equip the next generation of mobile pioneers to develop what’s next. Our collection of software and hardware tools and resources is designed so you can build upon our foundational technologies in new and innovative ways, creating the power to build products, enrich lives and even transform entire industries. At Qualcomm Developer Network, we aim to help you kickstart your development by being the catalyst for your vision, today, tomorrow, and in the future.
#ai #ondevice #inferencing #cloud
Join Devang Aggarwal, Senior Product Manager at Qualcomm, as he introduces AI Engine Direct SDK demo.
In this video, Devang showcases how the Qualcomm AI Engine Direct SDK optimizes the Llama 2, a 7 billion parameter model from Hugging Face, to deliver exceptional performance fully on the Qualcomm Hexagon NPU. Watch as he walks us through an end-to-end user interface demo where developers can input text prompts to discover top travel destinations, with real-time, efficient processing powered by the NPU.
For developers eager to dive deeper and use these technologies, Devang also highlights how to access resources through the Windows on Snapdragon portal.
The Qualcomm AI Engine Direct SDK is available for download now: qualcomm.com/developer/software/qualcomm-ai-engine-direct-sdk
See how you can use its unified API and core-specific libraries for running full-stack AI solutions on Snapdragon® processors. And find out more about the entire Qualcomm® AI Stack: qualcomm.com/developer/artificial-intelligence/overview
Learn more about Linaro: linaro.org
Subscribe: More QDN videos: tinyurl.com/2p8xmcw6
Do you have technical questions? Join our developer community at Discord: discord.gg/THUPBtskgs
ABOUT Qualcomm Developer Network (QDN) is a comprehensive program designed to equip the next generation of mobile pioneers to develop what’s next. Our collection of software and hardware tools and resources is designed so you can build upon our foundational technologies in new and innovative ways, creating the power to build products, enrich lives and even transform entire industries. At Qualcomm Developer Network, we aim to help you kickstart your development by being the catalyst for your vision, today, tomorrow, and in the future.
#ai #ondevice #inferencing #cloud










