Uploaded October 2025 | Updated November 2026, 1 day ago
NVIDIA has released a new update to the vLLM inference engine with performance gains for generative AI. This is a software update, that is better optimized (FlashInfer support, Xformers integration, and other optimizations) for the Jetson Thor.
---
β Please support my channel on Patreon!
Get early access to videos, members-only content, behind-the-scenes updates, and join the Gary Explains Discord! Join here π patreon.com/GaryExplains π
Twitter: twitter.com/garyexplains
Instagram: instagram.com/garyexplains
#garyexplains
NVIDIA has released a new update to the vLLM inference engine with performance gains for generative AI. This is a software update, that is better optimized (FlashInfer support, Xformers integration, and other optimizations) for the Jetson Thor.
---
β Please support my channel on Patreon!
Get early access to videos, members-only content, behind-the-scenes updates, and join the Gary Explains Discord! Join here π patreon.com/GaryExplains π
Twitter: twitter.com/garyexplains
Instagram: instagram.com/garyexplains
#garyexplains










