Uploaded August 2026 | Updated September 2026, 2 weeks ago
As LLMs grow in size, context length, and architectural complexity, vLLM must evolve to meet new performance and scalability challenges. This talk presents key improvements in vLLM's core architecture and highlights major optimizations in KV cache management and GPU kernels. Furthermore, this talk covers the latest updates related to vLLM community, large scale serving, and across hardware effort.
Discover more: amd.com/en/corporate/events/advancing-ai/sessions-catalog/vllm-in-2026-challenges-and-optimizations.html
***
Subscribe: bit.ly/Subscribe_to_AMD
Join the AMD Gaming Discord Server: discord.gg/amd-gaming
Visit the AMD Gaming Community Website: amdgaming.com
Like us on Facebook: bit.ly/AMD_on_Facebook
Follow us on Twitter: bit.ly/AMD_On_Twitter
Follow us on Twitch: Twitch.tv/AMD
Follow us on LinkedIn: bit.ly/AMD_on_Linkedin
Follow us on Instagram: bit.ly/AMD_on_Instagram
©2026 Advanced Micro Devices, Inc. AMD, the AMD Arrow Logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and other jurisdictions. Other names are for informational purposes only and may be trademarks of their respective owners.
As LLMs grow in size, context length, and architectural complexity, vLLM must evolve to meet new performance and scalability challenges. This talk presents key improvements in vLLM's core architecture and highlights major optimizations in KV cache management and GPU kernels. Furthermore, this talk covers the latest updates related to vLLM community, large scale serving, and across hardware effort.
Discover more: amd.com/en/corporate/events/advancing-ai/sessions-catalog/vllm-in-2026-challenges-and-optimizations.html
***
Subscribe: bit.ly/Subscribe_to_AMD
Join the AMD Gaming Discord Server: discord.gg/amd-gaming
Visit the AMD Gaming Community Website: amdgaming.com
Like us on Facebook: bit.ly/AMD_on_Facebook
Follow us on Twitter: bit.ly/AMD_On_Twitter
Follow us on Twitch: Twitch.tv/AMD
Follow us on LinkedIn: bit.ly/AMD_on_Linkedin
Follow us on Instagram: bit.ly/AMD_on_Instagram
©2026 Advanced Micro Devices, Inc. AMD, the AMD Arrow Logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and other jurisdictions. Other names are for informational purposes only and may be trademarks of their respective owners.
