NVIDIA and vLLM Full-Stack Collaboration for DeepSeek and MiniMax Performance | Ray Summit 2026 @anyscale
NVIDIA and vLLM Full-Stack Collaboration for DeepSeek and MiniMax Performance | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 1 hour ago
NVIDIA and the vLLM community collaborated to deliver record-setting DeepSeek and MiniMax performance in the SemiAnalysis InferenceX benchmark.

At Ray Summit 2026, Siyuan Fu, Software Engineer at NVIDIA, covers the full-stack optimization path, from kernel-level improvements powered by FlashInfer to distributed serving capabilities enabled by NVIDIA Dynamo, and shows how these contributions help vLLM users reach higher throughput, lower latency, and more efficient inference on NVIDIA GPUs.

You'll leave with a map of the optimizations and where they land in your stack.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
NVIDIA and vLLM Full-Stack Collaboration for DeepSeek and MiniMax Performance | Ray Summit 2026Inside BMWs AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026Scaling LLM Workloads on TPUs with Ray: From Pre-Training to Inference | Google | Ray Summit 2026Whats new in Ray and Anyscale: KubeRay Connect, Native RDMA, and more | Ray Summit 2026Anyscale on Azure: Build and deploy AI at scale in your own tenantWhy Current AI Cannot Truly See the World | Elorian AI | Ray Summit 2026Prompt Learning: A Reinforcement Learning-Inspired Approach to AI Optimization | Ray Summit 2025Introducing Terminal-Bench: Evaluating LLM Agents in Realistic Terminal Settings | Ray Summit 2025
Anyscale |

NVIDIA and vLLM Full-Stack Collaboration for DeepSeek and MiniMax Performance | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER