How Open-Source vLLM Topped the Artificial Analysis Leaderboard | DigitalOcean | Ray Summit 2026 @anyscale
How Open-Source vLLM Topped the Artificial Analysis Leaderboard | DigitalOcean | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 3 days ago
DigitalOcean's vLLM deployments reached leading Artificial Analysis results across frontier open-weight models, including 230 tokens per second per user on DeepSeek V3.2 and sub-second time to first token for 10,000-token Qwen 3.5 prompts.

At Ray Summit 2026, Debarshi Raha, VP and Fellow Engineer at DigitalOcean, breaks down the open-source optimization work behind those results, from low-batch kernel fusion and EAGLE3 speculative decoding to linear-attention fusions and dual-stream execution.

You'll leave seeing how profiling model-specific bottlenecks and upstreaming the fixes into vLLM delivers production inference performance that rivals proprietary stacks.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
How Open-Source vLLM Topped the Artificial Analysis Leaderboard | DigitalOcean | Ray Summit 2026How DigitalOcean Builds Next-Gen Inference with Ray, vLLM & More | Ray Summit 2025Leveraging Agent Skills for Ray Workloads | Anyscale | Ray Summit 2026Serving Frontier MoE Models at the Lowest Token Cost | NVIDIA | Ray Summit 2026NVIDIA NeMo Curator: Scaling Multi-Modal Data Curation Workflows | Ray Summit 2025How Daft Boosts Batch Inference Throughput with Dynamic Partitioning | Ray Summit 2025Wisedocs’ Journey: Rebuilding & Accelerating ML with KubeRay | Ray Summit 2025AMD and vLLM: Whats New | AMD | Ray Summit 2026How Zoox Built a Reliable, High-Velocity Model Serving Platform with Ray Serve | Ray Summit 2025Scaling Machine Learning at Tripadvisor: Our Journey with Ray and Anyscale | Ray Summit 2025Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026
Anyscale |

How Open-Source vLLM Topped the Artificial Analysis Leaderboard | DigitalOcean | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER