State of vLLM 2026 | Inferact | Ray Summit 2026 @anyscale
State of vLLM 2026 | Inferact | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 52 minutes ago
vLLM's engine, ecosystem, and contributor base are all growing fast. This talk surveys where the project stands and the roadmap ahead.

At Ray Summit 2026, Woosuk Kwon and Zachary Xi of Inferact cover the Flat Model and Model Runner V2 migrations, disaggregated serving with multi-tier KV offloading, speculative decoding toward 1000+ TPS, and production-grade quantized KV cache compression, plus the infrastructure, CI, and security work needed to support a rapidly growing contributor base and the expanding ecosystem around quantization, speculation, RL frameworks, and vLLM-Omni for real-time multimodal models.

You'll leave current on vLLM across its engine, ecosystem, and open-source practices.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
State of vLLM 2026 | Inferact | Ray Summit 2026From Benchmark #1 to Production | Nebius | Ray Summit 2026Foundation Model Distributed Training with Ray | Anyscale | Ray Summit 2026High-Throughput Inference for Synthetic Data & Evals at Sutro | Ray Summit 2025How a Transformers Model Loads in vLLM | Hugging Face | Ray Summit 2026NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025Koba: Disaggregated Data Loading for Multimodal Training at Luma AI | Luma AI | Ray Summit 2026A Compiler for Christmas | Brendan Burns #raysummitTowards Clinically Grounded LLMs | SonderMind | Ray Summit 2026Scaling LLM Post-Training at Character.AI | Ray Summit 2025Webinar: Getting Started with Distributed Training at ScaleHighly Compressed Gemma Models with Custom Quantization-Aware Training | DeepMind | Ray Summit 2026
Anyscale |

State of vLLM 2026 | Inferact | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER