GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026 @anyscale
GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 20 hours ago
Training trillion-parameter MoE models on long-horizon agentic tasks demands that inference and optimization scale independently.

At Ray Summit 2026, Sami Jaghouar and Radhika Gaonkar from Prime Intellect present the asynchronous prime-rl stack, using GLM-5.1 as a case study: runs at up to 131K sequence length with 256 rollouts and sub-five-minute steps on 28 H200 nodes. They explain how vLLM powers low-precision inference, prefill/decode disaggregation, prefix-aware routing, and distributed KV cache storage, while the trainer combines FSDP, context parallelism, and expert parallelism.

You'll leave seeing how these pieces reduce idle time and make frontier-scale agentic post-training more efficient.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026Accelerating vLLM with LMCache | Ray Summit 2025Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026SQL or Python? Why It’s the Wrong Question in the AI Era | Ray Summit 2025Brendan Burns: Lessons from Building Kubernetes and the Future of AI InfrastructureScaling AI the Snowflake Way: ML Workloads on Ray | Ray Summit 2025Scaling Ray on Kubernetes: Pragmatic Strategies for Every Team | Ray Summit 2025The Rise of vLLM: Building an Open Source LLM Inference EngineHow Red Hat Scales Large-Scale Serving with vLLM | Ray Summit 2025Ray in Production: Engineering Lessons from Spotifys Hendrix Framework | Spotify | Ray Summit 2026Accelerating Large Language Models: vLLM on TPUs | Google | Ray Summit 2026KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024
Anyscale |

GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER