SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026 @anyscale
SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 2 days ago
Agents have taken center stage in 2026, and as they shift to longer-horizon, multi-turn interactions, the systems challenges and requirements on training infrastructure have evolved with them.

At Ray Summit 2026, Sumanth Hegde and Eric Tang from Anyscale trace SkyRL from a set of modular APIs decoupling training, inference, and environments to where it is today: scalable, fully async RL training on 350B+ parameter MoE models with Megatron and vLLM, the multi-tenant Tinker Engine that lets researchers use their own hardware with Tinker's flexible training APIs, a redesign toward HTTP-based APIs for scalable inference with native RL API contributions to vLLM, and community recipes including large MoE training on long-horizon tasks and custom recursive language models.

You'll leave with a picture of modular, performant RL training and where SkyRL is headed.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026Secure & Scalable AI on Ray + Kubernetes: Google’s Decoupled Agent Pattern | Ray Summit 2025vLLM TPU: A new unified-backend supporting Pytorch and JAX natively on TPU | Ray Summit 2025Hugging Face + vLLM: One Model Definition to Rule Them All | Ray Summit 2025TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026Satellite Imagery to Machine-Readable Intelligence | Xoople | Ray Summit 2026One Cluster, End-to-End | AWS | Ray Summit 2026Matrix: Reliable Framework for Data-Centric Experimentation at Scale  | Ray Summit 2025Scaling Massive Transformer Training with KubeRay | Capital One | Ray Summit 2026How Workday Achieved 50x Cheaper Model Serving with Ray Serve | Ray Summit 2025From Reservation to 1,600 GPUs: A Petabyte-Scale Ray Data Pipeline | CoreWeave | Ray Summit 2026How Prime Intellect Builds Scalable Infrastructure for Agentic RL | Ray Summit 2025
Anyscale |

SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER