Adapting Ray to Scale RL Training for Nemotron | NVIDIA | Ray Summit 2026 @anyscale
Adapting Ray to Scale RL Training for Nemotron | NVIDIA | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 22 hours ago
Nemotron is one of the leading open model families pushing the frontier of large-scale reinforcement learning. Training it with RL means coordinating complex datasets, long sequence lengths, a 550B-parameter architecture, and workloads spanning thousands of GPUs.

At Ray Summit 2026, Wenwen Gao and Saurabh Mishra from NVIDIA share how they evolved Ray into a critical orchestration layer for RL at this scale, walking through key improvements across scheduling, fault tolerance, workload coordination, and large-scale training operations that made massive RL jobs more reliable and efficient.

You'll leave with practical best practices and hard-earned lessons for adapting Ray-based infrastructure to large-scale RL training workloads.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Adapting Ray to Scale RL Training for Nemotron | NVIDIA | Ray Summit 2026High-Performance LLM Serving on Intel: vLLM for XPU, HPU & CPU | Ray Summit 2025LeRobot Dataset v3.0: Scaling Reads with Ray | Anyscale | Ray Summit 2026Reward Stress Tests for Agentic Post-Training with Ray | Prime Intellect | Ray Summit 2026Inside Netflix’s Mako: The Next-Gen ML Training Platform | Ray Summit 2025Production-Grade Distributed Inference with llm-d | Red Hat | Ray Summit 2026Scaling RL with Ray, Kubernetes, and TPUs | Google | Ray Summit 2026How to Build a Fully Autonomous Excavator | Vincent Gonguet (Bedrock Robotics) | Ray Summit 2026Performant Training for All Workstreams | Latitude AI | Ray Summit 2026How Coinbase Uses Ray, vLLM & LiteLLM to Power Secure LLM Services | Ray Summit 2025MLOps with Ray on Anyscale | Ray Summit 2025Distributed Embeddings at Scale: Processing 10M+ Rows/ Day with Ray, GPUs & Qdrant | Ray Summit 2025
Anyscale |

Adapting Ray to Scale RL Training for Nemotron | NVIDIA | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER