What Makes RL the Hardest Workload in AI | Robert Nishihara (Anyscale) | Ray Summit 2026 @anyscale
What Makes RL the Hardest Workload in AI | Robert Nishihara (Anyscale) | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 13 hours ago
Reinforcement learning is one of the hardest distributed systems problems in AI: training, inference, and environments all running in one loop.

Robert Nishihara, creator of Ray and co-founder of Anyscale, breaks down the anatomy of a reinforcement learning workload on the Ray Summit 2026 Day 1 keynote stage: the components an RL system has to coordinate, why the combination of large-scale training and large-scale inference in a single loop stresses infrastructure in ways neither does alone, and how Ray was built for exactly this shape of problem.

Liked this video? Check out other Ray Summit keynote sessions: youtube.com/playlist?list=PLYnBpswCtPo4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
What Makes RL the Hardest Workload in AI | Robert Nishihara (Anyscale) | Ray Summit 2026Ray Data: Whats New - GPU Shuffle, Unity Catalog, DataSourceV2 | Anyscale | Ray Summit 2026Inside Adobe Firefly: JIT-Embedding with Ray Serve for Faster GenAI Training | Ray Summit 2025Running Embedding Processing for AI Search at Scale | Notion + AnyscaleServing vLLM on Agentic Production Workloads | Inferact | Ray Summit 2026Cost-Effective RL Post-Training with Ray and AWS Trainium | AWS + Anyscale | Ray Summit 2026Ray Serve: Advancing scalability and flexibility | Ray Summit 2025Trillion-Token Pretraining | Adyen | Ray Summit 2026Running Ray in Production: Google’s Guide to Operators & Observability | Ray Summit 2025From Agents to Action: Scaling Agentic AI with Ray on Intel Xeon | Intel | Ray Summit 2026Building an AI Science Factory | Andrew Beam (Lila Sciences) | Ray Summit 2026GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026
Anyscale |

What Makes RL the Hardest Workload in AI | Robert Nishihara (Anyscale) | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER