Inside Uber: Scaling Model Training with Ray | Ray Summit 2025 @anyscale
Inside Uber: Scaling Model Training with Ray | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 56 minutes ago
At Ray Summit 2025, Bharat Joshi and Peng Zhang from Uber share how Ray has become a cornerstone of Uber’s rapidly expanding machine learning infrastructure—powering scalable, flexible, and efficient distributed training across heterogeneous compute environments.

They begin by outlining Uber’s growing need to support large-scale training for LLMs, recommendation systems, and other high-capacity models, where traditional systems struggled to meet evolving performance and reliability requirements. Ray’s unified distributed computing model has enabled Uber to standardize training workflows while operating at massive scale.

The speakers then dive into the architectural strategies that have been critical to Uber’s success, including:

Multi-cloud training, allowing workloads to span diverse compute providers for improved flexibility and resource availability

Disaster recovery–ready design, ensuring continuity for production-grade ML workloads even in the face of cloud outages or regional failures

Cross-environment portability, supporting seamless transitions between cloud and on-premise clusters

They also share detailed learnings from optimizing performance and training throughput—covering GPU/accelerator efficiency techniques, system-level tuning, and the patterns that proved most effective for large distributed jobs.

Attendees will gain practical insights into how Uber leverages Ray to train large-scale models reliably across complex, mixed compute environments—and how these architectural lessons can be applied to enterprise ML systems of any scale.

Liked this video? Check out other Ray Summit breakout session recordings youtube.com/playlist?list=PLzTswPQNepXllnU0C36WtkC0dqkAoDulh

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Inside Uber: Scaling Model Training with Ray | Ray Summit 2025Why Ray Became a Distributed Computing Engine for Modern AINVIDIA and vLLM Full-Stack Collaboration for DeepSeek and MiniMax Performance | Ray Summit 2026Inside BMWs AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026Scaling LLM Workloads on TPUs with Ray: From Pre-Training to Inference | Google | Ray Summit 2026Whats new in Ray and Anyscale: KubeRay Connect, Native RDMA, and more | Ray Summit 2026Anyscale on Azure: Build and deploy AI at scale in your own tenantWhy Current AI Cannot Truly See the World | Elorian AI | Ray Summit 2026Prompt Learning: A Reinforcement Learning-Inspired Approach to AI Optimization | Ray Summit 2025Introducing Terminal-Bench: Evaluating LLM Agents in Realistic Terminal Settings | Ray Summit 2025
Anyscale |

Inside Uber: Scaling Model Training with Ray | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER