NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025 @anyscale
NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 59 minutes ago
At Ray Summit 2025, Jacob Huffman and Hao Wang from NVIDIA share how Roblox built a modern ML platform on Ray and leveraged it to train their large-scale 3D foundation model.

They begin by walking through the platform’s architecture, including how Roblox integrated KubeRay with Istio and Kubeflow to support authentication, multi-tenancy, and secure orchestration. They also highlight efforts to open-source the new KubeRay dashboard, designed to improve iterative development, along with infrastructure innovations such as p2p Docker image distribution, lazy pulling, and the ability to scale Ray jobs across multiple clusters.

Jacob and Hao then dive into the challenges Roblox faced when applying Ray to foundation-model training workloads. This includes orchestrating massive LLM batch labeling jobs, leveraging Ray Data at scale, and supporting large distributed pipelines across heterogeneous compute. Historically, Roblox relied on MPI to launch distributed training, which handled multi-GPU execution but lacked critical capabilities like observability and fault tolerance.

Over the past year, the Roblox platform team evaluated and adopted Ray Train as their default distributed training framework—successfully migrating the majority of their training workloads from MPI to Ray, improving reliability and simplifying operations.

Attendees will take away practical insights into building production-grade Ray platforms, modernizing distributed training workflows, and supporting multimodal foundation model development at scale.

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025Koba: Disaggregated Data Loading for Multimodal Training at Luma AI | Luma AI | Ray Summit 2026A Compiler for Christmas | Brendan Burns #raysummitTowards Clinically Grounded LLMs | SonderMind | Ray Summit 2026Scaling LLM Post-Training at Character.AI | Ray Summit 2025Webinar: Getting Started with Distributed Training at ScaleHighly Compressed Gemma Models with Custom Quantization-Aware Training | DeepMind | Ray Summit 2026Multi-Modal Data Processing Pipelines for AI Systems | Anyscale | Ray Summit 2026Ray Across the Stack Fine Tuning Qwen and Serving 3D Generation at Autodesk with AWS Trainium and InBuilding AV 3.0 for Autonomous Trucking | Felix Heide (Torc Robotics) | Ray Summit 2026Scaling PyTorch Training with Ray Data on Ubers Michelangelo AI Platform | Uber | Ray Summit 2026How Alibaba Cloud Accelerates AI Pipelines with AnalyticDB Ray | Ray Summit 2025
Anyscale |

NVIDIA’s Framework for Scalable Data Curation | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER