Inside Netflix’s Mako: The Next-Gen ML Training Platform | Ray Summit 2025 @anyscale
Inside Netflix’s Mako: The Next-Gen ML Training Platform | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 1 hour ago
At Ray Summit 2025, Avin Regmi and Matan Appelbaum from Netflix share how the company is building Mako, a next-generation ML training platform engineered to meet the demands of modern, large-scale AI workloads.

They begin by outlining how Netflix evolved its legacy training platform to support increasingly complex models, larger datasets, and rapidly growing GPU requirements. Central to this evolution was the development of a custom GPU scheduler designed to significantly improve utilization, reduce fragmentation, and ensure that large multi-node training jobs run efficiently and reliably.

The speakers then walk through the architectural changes that enabled Netflix to scale training across diverse workloads—highlighting critical decisions around resource orchestration, distributed execution, and system resilience. They also detail where Ray fits into this journey, including how its flexible distributed runtime supports key components of the platform and what the team learned from integrating Ray into high-performance training pipelines.

Attendees will gain insights into designing modern ML training platforms, optimizing GPU usage at scale, and leveraging Ray to support the next wave of AI infrastructure at Netflix.

Liked this video? Check out other Ray Summit breakout session recordings youtube.com/playlist?list=PLzTswPQNepXllnU0C36WtkC0dqkAoDulh

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Inside Netflix’s Mako: The Next-Gen ML Training Platform | Ray Summit 2025Production-Grade Distributed Inference with llm-d | Red Hat | Ray Summit 2026Scaling RL with Ray, Kubernetes, and TPUs | Google | Ray Summit 2026How to Build a Fully Autonomous Excavator | Vincent Gonguet (Bedrock Robotics) | Ray Summit 2026Performant Training for All Workstreams | Latitude AI | Ray Summit 2026How Coinbase Uses Ray, vLLM & LiteLLM to Power Secure LLM Services | Ray Summit 2025MLOps with Ray on Anyscale | Ray Summit 2025Distributed Embeddings at Scale: Processing 10M+ Rows/ Day with Ray, GPUs & Qdrant | Ray Summit 2025Scaling Physical AI & Robotics Systems with Ray | Anyscale | Ray Summit 2026Serving vLLM on Intel GPUs, CPUs, and Gaudi | Intel | Ray Summit 2026Elastic Expert Parallelism for vLLM | Ray Summit 2025Post-training Nemotron with Ray | Bryan Catanzaro (Nvidia) | Ray Summit 2026
Anyscale |

Inside Netflix’s Mako: The Next-Gen ML Training Platform | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER