Uploaded September 2026 | Updated November 2026, 4 days ago
Ray powers the foundation model lifecycle at Spotify, from data preprocessing and distributed training to evaluation and deployment.
At Ray Summit 2026, Shawn Lin and Aamir Anwar from Spotify share how their internal platform provisions Ray clusters on Kubernetes with on-demand GPU infrastructure, how Ray Data drives distributed preprocessing, tokenization, and sequence packing, and how Ray Train powers FSDP2 and HSDP strategies that adapt to cluster topology. They dig into the engineering challenges of scaling these systems, including real debugging stories like an NCCL deadlock caused by uneven end-of-epoch behavior across distributed workers.
You'll leave with engineering lessons from operating large-scale foundation model workflows in production.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Ray powers the foundation model lifecycle at Spotify, from data preprocessing and distributed training to evaluation and deployment.
At Ray Summit 2026, Shawn Lin and Aamir Anwar from Spotify share how their internal platform provisions Ray clusters on Kubernetes with on-demand GPU infrastructure, how Ray Data drives distributed preprocessing, tokenization, and sequence packing, and how Ray Train powers FSDP2 and HSDP strategies that adapt to cluster topology. They dig into the engineering challenges of scaling these systems, including real debugging stories like an NCCL deadlock caused by uneven end-of-epoch behavior across distributed workers.
You'll leave with engineering lessons from operating large-scale foundation model workflows in production.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com










