Ray in Production: Engineering Lessons from Spotifys Hendrix Framework | Spotify | Ray Summit 2026 @anyscale
Ray in Production: Engineering Lessons from Spotifys Hendrix Framework | Spotify | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 4 days ago
Ray powers the foundation model lifecycle at Spotify, from data preprocessing and distributed training to evaluation and deployment.

At Ray Summit 2026, Shawn Lin and Aamir Anwar from Spotify share how their internal platform provisions Ray clusters on Kubernetes with on-demand GPU infrastructure, how Ray Data drives distributed preprocessing, tokenization, and sequence packing, and how Ray Train powers FSDP2 and HSDP strategies that adapt to cluster topology. They dig into the engineering challenges of scaling these systems, including real debugging stories like an NCCL deadlock caused by uneven end-of-epoch behavior across distributed workers.

You'll leave with engineering lessons from operating large-scale foundation model workflows in production.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Ray in Production: Engineering Lessons from Spotifys Hendrix Framework | Spotify | Ray Summit 2026Accelerating Large Language Models: vLLM on TPUs | Google | Ray Summit 2026KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024Scaling the Ray Serve Controller to Thousands of Replicas | Anyscale | Ray Summit 2026Taming Distributed AI Training with Ray + Datadog Observability | Ray Summit 2025Webinar: Scaling LLM Fine-Tuning with FSDP, DeepSpeed, and RayFrom Prototype to Production: Securely Accelerating Physical AI with Vision-Language-Action ModelsClosing the Train-Inference Divide for Asynchronous RL at Scale | Lila Sciences | Ray Summit 2026SkyRL tx: A unified training and inference engine | Ray Summit 2025Scaling Production LLM Inference Using EKS Auto Mode & Ray Serve | Ray Summit 2025From Self-Managed Ray to Anyscale Services: Migrating ML Serving | Coinbase | Ray Summit 2026Where’s My Training Job? Ray & GPU Observability at Datadog | Datadog | Ray Summit 2026
Anyscale |

Ray in Production: Engineering Lessons from Spotify's Hendrix Framework | Spotify | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER