From Self-Managed Ray to Anyscale Services: Migrating ML Serving | Coinbase | Ray Summit 2026 @anyscale
From Self-Managed Ray to Anyscale Services: Migrating ML Serving | Coinbase | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 4 days ago
Coinbase moved production ML serving from self-managed Ray Serve on Kubernetes to Anyscale Services, and now powers roughly 1 billion inferences per day.

At Ray Summit 2026, Aman Choudhary and Akshit Trehan from Coinbase cover the compounding pain points that drove the migration: Ray upgrades that took weeks and left them behind on critical fixes, homogeneous nodes that forced GPU overprovisioning for CPU-only models, and manual deployments that took 30 to 60 minutes per rollout. They show how the move eliminated operational overhead while enabling heterogeneous compute, proper resource isolation, and reliability and performance improvements they couldn't achieve before.

You'll leave with a playbook for migrating production ML serving at scale.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
From Self-Managed Ray to Anyscale Services: Migrating ML Serving | Coinbase | Ray Summit 2026Where’s My Training Job? Ray & GPU Observability at Datadog | Datadog | Ray Summit 2026Serving a Frontier Open Model with Ray & vLLM | Nscale | Ray Summit 2026Multi-Region, Environment Isolated Ray Environments in the Notion Way | Notion | Ray Summit 2026Pinterest’s Approach to Real-Time ML Experimentation Using Ray | Ray Summit 2025From OOMs to 2x Throughput: Scaling Multimodal Data Curation on Ray | Zoox | Ray Summit 2026Custom Pipeline Parallelism for Frontier-Scale Model Serving | Apple | Ray Summit 2026Scaling LinkedIns Online Training Solution with Ray | Ray Summit 2025AI workloads introduce a system design shift ...Inside Lilas AI Research Platform | Lila Sciences | Ray Summit 2026LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026Training Frontier Knowledge Work Agents: A 397B Open Recipe with SkyRL | Mercor | Ray Summit 2026
Anyscale |

From Self-Managed Ray to Anyscale Services: Migrating ML Serving | Coinbase | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER