One Cluster, End-to-End | AWS | Ray Summit 2026 @anyscale
One Cluster, End-to-End | AWS | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 12 hours ago
Teams training large models on Ray often run three separate footprints: one for data processing, one for distributed training, one for serving. Each brings its own scheduler, its own scaling behavior, and its own idle GPUs.

At Ray Summit 2026, Shreyas Adiyodi and Anoop Saha from AWS walk through collapsing that into a single Amazon EKS cluster with SageMaker HyperPod: scheduling heterogeneous CPU and GPU Ray clusters against shared capacity with queue-based admission, where checkpointing belongs when a run spans days, recovering from node-level hardware failure without restarting the pipeline, tightening the experimentation loop, and deploying models for accelerated inference.

You'll leave with a reference architecture for end-to-end Ray pipelines on Kubernetes that maximizes GPU utilization across every stage of model development.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
One Cluster, End-to-End | AWS | Ray Summit 2026Matrix: Reliable Framework for Data-Centric Experimentation at Scale  | Ray Summit 2025Scaling Massive Transformer Training with KubeRay | Capital One | Ray Summit 2026How Workday Achieved 50x Cheaper Model Serving with Ray Serve | Ray Summit 2025From Reservation to 1,600 GPUs: A Petabyte-Scale Ray Data Pipeline | CoreWeave | Ray Summit 2026How Prime Intellect Builds Scalable Infrastructure for Agentic RL | Ray Summit 2025How KubeRay Is Evolving for Massive AI Workloads  | Ray Summit 2025Production-Ready Distributed Inference with Ray Serve | Anyscale | Ray Summit 2026Petabyte-Scale Video Curation on CoreWeave | CoreWeave | Ray Summit 2026Ray Direct Transport: RDMA Support in Ray Core | Ray Summit 2025Maximizing Compute Efficiency on Anyscale | Ray Summit 2025The PARK Stack: The LAMP Stack of the AI Era | Ben Lorica
Anyscale |

One Cluster, End-to-End | AWS | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER