Cascade: Write-Once Run-Anywhere Inference on Ray | Samsara | Ray Summit 2026 @anyscale
Cascade: Write-Once Run-Anywhere Inference on Ray | Samsara | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 3 hours ago
Physical AI systems like robotics and fleets need ML inference pipelines that scale across real-time decisions and offline backfills.

At Ray Summit 2026, Eagle Lo, Hao Yuan, and Freeman Mak from Samsara present Cascade, a declarative inference framework built on Ray that separates pipeline definition from execution. Pipelines are expressed as DSL-defined DAGs, and an execution planner optimizes and schedules them across Ray Serve, Ray Core, and Spark, so the same pipeline runs consistently across online serving and offline batch and backfill workflows, reducing duplicated logic while improving GPU utilization and throughput.

You'll leave with design decisions, tradeoffs, and patterns for building declarative pipelines and unifying online and offline inference.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

๐Ÿ”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Cascade: Write-Once Run-Anywhere Inference on Ray | Samsara | Ray Summit 2026Maximizing GB200 and GB300 Performance with Domain-Aware Scheduling | NVIDIA | Ray Summit 2026Ray Data on GPU - Breaking Preprocessing Bottleneck for Model Training | Stripe | Ray Summit 2026Miles: Enterprise-Facing Agentic RL Framework | RadixArk + Anyscale | Ray Summit 2026Beyond Text-to-Video: Omni-Context Generation in a 33B Model | MiniMax | Ray Summit 2026Inside NVIDIA Dynamo: Faster, Scalable AI Deployment | Ray Summit 2025Ray and MAI-Thinking-1 | Microsoft AI | Ray Summit 2026How the Data Center Shapes the Workload | Nscale | Ray Summit 2026Heterogeneous Pipelines as the Unlock for ML at Scale | Motive | Ray Summit 2026Building a Virtual Biology Platform on Ray | Recursion | Ray Summit 2026Ray Joins The Linux Foundation & PyTorch Sub-Foundation: Toward a Unified AI Compute StackHow Torc Robotics Scales Multimodal AI for Autonomous Driving with Ray
Anyscale |

Cascade: Write-Once Run-Anywhere Inference on Ray | Samsara | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER