Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026 @anyscale
Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 5 days ago
Ephemeral Ray clusters on Kubernetes improve cost efficiency and resource sharing, but once a cluster is deleted, the Ray dashboard, jobs, tasks, actors, logs, events, and node state disappear, making post-mortem debugging difficult.

At Ray Summit 2026, JiaWei Jiang (University of Washington), Aaron Liang (Google), and Hanju Chen (Texas A&M) introduce the Ray History Server, a new KubeRay project with two components: lightweight sidecars that persist the necessary data, and a stateless server that reconstructs the telemetry so users can view historical jobs, tasks, logs, and statuses.

You'll leave knowing how to keep observability after your clusters are gone.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026SQL or Python? Why It’s the Wrong Question in the AI Era | Ray Summit 2025Brendan Burns: Lessons from Building Kubernetes and the Future of AI InfrastructureScaling AI the Snowflake Way: ML Workloads on Ray | Ray Summit 2025Scaling Ray on Kubernetes: Pragmatic Strategies for Every Team | Ray Summit 2025The Rise of vLLM: Building an Open Source LLM Inference EngineHow Red Hat Scales Large-Scale Serving with vLLM | Ray Summit 2025Ray in Production: Engineering Lessons from Spotifys Hendrix Framework | Spotify | Ray Summit 2026Accelerating Large Language Models: vLLM on TPUs | Google | Ray Summit 2026KubeSecRay: Fortifying Multi-Tenant Ray Clusters on Kubernetes | Ray Summit 2024Scaling the Ray Serve Controller to Thousands of Replicas | Anyscale | Ray Summit 2026Taming Distributed AI Training with Ray + Datadog Observability | Ray Summit 2025
Anyscale |

Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER