Serving Fast and Smart: Getting the Most Out of Ray Serve LLM on GKE | Google | Ray Summit 2026 @anyscale
Serving Fast and Smart: Getting the Most Out of Ray Serve LLM on GKE | Google | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 4 days ago
Get more out of your LLM serving with Ray Serve on GKE.

At Ray Summit 2026, Seiji Eicher, Software Engineer at Anyscale, and Spencer Peterson, Software Engineer at Google, show how to configure the latest features end to end to maximize throughput, minimize latency, and stay on top of day-two operations: managing your RayServices, accelerators, and network ingress with Kubernetes and the Gateway API.

You'll leave with best practices for production LLM serving on GKE.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Serving Fast and Smart: Getting the Most Out of Ray Serve LLM on GKE | Google | Ray Summit 2026Anyscale on Azure: Build, Train, and Serve AI in Your Own Tenant | Microsoft | Ray Summit 2026Improved Scheduling Flexibility with Label Selectors in Ray | Ray Summit 2025Meet verl: An RL Framework for LLM Reasoning & Tool Use | Ray Summit 2025Scaling Machine Learning at Discord: Our Journey with Ray and Anyscale | Discord | Ray Summit 2026How BMW Scales Automotive AI Workloads with the Ray Framework | Ray Summit 2025Scaling Frontier AI with Ray on Kubernetes | KubeRay | Ray Summit 2026Ray Train on Anyscale: Observability and Reliability at Scale | Anyscale | Ray Summit 2026State of vLLM 2025 | Ray Summit 2025Training AI on the Scientific Process | Liam Fedus (Periodic Labs) | Ray Summit 2026Optimizing LLM Inference with AWS Trainium, Ray, vLLM, and AnyscaleLiquidAI’s Approach to Large-Scale Synthetic Data Generation Using Ray | Ray Summit 2025
Anyscale |

Serving Fast and Smart: Getting the Most Out of Ray Serve LLM on GKE | Google | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER