LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026 @anyscale
LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 23 hours ago
"Github repository: github.com/anyscale/ray-summit-training-2026/tree/main/llm-serving-for-coding-agents

Learn how to productionize large language models using distributed post-training and inference optimization techniques.

This hands-on training session covers multi-turn RL with SkyRL, agentic RL with LLM as a judge, performance monitoring and tuning of distributed LLM inference for RL rollouts, deploying custom LLMs on Anyscale and integrating them with agentic platforms like Claude Code, Cursor, and Codex, and optimizing deployment with fast loading, compile caching, FP8 KV cache, CUDA graphs, autoscaling, and speculative decoding.

You'll leave able to tune LLM serving end to end and compare costs across self-hosted GPUs, subscriptions, and token-based API billing.

Liked this video? Check out other Ray Summit training session recordings: youtube.com/playlist?list=PLUpYVYRTFCQM

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com/"
LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026Training Frontier Knowledge Work Agents: A 397B Open Recipe with SkyRL | Mercor | Ray Summit 2026Building Self-Serve, Multimodal Medical Image Pipelines with Ray | Heartflow | Ray Summit 2026Agents and Robots: The Human Effort Putting AI Into Production | Encord | Ray Summit 2026How Exa Indexes the Entire Web: Ray Data and Lance at Billion-Document Scale | Exa | Ray Summit 2026Unlocking Peak Workload Performance & Efficiency with Ray on Kubernetes | Ray Summit 2025Boosting vLLM Inference on Huawei NPU with Ray Compiled Graphs — Huawei | Ray Summit 2025Simulating the Physical World at Scale: Humanoid Locomotion with Ray | Lambda | Ray Summit 2026KV Cache and Long-Context Inference: Solutions for Inference at Scale | VAST Data | Ray Summit 2026Reward Hacking and the Gaps in Agentic AI | Ion Stoica (Anyscale) | Ray Summit 2026How AWS Scales Reinforcement Learning Across Thousands of GPUs | Ray Summit 2025Distributed Model Training with Ray at Capital One | Ray Summit 2025
Anyscale |

LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER