Uploaded September 2026 | Updated November 2026, 23 hours ago
"Github repository: github.com/anyscale/ray-summit-training-2026/tree/main/llm-serving-for-coding-agents
Learn how to productionize large language models using distributed post-training and inference optimization techniques.
This hands-on training session covers multi-turn RL with SkyRL, agentic RL with LLM as a judge, performance monitoring and tuning of distributed LLM inference for RL rollouts, deploying custom LLMs on Anyscale and integrating them with agentic platforms like Claude Code, Cursor, and Codex, and optimizing deployment with fast loading, compile caching, FP8 KV cache, CUDA graphs, autoscaling, and speculative decoding.
You'll leave able to tune LLM serving end to end and compare costs across self-hosted GPUs, subscriptions, and token-based API billing.
Liked this video? Check out other Ray Summit training session recordings: youtube.com/playlist?list=PLUpYVYRTFCQM
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com/"
"Github repository: github.com/anyscale/ray-summit-training-2026/tree/main/llm-serving-for-coding-agents
Learn how to productionize large language models using distributed post-training and inference optimization techniques.
This hands-on training session covers multi-turn RL with SkyRL, agentic RL with LLM as a judge, performance monitoring and tuning of distributed LLM inference for RL rollouts, deploying custom LLMs on Anyscale and integrating them with agentic platforms like Claude Code, Cursor, and Codex, and optimizing deployment with fast loading, compile caching, FP8 KV cache, CUDA graphs, autoscaling, and speculative decoding.
You'll leave able to tune LLM serving end to end and compare costs across self-hosted GPUs, subscriptions, and token-based API billing.
Liked this video? Check out other Ray Summit training session recordings: youtube.com/playlist?list=PLUpYVYRTFCQM
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com/"










