Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026 @anyscale
Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 4 days ago
Four focused lightning talks explore systems work for production agentic workloads.

At Ray Summit 2026, Tun Jian Tan of Embedded LLM covers Agentic API, Jeffrey Wang of Anyscale discusses KV-cache-aware serving with Ray Serve LLM, Danny An of Novita presents human-AI collaboration between agents and engineers, and Ananth Mahadevan of Verda shares lessons learned from serving GLM-5.2 and Kimi K3 in production.

You'll leave with four rapid-fire perspectives on running agents in production.

This session was part of the first vLLM Conference at Ray Summit, hosted by Inferact.

Liked this video? Check out other Ray Summit vLLM session recordings: youtube.com/playlist?list=PLXMguE8Nc9o4

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026AWS + vLLM: Building the Future of Open, Fast LLM Serving | Ray Summit 2025Transforming Grab’s AI Platform with Ray | Grab | Ray Summit 2026Ray + vLLM  Efficient Multi Node Orchestration for Sparse MoE Model Serving | Ray Summit 2025Hybrid RL + Imitation Learning for Robotics with Ray at RAI InstituteVideo Action Models | mimic robotics | Ray Summit 2026How Runhouse Orchestrates Multi-Cluster Ray Workloads | Ray Summit 2025Scaling DSpark Training Using vLLM, Speculators and Mooncake | Red Hat | Ray Summit 2026How vLLM and Ray Work TogetherRight Resource, Right Job: Heterogeneous Ray Clusters on Amazon EKS | Robinhood | Ray Summit 2026SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026
Anyscale |

Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER