Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026 @anyscale
Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 2 hours ago
Netflix built an async inference platform: a unified framework for batch inference and near-real-time serving on a single stack.

At Ray Summit 2026, Wenbing Bai and Naveen Somasundaram from Netflix cover patterns for multimodal inference with Ray and vLLM, including batching, GPU utilization, and common abstractions, plus practical lessons from running these workloads in production.

You'll leave with patterns for unifying batch and near-real-time inference on one stack.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026AWS + vLLM: Building the Future of Open, Fast LLM Serving | Ray Summit 2025Transforming Grab’s AI Platform with Ray | Grab | Ray Summit 2026Ray + vLLM  Efficient Multi Node Orchestration for Sparse MoE Model Serving | Ray Summit 2025Hybrid RL + Imitation Learning for Robotics with Ray at RAI InstituteVideo Action Models | mimic robotics | Ray Summit 2026How Runhouse Orchestrates Multi-Cluster Ray Workloads | Ray Summit 2025Scaling DSpark Training Using vLLM, Speculators and Mooncake | Red Hat | Ray Summit 2026How vLLM and Ray Work TogetherRight Resource, Right Job: Heterogeneous Ray Clusters on Amazon EKS | Robinhood | Ray Summit 2026SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026Secure & Scalable AI on Ray + Kubernetes: Google’s Decoupled Agent Pattern | Ray Summit 2025
Anyscale |

Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER