Scaling LinkedIns Online Training Solution with Ray | Ray Summit 2025 @anyscale
Scaling LinkedIns Online Training Solution with Ray | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 21 minutes ago
At Ray Summit 2025, Chen Zhu, Tao Huang, Yang Pei from LinkedIn share how the company adopted Ray to power a scalable online training system for real-time recommendation models—transforming the “Jobs You Might Be Interested In” ranking pipeline from slow, offline training to continuous, high-throughput updates.
They begin by outlining the limitations of LinkedIn’s traditional offline recommender workflows, where model freshness lagged by days or even weeks. This delay led to outdated recommendations, inconsistent features, and missed opportunities to adapt to rapidly changing user behavior and market dynamics.
By moving to online training with Ray, LinkedIn created a tight feedback loop that keeps models continuously refreshed—improving recommendation quality, boosting click-through rates, and cutting compute costs through incremental retraining. The result: up to 8.9× cost savings while delivering more relevant recommendations in real time.
The speakers then walk through the design of LinkedIn’s production online training system, including:

High-throughput streaming data generation

Scalable Kafka ingestion pipelines

A nearline training loop powered by Ray for fast, iterative updates

Key optimizations for throughput, latency, and system stability


They also share lessons learned from deploying Ray in a mission-critical production environment and the architectural choices that proved essential for reliability and scalability.
Attendees will leave with actionable insights into building Ray-powered online training systems that maintain model freshness, reduce costs, and drive measurable business impact.

Liked this video? Check out other Ray Summit breakout session recordings youtube.com/playlist?list=PLzTswPQNepXllnU0C36WtkC0dqkAoDulh

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Scaling LinkedIns Online Training Solution with Ray | Ray Summit 2025AI workloads introduce a system design shift ...Inside Lilas AI Research Platform | Lila Sciences | Ray Summit 2026LLM Post-Training and High-Performance Serving | Anyscale | Ray Summit 2026Training Frontier Knowledge Work Agents: A 397B Open Recipe with SkyRL | Mercor | Ray Summit 2026Building Self-Serve, Multimodal Medical Image Pipelines with Ray | Heartflow | Ray Summit 2026Agents and Robots: The Human Effort Putting AI Into Production | Encord | Ray Summit 2026How Exa Indexes the Entire Web: Ray Data and Lance at Billion-Document Scale | Exa | Ray Summit 2026Unlocking Peak Workload Performance & Efficiency with Ray on Kubernetes | Ray Summit 2025Boosting vLLM Inference on Huawei NPU with Ray Compiled Graphs — Huawei | Ray Summit 2025Simulating the Physical World at Scale: Humanoid Locomotion with Ray | Lambda | Ray Summit 2026KV Cache and Long-Context Inference: Solutions for Inference at Scale | VAST Data | Ray Summit 2026
Anyscale |

Scaling LinkedIn's Online Training Solution with Ray | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER