Wisedocs’ Journey: Rebuilding & Accelerating ML with KubeRay | Ray Summit 2025 @anyscale
Wisedocs’ Journey: Rebuilding & Accelerating ML with KubeRay | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 4 days ago
At Ray Summit 2025, Denys Linkov from Wisedocs shares how the company rebuilt its ML and AI serving layer on KubeRay—unlocking major gains in performance, cost efficiency, and deployment velocity.

He begins by outlining the challenges and opportunities involved in redesigning a production-grade serving stack. Wisedocs migrated 10 models to KubeRay to power both real-time and batch workloads, achieving a 50% reduction in cost while improving throughput by 10×. Denys walks through the architectural decisions that made this possible, from compute orchestration to workload isolation and scaling strategies.

The talk also covers the information and technical architecture that enabled Wisedocs to cut its time-to-production dramatically—from one month to just two days. Denys highlights how internal abstractions, standardized deployment patterns, and Ray’s distributed execution model streamlined the entire development-to-production cycle.

Finally, he discusses the tradeoffs of serving GenAI models versus encoder-based models within an internal Kubernetes environment, sharing lessons learned on performance tuning, resource management, and operational complexity.

Attendees will gain practical insights into modernizing ML serving stacks with Ray and KubeRay, balancing efficiency with reliability, and accelerating production deployment at scale.

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Wisedocs’ Journey: Rebuilding & Accelerating ML with KubeRay | Ray Summit 2025AMD and vLLM: Whats New | AMD | Ray Summit 2026How Zoox Built a Reliable, High-Velocity Model Serving Platform with Ray Serve | Ray Summit 2025Scaling Machine Learning at Tripadvisor: Our Journey with Ray and Anyscale | Ray Summit 2025Lightning on Agentic: Embedded LLM, Anyscale, Novita, and Verda | Ray Summit 2026Async Inference at Netflix: Batch and Near-Real-Time Serving | Netflix | Ray Summit 2026AWS + vLLM: Building the Future of Open, Fast LLM Serving | Ray Summit 2025Transforming Grab’s AI Platform with Ray | Grab | Ray Summit 2026Ray + vLLM  Efficient Multi Node Orchestration for Sparse MoE Model Serving | Ray Summit 2025Hybrid RL + Imitation Learning for Robotics with Ray at RAI InstituteVideo Action Models | mimic robotics | Ray Summit 2026How Runhouse Orchestrates Multi-Cluster Ray Workloads | Ray Summit 2025
Anyscale |

Wisedocs’ Journey: Rebuilding & Accelerating ML with KubeRay | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER