Inside BMWs AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026 @anyscale
Inside BMWs AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026  @anyscale
Uploaded September 2026 | Updated November 2026, 21 hours ago
Relying on APIs is a straightforward Day 1 solution, but the reality of production AI is that long-term enterprise scale requires self-hosting.

At Ray Summit 2026, Thomas Riedl, AI Platform Engineer at BMW Group, goes inside BMW's AI Gateway, the core of the Connected AI Platform bridging global engineering teams, a vast array of models, and millions of connected vehicles. He unpacks how BMW manages high-volume production traffic and maximizes hardware efficiency, showcasing the specific Ray and vLLM strategies that slash inference costs and power real-world applications at scale.

You'll leave with the architecture and economics of the transition to self-hosted AI at enterprise scale.

Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo

Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Inside BMWs AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026Scaling LLM Workloads on TPUs with Ray: From Pre-Training to Inference | Google | Ray Summit 2026Whats new in Ray and Anyscale: KubeRay Connect, Native RDMA, and more | Ray Summit 2026Anyscale on Azure: Build and deploy AI at scale in your own tenantWhy Current AI Cannot Truly See the World | Elorian AI | Ray Summit 2026Prompt Learning: A Reinforcement Learning-Inspired Approach to AI Optimization | Ray Summit 2025Introducing Terminal-Bench: Evaluating LLM Agents in Realistic Terminal Settings | Ray Summit 2025
Anyscale |

Inside BMW's AI Gateway: Self-Hosting Cost-Efficient AI at Enterprise Scale | BMW | Ray Summit 2026

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER