Uploaded April 2026 | Updated September 2026, 1 week ago
Talk by Engin Diri
socallinuxexpo.org/scale/23x/presentations/building-ai-platforms-without-losing-your-engineering-principles
As organizations adopt generative AI, platform teams must support multi-node inference, GPU-based model serving, and growing API sprawl while keeping the developer experience simple. This session explores Kubernetes-native approaches like kserve, high-throughput frameworks like vLLM, and gateways like LiteLLM for standardized model access. Attendees will learn concrete patterns for supporting AI at scale while preserving the principles that made their platforms successful.
Talk by Engin Diri
socallinuxexpo.org/scale/23x/presentations/building-ai-platforms-without-losing-your-engineering-principles
As organizations adopt generative AI, platform teams must support multi-node inference, GPU-based model serving, and growing API sprawl while keeping the developer experience simple. This session explores Kubernetes-native approaches like kserve, high-throughput frameworks like vLLM, and gateways like LiteLLM for standardized model access. Attendees will learn concrete patterns for supporting AI at scale while preserving the principles that made their platforms successful.
