Keynote: Plug in and Scale: Serving LLM Models on Kubernetes Ma... Shrinidhi Venkataraman & Nithin R @cncf

Updated September 2026, 3 weeks ago

Keynote: Plug in and Scale: Serving LLM Models on Kubernetes Ma... Shrinidhi Venkataraman & Nithin R

Beyond VLLM: Distributed LLM Inferencing With Llm-d on Kubernetes - Ravindra Patil, Red Hat

SBOMit: Making SBOMs Accurate With Attestations - Marco De Vincenzi & Justin Cappos, NYU

Project Lightning Talk: Opening Remarks - Hoon Jo, KubernetesLab.dev

$Beyond Single-Cluster Limits: Scaling GPU Workloads Across Kubernetes With… K. Das & E. Bayramova Dont miss out! Join us at our next KubeCon + CloudNativeCon events in Shanghai, China (8-9 September, 2026) and Salt Lake City, United States (Nov 9–12, 2026). Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io Beyond Single-Cluster Limits: Scaling GPU Workloads Across Kubernetes With Virtual Nodes - Kunal Das, Cast AI & Esmira Bayramova, Kimchi Our ML platform team hit a wall when GPU demand became unpredictable. Fine-tuning jobs queued for hours on busy days while expensive on-prem GPUs sat idle on others. Adding cloud GPU clusters solved capacity but fractured our workflow , developers juggled multiple kubeconfigs, Kueue couldnt see cross-cluster queues,workloads couldnt failover because multi-cluster was really just isolated clusters with shared dashboards. In this talk, we walk through how we used Liqos virtual node pattern to unify 5 heterogeneous clusters , mixing on-prem A100/ H100 nodes with cloud spot GPU instances from cloud providers , into a single schedulable topology. Well share how the vanilla Kubernetes scheduler handles placement using standard node selectors and affinities, how Ciliums cluster mesh compared to Liqos WireGuard-based network fabric for cross-cluster pod traffic, and how we integrated Kueue for unified job queuing across the virtual cluster.$

Detecting Compromised CI With eBPF and Cilium Tetragon - Liz Rice, Isovalent at Cisco

Shared Yet Isolated at Scale: Building Multi-Tenant Inference Platform on… Y. Hiraki & Y. Tanaka

The Death of the YAML-Engineer: Engineering Invisible Platf... Abhinav Sharma & Mumshad Mannambeth

⚡Lightning Talk: Learning Kubernetes From Logs: Building a Foundation for Future… K. Ishii

What Is a Virtual Power Plant (VPP) ? : Green Tech and the Modernization of the Grid - L. Malcom

SIG API Machinery in the Era of AI: Updates - Federico Bongiovanni, Google Cloud

CNCF [Cloud Native Computing Foundation] |

Keynote: Plug in and Scale: Serving LLM Models on Kubernetes Ma... Shrinidhi Venkataraman & Nithin R