Welcome to the Loop AI Inference Lifecycle with DDN @Techfieldday
Welcome to the Loop AI Inference Lifecycle with DDN  @Techfieldday
Uploaded October 2026 | Updated November 2026, 3 days ago
DDN, represented by Eric Wright and Scott Ekstrom, presented an overview of the complex AI inference lifecycle, highlighting their role in optimizing this process. The presentation, titled "Welcome to the Loop," illustrated the end-to-end path, beginning with initial prompts and system instructions that form the critical context. DDN's solution leverages its technology to load this context into an inference engine, building out the Key-Value KV cache and tokenizing the work. By integrating through a Nixto plugin and using RDMA for data movement, DDN's Infinia acts as a distributed repository for the KV cache, making it accessible across hundreds of GPUs in a massive data center environment. This approach allows DDN to bypass local memory and NVMe, ensuring the KV cache is non-localized and useful across many GPUs, thereby addressing the challenges of scale in enterprise AI serving.

The discussion further explored the benefits of DDN's approach for enhancing performance and efficiency, particularly for various AI workloads like retrieval augmented generation RAG and agentic flows. While initially a cold prefill for the first computation, subsequent runs achieve high KV cache reuse rates, significantly improving time to first token. DDN stores metadata alongside data for greater efficiency, especially as data scales, and emphasizes smarter eviction strategies for transient data. The company's deep co-engineering relationship with NVIDIA and its origins in high performance computing HPC position it uniquely to tackle difficult problems in AI infrastructure, offering solutions that make GPUs work more profitably by optimizing the data path and reducing CPU involvement.

Beyond technical optimizations, the presentation touched upon the broader implications and value proposition of DDN's solutions. They cater to a global audience, with a strong focus on ensuring data sovereignty and protection in highly regulated industries, particularly in European markets, by providing local support and dedicated infrastructure within cloud environments. DDN helps traditional storage engineers understand how their existing systems may not align with the demanding access patterns of AI inference engines. Ultimately, the company aims for fast, accurate, and cost-effective AI responses, securing data access, and supporting multi-tenancy within organizations. The profound impact of their technology is evident in diverse applications, from efficient processing of medical images like MRIs to ensuring critical infrastructure stability, emphasizing the human benefit derived from solving complex technical challenges.

Recorded live in Santa Clara, California on October 15, 2026 as part of AI Field Day 9. Watch the entire presentation at techfieldday.com/appearance/ddn-presents-at-ai-field-day-9 or visit techfieldday.com/event/aifd9 or ddn.com/solutions/ai-inference for more information.
Welcome to the Loop AI Inference Lifecycle with DDNBuilding Sovereign Al and Neoclouds From Components to Tokens with KeysightNetAlly Plug it in. Press a Button. Know what to doHPE Networking Data Center Scale Across with PTX & Customer On Ramp with MXCisco Secure Networking Simplifying Multicloud NetworkingCloud Innovation, AI, and Real-World Insights at Cloud Field Day 26 #CFD26 #TFDLiveThe Architecture Argument with Xsight LabsBuild a composable AI infrastructure Stack with RLC Pro AI and CIQOpsMill Infrastructure Automation and AlOps, Built on Data You Can TrustNokia Network Coding and Testing - Demo of What We Do EverydaySolidigm | The Physics of 400G Network Buffering and Storage TuningExtending AI-Native Operations Across the Full Stack with HPE
Tech Field Day |

Welcome to the Loop AI Inference Lifecycle with DDN

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER