Building the Database for Trillion-Scale AI Search | turbopuffer @aicouncilconf
Building the Database for Trillion-Scale AI Search | turbopuffer  @aicouncilconf
Uploaded June 2026 | Updated November 2026, 3 days ago
[2026 - DAY 1 - DATA ENG & DATABASES] This talk goes beyond architecture diagrams to share what actually happens when you operate an agentic search engine on trillions of documents. We'll dig into how an object storage-native design allows a small team of engineers to manage an AI search engine that scales to:

• Peak load of 1M+ writes per second and 30k+ searches per second
• 1+ trillion documents
• 5+ PB of logical data
• 400+ tenants
• p90 query latency less than 100 ms

Topics include:
• How using a modern storage architecture decreases COGS by 10x or more
• Optimizing traditional vector and FTS indexes for the high latency of object storage
• Building search algorithms that are fine-tuned for LLM-initiated searches
• A simple rate-limiting technique that provides strong performance isolation in multi-tenant environments
• Observability, reliability, and performance lessons learned from production incidents.

Viewers will leave with a concrete understanding of how separating storage from compute-and treating object storage as the primary database changes not only the cost structure, but the entire operational model of large-scale AI search.

SPEAKER:
Nikhil Benesch - CTO, turbopuffer

👉 Sign up for our "No BS" Newsletter to get the latest technical data & AI content: aicouncil.com/newsletter

ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.

FIND US:
Website: aicouncil.com
LinkedIn: linkedin.com/company/aicouncilconf
X: https://x.com/aicouncilconf
Building the Database for Trillion-Scale AI Search | turbopufferIM AI GINE Performance by Pete Soderling | AI Council 2026Designing & Engineering a Viral Multi-Model AI WorkflowWhat do you think is missing in order to make agentic coding trustworthy enough to deploy at scale?Internals of SlateDB: An Embedded Key Value Store Built On Object StorageFrom Concurrency Control to Concurrent SchedulingThe Art of Data: Reimagining Creative Processes with Data CultureWhat comes after Deep Learning? | Incept LabsChang Shes projections: The World Will Hit 1 Zettabyte of Data Per DayThe Open Layer: How Open Models, Routing, and Inference Are Reshaping Agentic EngineeringHow to Build Your Own Model RouterFailure is a Funnel
AI Council |

Building the Database for Trillion-Scale AI Search | turbopuffer

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER