Uploaded May 2025 | Updated September 2026, 1 hour ago
Ben walks us through Box's three-layer infrastructure puzzle: First, the mind-boggling base infrastructure (think millions of interactions per second and trillions of files). Second, their unique multi-tenant security challenge - unlike most SaaS platforms, Box users share content across company boundaries, making traditional tenant isolation impossible. And third, ensuring AI respects all these complex permissions while still delivering value.
The podcast then dives further into how vector embeddings can balloon file sizes - a few hundred bytes of text can require 4-6KB of vector data storage! We also dig into why RAG remains essential despite growing context windows, and how Box is developing AI agents that transform painful enterprise processes like RFP responses.
A fun, insightful look at what happens when cutting-edge AI meets enterprise-grade security and scale requirements!
Chapters
0:00 Weaviate Podcast #120!
0:20 Welcome Ben!
1:10 Exabyte Scale at Box
8:10 Infrastructure Rent vs. Buy
12:30 Founder-Led AI Adoption
19:37 Embeddings, RAG, and The AI Tipping Point
28:05 How many Vectors per Data Object?
37:20 Storage Tiers and Dynamic Indices in Retrieval
45:00 Agents
51:15 Agents for RFPs
Ben walks us through Box's three-layer infrastructure puzzle: First, the mind-boggling base infrastructure (think millions of interactions per second and trillions of files). Second, their unique multi-tenant security challenge - unlike most SaaS platforms, Box users share content across company boundaries, making traditional tenant isolation impossible. And third, ensuring AI respects all these complex permissions while still delivering value.
The podcast then dives further into how vector embeddings can balloon file sizes - a few hundred bytes of text can require 4-6KB of vector data storage! We also dig into why RAG remains essential despite growing context windows, and how Box is developing AI agents that transform painful enterprise processes like RFP responses.
A fun, insightful look at what happens when cutting-edge AI meets enterprise-grade security and scale requirements!
Chapters
0:00 Weaviate Podcast #120!
0:20 Welcome Ben!
1:10 Exabyte Scale at Box
8:10 Infrastructure Rent vs. Buy
12:30 Founder-Led AI Adoption
19:37 Embeddings, RAG, and The AI Tipping Point
28:05 How many Vectors per Data Object?
37:20 Storage Tiers and Dynamic Indices in Retrieval
45:00 Agents
51:15 Agents for RFPs
