Architecting Infrastructure for the AI Native Future: Scaling Autonomous Agents on Google TPUs @scaleconference
Architecting Infrastructure for the AI Native Future: Scaling Autonomous Agents on Google TPUs  @scaleconference
Uploaded June 2026 | Updated November 2026, 2 days ago
Architecting Infrastructure for the AI Native Future: Scaling Autonomous Agents on Google TPUs by Sabastian Mugazambi from Google

As the industry pivots toward an "AI Native" paradigm, the bottleneck for innovation has shifted from algorithmic design to the underlying infrastructure's ability to handle unprecedented scale and complexity. This session explores how Google TPU (Tensor Processing Unit) infrastructure serves as the catalyst for this transformation, specifically within the domains of large-scale Recommender Systems, MoEs, LLMs and the emerging era of Autonomous Agents.

We will delve into the architectural innovations of the latest TPU generations, demonstrating how their purpose-built design facilitates the massive throughput required for real-time recommendation engines and the high-speed inference necessary for agentic orchestration.

Want to learn more about the @Scale Conference? Visit our website here: atscaleconference.com
Architecting Infrastructure for the AI Native Future: Scaling Autonomous Agents on Google TPUsBuilding Storage for AI at ScaleLearn from Zoom’s AI Product Manager, Danran Chen!Live from SCCC: Fiber Networks Innovations for AI at Scale | Fabrice Ouandji and Sebastian GaultThe Agentic Infrastructure Gap: In-Distribution Languages Make It a Coding Problem | Joe DuffyLightning Talk: AI-Native Network Capacity Management | Mohab Gawish, MetaShip Fast, Break Nothing: How AI Tests What AI Builds | Sophie Zeng & Sreeja Thummala from MetaLess Problems, More Building!Live from SCCC: MetaRoCE: From Spec to NIC to Open Source | Balakrishnan Raman and Sandeep NagarajEvolving GenAI Media Infrastructure Deployments | Rushaan Mahajan, Sima LabsOur Journey to Safely Unleash Agents at Meta Scale | David Pariag from MetaAdopting AV1 for Real-Time Communication (RTC) at Scale | Yu Chen Sun Eric from Meta
@Scale |

Architecting Infrastructure for the AI Native Future: Scaling Autonomous Agents on Google TPUs

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER