Uploaded May 2025 | Updated November 2026, 44 minutes ago
[2025 - Day 3 - Lightning Talks] Willem Pienaar shares insights from building AI agents for complex operational scenarios, exploring why traditional testing approaches fail for agents tackling real-world problems without predefined playbooks. This talk offers valuable perspectives on creating deterministic simulation environments for testing agents in scenarios like distributed systems root cause analysis, crucial for teams building agents that must navigate dynamic systems without ground truth answers.
ABOUT THE SPEAKER:
Willem Pienaar, Co-Founder & CTO, Cleric -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
[2025 - Day 3 - Lightning Talks] Willem Pienaar shares insights from building AI agents for complex operational scenarios, exploring why traditional testing approaches fail for agents tackling real-world problems without predefined playbooks. This talk offers valuable perspectives on creating deterministic simulation environments for testing agents in scenarios like distributed systems root cause analysis, crucial for teams building agents that must navigate dynamic systems without ground truth answers.
ABOUT THE SPEAKER:
Willem Pienaar, Co-Founder & CTO, Cleric -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com

![How Open Frontier Labs Actually Train Their Models | Prime Intellect
[2026 - DAY 3 - MODEL SYSTEMS] Training a large language model is an exercise in tradeoffs you didnβt expect, where choices made for pre-training can shape post-training, agentic RL, and inference much later.
Should you spend a week optimizing infrastructure and architecture, or just start training when every design choice affects rollout speed, memory use, and serving cost?
This talk covers how to think about mdeol decisions: why architecture changes are rarely just about accuracy and almost always about performance, how inference choices determine what is feasible for post-training, and how frontier open labs design models for RL-heavy, agentic workloads.
Weβll walk through the full lifecycle of a model, from pre-training to mid-training to post-training RL, examining how decisions at each stage shape the next and why tradeoffs around efficiency, capability, and inference cost rarely have clean answers
SPEAKER:
Sami Jaghouar - Head of Research, Prime Intellect
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf How Open Frontier Labs Actually Train Their Models | Prime Intellect](https://i.ytimg.com/vi/JEoG1v62APM/mqdefault.jpg)

![Make Too Much Knowledge Just Enough Massive Scale RAG & GraphRAG w Open Source
[2025 - Day 3 - GenAI Applications] Skyler Thomas shares insights from building real-world RAG and GraphRAG systems that scale to hundreds of millions of documents, exploring the complex orchestration beyond trivial extract-and-search approaches. Whether youre designing production RAG systems or debugging complex vector workflows, this talk offers valuable perspectives on scaling to billions of vectors and using open standards like OpenTelemetry for monitoring distributed RAG orchestrations.
ABOUT THE SPEAKER:
Skyler Thomas, Co-Founder & CTO, Cake AI -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Make Too Much Knowledge Just Enough Massive Scale RAG & GraphRAG w Open Source](https://i.ytimg.com/vi/JiW9rX1CBZs/mqdefault.jpg)

![Building the Blueprint for Scalable Data Products in Public Sector | City of San Francisco
[2026 - DAY 3 - LIGHTNING TALK] This talk will provide a practical framework for moving past innovation theater to build durable, production-grade data tools within public sector constraints. Weβll explore how to navigate legacy infrastructure and strict compliance requirements to deliver real value to citizens.
SPEAKER:
Soumya Kalra - Chief Data Officer, City and County of San Francisco
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Building the Blueprint for Scalable Data Products in Public Sector | City of San Francisco](https://i.ytimg.com/vi/Kr76S8inySQ/mqdefault.jpg)
![Data Meets Intelligence: Where the Data Infra & AI Stack Converge
[2025 - Day 1 - Keynote] Naveen Rao and George Mathew share insights from their extensive experience at the intersection of data infrastructure and AI systems, exploring how this convergence is reshaping enterprise technology stacks and the architectural patterns emerging across industries. This keynote panel offers valuable guidance for seasoned leaders navigating AI adoption and practitioners building modern data platforms on the future of data and AI integration.
ABOUT THE SPEAKERS:
Naveen Rao, VP of AI, Databricks
George Mathew, Managing Director, Insight Partners -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Data Meets Intelligence: Where the Data Infra & AI Stack Converge](https://i.ytimg.com/vi/KvZ8F9-yrU4/mqdefault.jpg)
![Born Different: How AI Natives Build Startups
[2026 - Day 1 - KEYNOTE] The playbook for building a startup hasnt changed much in 20 years - until now. Fewer people, different skills, and a completely different sense of whats possible. A new generation of founders is shipping products with smaller teams, moving faster, and using AI across every function. Join a group of AI-native founders for a candid look at how theyre actually using AI inside their own companies - in their workflows, their code, their ops - and what the shape of their teams looks like as a result.
PANELISTS:
Alex Mashrabov - Co-founder & CEO, Higgsfield
Silas Alberti - Founding Team, Cognition
Nikhil Benesch - CTO, turbopuffer
Brie Wolfson - Chief Marketing Officer, Colossus / Positive Sum (Moderator)
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Born Different: How AI Natives Build Startups](https://i.ytimg.com/vi/LtH4QIKXroo/mqdefault.jpg)
![Running Enterprise Agents in Production: Architecture and Secure Execution Models | Salesforce
[2026 - DAY 2 - AI ENGINEERING] I lead large-scale AI implementations and design agents for some of the most security-sensitive enterprises in the world. The pattern is always the same: prototypes and MVPs are easy, running agents in production is not. The moment an agent touches real data and real systems, security, policy, identity, orchestration, and auditability dominate the design. You also discover how many teams must align to make it safe. Without a shared and evolving playbook, the deployment stalls. In this talk I outline the approach I use to build enterprise agents that actually run in production. I cover the core architecture, the supervisory runtime, and the secure execution model that keeps agents predictable: identity boundaries, retrieval controls, RBAC and ABAC alignment, sandboxed tools, and evaluation loops. Through this talk Id like to show what it really takes to operate agents inside large organizations and provide a practical blueprint you can adapt to your own environment.
The views, opinions, and content shared in this presentation are my own and do not represent those of any employer, past or present. Iβd also like to note that my book, Data Engineering for Multimodal AI (OβReilly), is authored independently and is neutral in perspective. It is not sponsored by Salesforce and does not represent Salesforceβs viewpoints.
SPEAKER:
Vasundra Srinivasan - Director, AI Architect Lead, Salesforce
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Running Enterprise Agents in Production: Architecture and Secure Execution Models | Salesforce](https://i.ytimg.com/vi/LthkAkIQhgc/mqdefault.jpg)
![LLMs for Data Science
[2025 - Day 1 - Data Science & Algos] Hadley Wickham shares insights from practical applications of LLMs in data science, exploring three key areas where these tools prove genuinely useful beyond the hype: writing code, writing prose, and rectangling non-rectangular data. For data scientists working with text, images, videos, or audio data, this talk offers valuable perspectives on leveraging LLMs effectively for real workflows and transforming fundamentally unstructured information.
ABOUT THE SPEAKER:
Hadley Wickham, Chief Scientist, Posit -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ LLMs for Data Science](https://i.ytimg.com/vi/MaMQNbwd1MQ/mqdefault.jpg)
![Open Source Success: Learnings from 1 Billion Downloads
[2025 - Day 3 - Lightning Talks] Avi Press shares insights from analyzing over 1 billion open source package downloads across 2000+ projects on Scarf, exploring user behaviors and interactions that reveal best practices for successful open source projects. This talk offers valuable perspectives on download formats, packaging systems, regional trends, and community engagement strategies, essential for maintainers, founders, and executives looking to boost project adoption and drive business growth.
ABOUT THE SPEAKER:
Avi Press, CEO, Scarf -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Open Source Success: Learnings from 1 Billion Downloads](https://i.ytimg.com/vi/NFS-xDVVdXE/mqdefault.jpg)