Uploaded May 2025 | Updated November 2026, 17 hours ago
[2025 - Day 3 - Databases] Etienne Dilocker shares insights from exploring the paradigm shift beyond traditional CRUD operations, examining how AI agents are transforming database interactions from structured queries to natural language conversations. This talk offers valuable perspectives on the future of database interaction where you can communicate with your data as if it were a co-worker, essential for teams working with vector databases or building agent-based systems.
ABOUT THE SPEAKER:
Etienne Dilocker, CTO, Weaviate -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
[2025 - Day 3 - Databases] Etienne Dilocker shares insights from exploring the paradigm shift beyond traditional CRUD operations, examining how AI agents are transforming database interactions from structured queries to natural language conversations. This talk offers valuable perspectives on the future of database interaction where you can communicate with your data as if it were a co-worker, essential for teams working with vector databases or building agent-based systems.
ABOUT THE SPEAKER:
Etienne Dilocker, CTO, Weaviate -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
![Enabling Highly Autonomous Trusted Agents
[2026 - DAY 3 - AI SECURITY & SAFETY] As AI agents become more autonomous, organizations face both unprecedented opportunities and emerging risks. Organizations need trusted agents not only to drive productivity but also to defend against emerging AI-powered threats.
So why aren’t more agents in production? This panel unpacks the key technical, organizational, and trust barriers, and explains why success requires buy-in beyond security, spanning CIOs, developers, and product teams.
We’ll close with what it takes to run agents safely at scale: governance, monitoring, and controls that build trust in real-world deployments. As AI agents become more autonomous, organizations face both unprecedented opportunities and emerging risks. Organizations need trusted agents not only to drive productivity but also to defend against emerging AI-powered threats.
PANELISTS:
Heather Ceylan - CISO, Box
Diana Kelley - CISO, Noma Security
Feross Aboukhadijeh - CEO, Socket
Allie Howe - Host, Insecure Agents podcast (moderator)
👉 Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Enabling Highly Autonomous Trusted Agents](https://i.ytimg.com/vi/l6aHWUfzk7E/mqdefault.jpg)
![Building Reliable Agentic AI Systems
[2025 - Day 1 - AI Engineering] Eno Reyes shares insights from agentic system design, exploring how to build reliable systems from stochastic components by drawing inspiration from robotics, cybernetics, and biology. This talk offers valuable perspectives on developing intuitions for non-deterministic decision making systems, particularly relevant for engineers working in this rapidly evolving field with huge potential for transforming software across industries.
ABOUT THE SPEAKER:
Eno Reyes, CTO, Factory -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Building Reliable Agentic AI Systems](https://i.ytimg.com/vi/loYitFrgxe8/mqdefault.jpg)
![Recursively Self-Improving Agents as Autonomous Software Engineering | Factory
[2026 - DAY 3 - LIGHTNING TALK] How people use agents changes every day. Capabilities expand, use cases broaden, and the surface of workflows, stacks, codebases, and models keeps growing with them. To keep pace and ship the highest-performing product, the agent has to continuously learn without human intervention. At Factory, we close the loop between production behavior and improvements, and our agent Droid now ships its own fixes back into our codebase every day.
We will trace one full cycle of Droid improving itself, from detecting user friction in production to a Droid-authored PR, validated against our regression suites and merged. We will use the cycle to address key design questions: how to privately extract and cluster signal from sessions in aggregate, how to ensure quality as the agent and evals coevolve, and how to reduce human review burden as the loop scales.
The signal-to-fix loop is a general architecture pattern for autonomous software engineering: telemetry and logs for input, tests and evals for validation, merging for deployment, and monitoring for feedback. Any production AI system that can describe its own behavior, validate its own changes, and ship its own code compounds itself.
SPEAKER:
Abhay Singhal - Member of Technical Staff, Factory
👉 Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Recursively Self-Improving Agents as Autonomous Software Engineering | Factory](https://i.ytimg.com/vi/m0VyJ4v-jrA/mqdefault.jpg)
![Eval Agents: How to Solve Error Cascades in Agents
[2025 - Day 1 - AI Engineering] Dhruv Singh shares insights from building multi-turn AI systems, exploring how errors compound and cascade in agents and RAG chatbots through real-world failure examples. For developers building interactive AI systems, this talk offers valuable perspectives on using eval agents tuned on real-world interactions to evaluate and improve agent performance, introducing the new world of trajectory evaluation needed for accurate agent assessment.
ABOUT THE SPEAKER:
Dhruv Singh, Co-Founder & CTO, HoneyHive AI -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Eval Agents: How to Solve Error Cascades in Agents](https://i.ytimg.com/vi/mixuVOQRYOc/mqdefault.jpg)
![5 Lessons from the Classroom for Evaluating Agents | Dev Interrupted
[2026 - DAY 2 - ANALYTICS & DATA SCI] Education researchers have spent a century figuring out how to build environments where complex, unpredictable systems self-correct through structured feedback. Software engineers building AI agents are solving the exact same problem from scratch and ignoring all of it. This talk bridges that gap. Im a former classroom teacher turned AI engineer, and Ill walk you through five pedagogical frameworks that map directly to eval design patterns for AI agents: backward design (define success criteria before you build), formative assessment (eval continuously, not just at the end), rubric design (multi-dimensional scoring instead of pass/fail), error analysis (categorize failure modes because same symptom doesnt mean same cause), and differentiated feedback (the agent, the user, and the knowledge base each need their own signal channel). What ties them together is back pressure: each framework is a way to capture signal from problems and route it to where it drives change. Thats what makes a system self-correcting instead of just self-reporting. Most AI observability is still about watching systems after the fact. This talk is about designing systems where the eval layer captures back pressure from failures and feeds it back upstream, so the system iterates on itself. Ive built production agents and won hackathons with this approach, and the core insight is simple: the best eval systems arent tests, theyre environments. And nobody knows more about designing those environments than teachers.
SPEAKER:
Andrew Zigler - GTM Engineer, LinearB & Podcast Host, Dev Interrupted
👉 Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf 5 Lessons from the Classroom for Evaluating Agents | Dev Interrupted](https://i.ytimg.com/vi/mkuwepBWKsU/mqdefault.jpg)
![From Scaling to Observability Solving Key Challenges for Distributed ML with Ray
[2025 - Day 2 - MLOps & Platforms] Nikita Vemuri shares insights from scaling distributed ML training across thousands of nodes with Ray, exploring the observability challenges of tracking vast amounts of system data in multi-node environments. Whether youre running large-scale ML workloads or building monitoring systems for distributed training, this talk offers valuable perspectives on correlating information across clusters and designing observability stacks that surface relevant insights while maintaining data privacy.
ABOUT THE SPEAKER:
Nikita Vemuri, Software Engineer, Anyscale -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ From Scaling to Observability Solving Key Challenges for Distributed ML with Ray](https://i.ytimg.com/vi/nfrmfyoKs6A/mqdefault.jpg)
![Jev: ChatGPT Co-Creator’s Answer to RLHF
4 months before TypeSafe AI launched Jev, founder Diogo Almeida stood up at AI Council and laid out the problem Jev was built to solve.
He never names the product in this talk. He says only that TypeSafe is going all in on automation and getting ready to ship in a couple of months, then spends 36 minutes on why he thinks the rest of the field is pointed the wrong way. TypeSafe came out of stealth on September 15, 2026 with $40M led by DCVC and launched Jev, a model that outputs typed decisions with probabilities for software to act on.
Almeida spent four and a half years at OpenAI, where he co-authored the InstructGPT paper and the GPT-4 Technical Report and worked on the RLHF research behind ChatGPT. His argument here starts from that work. His read is that roughly all production LLMs are trained with RLHF or some variation of it, and RLHF optimizes for human preference. Human preference is a different target from doing the task correctly. That gap is why AI looks superhuman on assistance work and falls apart on automation work that looks easier.
He walks through mode collapse, Yann LeCuns doomed-LLM argument, why a 1.3B-parameter InstructGPT model was preferred to 175B GPT-3 at following instructions, and where he thinks Suttons bitter lesson is incomplete. He closes on the question that started TypeSafe, which is what it would take to treat language models as a primitive that software calls, the way it calls a database or an API.
Recorded live at AI Council 2026 in San Francisco, May 12-14.
SPEAKER
Diogo Almeida, Co-founder and CEO, TypeSafe AI, InstructGPT and GPT-4 co-author
X: https://x.com/CompleteSkeptic
LinkedIn: https://www.linkedin.com/in/diogomda/
TypeSafe AI: https://typesafe.ai/
Jev: https://typesafe.ai/blog/introducing-system-one-models-and-jev
CHAPTERS
0:00 AI is too good to be true and too bad to be useful
0:51 Four and a half years at OpenAI
2:11 Where is the economic revolution?
5:23 Assistance work versus automation work
6:09 But arent coding agents automation?
9:43 When is a result too good to be true?
11:18 Suttons bitter lesson, and the bitterest lesson
13:49 What RLHF is and what it costs you
14:44 Yann LeCuns doomed-LLM argument
15:49 Mode collapse, RLHFs deal with the devil
18:18 Is software engineering easier than drive-thrus?
19:49 Why a model cant be trusted with stakes
20:42 Is ChatGPT cooked?
25:33 Type-safe language models, going beyond strings
27:13 The FLAN lesson, when the whole field is wrong
29:40 Can one model do assistance and automation?
31:08 What TypeSafe is building
33:42 Summary
35:00 Was RLHF AGI, and what was missing
[2026 - DAY 1 - INFERENCE SYSTEMS]
Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Jev: ChatGPT Co-Creator’s Answer to RLHF](https://i.ytimg.com/vi/o-y1HJ6buGQ/mqdefault.jpg)
![DuckDB Co-Creator Hannes Mühleisen on Why Single-Node Beats Distributed
[2025 - Day 1 - Data Eng & Infra] Hannes Mühleisen shares insights from co-creating DuckDB, exploring how this in-process analytical engines small footprint and high per-core efficiency unlocks creative data interaction possibilities. For engineers building data pipelines or deploying analytics anywhere from servers to small devices, this talk offers valuable guidance on leveraging DuckDBs vectorized processing and larger-than-memory capabilities for previously impossible use cases.
ABOUT THE SPEAKER:
Hannes Mühleisen, Co-Creator, DuckDB
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ DuckDB Co-Creator Hannes Mühleisen on Why Single-Node Beats Distributed](https://i.ytimg.com/vi/o53onmgnQDU/mqdefault.jpg)
![Why dbt Acquired SDF Building true SQL Comprehension
[2025 - Day 1 - Data Eng & Infra] Elias DeFaria shares insights from building SDFs multi-dialect SQL compiler that resolves proprietary SQL dialects into unified logical plans, exploring the breakthrough technology now powering dbt following the acquisition. This talk offers valuable perspectives on normalizing complex dialects and unlocking developer experience improvements in data governance and cost optimization, especially relevant for teams working with cross-engine workflows or building analytics infrastructure.
ABOUT THE SPEAKER:
Elias DeFaria, Staff Product Manager, dbt | Former Co-Founder & VP Product, SDF -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ Why dbt Acquired SDF Building true SQL Comprehension](https://i.ytimg.com/vi/oE8I2VQsKn4/mqdefault.jpg)
![AGI is Already Here (But Its Not What You Think)
[2025 - Day 3 - GenAI Applications] Joseph Gonzalez and Chenggang Wu share insights from redefining AGI through compound AI systems that compose LLMs with data and tools, exploring how orchestrating multiple models creates intelligence that rivals human capabilities. Whether youre building AI-powered workflows or developing general-purpose agents, this talk offers valuable perspectives on creating systems that outperform humans in both accuracy and efficiency while being notably faster.
ABOUT THE SPEAKERS:
Joseph Gonzalez, Professor, Head of AI, UC Berkeley / RunLLM
Chenggang Wu, Co-Founder & CTO, RunLLM -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ AGI is Already Here (But Its Not What You Think)](https://i.ytimg.com/vi/oSKV_c2ddWA/mqdefault.jpg)
![AI Launchpad 2025: NAO
[2025 - Day 1 - AI Launchpad] Claire Gouze and Christophe Blefari share insights from Nao, an AI code editor specifically designed for data teams, exploring how to streamline fragmented analytics engineering workflows across multiple tools. This session offers valuable perspectives on creating unified environments tailored to data professionals unique modeling needs, addressing productivity challenges from constant context switching between IDEs, CLIs, data warehouse UIs, documentation sites, and BI platforms.
ABOUT THE SPEAKERS:
Claire Gouze, Co-Founder & CEO, NAO
Christophe Blefari, Co-Founder, NAO -
🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
→ https://aicouncil.com/sf-2026
⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ AI Launchpad 2025: NAO](https://i.ytimg.com/vi/oyJziKnpElo/mqdefault.jpg)