Uploaded May 2025 | Updated November 2026, 41 minutes ago
[2025 - Day 3 - GenAI Applications] Niko Grupen shares insights from building agents for real-world knowledge work, exploring the delicate balance of AI and Human-Computer Interaction required for vertical problem spaces like law. Whether you're developing domain-specific agents or creating frameworks that mirror human processes, this talk offers valuable perspectives on leveraging domain expertise, mapping model problems to real-world challenges, and maximizing quality in production environments.
ABOUT THE SPEAKER:
Niko Grupen, Head of Applied Research, Harvey -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
[2025 - Day 3 - GenAI Applications] Niko Grupen shares insights from building agents for real-world knowledge work, exploring the delicate balance of AI and Human-Computer Interaction required for vertical problem spaces like law. Whether you're developing domain-specific agents or creating frameworks that mirror human processes, this talk offers valuable perspectives on leveraging domain expertise, mapping model problems to real-world challenges, and maximizing quality in production environments.
ABOUT THE SPEAKER:
Niko Grupen, Head of Applied Research, Harvey -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
![OpenAIβs Responses API: A New Foundation for Building with Models & Tools
[2025 - Day 2 - Foundation Models] Nikunj Handa shares insights from building OpenAIs Responses API, exploring how this programmatic agent API radically simplifies integration by transforming hundreds of lines of code into just a few. This talk offers valuable perspectives on the design decisions and engineering challenges behind creating an API uniquely engineered for agent-like use cases with built-in state management and semantic streaming, particularly relevant for developers building AI applications or integrating advanced reasoning capabilities.
ABOUT THE SPEAKER:
Nikunj Handa, Product Lead, OpenAI -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ OpenAIβs Responses API: A New Foundation for Building with Models & Tools](https://i.ytimg.com/vi/Vb1bf3bFJFI/mqdefault.jpg)

![From Prediction to Uplift: Causal Modeling for Better Decisions | Intuit
[2026 - DAY 2 - ANALYTICS & DATA SCI] Most AI/ML systems in production rely on predictive models. Businesses score users for churn risk, conversion likelihood, or click probability, and then make decisions based on those scores. But accurate predictions do not imply better decisions. A model that answers the question βWho will convert anyway?β very well is often a terrible guide for deciding who to target with an offer, notification, or intervention. More often than not, what we really care about is answering the question βWhose behavior will actually change because of our intervention?β rather than βWho will do X?β.
This gap between prediction and decision-making shows up in more and more places, such as marketing campaigns, product experiments, and even healthcare and risk interventions. Uplift modeling is a way to bridge this gap by estimating the causal effect of an intervention at the individual levelβwho is persuadable, who is a sure thing, who is a lost cause, and who might even be harmed or annoyed if we intervene. At Intuit, we use uplift modeling to enhance targeting and experimentation, helping us allocate marketing and product interventions more effectively across millions of customers.
In this talk, I will introduce uplift modeling as a practical form of causal AI that fits into existing experimentation and ML workflows. I will start by contrasting predictive and causal thinking, followed by core concepts like treatment effects and counterfactuals, using concrete examples. After that, I will dive into uplift modeling techniques, specifically using meta-learners in Python. Finally, we will go over evaluation techniques that are unique to uplift modeling and causal inference, and how they differ from standard ML metrics like F1 score or AUC.
This talk is aimed at data scientists and ML engineers at any level, including those with no background in causal inference. Basic familiarity with Python and machine learning concepts is helpful but not required. Attendees will leave with a clear mental model of when predictive models are not enough, an intuitive understanding of uplift modeling and its causal foundations, and a sense of how to start applying uplift models in their own AI/ML systems to target the right people.
SPEAKER:
Avik Basu - Staff Data Scientist, Intuit
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf From Prediction to Uplift: Causal Modeling for Better Decisions | Intuit](https://i.ytimg.com/vi/VrwJqbysoUU/mqdefault.jpg)
![The World Is Not Enough: RLβs Environment Problem
[2026 - Day 1 - KEYNOTE] While researchers may still opine about access to compute, most are hitting a new bottleneck: access to high-quality environments in which to post-train agents. Expanding agent capabilities will depend on how we curate and utilize data, much of which exists only in the minds of human experts today. This panel will explore the challenge of building environments, including the need to improve infrastructure reliability, the obstacles posed by subjective domains, and the challenge of achieving high variety. Weβll also discuss future opportunities, such as environments for long-horizon reasoning and continual learning, and what it will take to evolve environment design from a bespoke craft into a more automated, scalable discipline that consistently drives generalization.
PANELISTS:
Nic Ouporov - Co-founder & CEO, Fleet
Vincent Weisser - Co-founder & CEO, Prime Intellect
Thais Castello Branco - Founder & CEO, Taste
Sarah Catanzaro - General Partner, Amplify Partners (Moderator)
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf The World Is Not Enough: RLβs Environment Problem](https://i.ytimg.com/vi/WDDwOsY9rw8/mqdefault.jpg)
![OAKS: Open Agentic Knowledge Stack
[2025 - Day 3 - Lightning Talks] Alexy Khrabrov shares insights from the Open Agentic AI Knowledge Stack (OAKS), exploring how Knowledge Graphs power GraphRAG and bridge enterprise AI adoption with startup innovation around structured knowledge. This talk offers valuable perspectives on organizing domain knowledge for Small Specialized Models and Domain Expert Agents, particularly relevant for teams working on structured AI architectures with graph-based agentic workflows and scalable message passing frameworks.
ABOUT THE SPEAKER:
Alexy Khrabrov, AI/ML Community Architect, Neo4j -
ποΈ GET YOUR TICKET TO AI COUNCIL 2026 ποΈ
Meet the worlds top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.
β https://aicouncil.com/sf-2026
β‘ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
Website: https://aicouncil.com/ OAKS: Open Agentic Knowledge Stack](https://i.ytimg.com/vi/WgZA1FHSuLA/mqdefault.jpg)
![Breaking the Proof-of-Concept Cycle: Stop Prototyping and Get Into Production | GitLab
[2026 - DAY 3 - APPLIED AI] Most organizations are experimenting with AI at work. Proof of concepts are thriving in small-scale silos, but how can you scale those wins across an enterprise? This talk discusses the symptoms that trap teams in the cycle of perpetual prototyping and provides a practical framework for breaking through common technical, organizational, and cultural barriers to scale. Learn how to plan for production from day one and turn your AI experiments into solutions that stick.
SPEAKER:
Naheil McAvinue - Director, Enterprise Analytics & Data Science, Gitlab
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Breaking the Proof-of-Concept Cycle: Stop Prototyping and Get Into Production | GitLab](https://i.ytimg.com/vi/Wkpt2MDCaxI/mqdefault.jpg)
![Build Trustworthy LLM Apps Powered by Agentic Evals | Meta
[2026 - DAY 3 - LIGHTNING TALK] Agentic AI has certainly secured mindspace of industry. As more & more people continue to play with LLMs, they begin developing an intuition aka vibes around whether LLM is performing the task at hand well or not. While usecases like math problem, classification are easier to verify; generative content creation etc are not. Adding agents to the mix makes things lot more complex. This talk will highlight the particular challenges one may face as they continue their journey towards productionizing their Agentic application: outputs are non deterministic, ground truth is hard to find, and what used to work before no longer does. Yet LGTM isnt a deployment strategy.
While typical LLM chatbot can be seen as a more sophisticated Google search, were beginning to expect more from Agents: Dont just give an answer but actually perform the task. Security, bias, privacy etc suddenly become non-negotiable. Only after we handle these complexities, we can unblock real usecases in healthcare, finance, legal etc.
This talk tackles why agent evaluation is fundamentally harder than traditional ML testing: multi-step reasoning chains, tool use side effects & more. How to build evaluation datasets that actually reflect production scenarios, not just cherry-picked examples. Well cover automated evaluation pipelines using LLM-as-judge patterns, and when you can not avoid human in the loop. The session addresses detecting regressions before users do: setting up continuous evaluation that catches model degradation. Tricky cases when agent aces public evals but fails in production, and how to build evaluations that predict real-world performance.
SPEAKER:
Rushabh Mehta - Tech Lead, Meta
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Build Trustworthy LLM Apps Powered by Agentic Evals | Meta](https://i.ytimg.com/vi/XZwbeuwZxSk/mqdefault.jpg)
![The Agent Attack Surface: Why AI Is Breaking Software Security As We Know It | Socket
[2026 - DAY 3 - AI SECURITY & SAFETY] For decades, software security has followed a simple mental model: developers write code, security teams review it, and vulnerabilities get patched one by one. AI agents are about to break that model entirely.
Agents dont just run code β they choose tools, write new code, and select dependencies throughout the development process, often without any human in the loop. They lack the context to make safe decisions about what theyre pulling in: whether a package is malicious, maintained, or a typosquat of something legitimate. The software supply chain becomes dramatically harder to reason about when the software itself is deciding what to include.
At the same time, AI is supercharging vulnerability discovery, finding hundreds of new flaws at a pace the current model cant absorb. Putting the burden on individual developers is no longer acceptable.
Well discuss what a new security model looks like β one that operates at the ecosystem level and responds automatically to emerging threats.
SPEAKER:
Feross Aboukhadijeh = CEO, Socket
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf The Agent Attack Surface: Why AI Is Breaking Software Security As We Know It | Socket](https://i.ytimg.com/vi/XnP3td72tng/mqdefault.jpg)
![Data Lake CDC: Are we there yet? | ClickHouse
[2026 - DAY 3 - LIGHTNING TALK] The idea of incremental reads from data lakes has been cooking for years, but few are serving it up. As a user, you must wrangle change feeds, snapshots, time travel, that one corrupted manifest file. Do you need to be a Big Data Engineer to get it right? In this lightning talk, weβll explore whatβs broken, whats just hard, and why making data lake CDC accessible is a problem worth solving.
SPEAKER:
Marta Paes - Senior Product Manager, ClickHouse
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf Data Lake CDC: Are we there yet? | ClickHouse](https://i.ytimg.com/vi/XsEBpU1lrhs/mqdefault.jpg)

![The End of the Internet As We Know It
[2026 - Day 3 - KEYNOTE] In a recent New York Times op-ed, Mozilla CTO Raffi Krikorian warned that the informal detente that kept the internet secure β where writing software and finding vulnerabilities were equally hard β is over.
Raffi sits down with Pete Soderling to go deeper: what the Mythos moment means for builders right now, how teams should think about AI as co-author rather than tool, the economics of open source in a world of expensive foundation models, and whether open models can offer a credible alternative to the frontier labs.
Read Raffis NYT essay: https://www.nytimes.com/2026/04/15/opinion/mythos-open-souce-internet.html
SPEAKERS:
Raffi Krikorian - Chief Technology Officer, Mozilla
Pete Soderling - Founder & General Partner, Zero Prime
π Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter
ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.
FIND US:
Website: https://aicouncil.com/
LinkedIn: https://www.linkedin.com/company/aicouncilconf/
X: https://x.com/aicouncilconf The End of the Internet As We Know It](https://i.ytimg.com/vi/YCRE3yRvazg/mqdefault.jpg)