Orchestrating at Scale How Instacart Manages 20M+ Daily Workflows @aicouncilconf

Uploaded May 2025 | Updated September 2026, 3 weeks ago

[2025 - Day 1 - Data Eng & Infra] Anant Agarwal shares insights from orchestrating at scale, exploring how Instacart manages 20M+ daily workflows and the technical challenges of coordinating massive data operations. For engineers building workflow orchestration systems or scaling data pipelines, this talk offers valuable perspectives on managing complex distributed systems that power one of the world's largest on-demand platforms.

ABOUT THE SPEAKER:
Anant Agarwal, Staff Software Engineer, Instacart -

🎟️ GET YOUR TICKET TO AI COUNCIL 2026 🎟️
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.

→ aicouncil.com/sf-2026

⚡ FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com

Orchestrating at Scale How Instacart Manages 20M+ Daily Workflows

Stop Worrying About Foundation Models — Your Taste, Judgment, and UX Are the Real Moat

RAG in 2025: State of the Art and the Road Forward

Scaling CDC to Trillions of Rows: What Broke, What We Rebuilt, and What AI Demands Next | Artie

$How Action Bias Breaks Autonomous Software Maintenance | LogicStar.ai [2026 - DAY 3 - LIGHTNING TALK] Coding agents are increasingly trusted to resolve issues end-to-end: investigate, patch, ship, without a human in the loop. But in real-world maintenance tasks, a large fraction of incoming bug reports describe issues that are already fixed. A competent maintainer moves on. Current agents dont. In our new benchmark FixedBench, frontier models apply unnecessary edits to already-correct code in 35-65% of cases, even with full git history and a working environment. More reasoning doesnt help. Better prompts help, but trade one failure mode for another. Todays training rewards producing patches, not deciding whether one is needed. At scale, that quietly compounds into technical debt. The fix starts with framing inaction as a valid success state. SPEAKER: Mark Niklas Mueller - Co-founder & CTO, LogicStar.ai 👉 Sign up for our No BS Newsletter to get the latest technical data & AI content: https://aicouncil.com/newsletter ABOUT AI COUNCIL: AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools. FIND US: Website: https://aicouncil.com/ LinkedIn: https://www.linkedin.com/company/aicouncilconf/ X: https://x.com/aicouncilconf$

Rikai: A New Data Format for Analytics on Unstructured Data at Scale

Do the Boring Stuff to Make Open Source AI Win | Mozilla.ai

Q&A with Chang She, CEO, LanceDB: Why the 20-year-old data stack is breaking under AI workloads

Forgiveness, Not Permission: Running Agents On Production Data | Bauplan

Instant Preview Mode Real Time Feedback to Make SQL Data Exploration Fly

Embedding OLAP, Everywhere Lessons from Okta

Great Infra for Background Agents | Sail