Inference for Async Agents in Production | Doubleword @aicouncilconf
Inference for Async Agents in Production | Doubleword  @aicouncilconf
Uploaded June 2026 | Updated November 2026, 2 days ago
[2026 - Day 1 - AGENT INFRASTRUCTURE] As models improve, we are starting to build long-running, asynchronous agents such as deep research agents and browser agents that can execute multi-step workflows autonomously. These systems unlock new use cases, but they use orders of magnitude more tokens and compute, creating scaling bottlenecks.

This talk discusses practical strategies builders can use to maximize async agent performance while keeping inference costs under control. Topics covered include context engineering, compaction, cache maintenance, model routing, and batch inference. This talk is aimed at use case developers, with secondary relevance to platform engineers.

SPEAKER:
Meryem Arik - Co-founder & CEO, Doubleword

👉 Sign up for our "No BS" Newsletter to get the latest technical data & AI content: aicouncil.com/newsletter

ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.

FIND US:
Website: aicouncil.com
LinkedIn: linkedin.com/company/aicouncilconf
X: https://x.com/aicouncilconf
Inference for Async Agents in Production | DoublewordContext Engineering at the Frontier | Thrive CapitalThe Agentic Database: A New Way to Interact With Your DataEnabling Highly Autonomous Trusted AgentsBuilding Reliable Agentic AI SystemsRecursively Self-Improving Agents as Autonomous Software Engineering | FactoryEval Agents: How to Solve Error Cascades in Agents5 Lessons from the Classroom for Evaluating Agents | Dev InterruptedFrom Scaling to Observability Solving Key Challenges for Distributed ML with RayJev: ChatGPT Co-Creator’s Answer to RLHFDuckDB Co-Creator Hannes Mühleisen on Why Single-Node Beats DistributedWhy dbt Acquired SDF Building true SQL Comprehension
AI Council |

Inference for Async Agents in Production | Doubleword

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER