The best AI agents need less code than you think @LangChain
The best AI agents need less code than you think  @LangChain
Uploaded July 2026 | Updated November 2026, 4 days ago
Ben Tannyhill is a product manager at LangChain, where he's building LangSmith Engine—an agent that finds and fixes your agent's failures. Engine continuously analyzes your production traces, clusters them into actionable issues, and opens pull requests to fix them. Engine's architecture is a lot like an org chart: a main model delegating to a team of cheaper, faster sub-agents. It launched in public beta at Interrupt 2026, and in this conversation, Ben unpacks why it uses a sandbox as a tool, how the team turned it into a self-improving agent that learns from its own traces, and the hard problem of testing a fix before it ships.

We also discuss:
• Why Engine is "the agent for agent engineers"
• Making LangSmith agent-native with condensed trace views
• Why the team keeps handing more control to the agent
• Inside Engine's four sub-agents: the screener, verifier, and more
• Giving Engine memory with an agent overview document
• How to keep an always-on agent from blowing the inference budget
• Where Insights, Polly, and Engine are converging

Timestamps:
00:00 Introduction
01:25 LangSmith 101
02:22 Why Engine is "the agent for agent engineers"
03:49 Under the hood: Engine is a deep agent
06:08 Clustering millions of traces with condensed views
10:10 Why the team keeps handing more control to the agent
13:21 Why Engine uses a sandbox as a tool
14:11 Engine's four sub-agents and the org-chart analogy
16:51 Evals for Engine: IssueBench, Harbor, and synthetic environments
23:05 How Engine evolved: from noisy PRs to an issue inbox
25:56 Inside Engine's memory: the agent overview document
29:25 How to keep an always-on agent from blowing the inference budget
30:52 What models Engine uses
31:30 How Engine was rolled out: from Forge to public beta at Interrupt
34:18 Inside the two teams building Engine
35:53 Where Insights, Polly, and Engine are converging
40:06 The missing piece: testing a fix before it ships
42:22 Running a branched agent, and the write-access eval problem
46:35 Using Engine as long-term memory
47:39 Pointing Engine at coding-agent traces
48:49 Running Engine on Engine: the meta self-improvement loop

References:
• Anthropic: anthropic.com
• Chat LangChain: chat.langchain.com
• Claude Code: anthropic.com/claude-code
• Claude Haiku: anthropic.com/claude/haiku
• Claude Opus: anthropic.com/claude/opus
• Codex: openai.com/codex
• Context Hub: docs.langchain.com/langsmith/use-the-context-hub
• Credit Genie: creditgenie.com
• Deep Agents: docs.langchain.com/oss/python/deepagents/overview
• Gemini: gemini.google.com
• GPT-5.5: openai.com/index/introducing-gpt-5-5
• Harbor: harborframework.com
• Hex: https://hex.tech/
• Insights: docs.langchain.com/langsmith/insights
• Interrupt: interrupt.langchain.com
• LangGraph: langchain.com/langgraph
• LangSmith: smith.langchain.com
• LangSmith Chat (formerly Polly): docs.langchain.com/langsmith/chat
• LangSmith Engine: langchain.com/langsmith/engine
• LangSmith Observability: langchain.com/langsmith/observability
• Mintlify: mintlify.com
• OpenAI: openai.com
• Palash Shah: linkedin.com/in/palash-sh
• Terminal-Bench: tbench.ai
• Unify: unifygtm.com

Where to find Ben:
• LinkedIn: linkedin.com/in/benjamintannyhill
• Twitter/X: https://x.com/bentannyhill

Where to find Harrison:
• LinkedIn: linkedin.com/in/harrison-chase-961287118
• Twitter/X: https://x.com/hwchase17

Where to find LangChain:
• Website: langchain.com
• Docs: docs.langchain.com

Send feedback or questions to maxagency@langchain.dev
The best AI agents need less code than you thinkLangSmith Sandboxes: A Secure Computer for Your AgentJensen Huang: Why companies need open agent systemsHow 11x Built a Slack-Native Bug Triage Agent with LangSmith FleetWhat Is Human in the Loop?Inside Toyotas Manufacturing AI: LangChain, LangSmith, and Six Figure ROIThe Agent Development Lifecycle 101 by Harrison ChaseVanta and LangSmith: Assessing Compliance Evidence Like an AuditorNemoClaw + dcode: A governed blueprint for AI coding agentsShare your Managed Deep Agent with your team using SlackIntroducing LangSmith Custom Apps: Build custom interfaces around your agent dataBuilding Reliable Speech-to-Speech Voice Agents: Combining Gemini Live + LangChain Deep Agents
LangChain |

The best AI agents need less code than you think

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER