Uploaded April 2026 | Updated September 2026, 2 weeks ago
Out Now On Our Channel!
Watch the full talk:
β―
Every API is a Tool for Agents with Code Mode | Matt Carey
Offload your entire OpenAPI spec to sandboxed V8 isolates to bypass the 2.3M token context wall once and for all.
ποΈ "We got it all wrong." Matt Carey (Cloudflare) breaks down why the industry's approach to AI Agents and Tool Calling is hitting a hard limit. When your API reaches 2.3 million tokens, "cherry-picking" endpoints for your MCP server isn't just tedious β it's architecture suicide.
π‘ The solution? Code Mode. Instead of feeding bulky tool definitions into the LLM context, Matt proposes a paradigm shift: Agents writing code against a typed SDK, executed within secure, lightweight Dynamic Worker Loaders.
Whatβs inside this Node Congress 2026 deep-dive:
βοΈ The 2.3M Token Wall | Why traditional Function Calling fails at enterprise scale.
βοΈ Code Mode vs. Semantic Search | Why "Discovery on Demand" is more reliable than brittle RAG-based tool search.
βοΈ Infrastructure as a Sandbox | Running untrusted LLM code with 1ms cold starts via V8 isolates.
βοΈ MCP Evolution | How to scale Model Context Protocol for massive APIs while keeping your AI clients lean and token-efficient.
βοΈ Live Demo | Building a cross-service Agent workflow in a single round-trip.
π₯ Matt Carey is an Agent & MCP Specialist at Cloudflare and a core maintainer of the official MCP TypeScript SDK. He specializes in architecting autonomous systems using Cloudflare primitives like Dynamic Worker Loaders and Durable Objects, helping industry leaders build and scale production-ready AI agents. Beyond the terminal, Matt brings a high-performance mindset from his previous career as a professional windsurfer, having represented Malta at multiple World and European championships.
π Connect with Matt:
π linkedin.com/in/mattzcarey
π Explore Mattβs code and the MCP SDK:
π github.com/mattzcarey
π Deep dive into Mattβs insights:
π mattzcarey.com
π Build AI Agents on Cloudflare:
π developers.cloudflare.com/workers
π Follow the link to watch the full version of the talk and gain access to all Node Congress recordings:
π gitnation.com/events/node-congress-2026?utm_source=youtube&utm_medium=MattCarey
π¬ Donβt just watch β get your toughest architecture questions answered in real-time, be part of the room where Seniors and Architects shape the future, get ahead of the curve. Join us live at the next event!
π gitnation.com/events?utm_source=youtube&utm_medium=MattCarey
#AIAgents #Cloudflare #NodeCongress #MCP #ModelContextProtocol #CodeMode #SoftwareArchitecture #V8Isolates #OpenAPI #BackendEngineering #TypeScript #NodeJS #WebDev #LLM #AIEngineering #TokenOptimization #FunctionCalling #AgenticWorkflows #Cloud Computing #GitNation #CloudflareWorkers #JavaScriptConference #TechTalk #Shorts #ProgrammingLife #CodingTips #SoftwareEngineering
Out Now On Our Channel!
Watch the full talk:
β―
Every API is a Tool for Agents with Code Mode | Matt Carey
Offload your entire OpenAPI spec to sandboxed V8 isolates to bypass the 2.3M token context wall once and for all.
ποΈ "We got it all wrong." Matt Carey (Cloudflare) breaks down why the industry's approach to AI Agents and Tool Calling is hitting a hard limit. When your API reaches 2.3 million tokens, "cherry-picking" endpoints for your MCP server isn't just tedious β it's architecture suicide.
π‘ The solution? Code Mode. Instead of feeding bulky tool definitions into the LLM context, Matt proposes a paradigm shift: Agents writing code against a typed SDK, executed within secure, lightweight Dynamic Worker Loaders.
Whatβs inside this Node Congress 2026 deep-dive:
βοΈ The 2.3M Token Wall | Why traditional Function Calling fails at enterprise scale.
βοΈ Code Mode vs. Semantic Search | Why "Discovery on Demand" is more reliable than brittle RAG-based tool search.
βοΈ Infrastructure as a Sandbox | Running untrusted LLM code with 1ms cold starts via V8 isolates.
βοΈ MCP Evolution | How to scale Model Context Protocol for massive APIs while keeping your AI clients lean and token-efficient.
βοΈ Live Demo | Building a cross-service Agent workflow in a single round-trip.
π₯ Matt Carey is an Agent & MCP Specialist at Cloudflare and a core maintainer of the official MCP TypeScript SDK. He specializes in architecting autonomous systems using Cloudflare primitives like Dynamic Worker Loaders and Durable Objects, helping industry leaders build and scale production-ready AI agents. Beyond the terminal, Matt brings a high-performance mindset from his previous career as a professional windsurfer, having represented Malta at multiple World and European championships.
π Connect with Matt:
π linkedin.com/in/mattzcarey
π Explore Mattβs code and the MCP SDK:
π github.com/mattzcarey
π Deep dive into Mattβs insights:
π mattzcarey.com
π Build AI Agents on Cloudflare:
π developers.cloudflare.com/workers
π Follow the link to watch the full version of the talk and gain access to all Node Congress recordings:
π gitnation.com/events/node-congress-2026?utm_source=youtube&utm_medium=MattCarey
π¬ Donβt just watch β get your toughest architecture questions answered in real-time, be part of the room where Seniors and Architects shape the future, get ahead of the curve. Join us live at the next event!
π gitnation.com/events?utm_source=youtube&utm_medium=MattCarey
#AIAgents #Cloudflare #NodeCongress #MCP #ModelContextProtocol #CodeMode #SoftwareArchitecture #V8Isolates #OpenAPI #BackendEngineering #TypeScript #NodeJS #WebDev #LLM #AIEngineering #TokenOptimization #FunctionCalling #AgenticWorkflows #Cloud Computing #GitNation #CloudflareWorkers #JavaScriptConference #TechTalk #Shorts #ProgrammingLife #CodingTips #SoftwareEngineering
