Uploaded October 2026 | Updated November 2026, 1 day ago
Prompt caching can make an OpenAI API call 90% cheaper, but only if you actually hit the cache. Unify CTO Connor Heggie explains a limit most builders miss: the cache key tops out around 15 requests per second, so at real scale you have to engineer around it yourself. Full episode of Max Agency, LangChain's podcast on building production agents.
#AIagents #PromptCaching #OpenAI #LLMcost #Unify #LangChain
Prompt caching can make an OpenAI API call 90% cheaper, but only if you actually hit the cache. Unify CTO Connor Heggie explains a limit most builders miss: the cache key tops out around 15 requests per second, so at real scale you have to engineer around it yourself. Full episode of Max Agency, LangChain's podcast on building production agents.
#AIagents #PromptCaching #OpenAI #LLMcost #Unify #LangChain










