Context Engineering for LLM Apps: What Worked, What Didnt @infoq
Context Engineering for LLM Apps: What Worked, What Didnt  @infoq
Uploaded October 2026 | Updated November 2026, 1 day ago
Ricardo Ferreira's LLM assistant kept giving bad answers, so he switched to a newer model with a bigger context window. It didn't help, and it cost more. What fixed it was Context Engineering: memory layers, reranking, summarization and semantic caching.

Ricardo Ferreira has spent 25+ years building distributed systems and databases. To stress-test an open-source agent memory server built on Redis, he put an LLM behind an Alexa skill, which must answer within 8 seconds, and then used it with his family every day. This talk covers every context failure he hit along the way and how he fixed each one.

Recorded at QCon AI Boston 2026. QCon conferences are practitioner-driven events where senior engineers share real production experience.

In this talk, you will learn:
- Why upgrading to a larger model doesn't fix context poisoning, distraction, confusion or rot
- How to combine short-term session memory with long-term vector memory, including multi-tenant post-filtering
- How query compression, few-shot examples and reranking make answers more selective
- Why context that grows without limit drives up token cost, and how token windows and summarization keep it flat
- How semantic caching removed more than half of redundant LLM calls, and why you must recalibrate thresholds whenever you change models

đź”— Transcript & slides available on InfoQ: bit.ly/3Tz3lLn

#ContextEngineering #LLM #AIEngineering #RAG #SemanticCaching
Context Engineering for LLM Apps: What Worked, What DidntHow Platform Teams Reduce Friction Without Slowing Down DeliveryWhy We Deprecated Google Analytics (And Built a System 3x Cheaper)Making AI Reliable in the SDLC: The Role of Deterministic Context at ScaleManaging 238M Memberships at NetflixWhy AI Code Is Actually Write-Only  #infoqShipping Features vs. Managing Performance ⚡️Software is changing forever - Lead the change: QCon Software Development Conference.Anthropic Just Proved AI Hurts Developer Learning  #infoqSenior engineers do not just come to QCon for talks. They come for the conversations around them.Engineering Stable, Secure and Scalable Platforms: A Conversation with Matthew ListeAgentic Systems Without Chaos: Early Operating Models for Autonomous Agents
InfoQ |

Context Engineering for LLM Apps: What Worked, What Didn't

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER