Engineering Agency out of the Happy Path — Matthew Jewkes, Standard Cybernetics @aiDotEngineer
Engineering Agency out of the Happy Path — Matthew Jewkes, Standard Cybernetics  @aiDotEngineer
Uploaded November 2026 | Updated November 2026, 4 days ago
A biopharma automation reached 99.95% accuracy on its business critical tasks after the team separated actual errors from ambiguous cases and exceptions. Matthew Jewkes describes building that system at Clarivate, where indexing drug development documents meant handling tens of thousands of new tasks a month. An early agent approach reached around 80% to 83%. Working through 1,000 evaluation examples with domain experts exposed three different problems: the model could be wrong, the organization could lack an agreed answer, or genuinely new science could require judgment. Each needed its own route. The routine path became a tightly specified automation, with uncertain and unusual cases escalated instead of pushed through.

The larger payoff was recovering expert attention. Once routine decisions were handled, the remaining cases could be grouped for deliberate review: critical exceptions to clear, ambiguous low value work to freeze, and unusual demand that might justify a new product. One expert used that structured backlog to form an investment thesis before a major customer raised the same need. Jewkes lays out where the investment makes sense, how much evaluation work high reliability requires and why organizational ownership and trust matter alongside engineering. His bet is that companies will gain more from managing collective attention and judgment than from choosing a particular orchestration framework.

Speaker info:
- https://x.com/mjewkes
- linkedin.com/in/mjewkes

Timestamps:
0:00 - Expert attention and cheap execution
1:48 - Fully automate the happy path
4:18 - The biopharma indexing case study
6:39 - Errors, ambiguity and exceptions
8:52 - Routing uncertainty and the critical path
9:58 - From 95% to 99.95% accuracy
11:24 - Recovering expert judgment
12:51 - Exceptions as market signals
14:51 - Where full automation is worth the cost
17:17 - Evals and the value of human attention
Engineering Agency out of the Happy Path — Matthew Jewkes, Standard CyberneticsYour Agent Is a Lethal Trifecta (And What to Do About It) — Kim Maida, KeycardExploits Now Beat Patches: Open Source Security in the AI Era - Patrick Smyth, ChainguardHow Evals and Prompts Shape Agent Behavior — Preetika Bhateja & Daniel Bump, YouTube AdsWhy AI Wont Replace Stock Pickers - Jack Woodruff, Candlestick & Vinoo Ganesh, KeplerAIE CODE: Google DeepMind, OpenAI, ArtCraft, Cognition, Exa, Anthropic, Amp, et alWhen we can do anything, do we still know what we want? — Ryo LuAn Agent That Fixes Its Own Mistakes - Saloni Gandhi & Ziwei Guo, LinkedInAgentic Security: Permissions, Provenance, and the Agent Supply Chain — Steve Yegge, Gas TownYour Old Prompts Are Making Claude Worse - Lance Martin, AnthropicYour SKILL.md Is 70% Stuff the Model Already Knows - Nikolay Petrov, IntelScaling up Continual Learning — Ronak Malde, Trajectory
AI Engineer |

Engineering Agency out of the Happy Path — Matthew Jewkes, Standard Cybernetics

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER