Uploaded October 2026 | Updated November 2026, 5 days ago
Once you can measure an agent, the next question is how to make it better. Most teams stop at evaluation and fix problems by hand, one prompt tweak at a time.
What you will learn
- How to read and analyze an agent’s failing traces to find what’s really going wrong
- How to group individual failures into recurring failure modes
- How to automatically update an agent’s instructions, memory, and tools based on those failures
- How to do all of this with off-the-shelf libraries instead of building a bespoke pipeline
- How to A/B test the improved agent against the baseline and measure the gain in pass@k – no fine-tuning required
Once you can measure an agent, the next question is how to make it better. Most teams stop at evaluation and fix problems by hand, one prompt tweak at a time.
What you will learn
- How to read and analyze an agent’s failing traces to find what’s really going wrong
- How to group individual failures into recurring failure modes
- How to automatically update an agent’s instructions, memory, and tools based on those failures
- How to do all of this with off-the-shelf libraries instead of building a bespoke pipeline
- How to A/B test the improved agent against the baseline and measure the gain in pass@k – no fine-tuning required



