Uploaded November 2026 | Updated November 2026, 5 days ago
Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk
Codelab → https://g.dev/ai/self-evolving
Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest.
Chapters:
00:00 - Intro & the 4 pillars of agent evaluation
00:28 - What counts as success?
01:56 - Evaluation approaches: Comparators
03:45 - How to check: Deterministic code vs. LLM as a judge
05:50 - Building a custom metric in Python
08:00 - Configuring ADK eval & validating the evaluator
11:00 - Automating agent testing in CI/CD with Pytest
Speaker: Annie Wang
Products Mentioned: Agent Development Kit
Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk
Codelab → https://g.dev/ai/self-evolving
Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest.
Chapters:
00:00 - Intro & the 4 pillars of agent evaluation
00:28 - What counts as success?
01:56 - Evaluation approaches: Comparators
03:45 - How to check: Deterministic code vs. LLM as a judge
05:50 - Building a custom metric in Python
08:00 - Configuring ADK eval & validating the evaluator
11:00 - Automating agent testing in CI/CD with Pytest
Speaker: Annie Wang
Products Mentioned: Agent Development Kit










