Building a custom evaluation for your agent @googlecloudtech
Building a custom evaluation for your agent  @googlecloudtech
Uploaded November 2026 | Updated November 2026, 5 days ago
Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk
Codelab → https://g.dev/ai/self-evolving

Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest.

Chapters:
00:00 - Intro & the 4 pillars of agent evaluation
00:28 - What counts as success?
01:56 - Evaluation approaches: Comparators
03:45 - How to check: Deterministic code vs. LLM as a judge
05:50 - Building a custom metric in Python
08:00 - Configuring ADK eval & validating the evaluator
11:00 - Automating agent testing in CI/CD with Pytest

Speaker: Annie Wang
Products Mentioned: Agent Development Kit
Building a custom evaluation for your agentAgent Evaluation walkthroughBuild a full stack app with Antigravity voice prompts & sub-agentsBuild & connect an incident investigation agent with Elastic Agent Builder and Gemini Enterprise👩‍💻 Martin Omander takes over the Google Cloud Tech channelThe first prompt engineers run when a new LLM dropsWhy AI agents need their own identity & audit trailsGrounding agents in your trusted semantic models using Knowledge CatalogEnd-to-end agentic development with Google Gemini, Antigravity, and GitLabWhy AI apps fail in production (and how Google solved it)Dataflow for Real-time Marketing IntelligenceGoogle Cloud Live: Getting started with Gemini CLI
Google Cloud Tech |

Building a custom evaluation for your agent

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER