Building a custom evaluation for your agent
From Google Cloud Tech · · 13 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.
If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.
Description
Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk Codelab → https://g.dev/ai/self-evolving
Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest.
Chapters: 00:00 - Intro & the 4 pillars of agent evaluation 00:28 - What counts as success? 01:56 - Evaluation approaches: Comparators 03:45 - How to check: Deterministic code vs. LLM as a judge 05:50 - Building a custom metric in Python 08:00 - Configuring ADK eval & validating the evaluator 11:00 - Automating agent testing in CI/CD with Pytest
Speaker: Annie Wang Products Mentioned: Agent Development Kit