Skip to main content
AmigoFish

Building a custom evaluation for your agent

From Google Cloud Tech · · 13 min

The player loads from YouTube only when you click. It uses YouTube's privacy-enhanced mode.

If the video does not play, the owner may have turned off embedding. Watch it on YouTube instead.

Watch on YouTube

Not rated yet

Description

Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk Codelab → https://g.dev/ai/self-evolving

Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest.

Chapters: 00:00 - Intro & the 4 pillars of agent evaluation 00:28 - What counts as success? 01:56 - Evaluation approaches: Comparators 03:45 - How to check: Deterministic code vs. LLM as a judge 05:50 - Building a custom metric in Python 08:00 - Configuring ADK eval & validating the evaluator 11:00 - Automating agent testing in CI/CD with Pytest

Speaker: Annie Wang Products Mentioned: Agent Development Kit

Back to Google Cloud Tech · Report a problem