Michael Hablich

Product Manager – Chrome Developer Tooling
Google Austria GmbH
Austria

About

Michael Hablich is a product manager at Google, leading Chrome DevTools and Puppeteer—tools used daily by millions of developers and AI agents worldwide. He launched Chrome DevTools Model Context Protocol (MCP) support, enabling AI coding agents to debug web applications autonomously. With nearly 20 years of experience in software—from developer to engineering manager, program manager, and product leader—Michael has navigated multiple technology shifts. He has led initiatives such as WebDriver BiDi and Chrome for Testing, mentored startups at Google incubators, and teaches at St. Pölten University of Applied Sciences. He lives in Vienna, Austria.
Talk

Michael Hablich | What gets measured gets optimized: evaluating the tools and skills your agents use

Agents, Evals, Metrics
Everyone is shipping tools and skills for agents, but almost nobody can tell you whether those tools and skills actually help. “It felt better in the demo” is not a metric, and with agents, that impression is often wrong: something can look great in one transcript and quietly fail much of the time in aggregate. This deep dive shows how to put real numbers on the effectiveness and efficiency of agent-facing tools and skills. The order matters: effectiveness first, efficiency second, because reducing costs is worthless if the agent never reaches the goal. Using real evaluation infrastructure as a worked example, Michael Hablich covers how to run controlled experiments with and without the tools or skills, scored against explicit checks; how to read the results to decide where to invest; an honest case in which adding guidance made things worse; and the efficiency levers and their trade-offs that reduce costs once quality is maintained. Attendees will leave able to design an evaluation for their own agent tools instead of trusting a good-looking demo.