LEARN. PRACTICE. GROW.Concept and mechanism
Delivering more items measures output but does not automatically demonstrate improvement for users. Form a hypothesis connecting a change, its expected benefit, and the reason for that effect. Before an experiment, define what to observe, how to collect data, and which result would support the next decision. Use a comparable baseline, an observation period, and relevant segments. An overall average can hide continuing difficulties for occasional operators. Combine metrics with research to understand the observed mechanism. EBM helps distinguish activities, outputs, and outcomes while keeping attention on current value, opportunities, ability to innovate, and time to learn. Metrics serve decisions and need context rather than an appearance of precision.
Guided application
In a fictional example, 120 of 150 tasks finish without assistance: the observed rate is 80%. After a change, compare the same task definition and population before attributing any difference to the solution. A small sample or a week containing easier cases does not establish causality by itself. If time decreases but corrections increase, investigate the trade-off and consider stopping or adapting the experiment. Keep results that contradicted the hypothesis visible; redefining the metric merely to declare success destroys learning. The next step may be improving instructions, changing the solution, or abandoning the investment. This course’s final assessment practices those decisions without replacing real experience or awarding an external certification.
120 ÷ 150 = 0.80; interpretation requires context and an appropriate comparison.
Common pitfalls
Clicks treated as value; averages without segments; assumed causality; metrics selected afterward.
Related topics: Goal, value, and accountability · Needs and discovery · Ordering and explicit trade-offs
Learn from the observed effect and decide whether to continue, adapt, or stop.
Reference: How to set performance metrics for your service · Scrum Guide November2020; EBM May2024; primary product practice reviewed 2026-09-30