Definition
A systematic measurement of model or system behavior against defined tasks, criteria, datasets, or operational outcomes.
Distinguish it from nearby terms
An evaluation is the measurement process; a benchmark is a standardized evaluation set or protocol.
Check your understanding
The reported unit must say whether it measures a model, harness, full agent system, or production workflow.