Evaluation and reliability

Benchmark

stable definition

Definition

A standardized set of tasks, data, metrics, and procedures used to compare systems under a defined evaluation regime.

Distinguish it from nearby terms

A benchmark enables comparison inside its regime; it is not a general certificate of production quality.

Check your understanding

Report infrastructure, tools, budget, harness, contamination risk, and confidence intervals alongside a score.