Evaluation and reliability

Trace

working definition

Definition

A captured sequence of model calls, tool calls, events, timings, state changes, and outputs from an execution.

Distinguish it from nearby terms

A trace records execution detail; lineage connects that detail into reconstructable provenance; telemetry is the broader stream of operational measurements.

For agent systems, the trace often carries behavioral evidence that source code alone cannot provide. It shows which path the model actually took through tools, state, and decisions.

Check your understanding

Protect sensitive trace data while retaining enough evidence for diagnosis and accountability.