Inference and generation

Output token

stable definition

Definition

A token generated by a model as part of its response, often metered separately from input tokens.

Distinguish it from nearby terms

Output tokens are generated; input tokens include instructions and context supplied to the model.

Check your understanding

A short final answer can still require a large internal or multi-call inference budget.