Inference and generation

Maximum output tokens

stable definition

Definition

Maximum output tokens is a hard cap on the number of tokens a model may generate in one response.

Distinguish it from nearby terms

A context window limits total input plus output capacity; a max-output setting limits only generated continuation length.

Check your understanding

Calculate whether the requested input and reserved output fit within the model's context window.