Inference and generation

Temperature

stable definition

Definition

An inference setting that reshapes token probabilities, with higher values generally increasing variation and lower values concentrating choices.

Distinguish it from nearby terms

Temperature controls sampling distribution; it does not measure confidence, creativity, or factuality directly.

Check your understanding

A temperature of zero reduces sampling variation but does not guarantee identical or correct results across infrastructure.