Inference and generation

Logit

stable definition

Definition

A logit is an unnormalized score a model assigns to a candidate class or next token before normalization.

Distinguish it from nearby terms

A probability is normalized across alternatives; a logit can be any real-valued score and is not directly a confidence percentage.

Check your understanding

Explain how softmax converts a vector of logits into a probability distribution.