Definition
A decoder-only model generates each token conditioned on preceding tokens in one causal sequence.
Distinguish it from nearby terms
An encoder-decoder model separately encodes source input; a decoder-only model places instructions, context, and output into one continuation format.
Check your understanding
Show how prompt and response become one sequence while masking future tokens during training.