Definition
A causal language model learns a probability distribution for the next token conditioned on preceding tokens.
Distinguish it from nearby terms
A masked language model fills hidden positions using both left and right context; causal modeling prevents access to future tokens.
Check your understanding
Write the factorization of a sentence as successive next-token predictions in plain language.