Definition
A masked language model learns by predicting tokens deliberately hidden from an input while using surrounding context on both sides.
Distinguish it from nearby terms
A causal language model predicts future tokens using only preceding context.
Check your understanding
Explain why bidirectional context helps representation learning but does not directly define left-to-right generation.