Definition
An encoder transforms input into an internal representation useful for later prediction, retrieval, classification, or generation.
Distinguish it from nearby terms
A decoder turns a representation or prior tokens into outputs; an encoder creates the representation it consumes.
Check your understanding
Identify the input, representation, and downstream task the encoding must preserve.