Models and training

Decoder

stable definition

Definition

A decoder transforms an internal representation or prior outputs into a target output, reconstruction, or next-token sequence.

Distinguish it from nearby terms

An encoder maps input into representations; a decoder maps representations or preceding tokens toward outputs.

Check your understanding

Explain what conditions the decoder receives and how it chooses the next output.