Models and training

Encoder-decoder model

stable definition

Definition

An encoder-decoder model first represents an input with an encoder, then generates a target output with a decoder conditioned on that representation.

Distinguish it from nearby terms

A decoder-only model predicts continuations from a single causal sequence rather than using a separate input encoder.

Check your understanding

Map the source input, encoder representation, decoder context, and target output in translation.