Models and training

Backpropagation

stable definition

Definition

Backpropagation applies the chain rule backward through a computation graph to compute gradients of loss with respect to parameters.

Distinguish it from nearby terms

Backpropagation computes gradients; the optimizer decides how those gradients change the weights.

Check your understanding

Trace how an output error produces a gradient for an early-layer weight.