Definition
Gradient descent iteratively changes parameters using loss gradients so the objective is expected to improve.
Distinguish it from nearby terms
Backpropagation computes gradients through a neural network; gradient descent uses those gradients to update parameters.
Check your understanding
Describe the current parameters, computed gradient, step size, and update.