Definition
The learning rate controls the scale of parameter updates made by an optimizer.
Distinguish it from nearby terms
It is not the rate at which examples arrive; it is the step-size control for learning dynamics.
Check your understanding
Explain the failure modes of a value that is too high and one that is too low.