Definition
A loss function measures prediction error or undesired behavior for an example or batch during model training.
Distinguish it from nearby terms
Loss is usually minimized during training; an evaluation metric may be reported later and need not be differentiable.
Check your understanding
Identify what errors it penalizes, how strongly, and which important harms it omits.