Definition
A training constraint or penalty that discourages a model from fitting the training data too narrowly.
Distinguish it from nearby terms
Regularization changes the learning problem or training behavior. Validation measures performance on held-out data; it does not itself constrain the learned model.
Check your understanding
Useful regularization may slightly worsen training performance while improving performance on new data.