Definition
An activation function transforms a neuron's intermediate value, usually introducing nonlinearity or controlling signal flow.
Distinguish it from nearby terms
Weights and biases form a linear transformation; the activation determines how that signal passes onward.
Check your understanding
Explain why stacking only linear layers cannot represent arbitrary nonlinear relationships.