Models and training

Hyperparameter

stable definition

Definition

A configuration value chosen outside ordinary parameter learning, such as learning rate, batch size, or model depth.

Distinguish it from nearby terms

Parameters are learned from data; hyperparameters shape the training or inference process.

Check your understanding

Some runtime settings, such as temperature, are often called inference parameters rather than learned model parameters.

Also called

hyper-parameter

Public evidence