Models and training

Training batch

stable definition

Definition

A training batch is a subset of examples processed together for one optimization update or gradient estimate.

Distinguish it from nearby terms

An epoch covers the training dataset once in aggregate; a batch is one smaller unit within that pass.

Check your understanding

Explain how batch size affects memory, gradient noise, and update frequency.