Models and training

Graphics processing unit (GPU)

stable definition

Definition

A graphics processing unit is a highly parallel processor widely used for the matrix operations involved in neural-network training and inference.

Distinguish it from nearby terms

A model is software and learned parameters; a GPU is hardware that executes its computations.

Check your understanding

Explain how memory capacity, memory bandwidth, precision, and batching affect usable model performance.