Definition
The broad initial training phase that gives a model general representations and capabilities before task-specific adaptation.
Distinguish it from nearby terms
Pretraining creates the general model; fine-tuning adapts it to narrower behavior or tasks.
Check your understanding
Retrieval and prompting can specialize runtime behavior without additional pretraining.