Definition
A broadly trained model, usually learned through self-supervision on diverse data, that can be adapted to many downstream tasks.
Distinguish it from nearby terms
A foundation model is defined by broad pretraining and adaptability; an LLM is the language-oriented subset most people encounter.
Check your understanding
A fine-tuned application model may descend from a foundation model without itself serving as a broad foundation.