Models and training

Fine-tuning

stable definition

Definition

An additional training phase that adapts a pretrained model by updating some or all parameters using task- or domain-specific data.

Distinguish it from nearby terms

Fine-tuning changes weights; prompting, retrieval, and tools change runtime inputs or capabilities.

Check your understanding

Fine-tuning may improve a target behavior while degrading others, so it still requires evaluation.