Models and training

Instruction tuning

stable definition

Definition

Fine-tuning a pretrained model on examples of instructions and desired responses so it becomes better at following task directions.

Distinguish it from nearby terms

Instruction tuning is a training method; a system prompt is a runtime instruction.

Check your understanding

Instruction following remains probabilistic and does not create an enforceable policy boundary.