Inference and generation

In-context learning

stable definition

Definition

In-context learning is adaptation to instructions, examples, or patterns supplied within the active context without changing model parameters.

Distinguish it from nearby terms

Few-shot prompting is a method for eliciting it; fine-tuning changes weights and persists beyond one context.

Check your understanding

Test whether the behavior disappears when the contextual examples are removed.