Context and knowledge

Chunking

working definition

Definition

Splitting documents or data into retrieval units that can be indexed, selected, and placed into model context.

Distinguish it from nearby terms

Chunking defines retrieval units; tokenization defines model-processing units.

Check your understanding

Chunks that are too small lose context, while chunks that are too large waste budget and blur relevance.