Definition
Positional encoding supplies information about token order or distance that attention alone would not otherwise distinguish.
Distinguish it from nearby terms
Token embeddings represent token identity and learned meaning; positional information tells the model where tokens occur.
Check your understanding
Explain why swapping token order would be invisible to attention without some positional signal.