Definition
A neural-network architecture built around attention mechanisms that process relationships among sequence elements in parallel.
Distinguish it from nearby terms
Transformer is an architecture, not a synonym for LLM; transformers are also used for vision, audio, and multimodal tasks.
Check your understanding
GPT names one family of generative pretrained transformers, not every transformer model.