The transformer is the neural network architecture that revolutionized NLP and underpins all modern large language models. Its key innovation is the self-attention mechanism, which processes all tokens in parallel rather than sequentially, enabling massive speedups and much better long-range context handling. GPT, BERT, Claude, Gemini — they are all transformer-based. Transformers also power vision models, speech systems, and protein-folding research.