BERT (Bidirectional Encoder Representations from Transformers) is a foundational language model that reads text in both directions simultaneously, allowing deeper context understanding than left-to-right models. Released by Google in 2018, it kickstarted the modern pre-trained language model era and excels at classification, question answering, and named entity recognition. Its architecture influenced GPT, RoBERTa, and many successors.
LLMs & Models
BERT
Related terms
Learn to use these concepts in practice.
Join the 212AY Academy →