The context window is the maximum number of tokens a language model can process in a single request, including both input and output. GPT-4 Turbo supports 128,000 tokens; Claude 3 supports up to 200,000. A larger context window lets the model analyze longer documents and maintain more conversation history. However, longer contexts increase cost and can reduce attention to important details in the middle of input.
LLMs & Models
Context Window
Related terms
Learn to use these concepts in practice.
Join the 212AY Academy →