The context window is the maximum number of tokens a language model can process in a single request, including both input and output. GPT-4 Turbo supports 128,000 tokens; Claude 3 supports up to 200,000. A larger context window lets the model analyze longer documents and maintain more conversation history. However, longer contexts increase cost and can reduce attention to important details in the middle of input.