The Four Sources of Context
Instead of throwing all text into one flat string, split context into four layers by lifecycle. Click any layer on the left to inspect its retention strategy and a realistic snippet (colors match the interactive labs below):
Why More Context Degrades Accuracy
Liu et al. (2023, TACL 2024) Source: arXiv:2307.03172 ↗ gave GPT-3.5-Turbo 20 documents with the answer hidden in only one of them, then measured accuracy by position:
Chroma’s 2025 benchmark across 18 frontier models confirmed similar “Context Rot” (Chroma Research), and recent studies show that advertised “maximum context windows” far exceed “maximum effective context windows” (arXiv:2509.21361). Move the evidence slot below to inspect both attention decay and the live API payload: