💬Context Rot
Also known as Context Degradation, Long-Context Decay
A model gets worse at its task as the text you give it grows longer.
Think of it like
It is like a messy desk. The more you pile on, the less you can find.
Example
Lucy pastes ten long files into one chat and asks about one line. The model mixes up two files. In a fresh chat with only the right file, it answers well.
Why it matters
A bigger context window is not a free pass. Giving the model less, and the right text, often works better.
Definition
Common mistake
Key takeaways
- 1More is worse. Quality slides as input grows.
- 2Near misses hurt. Text that looks right but is not.
- 3Trim the input. Give only what the task needs.