Skip to content
BENIBIX Learn

Context Rot

AI💬 LLMsLanguage Model Limits

Also known as Context Degradation, Long-Context Decay

A model gets worse at its task as the text you give it grows longer.

Think of it like

It is like a messy desk. The more you pile on, the less you can find.

Example

Lucy pastes ten long files into one chat and asks about one line. The model mixes up two files. In a fresh chat with only the right file, it answers well.

Why it matters

A bigger context window is not a free pass. Giving the model less, and the right text, often works better.

Definition

Context rot is when a language model gets worse as you give it more text to read. The context window may hold far more, but quality still slides as the input grows. A 2025 study tested 18 models and found this in all of them, even on simple tasks. Text that looks like the answer but is not makes it worse. It is why long chats and huge prompts can drift.
Context rot is the left drop: quality slides as the input grows.

Common mistake

Filling the window because it fits. Each extra page can pull quality down.

Key takeaways

  1. 1
    More is worse. Quality slides as input grows.
  2. 2
    Near misses hurt. Text that looks right but is not.
  3. 3
    Trim the input. Give only what the task needs.

Compare

Learn it properly