💬Context Window
Also known as Context Length, Context Size
The most text, in tokens, a model can read at one time.
Think of it like
Think of it like a desk. Only so many pages fit on it at once.
Example
Jack pastes a 900-page book into a chat with a 200,000-token context window. The book is about 450,000 tokens, so the tool only takes in part of it.
Why it matters
It sets how long a chat can run. It also sets how big a file you can hand over before the model starts to lose things.
Definition
Common mistake
Key takeaways
- 1Counted in tokens. Input and output together.
- 2Thousands to millions. Depends on the model.
- 3Outside is unseen. Cut text is simply gone.