💬Max Tokens
Also known as Maximum Output Tokens, max_tokens, Output Token Limit
The most tokens a model may write in one reply. It stops at the cap.
Think of it like
Think of it like a friend who can only talk till the bell rings.
Example
Lucy sets max tokens to 100 and asks for a full report. The answer stops after about 75 words, mid-sentence.
Why it matters
Output tokens cost money and time. The cap keeps both under control.
Definition
Common mistake
Key takeaways
- 1Caps the reply. Counted in tokens.
- 2Stops hard. Even mid-sentence.
- 3Saves cost. No runaway answers.