☁️Tokens per Minute (TPM)
Also known as Token Rate Limit, AI Rate Limit, Requests per Minute (AI), RPM
A cap on how many tokens an app may use each minute. Over it, you wait.
Think of it like
It is like a tap that lets out only so much water each minute. The rest has to wait.
Example
Jack's app sends a burst of long chats to the Claude API. It passes its input tokens per minute limit and gets error 429, so the app waits and tries again.
Why it matters
A busy app hits this wall first. Knowing the limit lets you plan for peaks instead of failing at them.
Definition
Common mistake
Key takeaways
- 1Counted in tokens. Plus a cap on requests each minute.
- 2Over means wait. Error 429, then try again later.
- 3Grows with the account. Higher tiers get higher limits.