📈Tail Latency
Also known as p99 Latency, p95 Latency, 99th Percentile Latency, Latency Percentile, p99
How slow the slowest few requests are, often read as p99.
Think of it like
Think of it like the last kids out of school. Most leave fast, but someone still waits at the gate for the slow ones.
Example
Lucy's API has a median of 80 milliseconds, but its p99 is 2 seconds. One request in a hundred takes 25 times longer than usual.
Why it matters
Your busiest users make the most requests, so they meet the slow tail most often. The average makes things look better than they are.
Definition
Common mistake
Key takeaways
- 1The slow end. Not the typical request.
- 2Read as a percentile. 99 in 100 requests beat the p99.
- 3Grows with fan-out. Many calls make slow ones common.