🛠️Prompt Caching
Also known as Context Caching, Prefix Caching
Saving the work on a prompt's fixed start, so the next request reuses it.
Think of it like
Think of it like a teacher who keeps notes on a long book. Next time, they skip straight to the new question.
Example
Lucy's bot sends the same 50-page manual with every question. With prompt caching, only the first request pays full price for the manual. The rest reuse it.
Why it matters
For apps that resend a big fixed part, it can cut both cost and wait time a lot.
Definition
Common mistake
Key takeaways
- 1Reuse the fixed start. Same start, less work.
- 2Exact match. One change breaks it.
- 3Short-lived. Often minutes.