🧬Model Fallback
Also known as LLM Fallback, Fallback Model, Model Failover
Sending a call to a backup model when the first one fails.
Think of it like
Think of it like a spare tyre. When one tyre goes flat, you put on the spare and keep driving.
Example
Lucy's writing app uses a big model first. When that firm's service goes down, calls go to a smaller model from a different firm. Users barely notice.
Why it matters
Model providers do go down. A fallback keeps your app working through someone else's outage.
Definition
Common mistake
Key takeaways
- 1A list of models. In order.
- 2Try the next. When one fails.
- 3Test the backup. Before you need it.