# Model Fallback

> Sending a call to a backup model when the first one fails.

**Field:** Software Development  
**Category:** AI Engineering  
**Also known as:** LLM Fallback, Fallback Model, Model Failover

## Think of it like

Think of it like a spare tyre. When one tyre goes flat, you put on the spare and keep driving.

## Definition

Model fallback is a rule that sends a call to a backup model when the first choice fails. A call can fail when the model maker is down, a rate limit is hit, the call takes too long or the reply is broken. Then the app tries the next model on its list, and does not show an error. The backup may be a smaller model, or come from a different firm. The user gets an answer, maybe a bit different, not an error.

## Example

Lucy's writing app uses a big model first. When that firm's service goes down, calls go to a smaller model from a different firm. Users barely notice.

## Why it matters

Model providers do go down. A fallback keeps your app working through someone else's outage.

## Common mistake

Never testing the backup. A fallback model that was never tried with your prompts may answer in the wrong format.

## Three principles

- **A list of models.** In order.
- **Try the next.** When one fails.
- **Test the backup.** Before you need it.

## Related terms

- [Retry with Exponential Backoff](https://learn.benibix.com/term/development/retry-with-backoff)
- [LLM Gateway](https://learn.benibix.com/term/development/llm-gateway)
- [Token Pricing](https://learn.benibix.com/term/development/token-pricing)
- [Model Routing](https://learn.benibix.com/term/development/model-routing)

## Told apart from

- [Model Routing vs Model Fallback](https://learn.benibix.com/compare/model-routing-vs-model-fallback): People think model routing and model fallback are the same switch between models. Routing picks a model before the call is sent, based on how hard the request looks. Fallback waits for a call to fail, then sends it again to a second model. Routing saves money on easy requests. Fallback keeps the app up when a model is down.

![A call goes to the first model and fails with an error. The app sends the same call to a backup model, which answers.](https://learn.benibix.com/diagrams/dev-model-fallback.svg)

---

Source: https://learn.benibix.com/term/development/model-fallback
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-20
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
