# Batch Inference

> A model runs on lots of data at set times. The results are saved.

**Field:** Artificial Intelligence  
**Category:** MLOps & Deployment  
**Also known as:** Offline Inference, Batch Prediction, Batch Scoring

## Think of it like

Think of it like marking a whole stack of tests at night. The scores are ready in the morning.

## Definition

Batch inference runs a model on a big set of data all at once, at set times, and saves the results for later. A job reads many rows, such as every customer. It runs the model on each one and writes the scores to a table or file. Apps then read the saved scores and do not call the model. It is cheap and simple, since the work runs when machines are free and no one is waiting. The cost is that the results are only as fresh as the last run.

## Example

Each night Lucy's job scores all 2 million customers for how likely they are to leave. In the morning the sales team sees a list of the top 500 to call.

## Why it matters

Many uses don't need an answer this second. Batch work is far cheaper and easier to run than a live service.

## Common mistake

Using batch scores for something that changes by the minute. A score from last night can't see this morning's fraud.

## Three principles

- **All at once.** Many rows.
- **On a schedule.** Nightly or weekly.
- **Saved for later.** Only as fresh as the run.

## Related terms

- [Real-Time Inference](https://learn.benibix.com/term/ai/real-time-inference)
- [Model Serving](https://learn.benibix.com/term/ai/model-serving)
- [Inference (AI)](https://learn.benibix.com/term/ai/inference)
- [LLM Batch API](https://learn.benibix.com/term/development/batch-api)

## Told apart from

- [Batch vs Real-Time Inference](https://learn.benibix.com/compare/batch-inference-vs-real-time-inference): People often think real-time inference is just the better kind and batch is the old way. They fit different needs. Batch inference scores lots of data at set times and saves it. That is cheap, but only as fresh as the last run. Real-time inference answers each request as it comes. That is fresh, but costs more to keep running.

![Each night a job reads a big table of customers, runs the model on all of them, and writes the scores to a new table for the next day.](https://learn.benibix.com/diagrams/mo-batch-inference.svg)

---

Source: https://learn.benibix.com/term/ai/batch-inference
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
