⚙️Batch Inference
Also known as Offline Inference, Batch Prediction, Batch Scoring
A model runs on lots of data at set times. The results are saved.
Think of it like
Think of it like marking a whole stack of tests at night. The scores are ready in the morning.
Example
Each night Lucy's job scores all 2 million customers for how likely they are to leave. In the morning the sales team sees a list of the top 500 to call.
Why it matters
Many uses don't need an answer this second. Batch work is far cheaper and easier to run than a live service.
Definition
Common mistake
Key takeaways
- 1All at once. Many rows.
- 2On a schedule. Nightly or weekly.
- 3Saved for later. Only as fresh as the run.