# Inference (AI)

> Using a trained model to get an answer. It does not learn while it works.

**Field:** Artificial Intelligence  
**Category:** Foundations  
**Also known as:** Model Inference, AI Inference, Running a Model

## Think of it like

Think of it like a cook who has learned the recipe. Now they just make the meal.

## Definition

Inference is using a trained AI model to get an answer. You give the model a new input, and it gives back an output. The model does not learn anything new while it does this. Each answer costs a little computer time, so busy apps pay for inference all day. Speed matters here, because people are waiting for the reply.

## Example

Each time Emma asks a chatbot a question, the company runs the model once. A million questions a day means a million runs.

## Why it matters

Training happens once. Inference happens each time someone uses the model, so that is where most of the running cost is.

## Common mistake

Mixing up inference with training. Asking a model a question does not teach it your answer.

## Three principles

- **Uses, not learns.** The model stays the same.
- **Once per request.** Each answer is one run.
- **Speed counts.** Someone is waiting for it.

## Related terms

- [Training (AI)](https://learn.benibix.com/term/ai/training)
- [AI Model](https://learn.benibix.com/term/ai/ai-model)
- [Prediction (AI)](https://learn.benibix.com/term/ai/prediction)
- [Latency](https://learn.benibix.com/term/infrastructure/latency)
- [Inference Engine](https://learn.benibix.com/term/ai/inference-engine)
- [Batch Inference](https://learn.benibix.com/term/ai/batch-inference)

## Told apart from

- [Training vs Inference](https://learn.benibix.com/compare/training-vs-inference): People often think a chatbot learns from them while they talk. It does not. Training is when a model learns, and it is over before the model is shared. Inference is each time the model answers you. The model stays the same then, so your chat does not teach it.

## Taught in

- [AI Training and Inference](https://learn.benibix.com/learn/ai-foundations/ai-training-and-inference): AI Basics, 2/10

![Top row, training: many labelled examples flow into a model whose numbers get nudged. Bottom row, inference: one new photo goes into the finished model and the answer cat comes out.](https://learn.benibix.com/diagrams/ai-training-inference.svg)

---

Source: https://learn.benibix.com/term/ai/inference
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
