Skip to content
BENIBIX Learn

Inference (AI)

AI🧭 FoundationsAI Basics

Also known as Model Inference, AI Inference, Running a Model

Using a trained model to get an answer. It does not learn while it works.

Think of it like

Think of it like a cook who has learned the recipe. Now they just make the meal.

Example

Each time Emma asks a chatbot a question, the company runs the model once. A million questions a day means a million runs.

Why it matters

Training happens once. Inference happens each time someone uses the model, so that is where most of the running cost is.

Definition

Inference is using a trained AI model to get an answer. You give the model a new input, and it gives back an output. The model does not learn anything new while it does this. Each answer costs a little computer time, so busy apps pay for inference all day. Speed matters here, because people are waiting for the reply.
Inference is the bottom row. The model is locked, and it runs once for every question.

Common mistake

Mixing up inference with training. Asking a model a question does not teach it your answer.

Key takeaways

  1. 1
    Uses, not learns. The model stays the same.
  2. 2
    Once per request. Each answer is one run.
  3. 3
    Speed counts. Someone is waiting for it.

Compare

Learn it properly