🧭Inference (AI)
Also known as Model Inference, AI Inference, Running a Model
Using a trained model to get an answer. It does not learn while it works.
Think of it like
Think of it like a cook who has learned the recipe. Now they just make the meal.
Example
Each time Emma asks a chatbot a question, the company runs the model once. A million questions a day means a million runs.
Why it matters
Training happens once. Inference happens each time someone uses the model, so that is where most of the running cost is.
Definition
Common mistake
Key takeaways
- 1Uses, not learns. The model stays the same.
- 2Once per request. Each answer is one run.
- 3Speed counts. Someone is waiting for it.