# Ollama

> A free tool that gets an AI model and runs it on your PC. It takes one command.

**Field:** Artificial Intelligence  
**Category:** Running Locally  
**Also known as:** Ollama CLI, Ollama Server

## Think of it like

Think of it like an app store for AI models. You pick one, and it is ready to use.

## Definition

Ollama is a free, open-source tool that downloads and runs language models on your own machine with one command. It keeps a list of ready models. You type ollama run and a model name, and it fetches the model and starts a chat. It also runs a small local server that apps on the same machine can call, much like a cloud model API. It runs on Mac, Windows and Linux. It does the hard parts for you, such as picking a shrunk file and setting up the graphics card.

## Example

Emma wants to try a local model for the first time. She sets up Ollama and types one command. Two minutes later she is chatting with a small model.

## Example code

```bash
ollama run llama3.2
```

Download the model if needed, then start a chat with it.

## Why it matters

It made a local model as easy to run as any other app.

## Common mistake

Leaving its server open to the network. By default it is meant for your own machine, and anyone who can reach it can use it.

## Three principles

- **One command.** Fetch and run.
- **A model library.** Ready to pull.
- **Local server.** Apps can call it.

## Related terms

- [Inference Engine](https://learn.benibix.com/term/ai/inference-engine)
- [llama.cpp](https://learn.benibix.com/term/ai/llama-cpp)
- [LM Studio](https://learn.benibix.com/term/ai/lm-studio)
- [Local AI Model](https://learn.benibix.com/term/ai/local-ai-model)
- [Llama](https://learn.benibix.com/term/ai/llama)
- [Ollama Modelfile](https://learn.benibix.com/term/ai/ollama-modelfile)
- [Open WebUI](https://learn.benibix.com/term/ai/open-webui)

## Told apart from

- [Ollama vs LM Studio](https://learn.benibix.com/compare/ollama-vs-lm-studio): People often think Ollama and LM Studio are rival engines with different models inside. Both are easy front ends that run the same kinds of open models on your own machine. Ollama works from the command line and runs as a local server. LM Studio is a desktop app with windows, buttons and a chat panel. Both can serve other apps.
- [Ollama vs vLLM](https://learn.benibix.com/compare/ollama-vs-vllm): People often think vLLM is just a faster Ollama and the best pick for everyone. They are built for different jobs. Ollama makes it easy for one person to run a model on their own machine. vLLM is made to serve many users at once from GPU servers. It packs their requests together, so each card does more work.
- [Llama vs Ollama](https://learn.benibix.com/compare/llama-vs-ollama): People often think Ollama is a version of Llama, because the names sound alike. Llama is a family of models made by Meta. Ollama is a free tool. It gets models and runs them on your own computer. Ollama can run Llama, but it also runs Qwen, Mistral, Gemma and many more. One is the model, and the other is the program that runs it.
- [Ollama vs Open WebUI](https://learn.benibix.com/compare/ollama-vs-open-webui): People think Open WebUI is one more tool like Ollama, and they pick one or the other. They do two different jobs. Ollama runs the model on your machine. Open WebUI is only the chat screen in your browser. It sends your words to a runtime like Ollama and shows the reply, so the two are most often used together.
- [Ollama vs llama.cpp](https://learn.benibix.com/compare/ollama-vs-llama-cpp): People think Ollama and llama.cpp are two rival engines, and they are not. llama.cpp is the engine. It loads a GGUF file and runs the maths, with a long list of flags to set. Ollama is a tool built on the same core. It finds a model by name, picks the settings for you and keeps a small server running. Pick llama.cpp for control, and Ollama for ease.

![One command downloads a model and starts a chat. Behind it, a small local server answers apps on the same machine.](https://learn.benibix.com/diagrams/lo-ollama.svg)

---

Source: https://learn.benibix.com/term/ai/ollama
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
