# Token (AI)

> A small piece of text, often part of a word, that a model reads.

**Field:** Artificial Intelligence  
**Category:** LLMs  
**Also known as:** Token, LLM Token

## Think of it like

Think of it like a Lego brick of text. Words are built from one or more of them.

## Definition

A token is the small piece of text a language model reads and writes. It can be a whole word, part of a word, a space or a sign like a comma. In English, one token is about four letters, or three quarters of a word, on average. Each token has an ID number, and the model only ever sees those numbers. Prices and limits for AI tools are counted in tokens.

## Example

The words 'unbelievable cats' might become four tokens: 'un', 'belie', 'vable' and ' cats'. A 1,000-word English email is about 1,300 tokens.

## Why it matters

Cost, speed and how much a model can read at once are all measured in tokens, not words.

## Common mistake

Thinking one token is one word. Long or rare words take several, and many languages, Persian among them, need more tokens per word than English.

## Three principles

- **A piece of text.** Word, part of a word, or sign.
- **About four letters.** In English, on average.
- **The unit of cost.** Limits and prices use it.

## Related terms

- [Tokenizer](https://learn.benibix.com/term/ai/tokenizer)
- [Context Window](https://learn.benibix.com/term/ai/context-window)
- [Next-Token Prediction](https://learn.benibix.com/term/ai/next-token-prediction)
- [Large Language Model (LLM)](https://learn.benibix.com/term/ai/large-language-model)

## Taught in

- [Tokens and Tokenizers](https://learn.benibix.com/learn/ai-llms/tokens-and-tokenizers): LLMs, 2/15
- [Prompt Engineering Basics](https://learn.benibix.com/learn/ai-working-with-ai/prompt-engineering-basics): Prompt Engineering, 1/16
- [Claude Code and Its Surfaces](https://learn.benibix.com/learn/ai-claude-code/claude-code-and-its-surfaces): Claude Code, 1/16
- [AI Model Names and Sizes](https://learn.benibix.com/learn/ai-models-providers/ai-model-names-and-sizes): AI Models and Providers, 6/13
- [Chat with Your Documents](https://learn.benibix.com/learn/ai-use-case/chat-with-your-documents): AI Assistants and Chatbots, 4/13
- [Context, Recap and Copy](https://learn.benibix.com/learn/ai-claude-code-commands/context-recap-and-copy): Claude Code Commands, 5/17

![The words unbelievable cats are split into four tokens, un, belie, vable and cats, and each token has its own number under it.](https://learn.benibix.com/diagrams/llm-tokens.svg)

---

Source: https://learn.benibix.com/term/ai/token
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-18
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
