# Word Embedding

> Each word as a list of numbers, so words with close meanings sit close.

**Field:** Artificial Intelligence  
**Category:** NLP & Language  
**Also known as:** Word Vector, Word2Vec

## Think of it like

Think of it like a map where words that mean close things live on the same street.

## Definition

A word embedding gives each word a vector, a list of a few hundred numbers. The numbers are learned from a corpus, so words used in the same way end up with close vectors. 'Cat' sits near 'dog', and far from 'tax'. Directions in the space can carry meaning too: king minus man plus woman lands near queen. Word2Vec, from 2013, made the idea popular.

## Example

Lucy's search tool uses word embeddings. A search for 'car' also finds pages that only say 'vehicle', because the two vectors are close.

## Why it matters

Embeddings let a computer tell how alike two words are. The language models of today are built on this idea.

## Common mistake

Thinking the numbers are hand-picked meanings. Nobody chose them; they come from how words are used together.

## Three principles

- **A vector per word.** A few hundred numbers.
- **Close means alike.** Cat sits near dog.
- **Learned from text.** Not chosen by hand.

## Related terms

- [Vector](https://learn.benibix.com/term/general/vector)
- [Bag of Words](https://learn.benibix.com/term/ai/bag-of-words)
- [Dot Product](https://learn.benibix.com/term/general/dot-product)
- [Neural Network](https://learn.benibix.com/term/ai/neural-network)
- [Embedding (AI)](https://learn.benibix.com/term/ai/embedding)
- [BERT (Language Model)](https://learn.benibix.com/term/ai/bert)

## Told apart from

- [Bag of Words vs Word Embedding](https://learn.benibix.com/compare/bag-of-words-vs-word-embedding): People often think any way of turning words into numbers keeps their meaning. Bag of words only counts words, so 'car' and 'vehicle' are as far apart as 'car' and 'cake'. A word embedding gives each word a learned vector, so words with close meanings sit close. Counts are quick and clear; embeddings know which words are alike.

![A map of word points. Animal words sit close together in one corner, food words in another. An arrow from man to woman runs the same way as an arrow from king to queen.](https://learn.benibix.com/diagrams/nlp-embedding.svg)

---

Source: https://learn.benibix.com/term/ai/word-embedding
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-18
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
