# Indexing

> Storing a crawled page in the engine's big list. Then it can show up in results.

**Field:** Marketing & SEO  
**Category:** SEO  
**Also known as:** Search Index, Search Engine Indexing, Indexed Page

## Think of it like

It is like a librarian putting a new book on the right shelf. Now people can find it.

## Definition

Indexing is when a search engine stores a page it has crawled so it can show it in results. The engine works out what the page is about and files it in a giant list called the index. Not every crawled page gets in. Pages that are thin, copied or marked noindex are often left out. Only an indexed page can rank.

## Example

Emma searches site:example.com and sees 120 of her 150 pages. The other 30 were crawled but never indexed.

## Example code

```search
site:example.com
```

Type this into a search box to see roughly which pages of a site are indexed.

## Why it matters

A page that is not in the index can not be seen by searchers, however good it is.

## Common mistake

Blocking a page in robots.txt to keep it out of the index. The URL can still be listed from links. Use noindex instead.

## Three principles

- **Crawl first.** Only read pages can be stored.
- **Not every page.** Thin or copied pages get left out.
- **No index, no rank.** Results come only from the index.

## Related terms

- [Crawling](https://learn.benibix.com/term/marketing/crawling)
- [Search Ranking](https://learn.benibix.com/term/marketing/search-ranking)
- [Noindex Tag](https://learn.benibix.com/term/marketing/noindex)
- [Duplicate Content](https://learn.benibix.com/term/marketing/duplicate-content)
- [Search Engine](https://learn.benibix.com/term/marketing/search-engine)

## Told apart from

- [Crawling vs Indexing](https://learn.benibix.com/compare/crawling-vs-indexing): Crawling is the engine reading your page. Indexing is the engine deciding to keep it. A page can be read and not kept.

## Taught in

- [How Search Engines Work](https://learn.benibix.com/learn/marketing-seo/how-search-engines-work): SEO, 1/15

![Three boxes in a row joined by arrows: crawling, indexing and ranking.](https://learn.benibix.com/diagrams/crawl-index-rank.svg)

---

Source: https://learn.benibix.com/term/marketing/indexing
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-20
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
