Skip to content
BENIBIX Learn

Indexing

Marketing🔍 SEOSearch Engines

Also known as Search Index, Search Engine Indexing, Indexed Page

Storing a crawled page in the engine's big list. Then it can show up in results.

Think of it like

It is like a librarian putting a new book on the right shelf. Now people can find it.

Example

Emma searches site:example.com and sees 120 of her 150 pages. The other 30 were crawled but never indexed.

Why it matters

A page that is not in the index can not be seen by searchers, however good it is.

Definition

Indexing is when a search engine stores a page it has crawled so it can show it in results. The engine works out what the page is about and files it in a giant list called the index. Not every crawled page gets in. Pages that are thin, copied or marked noindex are often left out. Only an indexed page can rank.

Example code

search
site:example.com
Type this into a search box to see roughly which pages of a site are indexed.
Indexing is the middle box. A page that drops out here never reaches ranking.

Common mistake

Blocking a page in robots.txt to keep it out of the index. The URL can still be listed from links. Use noindex instead.

Key takeaways

  1. 1
    Crawl first. Only read pages can be stored.
  2. 2
    Not every page. Thin or copied pages get left out.
  3. 3
    No index, no rank. Results come only from the index.

Compare

Learn it properly