# Screaming Frog SEO Spider

> A program that walks a whole site. It lists the problems a search engine would hit.

**Field:** Marketing & SEO  
**Category:** SEO Tools  
**Also known as:** Screaming Frog, SEO Spider

## Think of it like

It is like a robot that walks each hall of your house. It writes down each broken light.

## Definition

Screaming Frog SEO Spider is a desktop program that crawls a website the way a search engine would. It visits every page it can reach and lists what it finds. That includes broken links, redirects, missing titles, duplicate pages and blocked pages. The free version crawls up to 500 web addresses at a time. A paid licence removes the limit and adds more checks.

## Example

Before a site move, an SEO crawls the old site with Screaming Frog. It exports all 3,200 addresses to plan a 301 redirect for each one.

## Why it matters

It shows a site the way a crawler sees it, problems and all, in minutes.

## Common mistake

Crawling a big live site at full speed. It can slow the server for real visitors. Turn the speed down.

## Three principles

- **Crawls like a bot.** Follows every link it can.
- **Lists problems.** Broken links, redirects, titles.
- **Free up to 500.** A licence lifts the limit.

## Related terms

- [Crawling](https://learn.benibix.com/term/marketing/crawling)
- [Technical SEO](https://learn.benibix.com/term/marketing/technical-seo)
- [301 Redirect](https://learn.benibix.com/term/marketing/redirect-301)
- [Duplicate Content](https://learn.benibix.com/term/marketing/duplicate-content)

## Taught in

- [Search Console and SEO Tools](https://learn.benibix.com/learn/marketing-seo/search-console-and-seo-tools): SEO, 14/15

---

Source: https://learn.benibix.com/term/marketing/screaming-frog
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-16
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
