# Apache Hadoop

> A free system for huge data. It runs on lots of cheap computers.

**Field:** Data Engineering  
**Category:** Processing  
**Also known as:** Hadoop, Hadoop Cluster, Hadoop YARN

## Think of it like

It is like a big team of workers with a shared shed. Each keeps some of the boxes and works on them where they sit.

## Definition

Apache Hadoop is a free, open source system for storing and processing huge data on many cheap computers. It has three main parts. HDFS stores the files across the computers. YARN shares out the computers' power. MapReduce runs the jobs. It sends the work to the computers that hold the data, rather than moving the data.

## Example

In the 2010s, a phone firm kept years of call logs on Hadoop. The cluster had 500 computers.

## Why it matters

It started the big data age. Many of its ideas live on in Spark, data lakes and cloud storage.

## Common mistake

Starting a new project on a Hadoop cluster. Cloud object storage and Spark now do the same job with far less to run.

## Three principles

- **HDFS.** Files spread over many computers.
- **YARN.** Shares out the computers' power.
- **Work goes to the data.** Not the other way round.

## Related terms

- [Hadoop Distributed File System (HDFS)](https://learn.benibix.com/term/data/hdfs)
- [MapReduce](https://learn.benibix.com/term/data/mapreduce)
- [Apache Spark](https://learn.benibix.com/term/data/apache-spark)
- [Big Data](https://learn.benibix.com/term/data/big-data)
- [Data Lake](https://learn.benibix.com/term/data/data-lake)

## Told apart from

- [Apache Hadoop vs MapReduce](https://learn.benibix.com/compare/apache-hadoop-vs-mapreduce): People think Hadoop and MapReduce are the same thing. MapReduce is a way to split a job into map and reduce steps over many computers. Hadoop is a whole system. It has a file store called HDFS, a part that shares out the computers, and a MapReduce engine. Spark can run on Hadoop with no MapReduce at all.

---

Source: https://learn.benibix.com/term/data/apache-hadoop
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
