Skip to content
BENIBIX Learn

Amazon EMR

Data⚙️ ProcessingDistributed Processing

Also known as AWS EMR, Amazon Elastic MapReduce, Elastic MapReduce, EMR

The AWS service that runs Spark and Hadoop clusters for you.

Think of it like

It is like a rented workshop that comes with all the big tools set up.

Example

A team starts an EMR cluster each night. It runs its Spark jobs on data in S3, then shuts the cluster down by morning.

Why it matters

Building a Spark cluster by hand is slow, fiddly work. EMR does it for you, so a team can focus on the jobs.

Definition

Amazon EMR is a cloud service from AWS that runs big data tools for you. It used to be called Amazon Elastic MapReduce. It sets up clusters for Apache Spark, Hadoop and similar tools. Data usually sits in Amazon S3, and clusters come and go around it. You pay for the machines while a cluster runs.
EMR builds a cluster like this for you. It runs on AWS machines.

Common mistake

Leaving a cluster running after the jobs are done. You pay for every machine for every hour it is on.

Key takeaways

  1. 1
    Managed clusters. AWS sets up the machines.
  2. 2
    Open tools. Spark, Hadoop and more.
  3. 3
    Data in S3. Clusters come and go around it.

Compare