⚙️Amazon EMR
Also known as AWS EMR, Amazon Elastic MapReduce, Elastic MapReduce, EMR
The AWS service that runs Spark and Hadoop clusters for you.
Think of it like
It is like a rented workshop that comes with all the big tools set up.
Example
A team starts an EMR cluster each night. It runs its Spark jobs on data in S3, then shuts the cluster down by morning.
Why it matters
Building a Spark cluster by hand is slow, fiddly work. EMR does it for you, so a team can focus on the jobs.
Definition
Common mistake
Key takeaways
- 1Managed clusters. AWS sets up the machines.
- 2Open tools. Spark, Hadoop and more.
- 3Data in S3. Clusters come and go around it.