⚙️MapReduce
Also known as Map Reduce, Hadoop MapReduce
Split the work. Many computers each do a part. Then join the results.
Think of it like
It is like a class counting a huge pile of beads. Each child counts a handful, then one child adds up all the counts.
Example
To count words in a billion web pages, each computer counts words in its own pages. Then all counts for "cat" go to one computer to be added up.
Why it matters
It showed how to use thousands of cheap computers as one. Spark and most big data tools grew from the idea.
Definition
Common mistake
Key takeaways
- 1Map. Each computer works on its slice.
- 2Shuffle. Same key, same computer.
- 3Reduce. Combine each key's values.