⚙️Hadoop Distributed File System (HDFS)
Also known as HDFS
Hadoop's file store. It cuts big files up and keeps three copies.
Think of it like
It is like tearing a big book into parts. You keep three copies of each part in three homes.
Example
A 1 GB log file is cut into 8 blocks. Each block sits on three of the cluster's computers.
Why it matters
It made it cheap to keep huge files safe on ordinary computers. Data lakes on cloud storage took its place in most new work.
Definition
Common mistake
Key takeaways
- 1Big blocks. 128 MB by default.
- 2Three copies. On different computers.
- 3NameNode. Knows where each block is.