🗄️Apache Parquet
Also known as Parquet, Parquet File
A file type that keeps data by column. Most data lakes use it.
Think of it like
It is like a tool box with a drawer for each kind of tool. You open just the drawer you need.
Example
A team turns a 10 GB CSV of orders into Parquet. The file shrinks to about 2 GB, and their queries run many times faster.
Why it matters
Almost every data tool reads and writes it. Picking it for lake files is rarely wrong.
Definition
Example code
python
import pandas as pd
df = pd.read_parquet("sales.parquet", columns=["month", "total"])Common mistake
Key takeaways
- 1By column. Each column is stored on its own.
- 2Skips chunks. Min and max notes let readers skip.
- 3Everywhere. Nearly every data tool reads it.