# Apache Parquet

> A file type that keeps data by column. Most data lakes use it.

**Field:** Data Engineering  
**Category:** Storage & Warehousing  
**Also known as:** Parquet, Parquet File

## Think of it like

It is like a tool box with a drawer for each kind of tool. You open just the drawer you need.

## Definition

Apache Parquet is an open file format that stores data by column. A file is split into row groups, and each group stores its columns apart. Each column chunk keeps small notes, such as its smallest and largest value. Readers use those notes to skip chunks they do not need. It is the most common file format in data lakes.

## Example

A team turns a 10 GB CSV of orders into Parquet. The file shrinks to about 2 GB, and their queries run many times faster.

## Example code

```python
import pandas as pd
df = pd.read_parquet("sales.parquet", columns=["month", "total"])
```

Read just two columns. The rest of the file is never loaded.

## Why it matters

Almost every data tool reads and writes it. Picking it for lake files is rarely wrong.

## Common mistake

Writing thousands of tiny Parquet files. Each file has a cost to open, so a few large files read faster.

## Three principles

- **By column.** Each column is stored on its own.
- **Skips chunks.** Min and max notes let readers skip.
- **Everywhere.** Nearly every data tool reads it.

## Related terms

- [Columnar Storage](https://learn.benibix.com/term/data/columnar-storage)
- [Apache ORC](https://learn.benibix.com/term/data/apache-orc)
- [Apache Avro](https://learn.benibix.com/term/data/apache-avro)
- [Apache Arrow](https://learn.benibix.com/term/data/apache-arrow)
- [Small Files Problem](https://learn.benibix.com/term/data/small-files-problem)
- [Comma-Separated Values (CSV)](https://learn.benibix.com/term/development/csv)
- [Data Lake](https://learn.benibix.com/term/data/data-lake)

## Told apart from

- [Apache Parquet vs Apache Avro](https://learn.benibix.com/compare/parquet-vs-avro): People think Parquet and Avro do the same job. Both are open file formats with a schema. Parquet stores data by column, so reports that read a few columns are fast. Avro stores whole rows, so it suits sending one record at a time, as in event streams.
- [Apache Arrow vs Apache Parquet](https://learn.benibix.com/compare/apache-arrow-vs-apache-parquet): People think Apache Arrow is a file format like Parquet, and it is not. Parquet is how table data is kept on disk, packed small. Arrow is how table data is laid out in memory while tools work on it. They work well as a pair. A tool reads Parquet from disk into Arrow in memory.

![The same three-row table stored two ways. In row storage each row's id, city and total sit side by side on disk. In column storage all the ids sit together, then all the cities, then all the totals, so a query for totals reads one block.](https://learn.benibix.com/diagrams/row-vs-column-storage.svg)

---

Source: https://learn.benibix.com/term/data/apache-parquet
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-16
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
