Data Warehouse vs Data Lake
People think a data lake is just a cheaper data warehouse. A warehouse only takes clean tables with a set shape. A lake takes raw files of any kind and shapes them when they are read. The warehouse is easier to trust. The lake is cheaper and keeps everything.
Data Warehouse
A big store of data built for reports. Clean data from many apps lives there.
A data warehouse is a database built for reports, not for running an app. Data from many systems is cleaned and loaded into it. It stores the data in tables with a fixed shape. It is tuned to scan millions of rows fast. Analysts use SQL on it to answer questions about the whole business.
Data Lake
A big, cheap store of raw files of every kind. Shape comes later.
A data lake is a cheap, huge store for raw data of every kind. Tables, JSON, logs, photos and video all go in as files. It usually sits on cloud object storage. Nothing is cleaned or shaped on the way in. Tools read the files later and apply a shape when they query them.
In one line
- Data Warehouse
- A big store of data built for reports. Clean data from many apps lives there.
- Data Lake
- A big, cheap store of raw files of every kind. Shape comes later.