Data Mesh vs Data Lake
People think data mesh is a kind of storage for raw data, like a data lake. A data lake is one place to keep raw files. Data mesh is a way to split data work between teams, each owning its own data. A company can run a mesh on top of a lake, so the two are not rivals.
Data Mesh
Each team owns its own data and shares it with the rest.
Data mesh is a way to split data work by business area, not hand it all to one central team. Each area, such as orders or marketing, owns its own data. It shares that data with others as a data product. A shared platform gives every team the same tools to build and publish. A small set of rules, agreed by all, keeps the products working together. The idea was set out by Zhamak Dehghani in 2019.
Data Lake
A big, cheap store of raw files of every kind. Shape comes later.
A data lake is a cheap, huge store for raw data of every kind. Tables, JSON, logs, photos and video all go in as files. It usually sits on cloud object storage. Nothing is cleaned or shaped on the way in. Tools read the files later and apply a shape when they query them.
In one line
- Data Mesh
- Each team owns its own data and shares it with the rest.
- Data Lake
- A big, cheap store of raw files of every kind. Shape comes later.