Query Engine vs Data Warehouse
People think a query engine is a data warehouse. A warehouse keeps the data and runs the queries, all in one product. A query engine only runs the queries. The data stays in files or other databases, and the engine reads it where it is. Both speak SQL, so from the outside they can look the same.
Query Engine
A tool that runs SQL on data kept somewhere else.
A query engine runs SQL over data that it does not store itself. The data stays where it is, in files in a data lake or in other databases. The engine reads it, splits the work across many machines and returns one answer. A warehouse stores and queries its own data. A query engine only does the querying. This split lets one engine read many kinds of storage.
Data Warehouse
A big store of data built for reports. Clean data from many apps lives there.
A data warehouse is a database built for reports, not for running an app. Data from many systems is cleaned and loaded into it. It stores the data in tables with a fixed shape. It is tuned to scan millions of rows fast. Analysts use SQL on it to answer questions about the whole business.
In one line
- Query Engine
- A tool that runs SQL on data kept somewhere else.
- Data Warehouse
- A big store of data built for reports. Clean data from many apps lives there.