⚙️Apache Hive
Also known as Hive, HiveQL
A tool that puts SQL on top of Hadoop files.
Think of it like
It is like a helper who hears one plain ask. Then they turn it into a list of jobs for lots of workers.
Example
An analyst writes one SELECT in Hive. Hive turns it into jobs that read 2 TB of log files on 50 machines.
Why it matters
It showed that people will use big data if they can ask in SQL. Its Metastore is still the table list many lake tools read.
Definition
Example code
sql
CREATE EXTERNAL TABLE logs (ts STRING, page STRING)
STORED AS PARQUET
LOCATION 'hdfs:///data/logs/';Common mistake
Key takeaways
- 1SQL in. People write plain SQL.
- 2Jobs out. Hive turns it into cluster jobs.
- 3A table list. The Metastore names every table.