Skip to content
BENIBIX Learn

Hive Metastore (HMS)

Also known as HMS, Apache Hive Metastore

The catalog that came with Apache Hive. Many tools still use it.

Think of it like

It is like an old card index in a library. Many readers still use it to find books.

Example

A bank's Spark jobs find each table in its Hive Metastore. A move to Unity Catalog means copying those entries.

Why it matters

Lots of older lakes depend on it. Moving off it is a common step when a firm picks a newer catalog.

Definition

Hive Metastore is the catalog that came with Apache Hive. It stores facts about each table: its name, its columns and where its files live. Other engines, such as Spark and Impala, read it through a service. For years, most Hadoop lakes used it. Many lakes still run it, while newer ones often pick other catalogs.
Hive Metastore can be the catalog in the middle. Engines ask it where each table lives.

Common mistake

Thinking you need Hive to use it. Spark and other engines can use the metastore with no Hive queries at all.

Key takeaways

  1. 1
    Came with Hive. Part of the Apache Hive project.
  2. 2
    Tables and partitions. Names, columns and file places.
  3. 3
    Shared service. Spark and Impala read it too.