Skip to content
BENIBIX Learn

Apache Hudi

Also known as Hudi, Hadoop Upserts Deletes and Incrementals

A table format built for fast updates. Jobs can read just what changed.

Think of it like

It is like a notebook where you fix one line. You do not copy out the whole page.

Example

A ride app updates millions of trip rows as fares are settled. Hudi applies the changes, and the next job reads only the changed trips.

Why it matters

Many lakes get a stream of changes, not new rows only. Hudi is shaped around that case.

Definition

Apache Hudi is an open table format built for frequent updates in a data lake. It was first built at Uber. It is good at upserts, which update a row if it exists or add it if not. It also lets a job read only the rows that changed since its last run. It offers two table types, Copy-on-Write and Merge-on-Read.

Common mistake

Picking a table type at random. Merge-on-Read writes fast but reads slower. Copy-on-Write is the other way round.

Key takeaways

  1. 1
    Upserts. Update if there, add if not.
  2. 2
    Incremental reads. Read only what changed.
  3. 3
    Two table types. Copy-on-Write or Merge-on-Read.