Skip to content
BENIBIX Learn

Data Lineage

Also known as Data Provenance, Column-Level Lineage, Lineage Graph

A map of where data came from and where it goes next.

Think of it like

It is like a family tree for a number. It shows where the number came from, all the way back.

Example

A revenue number on a dashboard looks wrong. Lineage traces it back through three tables to one source with a broken currency field.

Why it matters

It turns a day of detective work into a few clicks. It also shows who to warn before a change.

Definition

Data lineage is the map of where data comes from and where it goes. It shows which source tables feed a table, and which reports read from it. Column-level lineage goes further and traces each field. Tools build it by reading SQL, pipeline code and query logs. You use it to find the cause of a bad number. You also use it to see what will break before you change something.
Follow the arrows back to find the cause. Follow them forward to see what a change will break.

Common mistake

Drawing lineage by hand in a slide. It is out of date the next week. Build it from the code and logs.

Key takeaways

  1. 1
    Upstream. Trace a number back to its source.
  2. 2
    Downstream. See what a change will break.
  3. 3
    Built automatically. From SQL, code and query logs.

Compare