Skip to content
BENIBIX Learn

Apache Iceberg

Also known as Iceberg, Iceberg Table

A table format that many tools share. It hides how the files are split.

Think of it like

It is like a list on a toy box. It says which toys are in the box today.

Example

A bank keeps one Iceberg orders table. Its analysts query it from Trino while a Spark job writes new rows.

Why it matters

It keeps data free of any one engine. You can change tools without moving the data.

Definition

Apache Iceberg is an open table format for huge tables in a data lake. It tracks which files make up the table, in layers of small files. Each change makes a new snapshot of the table. Many engines can use the same tables, such as Spark, Trino, Flink and Snowflake. It hides how files are split, so queries do not need to know. Old snapshots let you go back in time.

Example code

sql
CREATE TABLE lake.shop.orders (
  id BIGINT, ts TIMESTAMP, total DECIMAL(10,2))
USING iceberg
PARTITIONED BY (days(ts));
In Spark SQL. Files are split by day, but queries just filter on ts.

Common mistake

Never cleaning up old snapshots. Each one keeps old files alive, and storage costs climb.

Key takeaways

  1. 1
    Many engines. One table, many tools.
  2. 2
    Hidden partitions. Queries need not know the file layout.
  3. 3
    Snapshots. Each change makes a version you can read.

Compare