Skip to content
BENIBIX Learn

Apache Flink

Data⚙️ ProcessingStreaming Engines

Also known as Flink, Flink SQL

A free tool that works on each event as soon as it comes in.

Think of it like

It is like a cashier who rings up each item the moment it hits the belt. There is no waiting for the full cart.

Example

A bank runs Flink on its card payments. It flags a card used in two countries within ten minutes, about a second after the second payment.

Why it matters

It gives low delay and correct results at the same time. That is why fraud, pricing and alert systems use it.

Definition

Apache Flink is a free, open source engine for processing streams of events one at a time. It works on event time, so late events still land in the right window. It keeps state, such as running totals, and saves it often in checkpoints. After a crash it starts from the last checkpoint, which gives exactly-once results. It also runs batch jobs and has a SQL layer.

Common mistake

Letting state grow forever. Set a time limit on old keys, or they fill the memory.

Key takeaways

  1. 1
    Event at a time. Not small batches.
  2. 2
    Event time. Late events land right.
  3. 3
    Checkpointed state. Exactly-once after a crash.

Compare