# Apache Kafka

> The most used free tool for event streams.

**Field:** Data Engineering  
**Category:** Ingestion & Streaming  
**Also known as:** Kafka, Kafka Cluster

## Think of it like

It is like a big notebook that many people write in. Each line stays. Readers keep a bookmark.

## Definition

Apache Kafka is a free, open source platform for event streaming. It stores events in topics. Topics are split into partitions and spread over servers called brokers. Events are written to the end of a log. They are kept for a set time, seven days by default. Many consumers can read the same events, each at its own pace.

## Example

LinkedIn first built Kafka to move its activity data. Today banks, shops and games use it to move clicks, payments and logs.

## Example code

```console
$ kafka-console-consumer.sh --bootstrap-server localhost:9092 \
    --topic orders --from-beginning
{"id": 1, "total": 19.5}
{"id": 2, "total": 42.0}
```

Read the orders topic from its first event, using the tool that ships with Kafka.

## Why it matters

It is the default backbone for event streaming. Most streaming tools can read from it and write to it.

## Common mistake

Using it as a simple job queue. It keeps order only inside a partition, and it does not delete a message when it is read.

## Three principles

- **A log, not a queue.** Events are kept after they are read.
- **Split to scale.** Topics spread over partitions and brokers.
- **Many readers.** Each group reads at its own pace.

## Related terms

- [Event Streaming](https://learn.benibix.com/term/data/event-streaming)
- [Kafka Topic](https://learn.benibix.com/term/data/kafka-topic)
- [Kafka Partition](https://learn.benibix.com/term/data/kafka-partition)
- [Kafka Consumer Group](https://learn.benibix.com/term/data/kafka-consumer-group)
- [Message Queue](https://learn.benibix.com/term/development/message-queue)
- [Kafka Producer](https://learn.benibix.com/term/data/kafka-producer)
- [Kafka Consumer](https://learn.benibix.com/term/data/kafka-consumer)

## Told apart from

- [Apache Kafka vs Confluent](https://learn.benibix.com/compare/apache-kafka-vs-confluent): People think Confluent and Kafka are the same thing. Apache Kafka is free, open source software that anyone can run. Confluent is a company that sells Kafka as a service. Its cloud runs the brokers for you and adds tools, like a schema registry. Your apps speak Kafka either way, so moving between them is mostly a change of settings.

![A producer writes events into a topic with three partitions, each an ordered list of numbered events. Two consumers in one group each read their own partitions, and each keeps its place with an offset.](https://learn.benibix.com/diagrams/kafka-topic-partitions.svg)

---

Source: https://learn.benibix.com/term/data/apache-kafka
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
