📥Apache Kafka
Also known as Kafka, Kafka Cluster
The most used free tool for event streams.
Think of it like
It is like a big notebook that many people write in. Each line stays. Readers keep a bookmark.
Example
LinkedIn first built Kafka to move its activity data. Today banks, shops and games use it to move clicks, payments and logs.
Why it matters
It is the default backbone for event streaming. Most streaming tools can read from it and write to it.
Definition
Example code
console
$ kafka-console-consumer.sh --bootstrap-server localhost:9092 \
--topic orders --from-beginning
{"id": 1, "total": 19.5}
{"id": 2, "total": 42.0}Common mistake
Key takeaways
- 1A log, not a queue. Events are kept after they are read.
- 2Split to scale. Topics spread over partitions and brokers.
- 3Many readers. Each group reads at its own pace.