🧭Micro-Batching
Also known as Micro-Batch, Micro Batch Processing
Tiny batches run every few seconds. It feels close to live, but stays simple.
Think of it like
It is like a bus that leaves every five minutes. It does not wait to fill up. It does not go for just one person.
Example
Spark Structured Streaming works in micro-batches by default. A job can pick up new rows every ten seconds and add them to a total.
Why it matters
Many teams want fresh data but not the work of true streaming. Micro-batches give them most of the speed for less effort.
Definition
Common mistake
Key takeaways
- 1Small and often. Batches of a few seconds each.
- 2Batch code. Each tiny batch runs like a normal job.
- 3Small fixed delay. Results lag by about one batch.