🧭Batch Processing
Also known as Batch Job, Batch Pipeline
Handling data in big piles at set times. One job runs over all of it.
Think of it like
It is like doing the wash once a week. You wait for a full load, then wash it all at once.
Example
A bank adds up all of the day's card payments at 2am. The report is ready when staff get in at 9am.
Why it matters
Most reports do not need second-by-second data. A nightly batch is cheaper and easier to fix than a live stream.
Definition
Common mistake
Key takeaways
- 1Wait, then run. Data piles up before the job starts.
- 2All at once. One run handles the whole pile.
- 3As fresh as the last run. Results are as old as the last job.