🧭Data Pipeline
A chain of steps that moves data from where it starts to where it ends up.
Think of it like
It is like a belt in a factory. Things go in one end, get worked on, and come out the other end.
Example
Every hour, a pipeline copies new orders from the shop. It adds tax. Then it writes them to the sales table.
Why it matters
A pipeline turns a one-time copy into a job. The job runs each day by itself. No one has to press a button.
Definition
Common mistake
Key takeaways
- 1Source to destination. Data flows one way through it.
- 2Steps in order. Each step feeds the next one.
- 3Safe to rerun. Running it twice must not double the data.