🗓️Workflow Scheduler
Also known as Pipeline Scheduler, Job Scheduler, Pipeline Schedule
The part that starts each pipeline at the right time. It often uses a cron rule.
Think of it like
It is like an alarm clock for jobs. When it rings, the job gets up and starts.
Example
Lucy schedules her sales pipeline for 6 am UTC. The night's orders are in by then, and the report is ready before the team logs on.
Why it matters
A run that starts too early reads data that is not there yet. One that starts too late leaves people waiting for numbers.
Definition
Example code
python
@dag(schedule="0 6 * * *") # 06:00 every day
@dag(schedule="@hourly") # top of every hour
@dag(schedule=None) # only when started by handCommon mistake
Key takeaways
- 1Cron rules. Minute, hour, day, month and weekday.
- 2One slice per run. Each run covers a set stretch of time.
- 3Time zones. Know which clock the schedule follows.