Skip to content
BENIBIX Learn

Airflow Scheduler

Data🗓️ OrchestrationApache Airflow

Also known as Scheduler (Airflow)

The Airflow part that starts runs on time. It queues tasks that are ready.

Think of it like

It is like a teacher with a bell. It rings to start each lesson and checks who is ready.

Example

At 6:00, the scheduler makes today's run of the sales DAG. A few seconds later, the first two tasks are queued.

Why it matters

Every task in Airflow starts because the scheduler said so. When tasks sit queued for a long time, the scheduler is the first place to look.

Definition

The Airflow scheduler is the part that decides what runs next. It makes new DAG runs when their time comes. It checks which tasks have all their upstream tasks done. It puts those tasks in a queue for the executor. It runs nonstop, and you can run more than one for safety. If it stops, nothing new starts.
The scheduler sits in the middle. It reads the database and decides, then hands work to the executor.

Common mistake

Thinking the scheduler runs the tasks. It only decides. The executor and its workers do the running.

Key takeaways

  1. 1
    Make runs. Starts DAG runs when they are due.
  2. 2
    Find ready tasks. Checks that upstream tasks are done.
  3. 3
    Queue them. Hands ready tasks to the executor.

Compare