# Data-Aware Scheduling

> A pipeline starts when its input data changes. It does not wait for a set time.

**Field:** Data Engineering  
**Category:** Orchestration  
**Also known as:** Event-Driven Scheduling, Asset-Triggered Scheduling, Dataset Scheduling

## Think of it like

You eat when the food is on the table. You do not eat just because the clock says six.

## Definition

Data-aware scheduling starts a pipeline when the data it needs has changed. One pipeline marks a table or file as updated when it finishes. Any pipeline that reads that table then starts by itself. No one has to guess how long the first one takes. It links pipelines that belong to different teams.

## Example

The orders team's load finishes at a different time each night. The finance report starts the moment it ends, never before.

## Example code

```python
from airflow.sdk import Asset, dag

orders = Asset("s3://lake/orders")

@dag(schedule=[orders])
def build_sales_report():
    ...
```

In Airflow 3, this pipeline runs each time a task updates the orders data.

## Why it matters

Fixed times force you to add a safety gap. Waiting on the data itself removes the gap and the wrong reports it causes.

## Common mistake

Chaining twenty pipelines this way with no picture of the links. One slow source then stalls a whole tree, and no one sees why.

## Three principles

- **Data as the trigger.** An updated table starts the next run.
- **Across teams.** Links pipelines that different people own.
- **No guessed gaps.** Runs start as soon as inputs land.

## Related terms

- [Workflow Scheduler](https://learn.benibix.com/term/data/workflow-scheduler)
- [Sensor Task](https://learn.benibix.com/term/data/sensor-task)
- [Software-Defined Asset](https://learn.benibix.com/term/data/software-defined-asset)
- [Task Dependency](https://learn.benibix.com/term/data/task-dependency)

![Three ways a run starts, side by side: a clock at 06:00, a sensor that checks every 5 minutes until a file appears, and an upstream table that, once updated, starts the downstream pipeline.](https://learn.benibix.com/diagrams/schedule-triggers.svg)

---

Source: https://learn.benibix.com/term/data/data-aware-scheduling
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
