# Pipeline Alerting

> A note to a person when a pipeline breaks or runs late.

**Field:** Data Engineering  
**Category:** Orchestration  
**Also known as:** Pipeline Alerts, Failure Alerts, Task Failure Notification

## Think of it like

It is like a smoke alarm in a kitchen. It shouts before the whole house fills with smoke.

## Definition

Pipeline alerting sends a message to a person when a pipeline goes wrong. The two main triggers are a task that fails and a run that misses its deadline. The message goes to a chat channel, an email or the person on call. A good alert says which task broke, which run it was and where the log is. Too many alerts are as bad as none, because people stop reading them.

## Example

The sales load fails at 03:10. An alert lands in the team chat with the task name and a link to the log. Jack fixes it before the 08:00 report goes out.

## Example code

```python
@task(on_failure_callback=send_to_chat)
def load_sales():
    ...
```

If this Airflow task fails, the function send_to_chat runs and posts an alert.

## Why it matters

A failed pipeline that nobody hears about turns into a wrong report in the morning. An alert turns it into a quick fix.

## Common mistake

Alerting on every retry. People learn to ignore the channel, and they miss the real failure.

## Three principles

- **Fail or late.** Both are worth a message.
- **Say where.** Task, run and a link to the log.
- **Few and real.** Noise teaches people to ignore it.

## Related terms

- [Workflow Orchestration](https://learn.benibix.com/term/data/workflow-orchestration)
- [Task Retry](https://learn.benibix.com/term/data/task-retry)
- [Data SLA](https://learn.benibix.com/term/data/data-sla)
- [Data Observability](https://learn.benibix.com/term/data/data-observability)
- [Data Downtime](https://learn.benibix.com/term/data/data-downtime)

## Told apart from

- [Pipeline Alerting vs Data Observability](https://learn.benibix.com/compare/pipeline-alerting-vs-data-observability): People think a pipeline with no failure alerts has good data. Pipeline alerts watch the jobs: did a task fail, did a run finish late? Data observability watches the data itself: are rows missing, are values strange? A job can finish green and still load an empty table. You need both to trust the numbers.

![Three tasks in a row: extract done, load failed and highlighted, report waiting. An arrow from the failed task leads to an alert in the team chat that names the task, the run and a log link. To the right, a 06:00 deadline that is not met leads to a late alert.](https://learn.benibix.com/diagrams/dat2-pipeline-alerting.svg)

---

Source: https://learn.benibix.com/term/data/pipeline-alerting
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
