🗓️Pipeline Alerting
Also known as Pipeline Alerts, Failure Alerts, Task Failure Notification
A note to a person when a pipeline breaks or runs late.
Think of it like
It is like a smoke alarm in a kitchen. It shouts before the whole house fills with smoke.
Example
The sales load fails at 03:10. An alert lands in the team chat with the task name and a link to the log. Jack fixes it before the 08:00 report goes out.
Why it matters
A failed pipeline that nobody hears about turns into a wrong report in the morning. An alert turns it into a quick fix.
Definition
Example code
python
@task(on_failure_callback=send_to_chat)
def load_sales():
...Common mistake
Key takeaways
- 1Fail or late. Both are worth a message.
- 2Say where. Task, run and a link to the log.
- 3Few and real. Noise teaches people to ignore it.