🗓️Airflow Provider Package
Also known as Airflow Provider, Provider Package, apache-airflow-providers
An add-on for Airflow. It brings the code to work with one outside system.
Think of it like
It is like an add-on pack for a board game. It brings new pieces for one new place.
Example
Jack's DAGs read from PostgreSQL and write to Amazon S3. He installs two providers, for postgres and for amazon, and nothing else.
Why it matters
Airflow itself stays small, and each system's code is updated on its own schedule. You get fixes for one system without moving all of Airflow.
Definition
Example code
console
$ pip install apache-airflow-providers-postgresCommon mistake
Key takeaways
- 1One system each. A package per service.
- 2Hooks and operators. Plus sensors for that system.
- 3Install what you use. Nothing extra comes with it.