🗓️Airflow Metadata Database
Also known as Airflow Metastore, Airflow Database
The database where Airflow keeps each run. It also holds task states and settings.
Think of it like
It is like the class book. Every name and every tick goes in it.
Example
After a year, a team's metadata database holds millions of old task rows. They clean out runs older than 90 days, and the web page is fast again.
Why it matters
It is the memory of the whole system. Lose it, and Airflow forgets what ran, what failed and how to reach your other systems.
Definition
Common mistake
Key takeaways
- 1All state. DAGs, runs and task instances.
- 2Shared hub. The scheduler and web page read it.
- 3Keep it lean. Clean out old rows on a schedule.