🛡️Schema Drift
Also known as Schema Change, Upstream Schema Change
When the columns of new data change and no one says so.
Think of it like
Someone moves the chairs while you sleep. You walk in the dark and bump into one.
Example
The app team renames price to unit_price. The nightly load still runs, but the price column in the warehouse is now empty.
Why it matters
It is one of the most common causes of broken pipelines. The silent kind can go unnoticed for weeks.
Definition
Common mistake
Key takeaways
- 1Unannounced change. Added, renamed, dropped or retyped.
- 2Loud or silent. A crash, or blanks that go unseen.
- 3Catch it early. Contracts and monitors spot it.