📈Data Leakage
Also known as Leakage, Target Leakage, Test Leakage
When the answers sneak into training. Test scores look great and real use fails.
Think of it like
Think of it like seeing the answers before a test. Your score is high, but you learned nothing.
Example
Jack's model predicts which patients will get sick. One feature is the date the patient got medicine. That date gives the answer away, so the model looks perfect and fails in real use.
Why it matters
It is one of the most common reasons a model that looked great fails after launch. Nothing warns you, because the scores look fine.
Definition
Common mistake
Key takeaways
- 1Answers sneak in. Facts the model should not have.
- 2Scores too good. Testing looks better than reality.
- 3Fails for real. New data shows the truth.