📈Test Set
Also known as Test Split, Hold-out Test Set
Data kept locked away. You use it once, at the end, for a fair final score.
Think of it like
Think of it like the final exam. You only sit it once, at the very end.
Example
Lucy's team finishes its spam model. Only then do they run it on 2,000 emails nobody has touched. It catches 96 percent of the spam.
Why it matters
It is your best guess of how the model will do for real users. A score from anywhere else is too hopeful.
Definition
Common mistake
Key takeaways
- 1Locked away. Not seen during building.
- 2Used once. For the final score.
- 3Honest guess. How it will do on new data.