Skip to content
BENIBIX Learn

Test Set

Also known as Test Split, Hold-out Test Set

Data kept locked away. You use it once, at the end, for a fair final score.

Think of it like

Think of it like the final exam. You only sit it once, at the very end.

Example

Lucy's team finishes its spam model. Only then do they run it on 2,000 emails nobody has touched. It catches 96 percent of the spam.

Why it matters

It is your best guess of how the model will do for real users. A score from anywhere else is too hopeful.

Definition

The test set is data kept locked away until the model is finished. It is used once, for the final score. Because the model never saw it, the score shows how well it will do on new data. If you peek at it while you build the model, it stops being a fair test. Many teams keep it hidden even from the people training the model.
The test set is the last part. It stays locked until the very end.

Common mistake

Checking the test set after every change. Each peek makes it a little less fair. Soon it is no longer a real test.

Key takeaways

  1. 1
    Locked away. Not seen during building.
  2. 2
    Used once. For the final score.
  3. 3
    Honest guess. How it will do on new data.

Compare

Learn it properly