Survivorship Bias vs Cherry Picking
People think survivorship bias is just another name for cherry picking, and it is not. Cherry picking is a choice: someone picks the facts that help and hides the rest. Survivorship bias needs no one to hide anything. The failures drop out by themselves, so even an honest person only sees the winners. The fix for one is to ask for all the data. The fix for the other is to ask where the missing cases went.
Survivorship Bias
You learn only from the winners. The losers are gone, so you do not see them.
Survivorship bias is drawing a lesson only from the things that made it through, while the failures are out of sight. Because the failures are missing, the lesson can be wrong. Stories of rich people who quit school leave out the many who quit and did not get rich. The fix is to ask what happened to the ones you cannot see.
Cherry Picking
Showing just the facts that help your claim, and hiding the rest.
Cherry picking is choosing only the facts that support a claim and leaving out the rest. Each fact shown may be true. But the full set of facts might tell a different story. It is common in ads, debates and reports that use a short time window. The fix is to ask what the rest of the data says.
In one line
- Survivorship Bias
- You learn only from the winners. The losers are gone, so you do not see them.
- Cherry Picking
- Showing just the facts that help your claim, and hiding the rest.