Skip to content
BENIBIX Learn

Survivorship Bias vs Cherry Picking

People think survivorship bias is just another name for cherry picking, and it is not. Cherry picking is a choice: someone picks the facts that help and hides the rest. Survivorship bias needs no one to hide anything. The failures drop out by themselves, so even an honest person only sees the winners. The fix for one is to ask for all the data. The fix for the other is to ask where the missing cases went.

General🤔 Critical Thinking

Survivorship Bias

You learn only from the winners. The losers are gone, so you do not see them.

Survivorship bias is drawing a lesson only from the things that made it through, while the failures are out of sight. Because the failures are missing, the lesson can be wrong. Stories of rich people who quit school leave out the many who quit and did not get rich. The fix is to ask what happened to the ones you cannot see.

Example
In a war, people studied the bullet holes on planes that came back. A statistician saw the real lesson. Armour should go where the returning planes had no holes, since planes hit there never came back.
Why it matters
It makes risky plans look safe and lucky habits look smart. Advice from winners alone can lead you wrong.
Full entry
General🤔 Critical Thinking

Cherry Picking

Showing just the facts that help your claim, and hiding the rest.

Cherry picking is choosing only the facts that support a claim and leaving out the rest. Each fact shown may be true. But the full set of facts might tell a different story. It is common in ads, debates and reports that use a short time window. The fix is to ask what the rest of the data says.

Example
A fund shows it grew 30% from March to June. It leaves out that it fell 40% over the whole year.
Why it matters
It can make almost any claim look true with real facts. Asking for the full picture is the only defence.
Full entry

In one line

Survivorship Bias
You learn only from the winners. The losers are gone, so you do not see them.
Cherry Picking
Showing just the facts that help your claim, and hiding the rest.