Skip to content
BENIBIX Learn

Survivorship Bias

Level 3 · Evidence and sources

Three ways proof can mislead when each fact is true. You look only at winners, show only the facts that help, or trust one story.

Course contentsLesson 6 of 8

After this lesson you can

  • Ask what is missing from a set of evidence
  • Spot cherry-picked facts
  • Weigh one story against many results

11 mincovers 3 glossary entries

Worth reading first: Slippery Slope Fallacy

How can true facts still mislead you?

Evidence can mislead even when each fact in it is true. Survivorship Bias means you learn only from the winners. The losers are gone, and nobody counts them. Cherry picking means you show only the facts that help your case. Anecdotal Evidence means you trust one story over the full count.

The famous case comes from World War II planes. Bombers that came back were covered in bullet holes on the wings and tail. The first idea was to add armour there. A statistician pointed out the flaw. Planes hit in the engines did not come back to be counted. The armour belonged where the holes were missing.

Survivorship Bias is everywhere success is studied. Books on how rich people got rich look only at those who made it. Many others did the same things and failed. Without them, you cannot tell skill from luck. Always ask who is missing from the picture.

Cherry picking is choosing the facts that fit and hiding the rest. A chart of one cold week can make it look like the world is not warming. A review site can show only the five-star ratings. Each fact is real. The selection is the lie.

Anecdotal Evidence is proof from one story, or a few. My grandad smoked and lived to 95. The story may be true, but one case says little about what usually happens. Large studies of millions of people show smoking cuts years off most lives.

Stories are powerful because they are vivid. A single moving story sticks in the mind far longer than a table of numbers. That is why ads and speeches lead with one person. Enjoy the story, then ask how typical it is.

The question that catches all three is the same. What would I see if I had all the cases, not just these? Look for the full count, the time span and the cases that did not make the news. If nobody can show you them, hold the claim loosely.

Each picture is true as far as it goes. Each one leaves out the part that would change the answer.

Worked example

Chloe reads about dropouts

Chloe reads that three famous tech founders left college, and wonders if she should too. The article names no one who left and failed.

She looks up the numbers. People with a degree, on average, earn more and are less often out of work. The three founders were the survivors.

The words for this lesson3

Check yourself

Why did the returning bombers show the wrong place for armour?

Finished this lesson?

Marking it complete also marks its 3 glossary entries learned, which updates your roadmap and your saved page. 0 are already marked.