Base Rate Fallacy
Level 1 · How we judge
Why a positive test for a rare illness is often wrong. Why bad luck seems to be for others. Why each job takes longer than we plan.
Course contentsLesson 4 of 14
Level 1 · How we judge
Level 2 · How we choose
Level 3 · Ourselves and others
Level 4 · Groups and influence
Level 5 · What drives us
Level 6 · How people differ
After this lesson you can
- Work out what a positive test means for a rare thing
- Spot optimism bias in a plan
- Use past jobs to estimate a new one
12 mincovers 3 glossary entries
Worth reading first: Availability Heuristic
Why is a positive test for a rare illness often wrong?
The base rate fallacy is ignoring how rare a thing is when you judge one case. Take an illness that 1 in 1,000 people have, and a test that wrongly flags 5 in 100 healthy people. Test 1,000 people, and about 51 come back positive. Only 1 of them is sick. A positive result means about a 2 percent chance.
Most people guess far higher, often 95 percent, because the test sounds good. They focus on the test and forget how few people had the illness to begin with. The rare thing has to beat the false alarms. And there are far more healthy people to set them off.
This is why doctors do not screen everyone for every rare illness. It is also why a second, different test is used to confirm a first positive. The base rate is the starting point, and the test only moves you from there.
Optimism bias is thinking bad luck is for other people. Most people expect to live longer, earn more and stay married more than the numbers say. It lifts the mood. It also means people skip insurance, savings and seat belts.
The planning fallacy is guessing a job will be quick, even when past jobs ran late. In a 1994 study, students guessed they would finish their final project in about 34 days. On average they took about 56. Fewer than a third finished by their own guess.
The cure for the planning fallacy is to use the base rate of your own past. How long did the last three projects like this take? Start there, not with the best case. People who ask how long it usually takes guess far better than those who imagine this time.
All three come from looking at the case in front of you and missing the bigger pattern. The fix is the same question each time. How often does this happen, to everyone or in my past?
Worked example
Owen plans a kitchen
Owen plans to redo his kitchen in 3 weekends. His last two home jobs each took about three times as long as he planned.
He tells his family to expect 9 weekends. It takes 8, and for once nobody is cross.
The words for this lesson3
Check yourself
A test for a rare illness comes back positive. What is the first thing to ask?
Finished this lesson?
Marking it complete also marks its 3 glossary entries learned, which updates your roadmap and your saved page. 0 are already marked.