🔢Statistical Significance
Also known as Statistically Significant, Significance Level, Alpha Level
A result that clears a bar set before the test. Chance alone would rarely give it.
Think of it like
It is like the bar in a high jump. Clear the bar and the jump counts.
Example
A shop tests two buttons on 1 million visitors. The new one wins by a tenth of a percentage point, with p = 0.01. The result is significant, but the gain is too small to matter.
Why it matters
News stories often use the word as if it meant big. Knowing the difference stops you from trusting a result too much.
Definition
Common mistake
Key takeaways
- 1Bar set first. Choose the level before the test.
- 20.05 is common. Some fields use far stricter bars.
- 3Not the same as big. Tiny effects can still clear it.