# Statistical Significance

> A result that clears a bar set before the test. Chance alone would rarely give it.

**Field:** General Knowledge  
**Category:** Math & Statistics  
**Also known as:** Statistically Significant, Significance Level, Alpha Level

## Think of it like

It is like the bar in a high jump. Clear the bar and the jump counts.

## Definition

A result is called significant when its p-value falls below a line set before the test. That line is called the significance level. The most common one is 0.05. Clearing it means the result would be rare if there were no real effect. It does not mean the effect is big or important. With lots of data, even a tiny effect can clear it.

## Example

A shop tests two buttons on 1 million visitors. The new one wins by a tenth of a percentage point, with p = 0.01. The result is significant, but the gain is too small to matter.

## Why it matters

News stories often use the word as if it meant big. Knowing the difference stops you from trusting a result too much.

## Common mistake

Setting the bar after seeing the data. Picking the line to suit the result makes the test worthless.

## Three principles

- **Bar set first.** Choose the level before the test.
- **0.05 is common.** Some fields use far stricter bars.
- **Not the same as big.** Tiny effects can still clear it.

## Related terms

- [P-Value](https://learn.benibix.com/term/general/p-value)
- [Hypothesis Test](https://learn.benibix.com/term/general/hypothesis-test)
- [Sample (Statistics)](https://learn.benibix.com/term/general/sample)
- [Confidence Interval](https://learn.benibix.com/term/general/confidence-interval)
- [A/B Test](https://learn.benibix.com/term/marketing/ab-test)
- [P-Hacking](https://learn.benibix.com/term/general/p-hacking)

## Taught in

- [Hypothesis Test and P-Value](https://learn.benibix.com/learn/general-math/hypothesis-test-and-p-value): Statistics, 9/10

![A bell curve showing the results you would expect if there were no real effect. A dashed line on the right marks the 0.05 bar. A solid line further out marks your result. The thin tail of the curve past your result is shaded and marked p-value.](https://learn.benibix.com/diagrams/gen-p-value.svg)

---

Source: https://learn.benibix.com/term/general/statistical-significance
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-20
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
