# P-Hacking

> Doing test after test, then showing just the one that came out the way you hoped.

**Field:** General Knowledge  
**Category:** Research  
**Also known as:** Data Dredging, Fishing for Significance, Significance Chasing

## Think of it like

It is like a dart game. You draw the target after you throw.

## Definition

P-hacking is trying many ways to analyse data until one gives a p-value under 0.05, then reporting only that one. Each extra try raises the chance of a fluke. Run 20 tests on pure noise, and on average one will cross the line by luck. The result looks real, but it is likely to fail when someone repeats the study.

## Example

A team finds no effect of a diet. They drop some people, split by age, then by sex, and at last find one group where p is 0.04. The paper reports only that group.

## Why it matters

It is one reason many published findings fail to repeat. Writing down the plan before the data comes in guards against it.

## Common mistake

Thinking it needs cheating. Most of it comes from honest people who try one more test and do not count the tries.

## Three principles

- **Many tries.** Each test adds a chance of a fluke.
- **One reported.** The misses stay hidden.
- **Plan first.** Write down the analysis before you look.

## Related terms

- [P-Value](https://learn.benibix.com/term/general/p-value)
- [Statistical Significance](https://learn.benibix.com/term/general/statistical-significance)
- [Replication Study](https://learn.benibix.com/term/general/replication)
- [Publication Bias](https://learn.benibix.com/term/general/publication-bias)
- [Cherry Picking](https://learn.benibix.com/term/general/cherry-picking)

![Two panels. Variables: a knob marked independent variable, what you change, with an arrow to a plant whose height is marked dependent variable, what you measure, and a note keep everything else the same. P-hacking: twenty bars for twenty tests on random data, one of which dips under a dashed line marked p of 0.05, and only that one is circled and labelled reported.](https://learn.benibix.com/diagrams/gen7-variables.svg)

---

Source: https://learn.benibix.com/term/general/p-hacking
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
