Skip to content
BENIBIX Learn

Minimum Detectable Effect (MDE)

General🔢 Math & StatisticsStatistics

Also known as MDE, Minimum Detectable Lift, Smallest Detectable Effect

The smallest change a test is big enough to notice.

Think of it like

It is like a kitchen scale that does not move for a crumb. You need to add a big spoon before it shows.

Example

A page converts at 3%. To catch a rise to 3.6% with the usual settings, a test needs about 14,000 visitors in each version.

Why it matters

It turns a hope into a sample size and a run time. Without it, people stop tests too early.

Definition

The minimum detectable effect is the smallest change a test is set up to catch. You pick it before the test starts. A smaller effect needs far more people, because halving it takes about four times the sample. If the real change is smaller than the MDE, the test will usually miss it. So the MDE decides how long a test must run.
The smaller the change you want to catch, the more visitors the test needs.

Common mistake

Reading a test with no winner as proof the change did nothing. The test may have been too small to see it.

Key takeaways

  1. 1
    Set it first. Choose it before the test runs.
  2. 2
    Small costs more. Half the effect needs four times the people.
  3. 3
    Sets the run time. Sample size over daily traffic.