🔢Minimum Detectable Effect (MDE)
Also known as MDE, Minimum Detectable Lift, Smallest Detectable Effect
The smallest change a test is big enough to notice.
Think of it like
It is like a kitchen scale that does not move for a crumb. You need to add a big spoon before it shows.
Example
A page converts at 3%. To catch a rise to 3.6% with the usual settings, a test needs about 14,000 visitors in each version.
Why it matters
Definition
Common mistake
Key takeaways
- 1Set it first. Choose it before the test runs.
- 2Small costs more. Half the effect needs four times the people.
- 3Sets the run time. Sample size over daily traffic.