CalculatorVilla

Minimum Reliably Detectable Effect (MRDE) Calculator

Calculate the Minimum Reliably Detectable Effect (MRDE / MDE)—the smallest relative and absolute metric uplift your experiment can detect with 80% or 90% statistical power at a 5% significance level.

Minimum Detectable Effect (Relative %): 13.73

Visitors, impressions, or users allocated to each experimental group

%

Current conversion, click-through, or engagement rate

Probability of detecting a true effect when one exists

Minimum Detectable Effect (Relative %)
13.73%

How to Use This Calculator

  1. Enter your sample size per test group.
  2. Enter your current baseline conversion rate percentage.
  3. Select statistical power (80% standard).
  4. Review the smallest relative and absolute effect your experiment can detect.

Formula & Calculation Methodology

MDE = (Z_α/2 + Z_β) × √[2p(1 − p) ÷ n] | Relative MDE = (MDE ÷ p) × 100%

Derived by inverting the standard two-sample z-test power equation. As sample size n increases, the detectable effect threshold shrinks proportional to 1/√n.

MDEMinimum absolute difference reliably detectable
Z_α/2Critical two-tailed z-score (1.96 for 95% confidence)
Z_βPower z-score (0.84 for 80% power, 1.28 for 90% power)
pBaseline conversion rate proportion
nSample size per branch

Worked Example

20,000 users per branch at 4.0% baseline with 80% power

sampleSizePerVariant: 20000
baselineRate: 4
power: 0.8
Result: MDE: 9.77% relative uplift (Absolute: 0.39 percentage points, Target: 4.39%)

100,000 users per branch at 5.0% baseline with 80% power

sampleSizePerVariant: 100000
baselineRate: 5
power: 0.8
Result: MDE: 5.46% relative uplift

Frequently Asked Questions

What happens if a true effect is smaller than the MRDE?↓

If the true effect is smaller than the MRDE, your test will likely finish inconclusive (p > 0.05), failing to reach statistical significance even if the variant is genuinely superior.

Why is MDE inversely proportional to the square root of sample size?↓

Because standard error scales with 1/√n. To cut your detectable effect in half (e.g. from 10% MDE down to 5% MDE), you must quadruple your sample size.

Can MRDE be calculated before launching an experiment?↓

Yes. Calculating MRDE during experiment planning is standard practice to prevent running "underpowered" tests that waste engineering time on undetectable goals.

What is a limitation of MRDE calculations?↓

It assumes binomial conversion variance. Continuous revenue metrics with heavy skew (whales) require higher sample sizes or log-transformation.

Related Calculators

Source Citation & Disclaimer

Informational tool only; not licensed tax, legal, or financial advice.