Ask Mallard
Analysis method

Bonferroni correction

5 min read

Bonferroni tests each hypothesis at the family error level divided by the number of tests, or multiplies each p-value by that number.

Fit

When to use it, and when not to

Use it when

  • You want to limit the chance of any false rejection across a defined family.
  • You need a simple single-step procedure valid with dependent tests.

Not when

Before you start

What you need

Decide these first
  1. The full family of hypothesesCount all tests supporting the shared claim, including planned tests with unremarkable results.
  2. The family error levelChoose the tolerated probability of any false rejection before looking at the results.
  3. Valid unadjusted p-valuesEach underlying test must suit the design, estimator and assumptions.
It rests on these
  1. Each true-null p-value is valid at its allocated level.How to check: Check the underlying tests. Multiplying an invalid p-value cannot make its inference valid.
  2. The specified family captures the selection behind the claims.How to check: Account for repeated looks, outcomes and analysis searches. Tests need not be independent.

Plain language

How it works

Let m be the planned number of tests and alpha the family error level. Reject a hypothesis when its raw p-value is at most alpha divided by m. Equivalently, compare min(1, m times p) with alpha. Bonferroni bounds the chance of any false rejection by the sum of true-null error probabilities. No independence assumption is needed.

Intervals and alternatives

For simultaneous intervals, allocate alpha divided by m to each interval error probability. Coverage is at least one minus alpha when each component interval meets its guarantee. Holm adjustment can reject more while keeping family-wise control. False discovery rate control targets the expected fraction of false rejections, a different goal. Choose that goal in the multiplicity overview.

Define the family before applying the correction
Planned family and valid p-values. Then Divide family alpha by test count. Then Compare raw p-values with threshold.Bonferroni correctionPlanned family and validp-valuesDivide family alpha bytest countCompare raw p-values withthresholdAny dependence is allowed; valid tests and a defined family are required.
Conceptual diagram. It shows the structure of the idea, not data from any study.

Worked example

A worked example

Invented for illustration
Setting
A trial prespecifies a family of 4 benefit hypotheses and a family error level of 0.05.
Question
Which hypotheses pass Bonferroni control?
Approach
The unadjusted p-values are 0.003, 0.012, 0.020 and 0.400. Multiply each by the family size and cap at one.
Result
The test threshold is 0.0125. Adjusted p-values are 0.012, 0.048, 0.080 and 1.000. The first 2 hypotheses reject at 0.05.
What it means
Two-sided marginal 98.75% intervals would give at least 95% simultaneous coverage if each interval has its stated coverage. Independence is not required.

In practice

Recent studies PubMed search · not vetted

Searching PubMed…

Watch out

Common mistakes

The one to remember

Define the test family before seeing results. Bonferroni controls family-wise error with valid p-values under any dependence, but can lose power. It cannot repair invalid tests or selective reporting.

  • Counting only tests with small p-values.Instead: Keep the prespecified family size. Dropping unfavorable tests defeats the error guarantee.
  • Comparing adjusted p-values with the divided threshold.Instead: Compare adjusted p-values with the family error level, or raw p-values with the divided threshold. Do not adjust twice.
  • Assuming a non-rejection proves no effect.Instead: Report effect estimates and intervals. The correction can reduce power, especially with many related tests.

Inside Mallard

How Mallard uses this

Plans do not link to this method yet.

No Mallard code example points to this page.
Atlas node analysis.bonferroni, the id a plan cue records.

How to report it

Report the prespecified family, number of tests, family error level, raw and adjusted p-values, and the correction. Label ordinary and simultaneous intervals clearly. A reporting guideline is not a design manual: use it to make the study transparent, not as a substitute for careful design. Check the target journal's own requirements as well, which this page cannot know.

Related Learn pages

Related designs and methods

Evidence

Sources & further reading

  1. Adjusting for multiple testing when reporting research results: the Bonferroni vs Holm methods (opens in a new tab) · Am J Public Health · doi 10.2105/ajph.86.5.726
  2. Some comments on frequently used multiple endpoint adjustment methods in clinical trials (opens in a new tab) · Stat Med · doi 10.1002/(sici)1097-0258(19971130)16:22<2529::aid-sim692>3.0.co;2-j
  3. Multiple significance tests: the Bonferroni method (opens in a new tab) · BMJ · doi 10.1136/bmj.310.6973.170
Prepared with AI assistance. PubMed records checked by title, authors, publication year and DOI on 2026-11-07: record verified, confirm it supports this use. No independent professional approval is claimed. Aickin and Gensler present p-value adjustments and compare Bonferroni with Holm. Sankoh and colleagues study endpoint procedures with simulations. Bland and Altman explain Bonferroni; that teaching note is not a primary comparison study. Bonferroni’s original 1936 work is not indexed in PubMed; no PMID is invented for it.
Last source review: 2026-11-07
AI-generated educational content
Mallard uses reputable methodological and reporting sources, but this material may contain errors or omit important context. Verify important methodological decisions with the cited sources and, when appropriate, a qualified research methodologist or statistician.