Ask Mallard
Core concept

Choosing superiority, noninferiority or equivalence

4 min read

Choose whether you need evidence of benefit, acceptable loss, or similarity within agreed bounds.

Fit

When it matters, and when it does not

It matters when

  • You must decide what claim a treatment comparison needs to support.
  • You can justify how much loss or difference would matter to patients.

It matters less when

Before you start

What to check in your study

Decide these first
  1. Direction of benefitState whether larger or smaller outcomes are better.
  2. Clinical marginChoose the largest acceptable loss, or both similarity bounds, before looking at results.
  3. Treatment questionSpecify the outcome, follow-up and handling of treatment changes.
It rests on these
  1. The margin has a clinical and historical justification.How to check: Check that the active control would still work in the current setting.
  2. Similarity reflects treatments rather than poor trial conduct.How to check: Examine adherence, missing outcomes and both assigned-group and per-protocol analyses.

Plain language

How it works

Superiority asks whether a treatment is better than its comparator. Noninferiority asks whether any loss is smaller than a justified margin. Equivalence asks whether the whole plausible difference lies within both bounds. None means the treatments are identical.

What decides the choice
Match the intended question to the approach. Need evidence of benefit leads to Superiority: compare with zero. Accept a justified loss leads to Noninferiority: clear the loss margin. Need bounded similarity leads to Equivalence: clear both bounds.Choose by the question and available structureNeed evidence of benefitSuperiority: compare with zeroAccept a justified lossNoninferiority: clear the loss marginNeed bounded similarityEquivalence: clear both boundsThese are choice criteria, not a ranking of evidence or a guarantee of validity.
Conceptual diagram. It shows the structure of the idea, not data from any study.
Choosing the approach

For a benefit difference, superiority needs the chosen confidence interval above zero. Noninferiority needs its lower bound above the negative margin. Equivalence needs both bounds inside the equivalence limits. Reverse the direction for harmful outcomes. Fix the test and error rate first. Schuirmann describes two one-sided tests; Piaggio and colleagues distinguish the trial claims.

Worked example

A worked example

Invented for illustration
Setting
A team compares cure rates for a simpler treatment.
Question
Is a small loss in cure acceptable?
Approach
The benefit scale is new minus standard. The margin is 5 percentage points. Assume a normally distributed estimate with standard error 1.5 points.
Result
The reference difference is 0 points; the estimate is -1 point, a change of -1. Its 95% interval is -3.94 to 1.94 points.
What it means
The interval clears -5, supporting noninferiority under this prespecified rule. It crosses zero, so superiority is not shown. Equivalence requires a separately prespecified two-sided margin and test.

In practice

Recent studies PubMed search · not vetted

Searching PubMed…

Watch out

Common mistakes

The one to remember

A nonsignificant superiority test proves neither noninferiority nor equivalence. Set clinically justified margins before seeing results; poor adherence can make treatments look misleadingly similar.

  • Choosing a margin after seeing the interval.Instead: Justify the margin in the protocol.
  • Reading no significant difference as equivalence.Instead: Test the planned bounds with the chosen error rate.
  • Trusting assigned-group similarity alone.Instead: Examine adherence and sensitivity analyses for the target question.

Inside Mallard

How Mallard uses this

Mallard includes this comparison in Learn search and the Atlas. Plans do not link to this comparison automatically.

No Mallard code example points to this page.
Atlas node concept.choosing_trial_hypotheses, the id a plan cue records.

Related Learn pages

Related designs and methods

Evidence

Sources & further reading

  1. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability (opens in a new tab) · J Pharmacokinet Biopharm · doi 10.1007/BF01068419
  2. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement (opens in a new tab) · JAMA · doi 10.1001/jama.2012.87802
Prepared with AI assistance. PubMed records checked on 2026-11-06 for title, authors, year and DOI. The cited methods support the comparisons; record verification is not independent methodological approval.
Last source review: 2026-11-06
AI-generated educational content
Mallard uses reputable methodological and reporting sources, but this material may contain errors or omit important context. Verify important methodological decisions with the cited sources and, when appropriate, a qualified research methodologist or statistician.