Choosing a meta-analysis model
Common-effect pooling targets one shared effect; random-effects pooling targets a mean across varying effects and needs a separate account of heterogeneity.
Fit
When it matters, and when it does not
It matters when
- You plan to pool comparable estimates from several studies.
- You need to distinguish uncertainty in a pooled mean from variation between underlying study effects.
It matters less when
- Studies answer incompatible questions. Use a structured synthesis without pooling. Read: Systematic review
- You pool sensitivity and specificity across test thresholds. Consider a diagnostic meta-analysis model. Read: Meta-analysis of diagnostic test accuracy
Before you start
What to check in your study
- What the summary should meanDecide whether a shared effect or a mean across varying effects answers the review question.
- Whether studies can be combinedCompare populations, interventions, outcome definitions and effect scales.
- How heterogeneity and uncertainty will be estimatedSpecify the variance estimator, interval method and sensitivity analyses.
- A common-effect interpretation assumes a shared underlying effect.How to check: Clinical differences can challenge that assumption even when a heterogeneity test is not significant.
- Random-effects inference needs a plausible distribution of effects.How to check: Few studies make its spread and prediction uncertain. Examine outliers and influential small studies.
Plain language
How it works
Common-effect inverse-variance pooling weights each estimate by its precision. Under a shared-effect model, it estimates that common effect. Random effects adds between-study variance, called tau-squared and measured in squared units of the effect, to each study variance before forming weights.
I-squared describes the share of observed variation attributed to heterogeneity rather than sampling error. It is not the spread of effects in clinical units. Both measures can be uncertain, especially with few studies.
Choose the target from the review question before testing heterogeneity. Report the mean, its confidence interval and the heterogeneity estimates. Consider a prediction interval when justified. Random effects gives smaller studies more relative weight and does not repair bias.
Worked example
A worked example
- Setting
- Two comparable studies estimate mean differences in the same units.
- Question
- Why can adding between-study variance change the summary?
- Approach
- Study estimates are 2 and 8, with variances 1 and 9. For illustration, set between-study variance to 9.
- Result
- Inverse-variance pooling gives 2.6 under common effect and about 4.14 under random effects. The latter gives the less precise study more relative weight, a change in the summary of about 1.54 units.
- What it means
- The two studies illustrate weights only. A between-study variance of 9 was supplied, not estimated from these data.
In practice
Recent studies PubMed search · not vetted
Watch out
Common mistakes
The one to remember
Do not choose a pooling model from a heterogeneity P value. Random effects cannot make incompatible studies comparable.
- Reading I-squared as the size of clinical differences.Instead: I-squared describes inconsistency relative to sampling error. Tau-squared measures between-study variance in the squared units of the chosen effect scale.
- Reading a confidence interval for the mean as a prediction interval.Instead: A prediction interval describes an underlying effect in a comparable new setting, allowing for heterogeneity and its uncertainty.
Inside Mallard
How Mallard uses this
Mallard lists Choosing a meta-analysis model under Core research concepts.
concept.choosing_meta_models_heterogeneity, the id a plan cue records.Related Learn pages
Related designs and methods
Evidence
Sources & further reading
- Measuring inconsistency in meta-analyses (opens in a new tab) · BMJ · doi 10.1136/bmj.327.7414.557
- A re-evaluation of random-effects meta-analysis (opens in a new tab) · J R Stat Soc Ser A Stat Soc · doi 10.1111/j.1467-985X.2008.00552.x