Effect modification and interaction
What question does this help answer?
“Does the association or treatment effect differ meaningfully across subgroups or values of another variable?”
Why it matters
Average effects can hide clinically important heterogeneity. However, subgroup analyses are easy to overinterpret, especially when many are examined after results are known.
How to think about it
Effect modification depends on the effect measure. A factor may modify an effect on the risk-difference scale but not on the relative-risk scale. Interaction terms in regression models test a specific scale and model form.
The same effect on two scales
How Mallard may use this concept
Mallard may recommend a prespecified interaction when the clinical question explicitly asks whether an effect differs by age, sex, baseline risk, site, disease severity, or another scientifically motivated characteristic.
Good practice
- Define important subgroups before looking at results when possible.
- Use an interaction test rather than comparing “significant” in one group with “not significant” in another.
- Report stratum-specific estimates with confidence intervals.
- State the effect scale.
- Limit exploratory subgroup fishing.
- Consider power: interaction tests often require larger samples than main-effect tests.
Common mistake
A p-value below 0.05 in one subgroup and above 0.05 in another does not by itself demonstrate effect modification.
Clinical example
A treatment may reduce absolute cardiovascular risk more among patients with high baseline risk even if the relative effect is similar across risk groups.
- Effect modification, interaction and mediation: an overview of theoretical insights for clinical investigators (opens in a new tab) · Clin Epidemiol · doi 10.2147/CLEP.S129728
- Recommendations for presenting analyses of effect modification and interaction (opens in a new tab) · Int J Epidemiol · doi 10.1093/ije/dyr218