Ask Mallard
Analysis method

Run chart

4 min read

A run chart plots a measure in time order against a fixed median to look for patterns suggesting a process change.

Fit

When to use it, and when not to

Use it when

  • You collect the same process measure at regular times while improving care.
  • You want an early view of whether a change persists over time.

Not when

Before you start

What you need

Decide these first
  1. The measure and time intervalKeep the numerator, denominator and collection process stable; retain the actual time order.
  2. A defined baseline periodChoose the baseline before judging change. State how its median is calculated.
  3. One published set of signal rulesState how ties and missing time points are treated. Different rule sets have different false-alarm rates.
It rests on these
  1. Each point measures the same process in the same way.How to check: Annotate changed definitions, patient mix and collection gaps.
  2. Serial dependence is considered when interpreting patterns.How to check: Seasonality and autocorrelation can create runs without a new intervention effect.
  3. Missing time points have a stated explanation.How to check: Keep gaps visible. If high-workload periods are missing more often, examine how those gaps could alter the pattern.

Plain language

How it works

Plot each value against time and draw the baseline median. Apply a prespecified rule set to runs or crossings of that line. For example, the Perla rules identify a shift from six consecutive points on one side, ignoring points on the median. Name the rule set; thresholds are not universal.

Run chart in steps
Define measure and baseline period; then Fix baseline median; then Plot all points in time order; then Apply prespecified rules and investigate signals.Run chartDefine measure and baseline periodFix baseline medianPlot all points in time orderApply prespecified rules and investigate signalsA run-chart signal suggests a change in the process, not its cause. Keep the baseline median fixed whileassessing a change; repeated recentering can hide a shift.
Conceptual diagram. It shows the structure of the idea, not data from any study.
Read the result

Annotate interventions and changes in data collection. An apparent shift can reflect seasonality, changed patients or missing periods. Perla and colleagues describe practical run-chart use; Anhøj and Olesen evaluate rules through simulation. Their results caution against treating every rising or falling sequence as a useful signal.

Worked example

A worked example

Invented for illustration
Setting
A clinic’s invented baseline weekly waits are 8, 9, 10, 11 and 12 minutes.
Question
Do later waits stay on one side of the baseline median?
Approach
Fix the baseline median at 10 minutes. Later weekly waits are 8, 7, 9, 8, 7 and 9 minutes.
Result
All 6 later points are under 10 minutes. Their median is 8 minutes, a decrease of 2 minutes from the baseline median.
What it means
Under a prespecified six-point shift rule, this is a signal to investigate. The very short baseline is illustrative; it does not establish that the clinic change caused the improvement.

In practice

Recent studies PubMed search · not vetted

Searching PubMed…

Watch out

Common mistakes

The one to remember

A run-chart signal suggests a change in the process, not its cause. Keep the baseline median fixed while assessing a change; repeated recentering can hide a shift.

  • Moving the median after every favorable point.Instead: Keep it fixed for the assessment period. Rebaseline only after a documented sustained process change.
  • Trying many rules until one signals.Instead: Choose one published rule set first and state its handling of ties.
  • Calling the intervention effective because waits shifted.Instead: Investigate other changes, case mix and seasonality; a chart alone cannot identify cause.

Inside Mallard

How Mallard uses this

Mallard includes this article in Learn search and the Atlas. The plan mapper does not link to this article yet.

No Mallard code example points to this page.
Atlas node analysis.run_chart, the id a plan cue records.

Related Learn pages

Related designs and methods

Evidence

Sources & further reading

  1. The run chart: a simple analytical tool for learning from variation in healthcare processes (opens in a new tab) · BMJ Qual Saf · doi 10.1136/bmjqs.2009.037895
  2. Run charts revisited: a simulation study of run chart rules for detection of non-random variation in health care processes (opens in a new tab) · PLoS One · doi 10.1371/journal.pone.0113825
Prepared with AI assistance. Source records were checked against PubMed on 2026-11-06, matching title, authors, year and available DOI. Perla and colleagues (2011) support the median and six-point shift convention; Anhøj and Olesen (2014) provide primary simulation evidence on rule performance. Record verification is not independent methodological approval.
Last source review: 2026-11-06
AI-generated educational content
Mallard uses reputable methodological and reporting sources, but this material may contain errors or omit important context. Verify important methodological decisions with the cited sources and, when appropriate, a qualified research methodologist or statistician.