Ask Mallard
Core concept

Choosing decision trees or Markov models

4 min read

Use a decision tree for a bounded sequence and a Markov model when repeated events and time in health states drive the answer.

Fit

When it matters, and when it does not

It matters when

  • You can describe each relevant pathway as a finite sequence over a suitable horizon.
  • Events do not recur in ways that make the tree unwieldy.

It matters less when

Before you start

What to check in your study

Decide these first
  1. Decision and horizonChoose the strategies, perspective and duration needed to capture important consequences.
  2. Relevant historyList recurring events and whether risk depends on duration or earlier events.
  3. Transitions and valuesIdentify event probabilities, costs, utilities and uncertainty for the intended setting.
It rests on these
  1. The model retains the history needed for future risks.How to check: Use states that distinguish relevant histories; test alternative structures.
  2. Probabilities use compatible time intervals.How to check: Check that outgoing transition probabilities sum to one for each state.
  3. The same perspective and horizon apply to each strategy.How to check: Include relevant consequences and test parameter and structural uncertainty.

Plain language

How it works

An economic decision tree branches through choices and events to final costs and outcomes. It is different from a classification tree used for prediction. A cohort Markov model repeatedly moves a population between health states, adding costs and outcomes over cycles.

What decides the choice
Match the intended question to the approach. Finite pathways capture the horizon leads to Decision tree: branch to final consequences. Repeated events and state time matter leads to Markov: repeat state transitions over cycles.Choose by the question and available structureFinite pathways capture the horizonDecision tree: branch to finalconsequencesRepeated events and state time matterMarkov: repeat state transitions overcyclesThese are choice criteria, not a ranking of evidence or a guarantee of validity.
Conceptual diagram. It shows the structure of the idea, not data from any study.
Choosing the approach

Beck and Pauker develop a Markov prognosis model; Sonnenberg and Beck explain when repeated events make trees difficult. Markov does not mean that transition risks must be constant over calendar time. The memory limit concerns history absent from the states. Tunnel states can track duration; other state structures or individual simulation can retain more history. Both approaches need validation and sensitivity analyses.

Conceptual diagram
A decision tree branches from a choice through possible events to consequences. A Markov model represents repeated movement between states, including remaining in a state. Basic transitions depend on the present state, so relevant history must be represented explicitly.Decision tree: branching pathsChoice of optionPossible events under that optionConsequence AConsequence BWeight consequences by chance probabilities.Compare each option.Markov model: repeated cyclesPresent stateSame state nextcycleAnother statenext cycleRepeat transitions over the horizonFuture movement depends on the present state. Addstates if history matters.Both are structures for assumptions and evidence. A projection is not proof of a causal effect, andMallard does not build or run these models.
Conceptual diagram. It shows the structure of the idea, not data from any study.

Worked example

A worked example

Invented for illustration
Setting
A model starts with 100 people in a well state.
Question
Can a short tree capture repeated periods of illness?
Approach
Each cycle, well people have a 0.8 chance of staying well and a 0.2 chance of becoming ill. Ill people stay ill.
Result
After one cycle, 80 of 100 remain well, or 80 in 100. After two cycles, 64 remain well and 36 are ill.
What it means
The second-cycle well count is 100 times 0.8 times 0.8. Allowing recovery would require another transition and change these counts.

In practice

Recent studies PubMed search · not vetted

Searching PubMed…

Watch out

Common mistakes

The one to remember

A cohort Markov model assumes future transitions depend on the current modeled state and time, not unrecorded history. Add states or another model when duration or prior events matter. A simpler tree is valid only if its horizon captures relevant consequences.

  • Applying an annual probability each month.Instead: Convert risks using a justified rate or time model.
  • Letting past events matter without recording them.Instead: Expand the states or choose a model that retains history.
  • Calling the more detailed model more credible.Instead: Validate structure and inputs against the decision and evidence.

Inside Mallard

How Mallard uses this

Mallard includes this comparison in Learn search and the Atlas. Plans do not link to this comparison automatically.

No Mallard code example points to this page.
Atlas node concept.choosing_tree_markov, the id a plan cue records.

Related Learn pages

Related designs and methods

Evidence

Sources & further reading

  1. The Markov process in medical prognosis (opens in a new tab) · Med Decis Making · doi 10.1177/0272989X8300300403
  2. Markov models in medical decision making: a practical guide (opens in a new tab) · Med Decis Making · doi 10.1177/0272989X9301300409
Prepared with AI assistance. PubMed records checked on 2026-11-06 for title, authors, year and DOI. The cited methods support the comparisons; record verification is not independent methodological approval.
Last source review: 2026-11-06
AI-generated educational content
Mallard uses reputable methodological and reporting sources, but this material may contain errors or omit important context. Verify important methodological decisions with the cited sources and, when appropriate, a qualified research methodologist or statistician.