Ask Mallard
Analysis method

Item response theory

4 min read

Item response theory links the chance of each item response to an unobserved trait, allowing measurement precision to vary across that trait.

Fit

When to use it, and when not to

Use it when

  • You develop or evaluate an item bank or a scale with item-level responses.
  • You want to know which items measure well at different trait levels.

Not when

Before you start

What you need

Decide these first
  1. The trait and intended useDefine what a higher score means and whose responses the scale should represent.
  2. Item responses and a suitable response modelBinary and ordered response formats need suitable models and enough responses in each category.
  3. How to set the trait scaleFix scale location and spread or use anchor items. Document linking across groups or forms.
It rests on these
  1. The chosen trait structure fits.How to check: Check whether one trait suffices or a multidimensional model is needed.
  2. Items are independent conditional on the modeled traits.How to check: Inspect residual item links, such as pairs sharing nearly identical wording.
  3. Item behavior supports the intended comparisons.How to check: Check differential item functioning: people at the same trait level may respond differently across groups.

Plain language

How it works

An item response curve gives the chance of a response at each trait level. Difficulty locates the curve; discrimination describes its steepness in models that estimate it.

Reading the method

Item information describes where an item contributes precision. It supports short forms or adaptive testing only after calibration and fit checks. Ordered responses use models with category thresholds.

Scope and evidence

Cella and colleagues describe the PROMIS item-bank program and its first large-scale testing. Those studies illustrate item-level modeling; they do not guarantee that a new bank works in every language or group.

The method in outline
Item models connect trait level with response chances. Information and comparability depend on the fitted model and its assumptions.Item models connect trait level with response chancesLatent trait levelItem parametersResponse probability curvePrecision across the trait rangeCheck fit and group comparabilityInformation and comparability depend on the fitted model and its assumptions.
Conceptual diagram. It shows the structure of the idea, not data from any study.

Worked example

A worked example

Invented for illustration
Setting
A team models a binary response to a symptom item.
Question
What is its response probability when trait level equals item difficulty?
Approach
Use a logistic item model with discrimination 1, difficulty 0 and trait level 0, with no guessing term.
Result
The response probability is 50 in 100: an expected 50 of 100 people at that trait level endorse the item.
What it means
This is a model probability, not an observed count or the prevalence of a disorder.

In practice

Recent studies PubMed search · not vetted

Searching PubMed…

Watch out

Common mistakes

The one to remember

A fitted item response model needs checks of dimensionality, local dependence, fit and group differences. Similar raw totals need not mean equally precise or comparable scores.

  • Assuming precision is constant across all scores.Instead: Examine item and test information across the trait range.
  • Comparing groups without checking item behavior.Instead: Assess group differences at the same trait level before interpreting score differences.

Inside Mallard

How Mallard uses this

Plans do not link to this method yet. Mallard does not run this analysis.

No Mallard code example points to this page.
Atlas node analysis.item_response_theory, the id a plan cue records.

Related Learn pages

Related designs and methods

Evidence

Sources & further reading

  1. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years (opens in a new tab) · Med Care · doi 10.1097/01.mlr.0000258615.42478.55
  2. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008 (opens in a new tab) · J Clin Epidemiol · doi 10.1016/j.jclinepi.2010.04.011
  3. Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS) (opens in a new tab) · Med Care · doi 10.1097/01.mlr.0000250483.85507.04
  4. Development and psychometric evaluation of item banks for memory and attention - supplements to the EORTC CAT Core instrument (opens in a new tab) · Health Qual Life Outcomes · doi 10.1186/s12955-023-02199-7
Prepared with AI assistance. PubMed records were checked by PMID, title, authors, year and DOI on 2026-11-06. The Cella papers describe PROMIS development and original item-bank testing. Reeve and colleagues support dimensionality, local independence and group-difference checks. Rogge and colleagues provide a second primary calibration application. No independent professional approval is claimed.
Last source review: 2026-11-06
AI-generated educational content
Mallard uses reputable methodological and reporting sources, but this material may contain errors or omit important context. Verify important methodological decisions with the cited sources and, when appropriate, a qualified research methodologist or statistician.