Journal article · 2023 · Open access

Estimating meaningful thresholds for multi-item questionnaires using item response theory

Berend Terluin, Jaimy Emerentiana Koopman, Lisa Hoogendam, Pip Griffiths, Caroline Barbara Terwee, Jakob Bue Bjørner

Quality of Life Research, 32(6), 1819–1830 · Published 13 February 2023 · DOI 10.1007/s11136-023-03355-8

Open PDFView at the publisherCite this paper

In brief

“Estimating meaningful thresholds for multi-item questionnaires using item response theory” is a 2023 journal article by Berend Terluin and 5 co-authors, published in Quality of Life Research. OpenAlex counts 20 citations as of 22 November 2026, which puts it in the top 8% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at Quality of Life Research.

Citations
20
Most cited in
2025 (8)
Field-weighted impact
2.44
References
38
Authors
6

Abstract

PURPOSE: Meaningful thresholds are needed to interpret patient-reported outcome measure (PROM) results. This paper introduces a new method, based on item response theory (IRT), to estimate such thresholds. The performance of the method is examined in simulated datasets and two real datasets, and compared with other methods. METHODS: The IRT method involves fitting an IRT model to the PROM items and an anchor item indicating the criterion state of interest. The difficulty parameter of the anchor item represents the meaningful threshold on the latent trait. The latent threshold is then linked to the corresponding expected PROM score. We simulated 4500 item response datasets to a 10-item PROM, and an anchor item. The datasets varied with respect to the mean and standard deviation of the latent trait, and the reliability of the anchor item. The real datasets consisted of a depression scale with a clinical depression diagnosis as anchor variable and a pain scale with a patient acceptable symptom state (PASS) question as anchor variable. RESULTS: The new IRT method recovered the true thresholds accurately across the simulated datasets. The other methods, except one, produced biased threshold estimates if the state prevalence was smaller or greater than 0.5. The adjusted predictive modeling method matched the new IRT method (also in the real datasets) but showed some residual bias if the prevalence was smaller than 0.3 or greater than 0.7. CONCLUSIONS: The new IRT method perfectly recovers meaningful (interpretational) thresholds for multi-item questionnaires, provided that the data satisfy the assumptions for IRT analysis.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Terluin, B., Koopman, J. E., Hoogendam, L., Griffiths, P., Terwee, C. B., & Bjørner, J. B. (2023). Estimating meaningful thresholds for multi-item questionnaires using item response theory. Quality of Life Research, 32(6), 1819–1830. https://doi.org/10.1007/s11136-023-03355-8

MLA 9

Terluin, Berend, et al. “Estimating meaningful thresholds for multi-item questionnaires using item response theory.” Quality of Life Research, vol. 32, no. 6, 2023, pp. 1819–1830. https://doi.org/10.1007/s11136-023-03355-8.

Chicago

Terluin, Berend, Jaimy Emerentiana Koopman, Lisa Hoogendam, Pip Griffiths, Caroline Barbara Terwee, and Jakob Bue Bjørner. 2023. “Estimating meaningful thresholds for multi-item questionnaires using item response theory.” Quality of Life Research 32 (6): 1819–1830. https://doi.org/10.1007/s11136-023-03355-8.

Harvard

Terluin, B. et al. (2023) ‘Estimating meaningful thresholds for multi-item questionnaires using item response theory’, Quality of Life Research, 32(6), pp. 1819–1830. doi:10.1007/s11136-023-03355-8.

IEEE

B. Terluin, J. E. Koopman, L. Hoogendam, P. Griffiths, C. B. Terwee, and J. B. Bjørner, “Estimating meaningful thresholds for multi-item questionnaires using item response theory,” Quality of Life Research, vol. 32, no. 6, pp. 1819–1830, 2023, doi: 10.1007/s11136-023-03355-8.

BibTeX

@article{terluin2023estimating,
  title     = {{Estimating meaningful thresholds for multi-item questionnaires using item response theory}},
  author    = {Terluin, Berend and Koopman, Jaimy Emerentiana and Hoogendam, Lisa and Griffiths, Pip and Terwee, Caroline Barbara and Bjørner, Jakob Bue},
  journal   = {Quality of Life Research},
  year      = {2023},
  volume    = {32},
  number    = {6},
  pages     = {1819--1830},
  doi       = {10.1007/s11136-023-03355-8},
  url       = {https://doi.org/10.1007/s11136-023-03355-8}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202344
202422
202588
202666

Its field-weighted citation impact is 2.44: it has been cited 2.44 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing

  • patient-reported outcome measures
  • item response theory
  • threshold estimation
  • depression rating scales
  • pain scales
  • patient acceptable symptom state
  • latent traits

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Terluin, B., Koopman, J. E., Hoogendam, L., Griffiths, P., Terwee, C. B., & Bjørner, J. B. (2023). Estimating meaningful thresholds for multi-item questionnaires using item response theory. Quality of Life Research, 32(6), 1819–1830. https://doi.org/10.1007/s11136-023-03355-8

How many times has this paper been cited?

20 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Quality of Life Research: sign in and open the PDF from this page.

Who wrote this paper?

Berend Terluin, Jaimy Emerentiana Koopman, Lisa Hoogendam, Pip Griffiths, Caroline Barbara Terwee, Jakob Bue Bjørner.

What is the DOI of this paper?

10.1007/s11136-023-03355-8, permanently at https://doi.org/10.1007/s11136-023-03355-8. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.