Journal article · 2023 · Open access
Estimating meaningful thresholds for multi-item questionnaires using item response theory
Quality of Life Research, 32(6), 1819–1830 · Published 13 February 2023 · DOI 10.1007/s11136-023-03355-8
In brief
“Estimating meaningful thresholds for multi-item questionnaires using item response theory” is a 2023 journal article by Berend Terluin and 5 co-authors, published in Quality of Life Research. OpenAlex counts 20 citations as of 22 November 2026, which puts it in the top 8% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read at Quality of Life Research.
- Citations
- 20
- Most cited in
- 2025 (8)
- Field-weighted impact
- 2.44
- References
- 38
- Authors
- 6
Abstract
PURPOSE: Meaningful thresholds are needed to interpret patient-reported outcome measure (PROM) results. This paper introduces a new method, based on item response theory (IRT), to estimate such thresholds. The performance of the method is examined in simulated datasets and two real datasets, and compared with other methods. METHODS: The IRT method involves fitting an IRT model to the PROM items and an anchor item indicating the criterion state of interest. The difficulty parameter of the anchor item represents the meaningful threshold on the latent trait. The latent threshold is then linked to the corresponding expected PROM score. We simulated 4500 item response datasets to a 10-item PROM, and an anchor item. The datasets varied with respect to the mean and standard deviation of the latent trait, and the reliability of the anchor item. The real datasets consisted of a depression scale with a clinical depression diagnosis as anchor variable and a pain scale with a patient acceptable symptom state (PASS) question as anchor variable. RESULTS: The new IRT method recovered the true thresholds accurately across the simulated datasets. The other methods, except one, produced biased threshold estimates if the state prevalence was smaller or greater than 0.5. The adjusted predictive modeling method matched the new IRT method (also in the real datasets) but showed some residual bias if the prevalence was smaller than 0.3 or greater than 0.7. CONCLUSIONS: The new IRT method perfectly recovers meaningful (interpretational) thresholds for multi-item questionnaires, provided that the data satisfy the assumptions for IRT analysis.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Terluin, B., Koopman, J. E., Hoogendam, L., Griffiths, P., Terwee, C. B., & Bjørner, J. B. (2023). Estimating meaningful thresholds for multi-item questionnaires using item response theory. Quality of Life Research, 32(6), 1819–1830. https://doi.org/10.1007/s11136-023-03355-8
MLA 9
Terluin, Berend, et al. “Estimating meaningful thresholds for multi-item questionnaires using item response theory.” Quality of Life Research, vol. 32, no. 6, 2023, pp. 1819–1830. https://doi.org/10.1007/s11136-023-03355-8.
Chicago
Terluin, Berend, Jaimy Emerentiana Koopman, Lisa Hoogendam, Pip Griffiths, Caroline Barbara Terwee, and Jakob Bue Bjørner. 2023. “Estimating meaningful thresholds for multi-item questionnaires using item response theory.” Quality of Life Research 32 (6): 1819–1830. https://doi.org/10.1007/s11136-023-03355-8.
Harvard
Terluin, B. et al. (2023) ‘Estimating meaningful thresholds for multi-item questionnaires using item response theory’, Quality of Life Research, 32(6), pp. 1819–1830. doi:10.1007/s11136-023-03355-8.
IEEE
B. Terluin, J. E. Koopman, L. Hoogendam, P. Griffiths, C. B. Terwee, and J. B. Bjørner, “Estimating meaningful thresholds for multi-item questionnaires using item response theory,” Quality of Life Research, vol. 32, no. 6, pp. 1819–1830, 2023, doi: 10.1007/s11136-023-03355-8.
BibTeX
@article{terluin2023estimating,
title = {{Estimating meaningful thresholds for multi-item questionnaires using item response theory}},
author = {Terluin, Berend and Koopman, Jaimy Emerentiana and Hoogendam, Lisa and Griffiths, Pip and Terwee, Caroline Barbara and Bjørner, Jakob Bue},
journal = {Quality of Life Research},
year = {2023},
volume = {32},
number = {6},
pages = {1819--1830},
doi = {10.1007/s11136-023-03355-8},
url = {https://doi.org/10.1007/s11136-023-03355-8}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 4 | |
| 2024 | 2 | |
| 2025 | 8 | |
| 2026 | 6 |
Its field-weighted citation impact is 2.44: it has been cited 2.44 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- patient-reported outcome measures
- item response theory
- threshold estimation
- depression rating scales
- pain scales
- patient acceptable symptom state
- latent traits
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Terluin, B., Koopman, J. E., Hoogendam, L., Griffiths, P., Terwee, C. B., & Bjørner, J. B. (2023). Estimating meaningful thresholds for multi-item questionnaires using item response theory. Quality of Life Research, 32(6), 1819–1830. https://doi.org/10.1007/s11136-023-03355-8
How many times has this paper been cited?
20 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Quality of Life Research: sign in and open the PDF from this page.
Who wrote this paper?
Berend Terluin, Jaimy Emerentiana Koopman, Lisa Hoogendam, Pip Griffiths, Caroline Barbara Terwee, Jakob Bue Bjørner.
What is the DOI of this paper?
10.1007/s11136-023-03355-8, permanently at https://doi.org/10.1007/s11136-023-03355-8. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.