Journal article · 2026 · Open access

Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias

Liselotte F.S. Langenhuijsen, Rolf H. H. Groenwold, Suzanne C. Cannegieter, Frederikus Albertus Klok, Merel van Diepen, Ype de Jong

Journal of Clinical Epidemiology, 194, 112232 · Published 18 March 2026 · DOI 10.1016/j.jclinepi.2026.112232

Free PDFView at the publisherCite this paper

In brief

“Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias” is a 2026 journal article by Liselotte F.S. Langenhuijsen and 5 co-authors, published in Journal of Clinical Epidemiology. OpenAlex counts 0 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Journal of Clinical Epidemiology.

Citations
0
References
72
Authors
6

Abstract

BACKGROUND AND OBJECTIVES: Prediction models used in clinical practice often suffer from high risk of bias (ROB), which affects their reliability. The Prediction model Risk Of Bias ASsessment Tool (PROBAST) assesses ROB but is criticized for being complex, time consuming and for showing a low interrater agreement and ceiling-effect. A short-form version, the SF-PROBAST, was developed to facilitate a two-step approach for large-scale ROB assessments while maintaining high sensitivity and specificity. This study evaluated the operational equivalence of the SF-PROBAST. METHODS: We applied the SF-PROBAST to an existing dataset of 2458 studies from 54 systematic reviews published before December 2021. We compared SF-PROBAST with PROBAST in terms of concordance and calculated sensitivity, specificity, positive and negative predictive value, and interrater agreement of the SF-PROBAST. RESULTS: The 2458 articles included 886 validation studies and 1592 development studies, of which 1542 (97%) reported PROBAST scores for the relevant SF-PROBAST questions. The SF-PROBAST showed a sensitivity of 82.6% (95% confidence interval [CI]: 80.7%-84.4%) and specificity of 80.1% (95% CI: 78.7%-81.5%), with positive and negative predictive values of 100% (95% CI: 99.6%-100%) and 65.5% (95% CI: 61.8%-69.1%), respectively, for assessing studies as high ROB, 68.5% (95% CI: 64.5%-72.5%) and 95.5% (95% CI: 94.2%-96.7%) for unclear ROB; 13.4% (95% CI: 7.3%-19.6%) and 100% (95% CI: 96.9%-100%) for low ROB. The overall concordance between the PROBAST and SF-PROBAST was 82.6%, showing good agreement (Kappa 0.74, 95% CI: 0.71-0.76), with the SF-PROBAST showing only underestimation of the actual ROB. The between-review interrater agreement of the SF-PROBAST was fair (Kappa 0.33, 95% CI: 0.25-0.40). CONCLUSION: SF-PROBAST showed good agreement with PROBAST scores and offers a time-efficient, simplified and reliable two-step alternative for assessing the methodological quality of prediction models. To assess potential misclassification, we recommend applying the full PROBAST to studies scored as low or unclear ROB on the SF-PROBAST.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Langenhuijsen, L. F., Groenwold, R. H. H., Cannegieter, S. C., Klok, F. A., van Diepen, M., & de Jong, Y. (2026). Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias. Journal of Clinical Epidemiology, 194, 112232. https://doi.org/10.1016/j.jclinepi.2026.112232

MLA 9

Langenhuijsen, Liselotte F.S., et al. “Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias.” Journal of Clinical Epidemiology, vol. 194, 2026, p. 112232. https://doi.org/10.1016/j.jclinepi.2026.112232.

Chicago

Langenhuijsen, Liselotte F.S., Rolf H. H. Groenwold, Suzanne C. Cannegieter, Frederikus Albertus Klok, Merel van Diepen, and Ype de Jong. 2026. “Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias.” Journal of Clinical Epidemiology 194: 112232. https://doi.org/10.1016/j.jclinepi.2026.112232.

Harvard

Langenhuijsen, L. F. et al. (2026) ‘Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias’, Journal of Clinical Epidemiology, 194, p. 112232. doi:10.1016/j.jclinepi.2026.112232.

IEEE

L. F. Langenhuijsen, R. H. H. Groenwold, S. C. Cannegieter, F. A. Klok, M. van Diepen, and Y. de Jong, “Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias,” Journal of Clinical Epidemiology, vol. 194, p. 112232, 2026, doi: 10.1016/j.jclinepi.2026.112232.

BibTeX

@article{langenhuijsen2026concordance,
  title     = {{Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias}},
  author    = {Langenhuijsen, Liselotte F.S. and Groenwold, Rolf H. H. and Cannegieter, Suzanne C. and Klok, Frederikus Albertus and van Diepen, Merel and de Jong, Ype},
  journal   = {Journal of Clinical Epidemiology},
  year      = {2026},
  volume    = {194},
  pages     = {112232},
  doi       = {10.1016/j.jclinepi.2026.112232},
  url       = {https://doi.org/10.1016/j.jclinepi.2026.112232}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • PROBAST
  • risk of bias assessment
  • prediction model validation
  • concordance
  • interobserver agreement
  • sensitivity and specificity
  • screening tool
  • systematic reviews

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Langenhuijsen, L. F., Groenwold, R. H. H., Cannegieter, S. C., Klok, F. A., van Diepen, M., & de Jong, Y. (2026). Concordance analysis of the short-form of the PROBAST as a screening tool: two-step risk of bias assessment showing only underestimation of risk of bias. Journal of Clinical Epidemiology, 194, 112232. https://doi.org/10.1016/j.jclinepi.2026.112232

How many times has this paper been cited?

0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal of Clinical Epidemiology.

Who wrote this paper?

Liselotte F.S. Langenhuijsen, Rolf H. H. Groenwold, Suzanne C. Cannegieter, Frederikus Albertus Klok, Merel van Diepen, Ype de Jong.

What is the DOI of this paper?

10.1016/j.jclinepi.2026.112232. The permanent link is https://doi.org/10.1016/j.jclinepi.2026.112232.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.