Journal article · 2026 · Open access
Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports
npj Digital Medicine · Published 13 November 2026 · DOI 10.1038/s41746-026-03469-6
In brief
“Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports” is a 2026 journal article by Zongyu Li and 21 co-authors, published in npj Digital Medicine. OpenAlex counts 0 citations as of 18 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at npj Digital Medicine.
- Citations
- 0
- References
- 36
- Authors
- 22
Abstract
Large language models (LLMs) can interpret radiology reports, but their ability to generate guideline-concordant recommendations from bladder cancer multiparametric MRI (mpMRI) reports remains uncertain. Following TRIPOD-LLM, we retrospectively evaluated nine API-accessed LLMs using 590 mpMRI reports from three hospitals under two input conditions: original Chinese reports and clinician-translated, quality-controlled English reports. Two physicians independently rated each model-generated recommendation on a 1–5 ordinal scale. We analyzed 21,240 ratings using patient-level random-intercept cumulative link mixed models, with paired Wilcoxon tests as secondary exploratory analyses. The association between input condition and physician rating differed across LLMs (likelihood-ratio chi-square = 683.05, df = 8, P < 0.001). Compared with original Chinese input, clinician-translated English input was associated with higher ratings for chatgpt-o3-pro (OR 2.79, 95% CI 2.29–3.41), deepseek-v4-flash (OR 1.46, 95% CI 1.19–1.81), claude-opus-4-7 (OR 3.07, 95% CI 2.47–3.82), and gpt-5.5 (OR 1.88, 95% CI 1.53–2.32), but with lower ratings for claude-sonnet-4-5 (OR 0.29, 95% CI 0.23–0.36; all Holm-adjusted P < 0.001). Four LLMs showed no clear input-condition difference. Center-specific contrasts also depended on input condition and were materially unchanged after adjustment for age, sex, pathological T stage, tumor grade, tumor number, and maximum lesion diameter. Inter-rater agreement was substantial (quadratic weighted kappa range, 0.621–0.743). Readability did not track physician-rated recommendation quality. These findings argue against clinician-translated English as a universal optimization strategy and support model-specific validation of input conditions before clinical deployment. LLM-generated recommendations from mpMRI reports are best positioned as clinician-supervised, imaging-based decision support rather than standalone treatment advice.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Li, Z., Zhang, C., Chen, X., Kang, L., Si, Q., Liu, Y., Hou, Y., Liu, Z., Ding, Y., Li, Y., Shi, P., Yu, L., Shi, H., Kuang, Y., Li, Y., Hu, J., Hu, H., Liu, Z., Zeng, G., . . . Liu, L. (2026). Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6
MLA 9
Li, Zongyu, et al. “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports.” npj Digital Medicine, 2026. https://doi.org/10.1038/s41746-026-03469-6.
Chicago
Li, Zongyu, Chengzhang Zhang, Xiaoni Chen, Liangqi Kang, Qinliang Si, Yiting Liu, Yaxin Hou, et al. 2026. “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports.” npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6.
Harvard
Li, Z. et al. (2026) ‘Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports’, npj Digital Medicine. doi:10.1038/s41746-026-03469-6.
IEEE
Z. Li et al., “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports,” npj Digital Medicine, 2026, doi: 10.1038/s41746-026-03469-6.
BibTeX
@article{li2026multicenter,
title = {{Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports}},
author = {Li, Zongyu and Zhang, Chengzhang and Chen, Xiaoni and Kang, Liangqi and Si, Qinliang and Liu, Yiting and Hou, Yaxin and Liu, Zhenghao and Ding, Yuhong and Li, Yang and Shi, Pengjie and Yu, Lina and Shi, Hongjie and Kuang, Yingchun and Li, Yixian and Hu, Junyi and Hu, Hailong and Liu, Zheng and Zeng, Guang and Shen, Chong and Chen, Ke and Liu, Lilong},
journal = {npj Digital Medicine},
year = {2026},
doi = {10.1038/s41746-026-03469-6},
url = {https://doi.org/10.1038/s41746-026-03469-6}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- large language models
- bladder cancer
- multiparametric MRI
- radiology report interpretation
- LLM benchmarking
- Chinese-English translation
- physician ratings
- interobserver agreement
Work with this paper
Most-cited papers in Medicine
- Yaşlı Kadınlarda Üreme SağlığıDemet Kokanalı, Yaprak Engin Üstün · Jinekoloji-Obstetrik ve Neonatoloji Tıp Dergisi · 2019 · 169,630 citations
- Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 CountriesHyuna Sung, Adalberto M. Filho, Mathieu Laversanne and 5 more · CA A Cancer Journal for Clinicians · 2021 · 119,885 citations
- “Mini-mental state”Marshal F. Folstein, Susan E. Folstein, Paul R. McHugh · Journal of Psychiatric Research · 1975 · 90,424 citations
- Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countriesFreddie Bray, Jacques Ferlay, Isabelle Soerjomataram and 3 more · CA A Cancer Journal for Clinicians · 2018 · 87,396 citations
- Hallmarks of Cancer: The Next GenerationDouglas Hanahan, Robert A. Weinberg · Cell · 2011 · 69,758 citations
Questions about this paper
How do I cite this paper in APA style?
Li, Z., Zhang, C., Chen, X., Kang, L., Si, Q., Liu, Y., Hou, Y., Liu, Z., Ding, Y., Li, Y., Shi, P., Yu, L., Shi, H., Kuang, Y., Li, Y., Hu, J., Hu, H., Liu, Z., Zeng, G., . . . Liu, L. (2026). Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6
How many times has this paper been cited?
0 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at npj Digital Medicine: sign in and open the PDF from this page.
Who wrote this paper?
Zongyu Li, Chengzhang Zhang, Xiaoni Chen, Liangqi Kang, Qinliang Si, Yiting Liu, Yaxin Hou, Zhenghao Liu, Yuhong Ding, Yang Li, Pengjie Shi, Lina Yu and 10 more.
What is the DOI of this paper?
10.1038/s41746-026-03469-6, permanently at https://doi.org/10.1038/s41746-026-03469-6. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.