Journal article · 2026 · Open access

Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports

Zongyu Li, Chengzhang Zhang, Xiaoni Chen, Liangqi Kang, Qinliang Si, Yiting Liu, Yaxin Hou, Zhenghao Liu, Yuhong Ding, Yang Li, Pengjie Shi, Lina Yu and 10 more

npj Digital Medicine · Published 13 November 2026 · DOI 10.1038/s41746-026-03469-6

Open PDFView at the publisherCite this paper

In brief

“Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports” is a 2026 journal article by Zongyu Li and 21 co-authors, published in npj Digital Medicine. OpenAlex counts 0 citations as of 18 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at npj Digital Medicine.

Citations
0
References
36
Authors
22

Abstract

Large language models (LLMs) can interpret radiology reports, but their ability to generate guideline-concordant recommendations from bladder cancer multiparametric MRI (mpMRI) reports remains uncertain. Following TRIPOD-LLM, we retrospectively evaluated nine API-accessed LLMs using 590 mpMRI reports from three hospitals under two input conditions: original Chinese reports and clinician-translated, quality-controlled English reports. Two physicians independently rated each model-generated recommendation on a 1–5 ordinal scale. We analyzed 21,240 ratings using patient-level random-intercept cumulative link mixed models, with paired Wilcoxon tests as secondary exploratory analyses. The association between input condition and physician rating differed across LLMs (likelihood-ratio chi-square = 683.05, df = 8, P < 0.001). Compared with original Chinese input, clinician-translated English input was associated with higher ratings for chatgpt-o3-pro (OR 2.79, 95% CI 2.29–3.41), deepseek-v4-flash (OR 1.46, 95% CI 1.19–1.81), claude-opus-4-7 (OR 3.07, 95% CI 2.47–3.82), and gpt-5.5 (OR 1.88, 95% CI 1.53–2.32), but with lower ratings for claude-sonnet-4-5 (OR 0.29, 95% CI 0.23–0.36; all Holm-adjusted P < 0.001). Four LLMs showed no clear input-condition difference. Center-specific contrasts also depended on input condition and were materially unchanged after adjustment for age, sex, pathological T stage, tumor grade, tumor number, and maximum lesion diameter. Inter-rater agreement was substantial (quadratic weighted kappa range, 0.621–0.743). Readability did not track physician-rated recommendation quality. These findings argue against clinician-translated English as a universal optimization strategy and support model-specific validation of input conditions before clinical deployment. LLM-generated recommendations from mpMRI reports are best positioned as clinician-supervised, imaging-based decision support rather than standalone treatment advice.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Li, Z., Zhang, C., Chen, X., Kang, L., Si, Q., Liu, Y., Hou, Y., Liu, Z., Ding, Y., Li, Y., Shi, P., Yu, L., Shi, H., Kuang, Y., Li, Y., Hu, J., Hu, H., Liu, Z., Zeng, G., . . . Liu, L. (2026). Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6

MLA 9

Li, Zongyu, et al. “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports.” npj Digital Medicine, 2026. https://doi.org/10.1038/s41746-026-03469-6.

Chicago

Li, Zongyu, Chengzhang Zhang, Xiaoni Chen, Liangqi Kang, Qinliang Si, Yiting Liu, Yaxin Hou, et al. 2026. “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports.” npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6.

Harvard

Li, Z. et al. (2026) ‘Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports’, npj Digital Medicine. doi:10.1038/s41746-026-03469-6.

IEEE

Z. Li et al., “Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports,” npj Digital Medicine, 2026, doi: 10.1038/s41746-026-03469-6.

BibTeX

@article{li2026multicenter,
  title     = {{Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports}},
  author    = {Li, Zongyu and Zhang, Chengzhang and Chen, Xiaoni and Kang, Liangqi and Si, Qinliang and Liu, Yiting and Hou, Yaxin and Liu, Zhenghao and Ding, Yuhong and Li, Yang and Shi, Pengjie and Yu, Lina and Shi, Hongjie and Kuang, Yingchun and Li, Yixian and Hu, Junyi and Hu, Hailong and Liu, Zheng and Zeng, Guang and Shen, Chong and Chen, Ke and Liu, Lilong},
  journal   = {npj Digital Medicine},
  year      = {2026},
  doi       = {10.1038/s41746-026-03469-6},
  url       = {https://doi.org/10.1038/s41746-026-03469-6}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education

  • large language models
  • bladder cancer
  • multiparametric MRI
  • radiology report interpretation
  • LLM benchmarking
  • Chinese-English translation
  • physician ratings
  • interobserver agreement

Work with this paper

Most-cited papers in Medicine

All highly cited Medicine papers

Questions about this paper

How do I cite this paper in APA style?

Li, Z., Zhang, C., Chen, X., Kang, L., Si, Q., Liu, Y., Hou, Y., Liu, Z., Ding, Y., Li, Y., Shi, P., Yu, L., Shi, H., Kuang, Y., Li, Y., Hu, J., Hu, H., Liu, Z., Zeng, G., . . . Liu, L. (2026). Multicenter benchmarking of large language models for bladder cancer management recommendations from mpMRI reports. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03469-6

How many times has this paper been cited?

0 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at npj Digital Medicine: sign in and open the PDF from this page.

Who wrote this paper?

Zongyu Li, Chengzhang Zhang, Xiaoni Chen, Liangqi Kang, Qinliang Si, Yiting Liu, Yaxin Hou, Zhenghao Liu, Yuhong Ding, Yang Li, Pengjie Shi, Lina Yu and 10 more.

What is the DOI of this paper?

10.1038/s41746-026-03469-6, permanently at https://doi.org/10.1038/s41746-026-03469-6. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.