Journal article · 2026 · Open access

From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients

Ping Wu, Yu Han, Jing Zhang, Yunqi Li, Mengna Jiang, Xinyu Lu, Haibin Zhang, Danyang Xu, Ming Hao, Lihong Wang, Qingping Wen

npj Digital Medicine · Published 23 October 2026 · DOI 10.1038/s41746-026-03372-0

Open PDFView at the publisherCite this paper

In brief

“From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients” is a 2026 journal article by Ping Wu and 10 co-authors, published in npj Digital Medicine. OpenAlex counts 1 citations as of 17 November 2026, which puts it in the top 9% of works published in 2026 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at npj Digital Medicine.

Citations
1
Most cited in
2026 (1)
Field-weighted impact
1.20
References
41
Authors
11

Abstract

Standardized patients (SPs) are central to clinical communication training but remain constrained by cost, scalability, and reliance on trained actors. We present AI standardized patients (AI-SPs), large language model–driven patient simulators built on a three-layer information architecture that adaptively modulates information disclosure according to learner skill. In Phase 1, blinded expert assessment of 350 simulated consultations generated by five frontier LLMs showed that, under a common architecture, learner skill level accounted for more of the observed performance variation than model choice ( η 2 = 0.31 vs. 0.06); whether this reflects the architecture itself cannot be determined without comparing models with and without it. In Phase 1b, analysis of 155 live student consultations identified systematic failures to elicit safety-critical information, enabling automated curriculum diagnostics without expert observation. In a Phase 2 three-arm pilot randomized study ( n = 58), OSCE performance gains with AI-SP training did not differ significantly from those with human SP training; the trial was designed to estimate effect sizes for a future confirmatory study, not to demonstrate equivalence. Self-efficacy gains were numerically largest with AI-SP training, but this exploratory difference did not survive correction for multiple comparisons. These findings suggest that architecture-driven AI-SPs could provide a scalable, model-portable approach to clinical communication training.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wu, P., Han, Y., Zhang, J., Li, Y., Jiang, M., Lu, X., Zhang, H., Xu, D., Hao, M., Wang, L., & Wen, Q. (2026). From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03372-0

MLA 9

Wu, Ping, et al. “From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients.” npj Digital Medicine, 2026. https://doi.org/10.1038/s41746-026-03372-0.

Chicago

Wu, Ping, Yu Han, Jing Zhang, Yunqi Li, Mengna Jiang, Xinyu Lu, Haibin Zhang, et al. 2026. “From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients.” npj Digital Medicine. https://doi.org/10.1038/s41746-026-03372-0.

Harvard

Wu, P. et al. (2026) ‘From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients’, npj Digital Medicine. doi:10.1038/s41746-026-03372-0.

IEEE

P. Wu et al., “From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients,” npj Digital Medicine, 2026, doi: 10.1038/s41746-026-03372-0.

BibTeX

@article{wu2026from,
  title     = {{From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients}},
  author    = {Wu, Ping and Han, Yu and Zhang, Jing and Li, Yunqi and Jiang, Mengna and Lu, Xinyu and Zhang, Haibin and Xu, Danyang and Hao, Ming and Wang, Lihong and Wen, Qingping},
  journal   = {npj Digital Medicine},
  year      = {2026},
  doi       = {10.1038/s41746-026-03372-0},
  url       = {https://doi.org/10.1038/s41746-026-03372-0}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education

  • large language models
  • patient simulator
  • clinical communication training
  • OSCE
  • self-efficacy
  • information disclosure
  • multi-model comparison

Work with this paper

Most-cited papers in Medicine

All highly cited Medicine papers

Questions about this paper

How do I cite this paper in APA style?

Wu, P., Han, Y., Zhang, J., Li, Y., Jiang, M., Lu, X., Zhang, H., Xu, D., Hao, M., Wang, L., & Wen, Q. (2026). From simulation to pedagogy: multi-model and randomized evaluation of structured AI standardized patients. npj Digital Medicine. https://doi.org/10.1038/s41746-026-03372-0

How many times has this paper been cited?

1 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at npj Digital Medicine: sign in and open the PDF from this page.

Who wrote this paper?

Ping Wu, Yu Han, Jing Zhang, Yunqi Li, Mengna Jiang, Xinyu Lu, Haibin Zhang, Danyang Xu, Ming Hao, Lihong Wang, Qingping Wen.

What is the DOI of this paper?

10.1038/s41746-026-03372-0, permanently at https://doi.org/10.1038/s41746-026-03372-0. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.