Journal article · 2026 · Open access

Verifiable summarization of electronic health records using large language models to support chart review

Ritchie Verma, Emily Alsentzer, Zachary H. Strasser, Leslie Chang, Kirollos Roman, Esteban Gershanik, Camellia Hernandez, Miguel A. Linares, Jorge Alberto Rodriguez, Durga Thakral, Ozan Ünlü, Jacqueline Guan-Ting You and 2 more

Journal of the American Medical Informatics Association · Published 20 October 2026 · DOI 10.1093/jamia/ocag181

Open PDFView at the publisherCite this paper

In brief

“Verifiable summarization of electronic health records using large language models to support chart review” is a 2026 journal article by Ritchie Verma and 13 co-authors, published in Journal of the American Medical Informatics Association. OpenAlex counts 16 citations as of 18 November 2026, which puts it in the top 8% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at medRxiv.

Citations
16
Most cited in
2026 (14)
Field-weighted impact
14.26
References
45
Authors
14

Abstract

OBJECTIVES: Information overload in electronic health records hampers clinicians' ability to efficiently extract and synthesize critical information from a patient's longitudinal health record, leading to increased cognitive burden and delays in care. This study explores the potential of large language models (LLMs) to address this challenge by generating problem-based admission summaries for patients admitted with heart failure, a leading cause of hospitalization worldwide. MATERIALS AND METHODS: We developed an extract-then-abstract approach guided by disease-specific "summary bundles" to generate summaries of longitudinal clinical notes that prioritize clinically relevant information. Through a mixed-methods evaluation using real-world clinical notes, we compared physicians' ability to answer patient-specific clinical questions with the LLM-generated summaries vs standard chart review. RESULTS: While summary access did not significantly reduce overall questionnaire completion time, frequent summary use significantly contributed to faster questionnaire completion (P = .002). Individual physicians varied in how effectively they leveraged the summaries. Importantly, summary use maintained accuracy in answering clinical questions (88.0% with summaries vs 86.4% without). All physicians indicated they were "likely" or "very likely" to use the summaries in clinical practice, and 87.5% reported that the summaries would save them time. Preferences for summary format varied, highlighting the need for customizable summaries aligned with individual clinician workflows. DISCUSSION: This exploratory, mixed-methods pilot study provides one of the first extrinsic evaluations of LLMs for longitudinal summarization, demonstrating their potential to enhance clinician efficiency, alleviate workload, and support informed decision-making in time-sensitive care environments. CONCLUSION: Our findings suggest that problem-based longitudinal summarization could improve chart review efficiency and standardize the presentation of clinical information, Variability in summary preferences and use underscores the need for user-centered evaluations to guide the development of LLM-generated summaries that align with clinician workflows.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Verma, R., Alsentzer, E., Strasser, Z. H., Chang, L., Roman, K., Gershanik, E., Hernandez, C., Linares, M. A., Rodriguez, J. A., Thakral, D., Ünlü, O., You, J. G.-T., Zhou, L., & Bates, D. W. (2026). Verifiable summarization of electronic health records using large language models to support chart review. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag181

MLA 9

Verma, Ritchie, et al. “Verifiable summarization of electronic health records using large language models to support chart review.” Journal of the American Medical Informatics Association, 2026. https://doi.org/10.1093/jamia/ocag181.

Chicago

Verma, Ritchie, Emily Alsentzer, Zachary H. Strasser, Leslie Chang, Kirollos Roman, Esteban Gershanik, Camellia Hernandez, et al. 2026. “Verifiable summarization of electronic health records using large language models to support chart review.” Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag181.

Harvard

Verma, R. et al. (2026) ‘Verifiable summarization of electronic health records using large language models to support chart review’, Journal of the American Medical Informatics Association. doi:10.1093/jamia/ocag181.

IEEE

R. Verma et al., “Verifiable summarization of electronic health records using large language models to support chart review,” Journal of the American Medical Informatics Association, 2026, doi: 10.1093/jamia/ocag181.

BibTeX

@article{verma2026verifiable,
  title     = {{Verifiable summarization of electronic health records using large language models to support chart review}},
  author    = {Verma, Ritchie and Alsentzer, Emily and Strasser, Zachary H. and Chang, Leslie and Roman, Kirollos and Gershanik, Esteban and Hernandez, Camellia and Linares, Miguel A. and Rodriguez, Jorge Alberto and Thakral, Durga and Ünlü, Ozan and You, Jacqueline Guan-Ting and Zhou, Li and Bates, David Westfall},
  journal   = {Journal of the American Medical Informatics Association},
  year      = {2026},
  doi       = {10.1093/jamia/ocag181},
  url       = {https://doi.org/10.1093/jamia/ocag181}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education

  • electronic health records
  • clinical summarization
  • large language models
  • medical records review
  • heart failure
  • medical question answering
  • clinician workload
  • user-centered design

Work with this paper

Most-cited papers in Medicine

All highly cited Medicine papers

Questions about this paper

How do I cite this paper in APA style?

Verma, R., Alsentzer, E., Strasser, Z. H., Chang, L., Roman, K., Gershanik, E., Hernandez, C., Linares, M. A., Rodriguez, J. A., Thakral, D., Ünlü, O., You, J. G.-T., Zhou, L., & Bates, D. W. (2026). Verifiable summarization of electronic health records using large language models to support chart review. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocag181

How many times has this paper been cited?

16 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at medRxiv: sign in and open the PDF from this page.

Who wrote this paper?

Ritchie Verma, Emily Alsentzer, Zachary H. Strasser, Leslie Chang, Kirollos Roman, Esteban Gershanik, Camellia Hernandez, Miguel A. Linares, Jorge Alberto Rodriguez, Durga Thakral, Ozan Ünlü, Jacqueline Guan-Ting You and 2 more.

What is the DOI of this paper?

10.1093/jamia/ocag181, permanently at https://doi.org/10.1093/jamia/ocag181. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.