Conference paper · 2024 · Open access

EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation

Yinghao Zhu, Changyu Ren, Zixiang Wang, Xiaochen Zheng, Shiyun Xie, Junlan Feng, Xi Zhu, Zhoujun Li, Liantao Ma, Chengwei Pan

ACM International Conference on Information and Knowledge Management (CIKM), 3549–3559 · Published 20 October 2024 · DOI 10.1145/3627673.3679582

Open PDFView at the publisherCite this paper

In brief

“EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation” is a 2024 conference paper by Yinghao Zhu and 9 co-authors, published in ACM International Conference on Information and Knowledge Management (CIKM). OpenAlex counts 84 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
84
Most cited in
2026 (43)
Field-weighted impact
7.19
References
49
Authors
10

Abstract

The integration of multimodal Electronic Health Records (EHR) data has significantly advanced clinical predictive capabilities. Existing models, which utilize clinical notes and multivariate time-series EHR data, often fall short of incorporating the necessary medical context for accurate clinical tasks, while previous approaches with knowledge graphs (KGs) primarily focus on structured knowledge extraction. In response, we propose EMERGE, a Retrieval-Augmented Generation (RAG) driven framework to enhance multimodal EHR predictive modeling. We extract entities from both time-series data and clinical notes by prompting Large Language Models (LLMs) and align them with professional PrimeKG, ensuring consistency. In addition to triplet relationships, we incorporate entities' definitions and descriptions for richer semantics. The extracted knowledge is then used to generate task-relevant summaries of patients' health statuses. Finally, we fuse the summary with other modalities using an adaptive multimodal fusion network with cross-attention. Extensive experiments on the MIMIC-III and MIMIC-IV datasets' in-hospital mortality and 30-day readmission tasks demonstrate the superior performance of the EMERGE framework over baseline models. Comprehensive ablation studies and analysis highlight the efficacy of each designed module and robustness to data sparsity. EMERGE contributes to refining the utilization of multimodal EHR data in healthcare, bridging the gap with nuanced medical contexts essential for informed clinical predictions. We have publicly released the code at https://github.com/yhzhu99/EMERGE.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhu, Y., Ren, C., Wang, Z., Zheng, X., Xie, S., Feng, J., Zhu, X., Li, Z., Ma, L., & Pan, C. (2024). EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation. ACM International Conference on Information and Knowledge Management (CIKM), 3549–3559. https://doi.org/10.1145/3627673.3679582

MLA 9

Zhu, Yinghao, et al. “EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation.” ACM International Conference on Information and Knowledge Management (CIKM), 2024, pp. 3549–3559. https://doi.org/10.1145/3627673.3679582.

Chicago

Zhu, Yinghao, Changyu Ren, Zixiang Wang, Xiaochen Zheng, Shiyun Xie, Junlan Feng, Xi Zhu, Zhoujun Li, Liantao Ma, and Chengwei Pan. 2024. “EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation.” ACM International Conference on Information and Knowledge Management (CIKM): 3549–3559. https://doi.org/10.1145/3627673.3679582.

Harvard

Zhu, Y. et al. (2024) ‘EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation’, ACM International Conference on Information and Knowledge Management (CIKM), pp. 3549–3559. doi:10.1145/3627673.3679582.

IEEE

Y. Zhu et al., “EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation,” ACM International Conference on Information and Knowledge Management (CIKM), pp. 3549–3559, 2024, doi: 10.1145/3627673.3679582.

BibTeX

@inproceedings{zhu2024emerge,
  title     = {{EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation}},
  author    = {Zhu, Yinghao and Ren, Changyu and Wang, Zixiang and Zheng, Xiaochen and Xie, Shiyun and Feng, Junlan and Zhu, Xi and Li, Zhoujun and Ma, Liantao and Pan, Chengwei},
  booktitle = {ACM International Conference on Information and Knowledge Management (CIKM)},
  year      = {2024},
  pages     = {3549--3559},
  doi       = {10.1145/3627673.3679582},
  url       = {https://doi.org/10.1145/3627673.3679582}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202311
202444
20253636
20264343

Its field-weighted citation impact is 7.19: it has been cited 7.19 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare

  • retrieval-augmented generation
  • knowledge graphs
  • named entity recognition
  • large language models
  • multimodal fusion
  • cross-attention
  • in-hospital mortality prediction
  • 30-day readmission prediction

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Zhu, Y., Ren, C., Wang, Z., Zheng, X., Xie, S., Feng, J., Zhu, X., Li, Z., Ma, L., & Pan, C. (2024). EMERGE: Enhancing Multimodal Electronic Health Records Predictive Modeling with Retrieval-Augmented Generation. ACM International Conference on Information and Knowledge Management (CIKM), 3549–3559. https://doi.org/10.1145/3627673.3679582

How many times has this paper been cited?

84 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Yinghao Zhu, Changyu Ren, Zixiang Wang, Xiaochen Zheng, Shiyun Xie, Junlan Feng, Xi Zhu, Zhoujun Li, Liantao Ma, Chengwei Pan.

What is the DOI of this paper?

10.1145/3627673.3679582, permanently at https://doi.org/10.1145/3627673.3679582. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.