Book chapter · 2025 · Open access
Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM
Studies in health technology and informatics, 329, 753–757 · Published 7 August 2025 · DOI 10.3233/shti250941
In brief
“Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM” is a 2025 book chapter by Hejie Cui and 5 co-authors, published in Studies in health technology and informatics. OpenAlex counts 35 citations as of 19 November 2026. It is open access under a CC BY-NC licence: the full text is free to read at Studies in health technology and informatics.
- Citations
- 35
- Most cited in
- 2025 (15)
- Field-weighted impact
- 26.07
- References
- 12
- Authors
- 6
Abstract
In recent decades, Electronic Health Records (EHRs) have become increasingly useful to support clinical decision-making and healthcare. EHRs usually contain heterogeneous information, such as structural data in tabular form and un-structured data in textual notes. Different types of information in EHRs can complement each other and provide a comprehensive picture of a patient's health status. While there has been a lot of research on the representation learning of structured EHR data, the fusion of different types of EHR data (multimodal fusion) is not well studied. This is mostly because of the complex medical coding systems and the noise and redundancy in the written notes. In this work, we propose a new framework called MINGLE, which effectively integrates both structures and semantics in EHR. Our framework uses a two-level infusion strategy to combine medical concept semantics and clinical note semantics into hypergraph neural networks, which learn the complex interactions between different types of data to generate visit representations for downstream prediction. Experiment results on two EHR datasets, the public MIMIC-III and private CRADLE, show that MINGLE can effectively improve predictive performance by 11.83% relatively, enhancing semantic integration as well as multimodal fusion for structural and textual EHR data.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Cui, H., Fang, X., Xu, R., Kan, X., Ho, J. C., & Yang, C. (2025). Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM. Studies in health technology and informatics, 329, 753–757. https://doi.org/10.3233/shti250941
MLA 9
Cui, Hejie, et al. “Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM.” Studies in health technology and informatics, vol. 329, 2025, pp. 753–757. https://doi.org/10.3233/shti250941.
Chicago
Cui, Hejie, Xinyu Fang, Ran Xu, Xuan Kan, Joyce C. Ho, and Carl Yang. 2025. “Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM.” Studies in health technology and informatics 329: 753–757. https://doi.org/10.3233/shti250941.
Harvard
Cui, H. et al. (2025) ‘Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM’, Studies in health technology and informatics, 329, pp. 753–757. doi:10.3233/shti250941.
IEEE
H. Cui, X. Fang, R. Xu, X. Kan, J. C. Ho, and C. Yang, “Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM,” Studies in health technology and informatics, vol. 329, pp. 753–757, 2025, doi: 10.3233/shti250941.
BibTeX
@incollection{cui2025multimodal,
title = {{Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM}},
author = {Cui, Hejie and Fang, Xinyu and Xu, Ran and Kan, Xuan and Ho, Joyce C. and Yang, Carl},
booktitle = {Studies in health technology and informatics},
publisher = {IOS Press},
year = {2025},
volume = {329},
pages = {753--757},
doi = {10.3233/shti250941},
url = {https://doi.org/10.3233/shti250941}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2024 | 7 | |
| 2025 | 15 | |
| 2026 | 12 |
Its field-weighted citation impact is 26.07: it has been cited 26.07 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- electronic health records
- multimodal fusion
- hypergraph neural networks
- clinical notes
- two-level fusion
- clinical prediction
- MIMIC-III
- cradle
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Cui, H., Fang, X., Xu, R., Kan, X., Ho, J. C., & Yang, C. (2025). Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM. Studies in health technology and informatics, 329, 753–757. https://doi.org/10.3233/shti250941
How many times has this paper been cited?
35 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Studies in health technology and informatics: sign in and open the full text from this page.
Who wrote this paper?
Hejie Cui, Xinyu Fang, Ran Xu, Xuan Kan, Joyce C. Ho, Carl Yang.
What is the DOI of this paper?
10.3233/shti250941, permanently at https://doi.org/10.3233/shti250941. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.