Journal article · 2019 · Open access
A study of deep learning methods for de-identification of clinical notes in cross-institute settings
BMC Medical Informatics and Decision Making, 19(S5), 232 · Published 1 December 2019 · DOI 10.1186/s12911-019-0935-4
In brief
“A study of deep learning methods for de-identification of clinical notes in cross-institute settings” is a 2019 journal article by Xi Yang and 6 co-authors, published in BMC Medical Informatics and Decision Making. OpenAlex counts 110 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at BMC Medical Informatics and Decision Making.
- Citations
- 110
- Most cited in
- 2022 (21)
- Field-weighted impact
- 3.42
- References
- 43
- Authors
- 7
Abstract
BACKGROUND: De-identification is a critical technology to facilitate the use of unstructured clinical text while protecting patient privacy and confidentiality. The clinical natural language processing (NLP) community has invested great efforts in developing methods and corpora for de-identification of clinical notes. These annotated corpora are valuable resources for developing automated systems to de-identify clinical text at local hospitals. However, existing studies often utilized training and test data collected from the same institution. There are few studies to explore automated de-identification under cross-institute settings. The goal of this study is to examine deep learning-based de-identification methods at a cross-institute setting, identify the bottlenecks, and provide potential solutions. METHODS: We created a de-identification corpus using a total 500 clinical notes from the University of Florida (UF) Health, developed deep learning-based de-identification models using 2014 i2b2/UTHealth corpus, and evaluated the performance using UF corpus. We compared five different word embeddings trained from the general English text, clinical text, and biomedical literature, explored lexical and linguistic features, and compared two strategies to customize the deep learning models using UF notes and resources. RESULTS: Pre-trained word embeddings using a general English corpus achieved better performance than embeddings from de-identified clinical text and biomedical literature. The performance of deep learning models trained using only i2b2 corpus significantly dropped (strict and relax F1 scores dropped from 0.9547 and 0.9646 to 0.8568 and 0.8958) when applied to another corpus annotated at UF Health. Linguistic features could further improve the performance of de-identification in cross-institute settings. After customizing the models using UF notes and resource, the best model achieved the strict and relaxed F1 scores of 0.9288 and 0.9584, respectively. CONCLUSIONS: It is necessary to customize de-identification models using local clinical text and other resources when applied in cross-institute settings. Fine-tuning is a potential solution to re-use pre-trained parameters and reduce the training time to customize deep learning-based de-identification models trained using clinical corpus from a different institution.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Yang, X., Lyu, T., Li, Q., Lee, C.-Y., Bian, J., Hogan, W. R., & Wu, Y. (2019). A study of deep learning methods for de-identification of clinical notes in cross-institute settings. BMC Medical Informatics and Decision Making, 19(S5), 232. https://doi.org/10.1186/s12911-019-0935-4
MLA 9
Yang, Xi, et al. “A study of deep learning methods for de-identification of clinical notes in cross-institute settings.” BMC Medical Informatics and Decision Making, vol. 19, no. S5, 2019, p. 232. https://doi.org/10.1186/s12911-019-0935-4.
Chicago
Yang, Xi, Tianchen Lyu, Qian Li, Chih-Yin Lee, Jiang Bian, William R. Hogan, and Yonghui Wu. 2019. “A study of deep learning methods for de-identification of clinical notes in cross-institute settings.” BMC Medical Informatics and Decision Making 19 (S5): 232. https://doi.org/10.1186/s12911-019-0935-4.
Harvard
Yang, X. et al. (2019) ‘A study of deep learning methods for de-identification of clinical notes in cross-institute settings’, BMC Medical Informatics and Decision Making, 19(S5), p. 232. doi:10.1186/s12911-019-0935-4.
IEEE
X. Yang et al., “A study of deep learning methods for de-identification of clinical notes in cross-institute settings,” BMC Medical Informatics and Decision Making, vol. 19, no. S5, p. 232, 2019, doi: 10.1186/s12911-019-0935-4.
BibTeX
@article{yang2019study,
title = {{A study of deep learning methods for de-identification of clinical notes in cross-institute settings}},
author = {Yang, Xi and Lyu, Tianchen and Li, Qian and Lee, Chih-Yin and Bian, Jiang and Hogan, William R. and Wu, Yonghui},
journal = {BMC Medical Informatics and Decision Making},
year = {2019},
volume = {19},
number = {S5},
pages = {232},
doi = {10.1186/s12911-019-0935-4},
url = {https://doi.org/10.1186/s12911-019-0935-4}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2019 | 1 | |
| 2020 | 9 | |
| 2021 | 9 | |
| 2022 | 21 | |
| 2023 | 18 | |
| 2024 | 19 | |
| 2025 | 21 | |
| 2026 | 12 |
Its field-weighted citation impact is 3.42: it has been cited 3.42 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- clinical notes
- deep learning
- word embeddings
- pre-trained model fine-tuning
- patient privacy
- clinical text
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Yang, X., Lyu, T., Li, Q., Lee, C.-Y., Bian, J., Hogan, W. R., & Wu, Y. (2019). A study of deep learning methods for de-identification of clinical notes in cross-institute settings. BMC Medical Informatics and Decision Making, 19(S5), 232. https://doi.org/10.1186/s12911-019-0935-4
How many times has this paper been cited?
110 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at BMC Medical Informatics and Decision Making: sign in and open the PDF from this page.
Who wrote this paper?
Xi Yang, Tianchen Lyu, Qian Li, Chih-Yin Lee, Jiang Bian, William R. Hogan, Yonghui Wu.
What is the DOI of this paper?
10.1186/s12911-019-0935-4, permanently at https://doi.org/10.1186/s12911-019-0935-4. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.