Journal article · 2025 · Open access
Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer
NEJM AI, 2(4), AIdbp2400537 · Published 27 March 2025 · DOI 10.1056/aidbp2400537
In brief
“Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer” is a 2025 journal article by Isabella C. Wiest and 9 co-authors, published in NEJM AI. OpenAlex counts 103 citations as of 19 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access under a CC BY-NC licence: the full text is free to read at medRxiv.
- Citations
- 103
- Most cited in
- 2026 (55)
- Field-weighted impact
- 18.84
- References
- 28
- Authors
- 10
Abstract
BACKGROUND: Medical research with real-world clinical data is challenging as a result of privacy requirements. Patient data should be anonymized before analysis in research studies. Anonymization procedures aim to reduce the reidentification risk below a certain threshold, while maintaining the usefulness of the data for research purposes. However, in the context of medical text, these procedures are notoriously hard to automate and, therefore, are not scalable. Recent advancements in natural language processing (NLP), driven by the development of large language models (LLMs), have markedly improved the automatic processing of unstructured text. METHODS: We hypothesize that LLMs are highly effective tools for extracting patient-related information, which can subsequently be used to remove personal information from medical reports, while at the same time preserving information required for downstream research purposes. To test this, we conducted a benchmark study using eight local LLMs (Llama-3 8B, Llama-3 70B, Llama-2 7B, Llama-2 70B, Llama-2 7B Sauerkraut, Llama-2 70B Sauerkraut, Mistral 7B, and Phi-3 Mini) to extract and remove patient-related information from a dataset of 250 real-world clinical letters. RESULTS: Our results demonstrate that our LLM-Anonymizer, when used with Llama-3 70B, achieved a success rate of 99.24% in removing text characters carrying personal identifying information. It missed only 0.76% of text characters with identified personal information and mistakenly redacted 2.43% of characters. CONCLUSIONS: We provide our full LLM-based Anonymizer pipeline under an open-source license. Its user-friendly web interface operates on local hardware and requires no programming skills. This tool has the potential to facilitate medical research by enabling the secure and efficient deidentification of clinical free-text data on-site, thereby addressing key challenges in medical data sharing. (Funded by German Federal Ministry of Education and Research, CAMINO, 01EO2101, and the European Research Council, ERC; NADIR, 101114631.).
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wiest, I. C., Leßmann, M.-E., Wolf, F., Ferber, D., van Treeck, M., Zhu, J., Ebert, M. P., Westphalen, C. B., Wermke, M., & Kather, J. N. (2025). Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer. NEJM AI, 2(4), AIdbp2400537. https://doi.org/10.1056/aidbp2400537
MLA 9
Wiest, Isabella C., et al. “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer.” NEJM AI, vol. 2, no. 4, 2025, p. AIdbp2400537. https://doi.org/10.1056/aidbp2400537.
Chicago
Wiest, Isabella C., Marie-Elisabeth Leßmann, Fabian Wolf, Dyke Ferber, Marko van Treeck, Jiefu Zhu, Matthias P. Ebert, Christoph Benedikt Westphalen, Martin Wermke, and Jakob Nikolas Kather. 2025. “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer.” NEJM AI 2 (4): AIdbp2400537. https://doi.org/10.1056/aidbp2400537.
Harvard
Wiest, I. C. et al. (2025) ‘Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer’, NEJM AI, 2(4), p. AIdbp2400537. doi:10.1056/aidbp2400537.
IEEE
I. C. Wiest et al., “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer,” NEJM AI, vol. 2, no. 4, p. AIdbp2400537, 2025, doi: 10.1056/aidbp2400537.
BibTeX
@article{wiest2025deidentifying,
title = {{Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer}},
author = {Wiest, Isabella C. and Leßmann, Marie-Elisabeth and Wolf, Fabian and Ferber, Dyke and van Treeck, Marko and Zhu, Jiefu and Ebert, Matthias P. and Westphalen, Christoph Benedikt and Wermke, Martin and Kather, Jakob Nikolas},
journal = {NEJM AI},
year = {2025},
volume = {2},
number = {4},
pages = {AIdbp2400537},
doi = {10.1056/aidbp2400537},
url = {https://doi.org/10.1056/aidbp2400537}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 2 | |
| 2025 | 46 | |
| 2026 | 55 |
Its field-weighted citation impact is 18.84: it has been cited 18.84 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- de-identification
- large language models
- personal information extraction
- re-identification risk
- local LLM deployment
- health data sharing
- patient data privacy
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wiest, I. C., Leßmann, M.-E., Wolf, F., Ferber, D., van Treeck, M., Zhu, J., Ebert, M. P., Westphalen, C. B., Wermke, M., & Kather, J. N. (2025). Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer. NEJM AI, 2(4), AIdbp2400537. https://doi.org/10.1056/aidbp2400537
How many times has this paper been cited?
103 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at medRxiv: sign in and open the PDF from this page.
Who wrote this paper?
Isabella C. Wiest, Marie-Elisabeth Leßmann, Fabian Wolf, Dyke Ferber, Marko van Treeck, Jiefu Zhu, Matthias P. Ebert, Christoph Benedikt Westphalen, Martin Wermke, Jakob Nikolas Kather.
What is the DOI of this paper?
10.1056/aidbp2400537, permanently at https://doi.org/10.1056/aidbp2400537. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.