Journal article · 2025 · Open access

Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer

Isabella C. Wiest, Marie-Elisabeth Leßmann, Fabian Wolf, Dyke Ferber, Marko van Treeck, Jiefu Zhu, Matthias P. Ebert, Christoph Benedikt Westphalen, Martin Wermke, Jakob Nikolas Kather

NEJM AI, 2(4), AIdbp2400537 · Published 27 March 2025 · DOI 10.1056/aidbp2400537

Open PDFView at the publisherCite this paper

In brief

“Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer” is a 2025 journal article by Isabella C. Wiest and 9 co-authors, published in NEJM AI. OpenAlex counts 103 citations as of 19 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access under a CC BY-NC licence: the full text is free to read at medRxiv.

Citations
103
Most cited in
2026 (55)
Field-weighted impact
18.84
References
28
Authors
10

Abstract

BACKGROUND: Medical research with real-world clinical data is challenging as a result of privacy requirements. Patient data should be anonymized before analysis in research studies. Anonymization procedures aim to reduce the reidentification risk below a certain threshold, while maintaining the usefulness of the data for research purposes. However, in the context of medical text, these procedures are notoriously hard to automate and, therefore, are not scalable. Recent advancements in natural language processing (NLP), driven by the development of large language models (LLMs), have markedly improved the automatic processing of unstructured text. METHODS: We hypothesize that LLMs are highly effective tools for extracting patient-related information, which can subsequently be used to remove personal information from medical reports, while at the same time preserving information required for downstream research purposes. To test this, we conducted a benchmark study using eight local LLMs (Llama-3 8B, Llama-3 70B, Llama-2 7B, Llama-2 70B, Llama-2 7B Sauerkraut, Llama-2 70B Sauerkraut, Mistral 7B, and Phi-3 Mini) to extract and remove patient-related information from a dataset of 250 real-world clinical letters. RESULTS: Our results demonstrate that our LLM-Anonymizer, when used with Llama-3 70B, achieved a success rate of 99.24% in removing text characters carrying personal identifying information. It missed only 0.76% of text characters with identified personal information and mistakenly redacted 2.43% of characters. CONCLUSIONS: We provide our full LLM-based Anonymizer pipeline under an open-source license. Its user-friendly web interface operates on local hardware and requires no programming skills. This tool has the potential to facilitate medical research by enabling the secure and efficient deidentification of clinical free-text data on-site, thereby addressing key challenges in medical data sharing. (Funded by German Federal Ministry of Education and Research, CAMINO, 01EO2101, and the European Research Council, ERC; NADIR, 101114631.).

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wiest, I. C., Leßmann, M.-E., Wolf, F., Ferber, D., van Treeck, M., Zhu, J., Ebert, M. P., Westphalen, C. B., Wermke, M., & Kather, J. N. (2025). Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer. NEJM AI, 2(4), AIdbp2400537. https://doi.org/10.1056/aidbp2400537

MLA 9

Wiest, Isabella C., et al. “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer.” NEJM AI, vol. 2, no. 4, 2025, p. AIdbp2400537. https://doi.org/10.1056/aidbp2400537.

Chicago

Wiest, Isabella C., Marie-Elisabeth Leßmann, Fabian Wolf, Dyke Ferber, Marko van Treeck, Jiefu Zhu, Matthias P. Ebert, Christoph Benedikt Westphalen, Martin Wermke, and Jakob Nikolas Kather. 2025. “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer.” NEJM AI 2 (4): AIdbp2400537. https://doi.org/10.1056/aidbp2400537.

Harvard

Wiest, I. C. et al. (2025) ‘Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer’, NEJM AI, 2(4), p. AIdbp2400537. doi:10.1056/aidbp2400537.

IEEE

I. C. Wiest et al., “Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer,” NEJM AI, vol. 2, no. 4, p. AIdbp2400537, 2025, doi: 10.1056/aidbp2400537.

BibTeX

@article{wiest2025deidentifying,
  title     = {{Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer}},
  author    = {Wiest, Isabella C. and Leßmann, Marie-Elisabeth and Wolf, Fabian and Ferber, Dyke and van Treeck, Marko and Zhu, Jiefu and Ebert, Matthias P. and Westphalen, Christoph Benedikt and Wermke, Martin and Kather, Jakob Nikolas},
  journal   = {NEJM AI},
  year      = {2025},
  volume    = {2},
  number    = {4},
  pages     = {AIdbp2400537},
  doi       = {10.1056/aidbp2400537},
  url       = {https://doi.org/10.1056/aidbp2400537}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202422
20254646
20265555

Its field-weighted citation impact is 18.84: it has been cited 18.84 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data

  • de-identification
  • large language models
  • personal information extraction
  • re-identification risk
  • local LLM deployment
  • health data sharing
  • patient data privacy

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Wiest, I. C., Leßmann, M.-E., Wolf, F., Ferber, D., van Treeck, M., Zhu, J., Ebert, M. P., Westphalen, C. B., Wermke, M., & Kather, J. N. (2025). Deidentifying Medical Documents with Local, Privacy-Preserving Large Language Models: The LLM-Anonymizer. NEJM AI, 2(4), AIdbp2400537. https://doi.org/10.1056/aidbp2400537

How many times has this paper been cited?

103 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at medRxiv: sign in and open the PDF from this page.

Who wrote this paper?

Isabella C. Wiest, Marie-Elisabeth Leßmann, Fabian Wolf, Dyke Ferber, Marko van Treeck, Jiefu Zhu, Matthias P. Ebert, Christoph Benedikt Westphalen, Martin Wermke, Jakob Nikolas Kather.

What is the DOI of this paper?

10.1056/aidbp2400537, permanently at https://doi.org/10.1056/aidbp2400537. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.