Journal article · 2024 · Open access

Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records

Yarasam Yashwanth, Rajashree Shettar

IEEE Access, 12, 110385–110393 · Published 1 January 2024 · DOI 10.1109/access.2024.3439680

Open full textCite this paper

In brief

“Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records” is a 2024 journal article by Yarasam Yashwanth and Rajashree Shettar, published in IEEE Access. OpenAlex counts 26 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at IEEE Access.

Citations
26
Most cited in
2025 (18)
Field-weighted impact
2.14
References
36
Authors
2

Abstract

The paper aims to evaluate and provide a comparative analysis of the performance and fine-tuning cost of various Large Language Models (LLMs) such as GPT-3.5, GPT-4, PaLM, Bard, and Llama in automating the de-identification of Protected Health Information (PHI) from medical records, ensuring patient and healthcare professional privacy. Zero-shot learning was utilized initially to assess the capabilities of these LLMs in de-identifying medical data. Subsequently, each model was fine-tuned with varying training set sizes to observe changes in performance. The study also investigates the impact of the specificity of prompts on the accuracy of de-identification tasks. Fine-tuning LLMs with specific examples significantly enhanced the accuracy of the de-identification process, surpassing the zero-shot learning accuracy of pre-trained counterparts. Notably, a fine-tuned GPT-3.5 model with a few-shot learning technique was able to exceed the performance of a zero-shot learning GPT-4 model, with 99% accuracy. Detailed prompts resulted in higher task accuracy across all models, yet fine-tuned models with brief instructions still outperformed pre-trained models given detailed prompts. Also, the fine-tuned models were more resilient to medical record format change than the zero-shot models. Code, calculations, and comparisons are available at https://github.com/YashwanthYS/De-Identification-of-medical-Records. The findings underscore the potential of LLMs, particularly when fine-tuned, to effectively automate the de-identification of PHI in medical records. The study highlights the importance of model training and prompt specificity in achieving high accuracy in de-identification tasks.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Yashwanth, Y., & Shettar, R. (2024). Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records. IEEE Access, 12, 110385–110393. https://doi.org/10.1109/access.2024.3439680

MLA 9

Yashwanth, Yarasam, and Rajashree Shettar. “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records.” IEEE Access, vol. 12, 2024, pp. 110385–110393. https://doi.org/10.1109/access.2024.3439680.

Chicago

Yashwanth, Yarasam and Rajashree Shettar. 2024. “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records.” IEEE Access 12: 110385–110393. https://doi.org/10.1109/access.2024.3439680.

Harvard

Yashwanth, Y. and Shettar, R. (2024) ‘Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records’, IEEE Access, 12, pp. 110385–110393. doi:10.1109/access.2024.3439680.

IEEE

Y. Yashwanth and R. Shettar, “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records,” IEEE Access, vol. 12, pp. 110385–110393, 2024, doi: 10.1109/access.2024.3439680.

BibTeX

@article{yashwanth2024zero,
  title     = {{Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records}},
  author    = {Yashwanth, Yarasam and Shettar, Rajashree},
  journal   = {IEEE Access},
  year      = {2024},
  volume    = {12},
  pages     = {110385--110393},
  doi       = {10.1109/access.2024.3439680},
  url       = {https://doi.org/10.1109/access.2024.3439680}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202411
20251818
202677

Its field-weighted citation impact is 2.14: it has been cited 2.14 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data

  • de-identification
  • protected health information
  • medical records
  • large language models
  • zero-shot learning
  • few-shot learning
  • prompt specificity
  • fine-tuning

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Yashwanth, Y., & Shettar, R. (2024). Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records. IEEE Access, 12, 110385–110393. https://doi.org/10.1109/access.2024.3439680

How many times has this paper been cited?

26 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at IEEE Access: sign in and open the full text from this page.

Who wrote this paper?

Yarasam Yashwanth, Rajashree Shettar.

What is the DOI of this paper?

10.1109/access.2024.3439680, permanently at https://doi.org/10.1109/access.2024.3439680. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.