Journal article · 2024 · Open access
Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records
IEEE Access, 12, 110385–110393 · Published 1 January 2024 · DOI 10.1109/access.2024.3439680
In brief
“Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records” is a 2024 journal article by Yarasam Yashwanth and Rajashree Shettar, published in IEEE Access. OpenAlex counts 26 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at IEEE Access.
- Citations
- 26
- Most cited in
- 2025 (18)
- Field-weighted impact
- 2.14
- References
- 36
- Authors
- 2
Abstract
The paper aims to evaluate and provide a comparative analysis of the performance and fine-tuning cost of various Large Language Models (LLMs) such as GPT-3.5, GPT-4, PaLM, Bard, and Llama in automating the de-identification of Protected Health Information (PHI) from medical records, ensuring patient and healthcare professional privacy. Zero-shot learning was utilized initially to assess the capabilities of these LLMs in de-identifying medical data. Subsequently, each model was fine-tuned with varying training set sizes to observe changes in performance. The study also investigates the impact of the specificity of prompts on the accuracy of de-identification tasks. Fine-tuning LLMs with specific examples significantly enhanced the accuracy of the de-identification process, surpassing the zero-shot learning accuracy of pre-trained counterparts. Notably, a fine-tuned GPT-3.5 model with a few-shot learning technique was able to exceed the performance of a zero-shot learning GPT-4 model, with 99% accuracy. Detailed prompts resulted in higher task accuracy across all models, yet fine-tuned models with brief instructions still outperformed pre-trained models given detailed prompts. Also, the fine-tuned models were more resilient to medical record format change than the zero-shot models. Code, calculations, and comparisons are available at https://github.com/YashwanthYS/De-Identification-of-medical-Records. The findings underscore the potential of LLMs, particularly when fine-tuned, to effectively automate the de-identification of PHI in medical records. The study highlights the importance of model training and prompt specificity in achieving high accuracy in de-identification tasks.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Yashwanth, Y., & Shettar, R. (2024). Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records. IEEE Access, 12, 110385–110393. https://doi.org/10.1109/access.2024.3439680
MLA 9
Yashwanth, Yarasam, and Rajashree Shettar. “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records.” IEEE Access, vol. 12, 2024, pp. 110385–110393. https://doi.org/10.1109/access.2024.3439680.
Chicago
Yashwanth, Yarasam and Rajashree Shettar. 2024. “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records.” IEEE Access 12: 110385–110393. https://doi.org/10.1109/access.2024.3439680.
Harvard
Yashwanth, Y. and Shettar, R. (2024) ‘Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records’, IEEE Access, 12, pp. 110385–110393. doi:10.1109/access.2024.3439680.
IEEE
Y. Yashwanth and R. Shettar, “Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records,” IEEE Access, vol. 12, pp. 110385–110393, 2024, doi: 10.1109/access.2024.3439680.
BibTeX
@article{yashwanth2024zero,
title = {{Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records}},
author = {Yashwanth, Yarasam and Shettar, Rajashree},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {110385--110393},
doi = {10.1109/access.2024.3439680},
url = {https://doi.org/10.1109/access.2024.3439680}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 1 | |
| 2025 | 18 | |
| 2026 | 7 |
Its field-weighted citation impact is 2.14: it has been cited 2.14 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- de-identification
- protected health information
- medical records
- large language models
- zero-shot learning
- few-shot learning
- prompt specificity
- fine-tuning
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Yashwanth, Y., & Shettar, R. (2024). Zero and Few Short Learning Using Large Language Models for De-Identification of Medical Records. IEEE Access, 12, 110385–110393. https://doi.org/10.1109/access.2024.3439680
How many times has this paper been cited?
26 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at IEEE Access: sign in and open the full text from this page.
Who wrote this paper?
Yarasam Yashwanth, Rajashree Shettar.
What is the DOI of this paper?
10.1109/access.2024.3439680, permanently at https://doi.org/10.1109/access.2024.3439680. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.