Preprint · 2024 · Open access
SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks
arXiv (Cornell University) · Published 13 March 2024 · DOI 10.48550/arxiv.2403.08481
In brief
“SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks” is a 2024 preprint by Guy Amit and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 18 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 18
- Most cited in
- 2025 (9)
- References
- 44
- Authors
- 3
Abstract
Natural language processing models have experienced a significant upsurge in recent years, with numerous applications being built upon them. Many of these applications require fine-tuning generic base models on customized, proprietary datasets. This fine-tuning data is especially likely to contain personal or sensitive information about individuals, resulting in increased privacy risk. Membership inference attacks are the most commonly employed attack to assess the privacy leakage of a machine learning model. However, limited research is available on the factors that affect the vulnerability of language models to this kind of attack, or on the applicability of different defense strategies in the language domain. We provide the first systematic review of the vulnerability of fine-tuned large language models to membership inference attacks, the various factors that come into play, and the effectiveness of different defense strategies. We find that some training methods provide significantly reduced privacy risk, with the combination of differential privacy and low-rank adaptors achieving the best privacy protection against these attacks.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Amit, G., Goldsteen, A., & Farkash, A. (2024). SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481
MLA 9
Amit, Guy, et al. “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2403.08481.
Chicago
Amit, Guy, Abigail Goldsteen, and Ariel Farkash. 2024. “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481.
Harvard
Amit, G., Goldsteen, A. and Farkash, A. (2024) ‘SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks’, arXiv (Cornell University). doi:10.48550/arxiv.2403.08481.
IEEE
G. Amit, A. Goldsteen, and A. Farkash, “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2403.08481.
BibTeX
@misc{amit2024reducing,
title = {{SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks}},
author = {Amit, Guy and Goldsteen, Abigail and Farkash, Ariel},
howpublished = {arXiv (Cornell University)},
year = {2024},
doi = {10.48550/arxiv.2403.08481},
url = {https://doi.org/10.48550/arxiv.2403.08481}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 3 | |
| 2025 | 9 | |
| 2026 | 6 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- membership inference attacks
- fine-tuned language models
- large language models
- privacy leakage
- differential privacy
- training data privacy
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Amit, G., Goldsteen, A., & Farkash, A. (2024). SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481
How many times has this paper been cited?
18 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Guy Amit, Abigail Goldsteen, Ariel Farkash.
What is the DOI of this paper?
10.48550/arxiv.2403.08481, permanently at https://doi.org/10.48550/arxiv.2403.08481. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.