Preprint · 2024 · Open access

SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks

Guy Amit, Abigail Goldsteen, Ariel Farkash

arXiv (Cornell University) · Published 13 March 2024 · DOI 10.48550/arxiv.2403.08481

Open PDFView at the publisherCite this paper

In brief

“SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks” is a 2024 preprint by Guy Amit and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 18 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
18
Most cited in
2025 (9)
References
44
Authors
3

Abstract

Natural language processing models have experienced a significant upsurge in recent years, with numerous applications being built upon them. Many of these applications require fine-tuning generic base models on customized, proprietary datasets. This fine-tuning data is especially likely to contain personal or sensitive information about individuals, resulting in increased privacy risk. Membership inference attacks are the most commonly employed attack to assess the privacy leakage of a machine learning model. However, limited research is available on the factors that affect the vulnerability of language models to this kind of attack, or on the applicability of different defense strategies in the language domain. We provide the first systematic review of the vulnerability of fine-tuned large language models to membership inference attacks, the various factors that come into play, and the effectiveness of different defense strategies. We find that some training methods provide significantly reduced privacy risk, with the combination of differential privacy and low-rank adaptors achieving the best privacy protection against these attacks.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Amit, G., Goldsteen, A., & Farkash, A. (2024). SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481

MLA 9

Amit, Guy, et al. “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2403.08481.

Chicago

Amit, Guy, Abigail Goldsteen, and Ariel Farkash. 2024. “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481.

Harvard

Amit, G., Goldsteen, A. and Farkash, A. (2024) ‘SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks’, arXiv (Cornell University). doi:10.48550/arxiv.2403.08481.

IEEE

G. Amit, A. Goldsteen, and A. Farkash, “SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2403.08481.

BibTeX

@misc{amit2024reducing,
  title     = {{SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks}},
  author    = {Amit, Guy and Goldsteen, Abigail and Farkash, Ariel},
  howpublished = {arXiv (Cornell University)},
  year      = {2024},
  doi       = {10.48550/arxiv.2403.08481},
  url       = {https://doi.org/10.48550/arxiv.2403.08481}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202433
202599
202666

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data

  • membership inference attacks
  • fine-tuned language models
  • large language models
  • privacy leakage
  • differential privacy
  • training data privacy

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Amit, G., Goldsteen, A., & Farkash, A. (2024). SoK: Reducing the Vulnerability of Fine-tuned Language Models to Membership Inference Attacks. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2403.08481

How many times has this paper been cited?

18 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Guy Amit, Abigail Goldsteen, Ariel Farkash.

What is the DOI of this paper?

10.48550/arxiv.2403.08481, permanently at https://doi.org/10.48550/arxiv.2403.08481. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.