Preprint · 2024 · Open access
Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions
arXiv (Cornell University) · Published 9 December 2024 · DOI 10.48550/arxiv.2412.06113
In brief
“Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions” is a 2024 preprint by Zhao, Guoshenghui and Eric Song, published in arXiv (Cornell University). OpenAlex counts 44 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 44
- Most cited in
- 2026 (27)
- References
- 12
- Authors
- 2
Abstract
The rapid advancement of large language models (LLMs) has revolutionized natural language processing, enabling applications in diverse domains such as healthcare, finance and education. However, the growing reliance on extensive data for training and inference has raised significant privacy concerns, ranging from data leakage to adversarial attacks. This survey comprehensively explores the landscape of privacy-preserving mechanisms tailored for LLMs, including differential privacy, federated learning, cryptographic protocols, and trusted execution environments. We examine their efficacy in addressing key privacy challenges, such as membership inference and model inversion attacks, while balancing trade-offs between privacy and model utility. Furthermore, we analyze privacy-preserving applications of LLMs in privacy-sensitive domains, highlighting successful implementations and inherent limitations. Finally, this survey identifies emerging research directions, emphasizing the need for novel frameworks that integrate privacy by design into the lifecycle of LLMs. By synthesizing state-of-the-art approaches and future trends, this paper provides a foundation for developing robust, privacy-preserving large language models that safeguard sensitive information without compromising performance.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Guoshenghui, Z., & Song, E. (2024). Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2412.06113
MLA 9
Guoshenghui, Zhao,, and Eric Song. “Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2412.06113.
Chicago
Guoshenghui, Zhao, and Eric Song. 2024. “Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2412.06113.
Harvard
Guoshenghui, Z. and Song, E. (2024) ‘Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions’, arXiv (Cornell University). doi:10.48550/arxiv.2412.06113.
IEEE
Z. Guoshenghui and E. Song, “Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2412.06113.
BibTeX
@misc{guoshenghui2024privacy,
title = {{Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions}},
author = {Guoshenghui, Zhao, and Song, Eric},
howpublished = {arXiv (Cornell University)},
year = {2024},
doi = {10.48550/arxiv.2412.06113},
url = {https://doi.org/10.48550/arxiv.2412.06113}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- differential privacy
- federated learning
- cryptographic protocols
- trusted execution environments
- membership inference attacks
- model inversion attacks
- privacy-utility trade-off
- privacy by design
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Guoshenghui, Z., & Song, E. (2024). Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2412.06113
How many times has this paper been cited?
44 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Zhao, Guoshenghui, Eric Song.
What is the DOI of this paper?
10.48550/arxiv.2412.06113, permanently at https://doi.org/10.48550/arxiv.2412.06113. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.