Preprint · 2024 · Open access
Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer
Published 7 June 2024 · DOI 10.36227/techrxiv.171777861.19290790/v1
In brief
“Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer” is a 2024 preprint by Avisha Das and 4 co-authors. OpenAlex counts 1 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 1
- Most cited in
- 2025 (1)
- References
- 27
- Authors
- 5
Abstract
Large language models (LLMs) with billions of parameters and trained on massive amounts of crowdsourced public data have made a dramatic impact on natural language processing (NLP) tasks. Domain specific 'finetuning' of LLMs has further improved model behavior through task-specific alignment and refinement. However with the widespread development and deployment of LLMs, existing vulnerabilities in these models have made way for perpetrators to manipulate them for malicious intentions. The widespread integration of LLMs in clinical NLP underscores the looming threat of privacy leakage and targeted attacks like prompt injection or data poisoning. In this work, we designed a systematic framework to expose vulnerabilities of clinical generative language model with a specific emphasis on its application to clinical notes. We design three attack pipelines to highlight model's susceptibility to core types of targeted attacks-(i) instruction-based data poisoning, (ii) trigger-based model editing and (iii) membership inference on de-identified breast cancer clinical notes. Our proposed framework is the first work to investigate the extent of LLM-based attacks in the clinical domain. Our findings reveal successful manipulation of LLM behavior, prompting concerns about the stealthiness and effectiveness of such attacks. Through this work, we hope to emphasize on the urgency of comprehending these vulnerabilities in LLMs and encourage the mindful and responsible usage of LLMs in the clinical domain.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Das, A., Tariq, A., Batalini, F., Dhara, B., & Banerjee, I. (2024). Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer. https://doi.org/10.36227/techrxiv.171777861.19290790/v1
MLA 9
Das, Avisha, et al. “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer.” 2024. https://doi.org/10.36227/techrxiv.171777861.19290790/v1.
Chicago
Das, Avisha, Amara Tariq, Felipe Batalini, Bodhisattwa Dhara, and Imon Banerjee. 2024. “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer.” https://doi.org/10.36227/techrxiv.171777861.19290790/v1.
Harvard
Das, A. et al. (2024) ‘Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer’. doi:10.36227/techrxiv.171777861.19290790/v1.
IEEE
A. Das, A. Tariq, F. Batalini, B. Dhara, and I. Banerjee, “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer,” 2024, doi: 10.36227/techrxiv.171777861.19290790/v1.
BibTeX
@misc{das2024framework,
title = {{Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer}},
author = {Das, Avisha and Tariq, Amara and Batalini, Felipe and Dhara, Bodhisattwa and Banerjee, Imon},
year = {2024},
doi = {10.36227/techrxiv.171777861.19290790/v1},
url = {https://doi.org/10.36227/techrxiv.171777861.19290790/v1}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- large language models
- clinical large language models
- LLM vulnerabilities
- data poisoning
- prompt injection
- membership inference
- clinical notes
- breast cancer
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Das, A., Tariq, A., Batalini, F., Dhara, B., & Banerjee, I. (2024). Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer. https://doi.org/10.36227/techrxiv.171777861.19290790/v1
How many times has this paper been cited?
1 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: sign in and open the full text from this page.
Who wrote this paper?
Avisha Das, Amara Tariq, Felipe Batalini, Bodhisattwa Dhara, Imon Banerjee.
What is the DOI of this paper?
10.36227/techrxiv.171777861.19290790/v1, permanently at https://doi.org/10.36227/techrxiv.171777861.19290790/v1. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.