Preprint · 2024 · Open access

Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer

Avisha Das, Amara Tariq, Felipe Batalini, Bodhisattwa Dhara, Imon Banerjee

Published 7 June 2024 · DOI 10.36227/techrxiv.171777861.19290790/v1

Open full textCite this paper

In brief

“Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer” is a 2024 preprint by Avisha Das and 4 co-authors. OpenAlex counts 1 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
1
Most cited in
2025 (1)
References
27
Authors
5

Abstract

Large language models (LLMs) with billions of parameters and trained on massive amounts of crowdsourced public data have made a dramatic impact on natural language processing (NLP) tasks. Domain specific 'finetuning' of LLMs has further improved model behavior through task-specific alignment and refinement. However with the widespread development and deployment of LLMs, existing vulnerabilities in these models have made way for perpetrators to manipulate them for malicious intentions. The widespread integration of LLMs in clinical NLP underscores the looming threat of privacy leakage and targeted attacks like prompt injection or data poisoning. In this work, we designed a systematic framework to expose vulnerabilities of clinical generative language model with a specific emphasis on its application to clinical notes. We design three attack pipelines to highlight model's susceptibility to core types of targeted attacks-(i) instruction-based data poisoning, (ii) trigger-based model editing and (iii) membership inference on de-identified breast cancer clinical notes. Our proposed framework is the first work to investigate the extent of LLM-based attacks in the clinical domain. Our findings reveal successful manipulation of LLM behavior, prompting concerns about the stealthiness and effectiveness of such attacks. Through this work, we hope to emphasize on the urgency of comprehending these vulnerabilities in LLMs and encourage the mindful and responsible usage of LLMs in the clinical domain.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Das, A., Tariq, A., Batalini, F., Dhara, B., & Banerjee, I. (2024). Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer. https://doi.org/10.36227/techrxiv.171777861.19290790/v1

MLA 9

Das, Avisha, et al. “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer.” 2024. https://doi.org/10.36227/techrxiv.171777861.19290790/v1.

Chicago

Das, Avisha, Amara Tariq, Felipe Batalini, Bodhisattwa Dhara, and Imon Banerjee. 2024. “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer.” https://doi.org/10.36227/techrxiv.171777861.19290790/v1.

Harvard

Das, A. et al. (2024) ‘Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer’. doi:10.36227/techrxiv.171777861.19290790/v1.

IEEE

A. Das, A. Tariq, F. Batalini, B. Dhara, and I. Banerjee, “Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer,” 2024, doi: 10.36227/techrxiv.171777861.19290790/v1.

BibTeX

@misc{das2024framework,
  title     = {{Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer}},
  author    = {Das, Avisha and Tariq, Amara and Batalini, Felipe and Dhara, Bodhisattwa and Banerjee, Imon},
  year      = {2024},
  doi       = {10.36227/techrxiv.171777861.19290790/v1},
  url       = {https://doi.org/10.36227/techrxiv.171777861.19290790/v1}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning

  • large language models
  • clinical large language models
  • LLM vulnerabilities
  • data poisoning
  • prompt injection
  • membership inference
  • clinical notes
  • breast cancer

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Das, A., Tariq, A., Batalini, F., Dhara, B., & Banerjee, I. (2024). Framework for Exposing Vulnerabilities of Clinical Large Language Model: A Case Study in Breast Cancer. https://doi.org/10.36227/techrxiv.171777861.19290790/v1

How many times has this paper been cited?

1 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: sign in and open the full text from this page.

Who wrote this paper?

Avisha Das, Amara Tariq, Felipe Batalini, Bodhisattwa Dhara, Imon Banerjee.

What is the DOI of this paper?

10.36227/techrxiv.171777861.19290790/v1, permanently at https://doi.org/10.36227/techrxiv.171777861.19290790/v1. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.