Journal article · 2024 · Open access

Security Analysis of Large Language Models on API Misuse Programming Repair

Rui Zhang, Ziyue Qiao, Yong Yu

International Journal of Intelligent Systems, 2024(1) · Published 1 January 2024 · DOI 10.1155/2024/7135765

Open PDFView at the publisherCite this paper

In brief

“Security Analysis of Large Language Models on API Misuse Programming Repair” is a 2024 journal article by Rui Zhang and 2 co-authors, published in International Journal of Intelligent Systems. OpenAlex counts 1 citations as of 19 November 2026. It is open access under a CC BY licence: the full text is free to read at International Journal of Intelligent Systems.

Citations
1
Most cited in
2025 (1)
Field-weighted impact
0.19
References
28
Authors
3

Abstract

Application programming interface (API) misuse refers to misconceptions or carelessness in the anticipated usage of APIs, threatening the software system’s security. Moreover, API misuses demonstrate significant concealment and are challenging to uncover. Recent advancements have explored enhanced LLMs in a variety of software engineering (SE) activities, such as code repair. Nonetheless, the security implications of using LLMs for these purposes remain underexplored, particularly concerning the issue of API misuse. In this paper, we present an empirical study to observe the bug‐fixing capabilities of LLMs in addressing API misuse related to monitoring resource management (MRM API misuse). Initially, we propose APImisRepair, a real‐world benchmark for repairing MRM API misuse, including buggy programs, corresponding fixed programs, and descriptions of API misuse. Subsequently, we assess the performance of several LLMs using the APImisRepair benchmark. Findings reveal the vulnerabilities of LLMs in repairing MRM API misuse and find several reasons, encompassing factors such as fault localization and a lack of awareness regarding API misuse. Additionally, we have insights on improving LLMs in terms of their ability to fix MRM API misuse and introduce a crafted approach, APImisAP. Experimental results demonstrate that APImisAP exhibits a certain degree of improvement in the security of LLMs.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhang, R., Qiao, Z., & Yu, Y. (2024). Security Analysis of Large Language Models on API Misuse Programming Repair. International Journal of Intelligent Systems, 2024(1). https://doi.org/10.1155/2024/7135765

MLA 9

Zhang, Rui, et al. “Security Analysis of Large Language Models on API Misuse Programming Repair.” International Journal of Intelligent Systems, vol. 2024, no. 1, 2024. https://doi.org/10.1155/2024/7135765.

Chicago

Zhang, Rui, Ziyue Qiao, and Yong Yu. 2024. “Security Analysis of Large Language Models on API Misuse Programming Repair.” International Journal of Intelligent Systems 2024 (1). https://doi.org/10.1155/2024/7135765.

Harvard

Zhang, R., Qiao, Z. and Yu, Y. (2024) ‘Security Analysis of Large Language Models on API Misuse Programming Repair’, International Journal of Intelligent Systems, 2024(1). doi:10.1155/2024/7135765.

IEEE

R. Zhang, Z. Qiao, and Y. Yu, “Security Analysis of Large Language Models on API Misuse Programming Repair,” International Journal of Intelligent Systems, vol. 2024, no. 1, 2024, doi: 10.1155/2024/7135765.

BibTeX

@article{zhang2024security,
  title     = {{Security Analysis of Large Language Models on API Misuse Programming Repair}},
  author    = {Zhang, Rui and Qiao, Ziyue and Yu, Yong},
  journal   = {International Journal of Intelligent Systems},
  year      = {2024},
  volume    = {2024},
  number    = {1},
  doi       = {10.1155/2024/7135765},
  url       = {https://doi.org/10.1155/2024/7135765}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Information Systems › Software Engineering Research

  • API misuse
  • large language models
  • code repair
  • LLM security
  • fault location

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Zhang, R., Qiao, Z., & Yu, Y. (2024). Security Analysis of Large Language Models on API Misuse Programming Repair. International Journal of Intelligent Systems, 2024(1). https://doi.org/10.1155/2024/7135765

How many times has this paper been cited?

1 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at International Journal of Intelligent Systems: sign in and open the PDF from this page.

Who wrote this paper?

Rui Zhang, Ziyue Qiao, Yong Yu.

What is the DOI of this paper?

10.1155/2024/7135765, permanently at https://doi.org/10.1155/2024/7135765. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.