Journal article · 2026 · Open access

When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?

Jun Chen, Songqiang Chen, Jialun Cao, Jiasi Shen, Shing-Chi Cheung

ACM Transactions on Software Engineering and Methodology · Published 25 June 2026 · DOI 10.1145/3821424

Open PDFView at the publisherCite this paper

In brief

“When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” is a 2026 journal article by Jun Chen and 4 co-authors, published in ACM Transactions on Software Engineering and Methodology. OpenAlex counts 24 citations as of 19 November 2026, which puts it in the top 3% of works published in 2026 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
24
Most cited in
2026 (19)
Field-weighted impact
49.98
References
54
Authors
5

Abstract

Retrieval-augmented generation (RAG) has increasingly shown its power in extending large language models’ (LLMs’) capability beyond their pre-trained knowledge. Existing works showed that RAG can help with software development tasks such as code generation and test generation. Yet, the effectiveness of adapting LLMs to their unfamiliar, less-common or fast-evolving library APIs using RAG remains unknown. To bridge this gap, we take an initial step to study this unexplored yet practical setting – when developers code with an unfamiliar library, they often refer to its API documentation; likewise, when LLMs are allowed to look up API documentation of their unfamiliar libraries via RAG, to what extent can LLMs be advanced? To mimic such a setting, we select four less-common open-source Python libraries with a total of 1017 eligible APIs. We study the factors that affect the effectiveness of using the documentation of less-common libraries as additional knowledge for retrieval and generation. Our study yields interesting findings: (1) RAG helps improve LLMs’ performance by 83% \(\sim\) 220%. (2) Example code contributes the most to advancing LLMs, compared to the descriptive texts and parameter lists in the API documentation. (3) LLMs could sometimes tolerate mild noises (typos in description or incorrect parameters) by referencing their pre-trained knowledge or document context. Based on the findings, we advocate that developers pay more attention to the quality and diversity of code examples in the API documentation. The study sheds light on the future low-code software development workflows with LLMs.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Chen, J., Chen, S., Cao, J., Shen, J., & Cheung, S.-C. (2026). When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries? ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424

MLA 9

Chen, Jun, et al. “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” ACM Transactions on Software Engineering and Methodology, 2026. https://doi.org/10.1145/3821424.

Chicago

Chen, Jun, Songqiang Chen, Jialun Cao, Jiasi Shen, and Shing-Chi Cheung. 2026. “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424.

Harvard

Chen, J. et al. (2026) ‘When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?’, ACM Transactions on Software Engineering and Methodology. doi:10.1145/3821424.

IEEE

J. Chen, S. Chen, J. Cao, J. Shen, and S.-C. Cheung, “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?,” ACM Transactions on Software Engineering and Methodology, 2026, doi: 10.1145/3821424.

BibTeX

@article{chen2026when,
  title     = {{When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?}},
  author    = {Chen, Jun and Chen, Songqiang and Cao, Jialun and Shen, Jiasi and Cheung, Shing-Chi},
  journal   = {ACM Transactions on Software Engineering and Methodology},
  year      = {2026},
  doi       = {10.1145/3821424},
  url       = {https://doi.org/10.1145/3821424}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Information Systems › Software Engineering Research

  • retrieval-augmented generation
  • API documentation
  • large language models
  • code generation
  • Python library
  • code examples
  • documentation quality

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Chen, J., Chen, S., Cao, J., Shen, J., & Cheung, S.-C. (2026). When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries? ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424

How many times has this paper been cited?

24 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Jun Chen, Songqiang Chen, Jialun Cao, Jiasi Shen, Shing-Chi Cheung.

What is the DOI of this paper?

10.1145/3821424, permanently at https://doi.org/10.1145/3821424. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.