Journal article · 2026 · Open access
When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?
ACM Transactions on Software Engineering and Methodology · Published 25 June 2026 · DOI 10.1145/3821424
In brief
“When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” is a 2026 journal article by Jun Chen and 4 co-authors, published in ACM Transactions on Software Engineering and Methodology. OpenAlex counts 24 citations as of 19 November 2026, which puts it in the top 3% of works published in 2026 by citations. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 24
- Most cited in
- 2026 (19)
- Field-weighted impact
- 49.98
- References
- 54
- Authors
- 5
Abstract
Retrieval-augmented generation (RAG) has increasingly shown its power in extending large language models’ (LLMs’) capability beyond their pre-trained knowledge. Existing works showed that RAG can help with software development tasks such as code generation and test generation. Yet, the effectiveness of adapting LLMs to their unfamiliar, less-common or fast-evolving library APIs using RAG remains unknown. To bridge this gap, we take an initial step to study this unexplored yet practical setting – when developers code with an unfamiliar library, they often refer to its API documentation; likewise, when LLMs are allowed to look up API documentation of their unfamiliar libraries via RAG, to what extent can LLMs be advanced? To mimic such a setting, we select four less-common open-source Python libraries with a total of 1017 eligible APIs. We study the factors that affect the effectiveness of using the documentation of less-common libraries as additional knowledge for retrieval and generation. Our study yields interesting findings: (1) RAG helps improve LLMs’ performance by 83% \(\sim\) 220%. (2) Example code contributes the most to advancing LLMs, compared to the descriptive texts and parameter lists in the API documentation. (3) LLMs could sometimes tolerate mild noises (typos in description or incorrect parameters) by referencing their pre-trained knowledge or document context. Based on the findings, we advocate that developers pay more attention to the quality and diversity of code examples in the API documentation. The study sheds light on the future low-code software development workflows with LLMs.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Chen, J., Chen, S., Cao, J., Shen, J., & Cheung, S.-C. (2026). When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries? ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424
MLA 9
Chen, Jun, et al. “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” ACM Transactions on Software Engineering and Methodology, 2026. https://doi.org/10.1145/3821424.
Chicago
Chen, Jun, Songqiang Chen, Jialun Cao, Jiasi Shen, and Shing-Chi Cheung. 2026. “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?” ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424.
Harvard
Chen, J. et al. (2026) ‘When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?’, ACM Transactions on Software Engineering and Methodology. doi:10.1145/3821424.
IEEE
J. Chen, S. Chen, J. Cao, J. Shen, and S.-C. Cheung, “When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?,” ACM Transactions on Software Engineering and Methodology, 2026, doi: 10.1145/3821424.
BibTeX
@article{chen2026when,
title = {{When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries?}},
author = {Chen, Jun and Chen, Songqiang and Cao, Jialun and Shen, Jiasi and Cheung, Shing-Chi},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
doi = {10.1145/3821424},
url = {https://doi.org/10.1145/3821424}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- retrieval-augmented generation
- API documentation
- large language models
- code generation
- Python library
- code examples
- documentation quality
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Chen, J., Chen, S., Cao, J., Shen, J., & Cheung, S.-C. (2026). When Retrieval Augmentation Meets API Documentation: Can LLMs Code with Less-Common Libraries? ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3821424
How many times has this paper been cited?
24 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Jun Chen, Songqiang Chen, Jialun Cao, Jiasi Shen, Shing-Chi Cheung.
What is the DOI of this paper?
10.1145/3821424, permanently at https://doi.org/10.1145/3821424. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.