Preprint · 2024 · Open access
You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations
arXiv (Cornell University) · Published 7 February 2024 · DOI 10.48550/arxiv.2402.05102
In brief
“You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations” is a 2024 preprint by Alix Decrop and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 28 citations as of 19 November 2026. It is open access under a CC BY-SA licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 28
- Most cited in
- 2026 (17)
- References
- 64
- Authors
- 5
Abstract
REST APIs are prevalent among web service implementations, easing interoperability through the HTTP protocol. API testers and users exploit the widely adopted OpenAPI Specification (OAS), a machine-readable standard to document REST APIs. However, documenting APIs is a time-consuming and error-prone task, and existing documentation is not always complete, publicly accessible, or up-to-date. This situation limits the efficiency of testing tools and hinders human comprehension. Large Language Models (LLMs) offer the potential to automatically infer API documentation, using their colossal training data. In this paper, we present RESTSpecIT, the first automated approach that infers documentation and performs black-box testing of REST APIs by leveraging LLMs. Our approach requires minimal user input compared to state-of-the-art tools; Given an API name and an LLM access key, RESTSpecIT generates API request seeds and mutates them with data returned by the LLM. The tool then analyzes API responses for documentation inference and testing purposes. RESTSpecIT utilizes an in-context prompt masking strategy, requiring no prior model fine-tuning. We evaluate the quality of our tool with three state-of-the-art LLMs: DeepSeek V3, GPT-4.1, and GPT-3.5. Our evaluation demonstrates that RESTSpecIT can (1) infer documentation with 88.62% of routes and 89.25% of query parameters found on average, (2) discover undocumented API data, (3) operate efficiently (in terms of model costs, requests sent, runtime), and (4) assist REST API testing by uncovering server errors and generating valid OpenAPI Specification inputs for testing tools.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Decrop, A., Devroey, X., Papadakis, M., Schobbens, P., & Perrouin, G. (2024). You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102
MLA 9
Decrop, Alix, et al. “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2402.05102.
Chicago
Decrop, Alix, Xavier Devroey, Mike Papadakis, Pierre‐Yves Schobbens, and Gilles Perrouin. 2024. “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102.
Harvard
Decrop, A. et al. (2024) ‘You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations’, arXiv (Cornell University). doi:10.48550/arxiv.2402.05102.
IEEE
A. Decrop, X. Devroey, M. Papadakis, P. Schobbens, and G. Perrouin, “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2402.05102.
BibTeX
@misc{decrop2024rest,
title = {{You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations}},
author = {Decrop, Alix and Devroey, Xavier and Papadakis, Mike and Schobbens, Pierre‐Yves and Perrouin, Gilles},
howpublished = {arXiv (Cornell University)},
year = {2024},
doi = {10.48550/arxiv.2402.05102},
url = {https://doi.org/10.48550/arxiv.2402.05102}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 2 | |
| 2025 | 9 | |
| 2026 | 17 |
Topic and keywords
Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- large language models
- OpenAPI
- black-box testing
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Decrop, A., Devroey, X., Papadakis, M., Schobbens, P., & Perrouin, G. (2024). You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102
How many times has this paper been cited?
28 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Alix Decrop, Xavier Devroey, Mike Papadakis, Pierre‐Yves Schobbens, Gilles Perrouin.
What is the DOI of this paper?
10.48550/arxiv.2402.05102, permanently at https://doi.org/10.48550/arxiv.2402.05102. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.