Preprint · 2024 · Open access

You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations

Alix Decrop, Xavier Devroey, Mike Papadakis, Pierre‐Yves Schobbens, Gilles Perrouin

arXiv (Cornell University) · Published 7 February 2024 · DOI 10.48550/arxiv.2402.05102

Open PDFView at the publisherCite this paper

In brief

“You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations” is a 2024 preprint by Alix Decrop and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 28 citations as of 19 November 2026. It is open access under a CC BY-SA licence: the full text is free to read at arXiv (Cornell University).

Citations
28
Most cited in
2026 (17)
References
64
Authors
5

Abstract

REST APIs are prevalent among web service implementations, easing interoperability through the HTTP protocol. API testers and users exploit the widely adopted OpenAPI Specification (OAS), a machine-readable standard to document REST APIs. However, documenting APIs is a time-consuming and error-prone task, and existing documentation is not always complete, publicly accessible, or up-to-date. This situation limits the efficiency of testing tools and hinders human comprehension. Large Language Models (LLMs) offer the potential to automatically infer API documentation, using their colossal training data. In this paper, we present RESTSpecIT, the first automated approach that infers documentation and performs black-box testing of REST APIs by leveraging LLMs. Our approach requires minimal user input compared to state-of-the-art tools; Given an API name and an LLM access key, RESTSpecIT generates API request seeds and mutates them with data returned by the LLM. The tool then analyzes API responses for documentation inference and testing purposes. RESTSpecIT utilizes an in-context prompt masking strategy, requiring no prior model fine-tuning. We evaluate the quality of our tool with three state-of-the-art LLMs: DeepSeek V3, GPT-4.1, and GPT-3.5. Our evaluation demonstrates that RESTSpecIT can (1) infer documentation with 88.62% of routes and 89.25% of query parameters found on average, (2) discover undocumented API data, (3) operate efficiently (in terms of model costs, requests sent, runtime), and (4) assist REST API testing by uncovering server errors and generating valid OpenAPI Specification inputs for testing tools.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Decrop, A., Devroey, X., Papadakis, M., Schobbens, P., & Perrouin, G. (2024). You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102

MLA 9

Decrop, Alix, et al. “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2402.05102.

Chicago

Decrop, Alix, Xavier Devroey, Mike Papadakis, Pierre‐Yves Schobbens, and Gilles Perrouin. 2024. “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102.

Harvard

Decrop, A. et al. (2024) ‘You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations’, arXiv (Cornell University). doi:10.48550/arxiv.2402.05102.

IEEE

A. Decrop, X. Devroey, M. Papadakis, P. Schobbens, and G. Perrouin, “You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2402.05102.

BibTeX

@misc{decrop2024rest,
  title     = {{You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations}},
  author    = {Decrop, Alix and Devroey, Xavier and Papadakis, Mike and Schobbens, Pierre‐Yves and Perrouin, Gilles},
  howpublished = {arXiv (Cornell University)},
  year      = {2024},
  doi       = {10.48550/arxiv.2402.05102},
  url       = {https://doi.org/10.48550/arxiv.2402.05102}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202422
202599
20261717

Topic and keywords

Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques

  • large language models
  • OpenAPI
  • black-box testing

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Decrop, A., Devroey, X., Papadakis, M., Schobbens, P., & Perrouin, G. (2024). You Can REST Now: Automated REST API Documentation and Testing via LLM-Assisted Request Mutations. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2402.05102

How many times has this paper been cited?

28 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Alix Decrop, Xavier Devroey, Mike Papadakis, Pierre‐Yves Schobbens, Gilles Perrouin.

What is the DOI of this paper?

10.48550/arxiv.2402.05102, permanently at https://doi.org/10.48550/arxiv.2402.05102. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.