Conference paper · 2026 · Open access
MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs
IEEE International Conference on Artificial Intelligence Testing (AITest), 235–248 · Published 1 July 2026 · DOI 10.1109/aitest70988.2026.00043
In brief
“MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs” is a 2026 conference paper by Xiaoke Han and Hong Zhu, published in IEEE International Conference on Artificial Intelligence Testing (AITest). OpenAlex counts 3 citations as of 19 November 2026, which puts it in the top 4% of works published in 2026 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 3
- Most cited in
- 2026 (3)
- Field-weighted impact
- 4.07
- References
- 31
- Authors
- 2
Abstract
Testing RESTful API is increasingly complicated but indispensable to quality assurance of cloud-native applications. This paper reports a multi-agent system called MASTEST that combines LLM-based intelligent agents and programmed agents to automate REST API testing. They form a complete tool chain covering the whole workflow of REST API test with API specification in the OpenAPI Swagger format as the input. It also incorporates human testers in the process to review and correct LLM generated test artefacts to control the quality of testing activities. MASTEST is evaluated on two LLMs, GPT-4o and DeepSeek V3.1 Reasoner with five public APIs. Its performances on various testing activities are measured by a wide range of metrics, including adequacy and coverage metrics, the syntax and data type correctness of generated test scripts, the usability of LLM generated test cases and scripts, as well as the bug detection ability. Experiment results demonstrated that both DeepSeek and GPT-4o achieved a high overall performance but had strengths and weaknesses on different testing activities. MASTEST generated test cases achieved 94% and 98% unit test coverage and 79% and 78% system test coverage for GPT-4o and DeepSeek respectively in comparison with human designed test cases. The generated test scripts maintained 100% syntax correctness and only required minimal manual edits for semantic correctness. The generated test scripts contain assertions on the expected status code as well as contents in the response messages. They are highly capable of detecting bugs in the REST APIs. Experiment data shows that the bug detection rates are between 2.13 to 4.50 per operation. These findings indicate that MASTEST is highly efficient and effective.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Han, X., & Zhu, H. (2026). MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs. IEEE International Conference on Artificial Intelligence Testing (AITest), 235–248. https://doi.org/10.1109/aitest70988.2026.00043
MLA 9
Han, Xiaoke, and Hong Zhu. “MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs.” IEEE International Conference on Artificial Intelligence Testing (AITest), 2026, pp. 235–248. https://doi.org/10.1109/aitest70988.2026.00043.
Chicago
Han, Xiaoke and Hong Zhu. 2026. “MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs.” IEEE International Conference on Artificial Intelligence Testing (AITest): 235–248. https://doi.org/10.1109/aitest70988.2026.00043.
Harvard
Han, X. and Zhu, H. (2026) ‘MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs’, IEEE International Conference on Artificial Intelligence Testing (AITest), pp. 235–248. doi:10.1109/aitest70988.2026.00043.
IEEE
X. Han and H. Zhu, “MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs,” IEEE International Conference on Artificial Intelligence Testing (AITest), pp. 235–248, 2026, doi: 10.1109/aitest70988.2026.00043.
BibTeX
@inproceedings{han2026mastest,
title = {{MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs}},
author = {Han, Xiaoke and Zhu, Hong},
booktitle = {IEEE International Conference on Artificial Intelligence Testing (AITest)},
year = {2026},
pages = {235--248},
doi = {10.1109/aitest70988.2026.00043},
url = {https://doi.org/10.1109/aitest70988.2026.00043}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- REST API testing
- LLM agents
- multi-agent systems
- test automation
- GPT-4o
- DeepSeek
- test case generation
- test script generation
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Han, X., & Zhu, H. (2026). MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs. IEEE International Conference on Artificial Intelligence Testing (AITest), 235–248. https://doi.org/10.1109/aitest70988.2026.00043
How many times has this paper been cited?
3 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Xiaoke Han, Hong Zhu.
What is the DOI of this paper?
10.1109/aitest70988.2026.00043, permanently at https://doi.org/10.1109/aitest70988.2026.00043. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.