Journal article · 2026 · Open access
Mutation-Guided Unit Test Generation With a Large Language Model
IEEE Transactions on Software Engineering, 52(5), 1657–1671 · Published 10 April 2026 · DOI 10.1109/tse.2026.3682975
In brief
“Mutation-Guided Unit Test Generation With a Large Language Model” is a 2026 journal article by Guancheng Wang and 3 co-authors, published in IEEE Transactions on Software Engineering. OpenAlex counts 30 citations as of 17 November 2026, which puts it in the top 1% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 30
- Most cited in
- 2026 (30)
- Field-weighted impact
- 87.68
- References
- 77
- Authors
- 4
Abstract
Unit tests play a vital role in uncovering potential faults in software. While tools like EvoSuite focus on maximizing code coverage, recent advances in large language models (LLMs) have shifted attention toward LLM-based test generation. However, code coverage metrics—such as line and branch coverage—remain overly emphasized in reported research, despite being weak indicators of a test suite’s fault-detection capability. In contrast,mutation scoreoffers a more reliable and stringent measure, as demonstrated in our findings where some test suites achieve 100% coverage but only 4% mutation score. Although a few studies consider mutation score, the effectiveness of LLMs in killing mutants remains underexplored.In this paper, we propose MUTGEN, a mutation-guided, LLM-based test generation approach that incorporates mutation feedback directly into the prompt. Evaluated on 204 subjects from two benchmarks, MUTGEN significantly outperforms both EvoSuite and vanilla prompt-based strategies in terms of mutation score. Furthermore, MUTGEN introduces an iterative generation mechanism that pushes the limits of LLMs in killing additional mutants. Our study also provides insights into the limitations of LLM-based generation, analyzing the reasons for live and uncovered mutants, and the impact of different mutation operators on generation effectiveness.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wang, G., Xu, Q., Briand, L., & Liu, K. (2026). Mutation-Guided Unit Test Generation With a Large Language Model. IEEE Transactions on Software Engineering, 52(5), 1657–1671. https://doi.org/10.1109/tse.2026.3682975
MLA 9
Wang, Guancheng, et al. “Mutation-Guided Unit Test Generation With a Large Language Model.” IEEE Transactions on Software Engineering, vol. 52, no. 5, 2026, pp. 1657–1671. https://doi.org/10.1109/tse.2026.3682975.
Chicago
Wang, Guancheng, Qinghua Xu, Lionel Briand, and Kui Liu. 2026. “Mutation-Guided Unit Test Generation With a Large Language Model.” IEEE Transactions on Software Engineering 52 (5): 1657–1671. https://doi.org/10.1109/tse.2026.3682975.
Harvard
Wang, G. et al. (2026) ‘Mutation-Guided Unit Test Generation With a Large Language Model’, IEEE Transactions on Software Engineering, 52(5), pp. 1657–1671. doi:10.1109/tse.2026.3682975.
IEEE
G. Wang, Q. Xu, L. Briand, and K. Liu, “Mutation-Guided Unit Test Generation With a Large Language Model,” IEEE Transactions on Software Engineering, vol. 52, no. 5, pp. 1657–1671, 2026, doi: 10.1109/tse.2026.3682975.
BibTeX
@article{wang2026mutation,
title = {{Mutation-Guided Unit Test Generation With a Large Language Model}},
author = {Wang, Guancheng and Xu, Qinghua and Briand, Lionel and Liu, Kui},
journal = {IEEE Transactions on Software Engineering},
year = {2026},
volume = {52},
number = {5},
pages = {1657--1671},
doi = {10.1109/tse.2026.3682975},
url = {https://doi.org/10.1109/tse.2026.3682975}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- unit test generation
- mutation testing
- mutation score
- large language models
- LLM-based test generation
- EvoSuite
- mutation operator
- code coverage
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wang, G., Xu, Q., Briand, L., & Liu, K. (2026). Mutation-Guided Unit Test Generation With a Large Language Model. IEEE Transactions on Software Engineering, 52(5), 1657–1671. https://doi.org/10.1109/tse.2026.3682975
How many times has this paper been cited?
30 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Guancheng Wang, Qinghua Xu, Lionel Briand, Kui Liu.
What is the DOI of this paper?
10.1109/tse.2026.3682975, permanently at https://doi.org/10.1109/tse.2026.3682975. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.