Review article · 2025 · Open access
Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences
JAMA Network Open, 8(6), e2515160 · Published 12 June 2025 · DOI 10.1001/jamanetworkopen.2025.15160
In brief
“Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences” is a 2025 review article by Gengyan Tang and Hao Cai, published in JAMA Network Open. OpenAlex counts 37 citations as of 18 November 2026, which puts it in the top 2% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at JAMA Network Open.
- Citations
- 37
- Most cited in
- 2026 (30)
- Field-weighted impact
- 3.48
- References
- 52
- Authors
- 2
Abstract
Importance: Systematic reviews are the criterion standard for evidence synthesis in the life sciences, yet their reliability and integrity are threatened by citation contamination from fabricated publications produced by paper mills. Despite growing awareness, the extent and implications of this issue remain unclear. Objectives: To analyze the prevalence, characteristics, affected subject areas, and citation patterns of retracted paper mill articles cited in systematic reviews. Design, Setting, and Participants: This cross-sectional study analyzed systematic reviews published between 2013 and 2024, indexed in Web of Science (WoS). References were matched against the Retraction Watch dataset, and full texts were reviewed to identify retracted paper mill articles incorporated into the evidence synthesis. Main Outcomes and Measures: The study assessed (1) contamination prevalence, defined as the proportion of systematic reviews incorporating retracted paper mill articles into the evidence synthesis; (2) geographic distribution of citing authors according to institutional affiliations; (3) citation timing and trends, including the time lag between incorporation and article retraction; (4) affected research areas, categorized by WoS subject classifications; and (5) citation patterns, including highly contaminated reviews (≥3 incorporations of retracted articles). Results: Of the total of 200 000 systematic reviews, 299 incorporated at least 1 retracted paper mill article into the evidence synthesis (contamination rate, 0.15%). Among them, 256 (85.6%) included a single retracted article, and 43 (14.4%) included multiple such articles. Of 1802 author affiliations associated with the contaminated reviews, 660 (36.6%) were from institutions in China. Of 385 total citations, 124 (32.2%) occurred after retraction, including 13 occurring more than 500 days after the retraction date. Oncology was the most affected field (48 of 299 [16.1%]). Five reviews each included 5 or more retracted articles, all published in journals under questionable publishers. Conclusions and Relevance: In this cross-sectional study of life sciences systematic reviews, contamination remained low but increased over time, posing a risk to research integrity. Continued citation of retracted articles, even after retraction, highlights the need for rigorous screening practices. Correcting contaminated reviews and developing automated detection tools are essential to preserving the credibility of systematic reviews.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Tang, G., & Cai, H. (2025). Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences. JAMA Network Open, 8(6), e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160
MLA 9
Tang, Gengyan, and Hao Cai. “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences.” JAMA Network Open, vol. 8, no. 6, 2025, p. e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160.
Chicago
Tang, Gengyan and Hao Cai. 2025. “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences.” JAMA Network Open 8 (6): e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160.
Harvard
Tang, G. and Cai, H. (2025) ‘Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences’, JAMA Network Open, 8(6), p. e2515160. doi:10.1001/jamanetworkopen.2025.15160.
IEEE
G. Tang and H. Cai, “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences,” JAMA Network Open, vol. 8, no. 6, p. e2515160, 2025, doi: 10.1001/jamanetworkopen.2025.15160.
BibTeX
@article{tang2025citation,
title = {{Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences}},
author = {Tang, Gengyan and Cai, Hao},
journal = {JAMA Network Open},
year = {2025},
volume = {8},
number = {6},
pages = {e2515160},
doi = {10.1001/jamanetworkopen.2025.15160},
url = {https://doi.org/10.1001/jamanetworkopen.2025.15160}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Social Sciences › Education › Academic integrity and plagiarism
- paper mills
- retracted article
- systematic reviews
- research integrity
- evidence synthesis
- citation patterns
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Tang, G., & Cai, H. (2025). Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences. JAMA Network Open, 8(6), e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160
How many times has this paper been cited?
37 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at JAMA Network Open: sign in and open the PDF from this page.
Who wrote this paper?
Gengyan Tang, Hao Cai.
What is the DOI of this paper?
10.1001/jamanetworkopen.2025.15160, permanently at https://doi.org/10.1001/jamanetworkopen.2025.15160. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.