Review article · 2025 · Open access

Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences

Gengyan Tang, Hao Cai

JAMA Network Open, 8(6), e2515160 · Published 12 June 2025 · DOI 10.1001/jamanetworkopen.2025.15160

Open PDFView at the publisherCite this paper

In brief

“Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences” is a 2025 review article by Gengyan Tang and Hao Cai, published in JAMA Network Open. OpenAlex counts 37 citations as of 18 November 2026, which puts it in the top 2% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at JAMA Network Open.

Citations
37
Most cited in
2026 (30)
Field-weighted impact
3.48
References
52
Authors
2

Abstract

Importance: Systematic reviews are the criterion standard for evidence synthesis in the life sciences, yet their reliability and integrity are threatened by citation contamination from fabricated publications produced by paper mills. Despite growing awareness, the extent and implications of this issue remain unclear. Objectives: To analyze the prevalence, characteristics, affected subject areas, and citation patterns of retracted paper mill articles cited in systematic reviews. Design, Setting, and Participants: This cross-sectional study analyzed systematic reviews published between 2013 and 2024, indexed in Web of Science (WoS). References were matched against the Retraction Watch dataset, and full texts were reviewed to identify retracted paper mill articles incorporated into the evidence synthesis. Main Outcomes and Measures: The study assessed (1) contamination prevalence, defined as the proportion of systematic reviews incorporating retracted paper mill articles into the evidence synthesis; (2) geographic distribution of citing authors according to institutional affiliations; (3) citation timing and trends, including the time lag between incorporation and article retraction; (4) affected research areas, categorized by WoS subject classifications; and (5) citation patterns, including highly contaminated reviews (≥3 incorporations of retracted articles). Results: Of the total of 200 000 systematic reviews, 299 incorporated at least 1 retracted paper mill article into the evidence synthesis (contamination rate, 0.15%). Among them, 256 (85.6%) included a single retracted article, and 43 (14.4%) included multiple such articles. Of 1802 author affiliations associated with the contaminated reviews, 660 (36.6%) were from institutions in China. Of 385 total citations, 124 (32.2%) occurred after retraction, including 13 occurring more than 500 days after the retraction date. Oncology was the most affected field (48 of 299 [16.1%]). Five reviews each included 5 or more retracted articles, all published in journals under questionable publishers. Conclusions and Relevance: In this cross-sectional study of life sciences systematic reviews, contamination remained low but increased over time, posing a risk to research integrity. Continued citation of retracted articles, even after retraction, highlights the need for rigorous screening practices. Correcting contaminated reviews and developing automated detection tools are essential to preserving the credibility of systematic reviews.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Tang, G., & Cai, H. (2025). Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences. JAMA Network Open, 8(6), e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160

MLA 9

Tang, Gengyan, and Hao Cai. “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences.” JAMA Network Open, vol. 8, no. 6, 2025, p. e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160.

Chicago

Tang, Gengyan and Hao Cai. 2025. “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences.” JAMA Network Open 8 (6): e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160.

Harvard

Tang, G. and Cai, H. (2025) ‘Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences’, JAMA Network Open, 8(6), p. e2515160. doi:10.1001/jamanetworkopen.2025.15160.

IEEE

G. Tang and H. Cai, “Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences,” JAMA Network Open, vol. 8, no. 6, p. e2515160, 2025, doi: 10.1001/jamanetworkopen.2025.15160.

BibTeX

@article{tang2025citation,
  title     = {{Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences}},
  author    = {Tang, Gengyan and Cai, Hao},
  journal   = {JAMA Network Open},
  year      = {2025},
  volume    = {8},
  number    = {6},
  pages     = {e2515160},
  doi       = {10.1001/jamanetworkopen.2025.15160},
  url       = {https://doi.org/10.1001/jamanetworkopen.2025.15160}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Social Sciences › Education › Academic integrity and plagiarism

  • paper mills
  • retracted article
  • systematic reviews
  • research integrity
  • evidence synthesis
  • citation patterns

Work with this paper

Most-cited papers in Social Sciences

All highly cited Social Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Tang, G., & Cai, H. (2025). Citation Contamination by Paper Mill Articles in Systematic Reviews of the Life Sciences. JAMA Network Open, 8(6), e2515160. https://doi.org/10.1001/jamanetworkopen.2025.15160

How many times has this paper been cited?

37 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at JAMA Network Open: sign in and open the PDF from this page.

Who wrote this paper?

Gengyan Tang, Hao Cai.

What is the DOI of this paper?

10.1001/jamanetworkopen.2025.15160, permanently at https://doi.org/10.1001/jamanetworkopen.2025.15160. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.