Review article · 2025 · Open access
Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research
Regional Anesthesia & Pain Medicine, 51(4), 437–442 · Published 16 February 2025 · DOI 10.1136/rapm-2024-106358
In brief
“Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research” is a 2025 review article by Anam Purewal and 4 co-authors, published in Regional Anesthesia & Pain Medicine. OpenAlex counts 39 citations as of 18 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Regional Anesthesia & Pain Medicine.
- Citations
- 39
- Most cited in
- 2026 (26)
- Field-weighted impact
- 3.33
- References
- 17
- Authors
- 5
Abstract
Introduction Artificial intelligence (AI), particularly large-language models like Chat Generative Pre-Trained Transformer (ChatGPT), has demonstrated potential in streamlining research methodologies. Systematic reviews and meta-analyses, often considered the pinnacle of evidence-based medicine, are inherently time-intensive and demand meticulous planning, rigorous data extraction, thorough analysis, and careful synthesis. Despite promising applications of AI, its utility in conducting systematic reviews with meta-analysis remains unclear. This study evaluated ChatGPT’s accuracy in conducting key tasks of a systematic review with meta-analysis. Methods This validation study used data from a published meta-analysis on emotional functioning after spinal cord stimulation. ChatGPT-4o performed title/abstract screening, full-text study selection, and data pooling for this systematic review with meta-analysis. Comparisons were made against human-executed steps, which were considered the gold standard. Outcomes of interest included accuracy, sensitivity, specificity, positive predictive value, and negative predictive value for screening and full-text review tasks. We also assessed for discrepancies in pooled effect estimates and forest plot generation. Results For title and abstract screening, ChatGPT achieved an accuracy of 70.4%, sensitivity of 54.9%, and specificity of 80.1%. In the full-text screening phase, accuracy was 68.4%, sensitivity 75.6%, and specificity 66.8%. ChatGPT successfully pooled data for five forest plots, achieving 100% accuracy in calculating pooled mean differences, 95% CIs, and heterogeneity estimates ( I 2 score and tau-squared values) for most outcomes, with minor discrepancies in tau-squared values (range 0.01–0.05). Forest plots showed no significant discrepancies. Conclusion ChatGPT demonstrates modest to moderate accuracy in screening and study selection tasks, but performs well in data pooling and meta-analytic calculations. These findings underscore the potential of AI to augment systematic review methodologies, while also emphasizing the need for human oversight to ensure accuracy and integrity in research workflows.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Purewal, A., Fautsch, K. J., Klasová, J., Hussain, N., & D'Souza, R. S. (2025). Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research. Regional Anesthesia & Pain Medicine, 51(4), 437–442. https://doi.org/10.1136/rapm-2024-106358
MLA 9
Purewal, Anam, et al. “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research.” Regional Anesthesia & Pain Medicine, vol. 51, no. 4, 2025, pp. 437–442. https://doi.org/10.1136/rapm-2024-106358.
Chicago
Purewal, Anam, Kalli J. Fautsch, Johana Klasová, Nasir Hussain, and Ryan Steven D'Souza. 2025. “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research.” Regional Anesthesia & Pain Medicine 51 (4): 437–442. https://doi.org/10.1136/rapm-2024-106358.
Harvard
Purewal, A. et al. (2025) ‘Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research’, Regional Anesthesia & Pain Medicine, 51(4), pp. 437–442. doi:10.1136/rapm-2024-106358.
IEEE
A. Purewal, K. J. Fautsch, J. Klasová, N. Hussain, and R. S. D'Souza, “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research,” Regional Anesthesia & Pain Medicine, vol. 51, no. 4, pp. 437–442, 2025, doi: 10.1136/rapm-2024-106358.
BibTeX
@article{purewal2025human,
title = {{Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research}},
author = {Purewal, Anam and Fautsch, Kalli J. and Klasová, Johana and Hussain, Nasir and D'Souza, Ryan Steven},
journal = {Regional Anesthesia \& Pain Medicine},
year = {2025},
volume = {51},
number = {4},
pages = {437--442},
doi = {10.1136/rapm-2024-106358},
url = {https://doi.org/10.1136/rapm-2024-106358}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- ChatGPT
- large language models
- artificial intelligence in research
- systematic review methodology
- meta-analysis
- chronic pain
- spinal cord stimulation
- emotional functioning
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Purewal, A., Fautsch, K. J., Klasová, J., Hussain, N., & D'Souza, R. S. (2025). Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research. Regional Anesthesia & Pain Medicine, 51(4), 437–442. https://doi.org/10.1136/rapm-2024-106358
How many times has this paper been cited?
39 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Regional Anesthesia & Pain Medicine: sign in and open the PDF from this page.
Who wrote this paper?
Anam Purewal, Kalli J. Fautsch, Johana Klasová, Nasir Hussain, Ryan Steven D'Souza.
What is the DOI of this paper?
10.1136/rapm-2024-106358, permanently at https://doi.org/10.1136/rapm-2024-106358. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.