Review article · 2025 · Open access

Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research

Anam Purewal, Kalli J. Fautsch, Johana Klasová, Nasir Hussain, Ryan Steven D'Souza

Regional Anesthesia & Pain Medicine, 51(4), 437–442 · Published 16 February 2025 · DOI 10.1136/rapm-2024-106358

Open PDFView at the publisherCite this paper

In brief

“Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research” is a 2025 review article by Anam Purewal and 4 co-authors, published in Regional Anesthesia & Pain Medicine. OpenAlex counts 39 citations as of 18 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY-NC licence: the full text is free to read at Regional Anesthesia & Pain Medicine.

Citations
39
Most cited in
2026 (26)
Field-weighted impact
3.33
References
17
Authors
5

Abstract

Introduction Artificial intelligence (AI), particularly large-language models like Chat Generative Pre-Trained Transformer (ChatGPT), has demonstrated potential in streamlining research methodologies. Systematic reviews and meta-analyses, often considered the pinnacle of evidence-based medicine, are inherently time-intensive and demand meticulous planning, rigorous data extraction, thorough analysis, and careful synthesis. Despite promising applications of AI, its utility in conducting systematic reviews with meta-analysis remains unclear. This study evaluated ChatGPT’s accuracy in conducting key tasks of a systematic review with meta-analysis. Methods This validation study used data from a published meta-analysis on emotional functioning after spinal cord stimulation. ChatGPT-4o performed title/abstract screening, full-text study selection, and data pooling for this systematic review with meta-analysis. Comparisons were made against human-executed steps, which were considered the gold standard. Outcomes of interest included accuracy, sensitivity, specificity, positive predictive value, and negative predictive value for screening and full-text review tasks. We also assessed for discrepancies in pooled effect estimates and forest plot generation. Results For title and abstract screening, ChatGPT achieved an accuracy of 70.4%, sensitivity of 54.9%, and specificity of 80.1%. In the full-text screening phase, accuracy was 68.4%, sensitivity 75.6%, and specificity 66.8%. ChatGPT successfully pooled data for five forest plots, achieving 100% accuracy in calculating pooled mean differences, 95% CIs, and heterogeneity estimates ( I 2 score and tau-squared values) for most outcomes, with minor discrepancies in tau-squared values (range 0.01–0.05). Forest plots showed no significant discrepancies. Conclusion ChatGPT demonstrates modest to moderate accuracy in screening and study selection tasks, but performs well in data pooling and meta-analytic calculations. These findings underscore the potential of AI to augment systematic review methodologies, while also emphasizing the need for human oversight to ensure accuracy and integrity in research workflows.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Purewal, A., Fautsch, K. J., Klasová, J., Hussain, N., & D'Souza, R. S. (2025). Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research. Regional Anesthesia & Pain Medicine, 51(4), 437–442. https://doi.org/10.1136/rapm-2024-106358

MLA 9

Purewal, Anam, et al. “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research.” Regional Anesthesia & Pain Medicine, vol. 51, no. 4, 2025, pp. 437–442. https://doi.org/10.1136/rapm-2024-106358.

Chicago

Purewal, Anam, Kalli J. Fautsch, Johana Klasová, Nasir Hussain, and Ryan Steven D'Souza. 2025. “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research.” Regional Anesthesia & Pain Medicine 51 (4): 437–442. https://doi.org/10.1136/rapm-2024-106358.

Harvard

Purewal, A. et al. (2025) ‘Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research’, Regional Anesthesia & Pain Medicine, 51(4), pp. 437–442. doi:10.1136/rapm-2024-106358.

IEEE

A. Purewal, K. J. Fautsch, J. Klasová, N. Hussain, and R. S. D'Souza, “Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research,” Regional Anesthesia & Pain Medicine, vol. 51, no. 4, pp. 437–442, 2025, doi: 10.1136/rapm-2024-106358.

BibTeX

@article{purewal2025human,
  title     = {{Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research}},
  author    = {Purewal, Anam and Fautsch, Kalli J. and Klasová, Johana and Hussain, Nasir and D'Souza, Ryan Steven},
  journal   = {Regional Anesthesia \& Pain Medicine},
  year      = {2025},
  volume    = {51},
  number    = {4},
  pages     = {437--442},
  doi       = {10.1136/rapm-2024-106358},
  url       = {https://doi.org/10.1136/rapm-2024-106358}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • ChatGPT
  • large language models
  • artificial intelligence in research
  • systematic review methodology
  • meta-analysis
  • chronic pain
  • spinal cord stimulation
  • emotional functioning

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Purewal, A., Fautsch, K. J., Klasová, J., Hussain, N., & D'Souza, R. S. (2025). Human versus artificial intelligence: evaluating ChatGPT’s performance in conducting published systematic reviews with meta-analysis in chronic pain research. Regional Anesthesia & Pain Medicine, 51(4), 437–442. https://doi.org/10.1136/rapm-2024-106358

How many times has this paper been cited?

39 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Regional Anesthesia & Pain Medicine: sign in and open the PDF from this page.

Who wrote this paper?

Anam Purewal, Kalli J. Fautsch, Johana Klasová, Nasir Hussain, Ryan Steven D'Souza.

What is the DOI of this paper?

10.1136/rapm-2024-106358, permanently at https://doi.org/10.1136/rapm-2024-106358. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.