Journal article · 2026 · Open access
Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure
European Heart Journal - Digital Health, 7(Supplement_1) · Published 1 January 2026 · DOI 10.1093/ehjdh/ztaf143.012
In brief
“Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure” is a 2026 journal article by Sotiris Christoforou and 7 co-authors, published in European Heart Journal - Digital Health. OpenAlex counts 0 citations as of 18 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at European Heart Journal - Digital Health.
- Citations
- 0
- Authors
- 8
Abstract
Background Data extraction is a critical and time-intensive step in conducting systematic reviews and meta-analyses. As the volume of published biomedical literature increases, the integration of artificial intelligence (AI) tools, particularly large language models (LLMs), has emerged as a potential solution to accelerate this process. However, their reliability and accuracy in extracting complex data from clinical studies remain largely untested. Purpose This study aimed to evaluate the accuracy, quality, and time efficiency of three LLMs-ChatGPT, DeepSeek, and LeChat-in extracting key data from eligible studies for a systematic review and meta-analysis assessing the effects of glucagon-like peptide-1 receptor agonists in patients with heart failure. Methods A set of 25 studies previously deemed eligible for inclusion in the meta-analysis of this systematic review were used during our evaluation. The three LLMs were prompted to extract data from each article using only publicly available information from the web. An extraction was considered accurate if the model extracted one correct baseline characteristic and one correct result that matched human investigator-selected data. Additionally, the time taken per data extraction task was recorded for each model. Results ChatGPT successfully extracted valid data from 10 studies. Of those, 90% were precisely correct, and 10% were partially correct, meaning that one valid element was captured while another was missing or incorrect. DeepSeek extracted data from only 1 study, which was incorrect. LeChat extracted data from 20 studies; however, only 30% of its extractions were fully correct, 40% partially correct, and 30% incorrect. Regarding time efficiency, ChatGPT required an average of 17.87 seconds per extraction, DeepSeek 30.20 seconds, and LeChat 17.63 seconds. Conclusions This study highlights the potential of AI language models to expedite data extraction in a systematic review and meta-analysis by automating data extraction tasks. While LeChat demonstrated a higher extraction rate, its data quality was inconsistent. ChatGPT provided a more balanced performance, offering reliable accuracy and speed. These findings suggest that although AI tools can significantly reduce the time burden of data extraction, human oversight remains essential to ensure data validity. Further model optimization may enhance the future role and applicability of AI in biomedical research.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Christoforou, S., Kounnafi, M., Ioannou, K. I., Christophides, T., Figlioli, G., Piovani, D., Bonovas, S., & Nikolopoulos, G. K. (2026). Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure. European Heart Journal - Digital Health, 7(Supplement_1). https://doi.org/10.1093/ehjdh/ztaf143.012
MLA 9
Christoforou, Sotiris, et al. “Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure.” European Heart Journal - Digital Health, vol. 7, no. Supplement_1, 2026. https://doi.org/10.1093/ehjdh/ztaf143.012.
Chicago
Christoforou, Sotiris, Maria Kounnafi, Kyriakos I. Ioannou, Theodoros Christophides, Gisella Figlioli, Daniele Piovani, S Bonovas, and Georgios K. Nikolopoulos. 2026. “Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure.” European Heart Journal - Digital Health 7 (Supplement_1). https://doi.org/10.1093/ehjdh/ztaf143.012.
Harvard
Christoforou, S. et al. (2026) ‘Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure’, European Heart Journal - Digital Health, 7(Supplement_1). doi:10.1093/ehjdh/ztaf143.012.
IEEE
S. Christoforou et al., “Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure,” European Heart Journal - Digital Health, vol. 7, no. Supplement_1, 2026, doi: 10.1093/ehjdh/ztaf143.012.
BibTeX
@article{christoforou2026assessing,
title = {{Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure}},
author = {Christoforou, Sotiris and Kounnafi, Maria and Ioannou, Kyriakos I. and Christophides, Theodoros and Figlioli, Gisella and Piovani, Daniele and Bonovas, S and Nikolopoulos, Georgios K.},
journal = {European Heart Journal - Digital Health},
year = {2026},
volume = {7},
number = {Supplement_1},
doi = {10.1093/ehjdh/ztaf143.012},
url = {https://doi.org/10.1093/ehjdh/ztaf143.012}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- large language models
- automated data extraction
- ChatGPT
- DeepSeek
- GLP-1 receptor agonists
- heart failure
- systematic reviews
- meta-analysis
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Christoforou, S., Kounnafi, M., Ioannou, K. I., Christophides, T., Figlioli, G., Piovani, D., Bonovas, S., & Nikolopoulos, G. K. (2026). Assessing the efficacy of large language models in data extraction for a meta-analysis on the role of glucagon-like peptide-1 receptor agonists in heart failure. European Heart Journal - Digital Health, 7(Supplement_1). https://doi.org/10.1093/ehjdh/ztaf143.012
How many times has this paper been cited?
0 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at European Heart Journal - Digital Health: sign in and open the full text from this page.
Who wrote this paper?
Sotiris Christoforou, Maria Kounnafi, Kyriakos I. Ioannou, Theodoros Christophides, Gisella Figlioli, Daniele Piovani, S Bonovas, Georgios K. Nikolopoulos.
What is the DOI of this paper?
10.1093/ehjdh/ztaf143.012, permanently at https://doi.org/10.1093/ehjdh/ztaf143.012. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.