Journal article · 1997 · Open access

Bias in meta-analysis detected by a simple, graphical test

Matthias Egger, George Davey Smith, Martin Schneider, C. Minder

BMJ, 315(7109), 629–634 · Published 13 September 1997 · DOI 10.1136/bmj.315.7109.629

Read the free full textView at the publisherCite this paper

In brief

“Bias in meta-analysis detected by a simple, graphical test” is a 1997 journal article by Matthias Egger and 3 co-authors, published in BMJ. OpenAlex counts 57,929 citations as of 15 November 2026, which puts it in the top 1% of works published in 1997 by citations. It is open access: the full text is free to read at PubMed Central.

Citations
57,929
Most cited in
2026 (4,804)
Field-weighted impact
63.93
References
89
Authors
4

Abstract

Objective: Funnel plots (plots of effect estimates against sample size) may be useful to detect bias in meta-analyses that were later contradicted by large trials. We examined whether a simple test of asymmetry of funnel plots predicts discordance of results when meta-analyses are compared to large trials, and we assessed the prevalence of bias in published meta-analyses. Design: Medline search to identify pairs consisting of a meta-analysis and a single large trial (concordance of results was assumed if effects were in the same direction and the meta-analytic estimate was within 30% of the trial); analysis of funnel plots from 37 meta-analyses identified from a hand search of four leading general medicine journals 1993-6 and 38 meta-analyses from the second 1996 issue of the Cochrane Database of Systematic Reviews . Main outcome measure: Degree of funnel plot asymmetry as measured by the intercept from regression of standard normal deviates against precision. Results: In the eight pairs of meta-analysis and large trial that were identified (five from cardiovascular medicine, one from diabetic medicine, one from geriatric medicine, one from perinatal medicine) there were four concordant and four discordant pairs. In all cases discordance was due to meta-analyses showing larger effects. Funnel plot asymmetry was present in three out of four discordant pairs but in none of concordant pairs. In 14 (38%) journal meta-analyses and 5 (13%) Cochrane reviews, funnel plot asymmetry indicated that there was bias. Conclusions: A simple analysis of funnel plots provides a useful test for the likely presence of bias in meta-analyses, but as the capacity to detect bias will be limited when meta-analyses are based on a limited number of small trials the results from such analyses should be treated with considerable caution. Key messages Systematic reviews of randomised trials are the best strategy for appraising evidence; however, the findings of some meta-analyses were later contradicted by large trials Funnel plots, plots of the trials' effect estimates against sample size, are skewed and asymmetrical in the presence of publication bias and other biases Funnel plot asymmetry, measured by regression analysis, predicts discordance of results when meta-analyses are compared with single large trials Funnel plot asymmetry was found in 38% of meta-analyses published in leading general medicine journals and in 13% of reviews from the Cochrane Database of Systematic Reviews Critical examination of systematic reviews for publication and related biases should be considered a routine procedure

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629

MLA 9

Egger, Matthias, et al. “Bias in meta-analysis detected by a simple, graphical test.” BMJ, vol. 315, no. 7109, 1997, pp. 629–634. https://doi.org/10.1136/bmj.315.7109.629.

Chicago

Egger, Matthias, George Davey Smith, Martin Schneider, and C. Minder. 1997. “Bias in meta-analysis detected by a simple, graphical test.” BMJ 315 (7109): 629–634. https://doi.org/10.1136/bmj.315.7109.629.

Harvard

Egger, M. et al. (1997) ‘Bias in meta-analysis detected by a simple, graphical test’, BMJ, 315(7109), pp. 629–634. doi:10.1136/bmj.315.7109.629.

IEEE

M. Egger, G. D. Smith, M. Schneider, and C. Minder, “Bias in meta-analysis detected by a simple, graphical test,” BMJ, vol. 315, no. 7109, pp. 629–634, 1997, doi: 10.1136/bmj.315.7109.629.

BibTeX

@article{egger1997bias,
  title     = {{Bias in meta-analysis detected by a simple, graphical test}},
  author    = {Egger, Matthias and Smith, George Davey and Schneider, Martin and Minder, C.},
  journal   = {BMJ},
  year      = {1997},
  volume    = {315},
  number    = {7109},
  pages     = {629--634},
  doi       = {10.1136/bmj.315.7109.629},
  url       = {https://doi.org/10.1136/bmj.315.7109.629}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20172,7432743
20182,8402840
20193,1493149
20203,8583858
20214,2924292
20224,3614361
20234,1184118
20244,6794679
20254,7094709
20264,8044804

Its field-weighted citation impact is 63.93: it has been cited 63.93 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews

  • meta-analysis bias
  • publication bias
  • funnel plot asymmetry
  • Cochrane Database of Systematic Reviews
  • systematic reviews
  • geriatrics
  • perinatal medicine
  • general medicine journals

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629

How many times has this paper been cited?

57,929 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at PubMed Central.

Who wrote this paper?

Matthias Egger, George Davey Smith, Martin Schneider, C. Minder.

What is the DOI of this paper?

10.1136/bmj.315.7109.629. The permanent link is https://doi.org/10.1136/bmj.315.7109.629.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.