Journal article · 2016 · Open access

Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance

Ludovic Chaput, Juan Martinez‐Sanz, Nicolas Saettel, Liliane Mouawad

Journal of Cheminformatics, 8(1), 56 · Published 17 October 2016 · DOI 10.1186/s13321-016-0167-x

Free PDFView at the publisherCite this paper

In brief

“Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance” is a 2016 journal article by Ludovic Chaput and 3 co-authors, published in Journal of Cheminformatics. OpenAlex counts 122 citations as of 15 November 2026, which puts it in the top 2% of works published in 2016 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Cheminformatics.

Citations
122
Most cited in
2020 (20)
Field-weighted impact
3.86
References
36
Authors
4

Abstract

BACKGROUND: In a structure-based virtual screening, the choice of the docking program is essential for the success of a hit identification. Benchmarks are meant to help in guiding this choice, especially when undertaken on a large variety of protein targets. Here, the performance of four popular virtual screening programs, Gold, Glide, Surflex and FlexX, is compared using the Directory of Useful Decoys-Enhanced database (DUD-E), which includes 102 targets with an average of 224 ligands per target and 50 decoys per ligand, generated to avoid biases in the benchmarking. Then, a relationship between these program performances and the properties of the targets or the small molecules was investigated. RESULTS: The comparison was based on two metrics, with three different parameters each. The BEDROC scores with α = 80.5, indicated that, on the overall database, Glide succeeded (score > 0.5) for 30 targets, Gold for 27, FlexX for 14 and Surflex for 11. The performance did not depend on the hydrophobicity nor the openness of the protein cavities, neither on the families to which the proteins belong. However, despite the care in the construction of the DUD-E database, the small differences that remain between the actives and the decoys likely explain the successes of Gold, Surflex and FlexX. Moreover, the similarity between the actives of a target and its crystal structure ligand seems to be at the basis of the good performance of Glide. When all targets with significant biases are removed from the benchmarking, a subset of 47 targets remains, for which Glide succeeded for only 5 targets, Gold for 4 and FlexX and Surflex for 2. CONCLUSION: The performance dramatic drop of all four programs when the biases are removed shows that we should beware of virtual screening benchmarks, because good performances may be due to wrong reasons. Therefore, benchmarking would hardly provide guidelines for virtual screening experiments, despite the tendency that is maintained, i.e., Glide and Gold display better performance than FlexX and Surflex. We recommend to always use several programs and combine their results. Graphical AbstractSummary of the results obtained by virtual screening with the four programs, Glide, Gold, Surflex and FlexX, on the 102 targets of the DUD-E database. The percentage of targets with successful results, i.e., with BDEROC(α = 80.5) > 0.5, when the entire database is considered are in Blue, and when targets with biased chemical libraries are removed are in Red.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Chaput, L., Martinez‐Sanz, J., Saettel, N., & Mouawad, L. (2016). Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance. Journal of Cheminformatics, 8(1), 56. https://doi.org/10.1186/s13321-016-0167-x

MLA 9

Chaput, Ludovic, et al. “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance.” Journal of Cheminformatics, vol. 8, no. 1, 2016, p. 56. https://doi.org/10.1186/s13321-016-0167-x.

Chicago

Chaput, Ludovic, Juan Martinez‐Sanz, Nicolas Saettel, and Liliane Mouawad. 2016. “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance.” Journal of Cheminformatics 8 (1): 56. https://doi.org/10.1186/s13321-016-0167-x.

Harvard

Chaput, L. et al. (2016) ‘Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance’, Journal of Cheminformatics, 8(1), p. 56. doi:10.1186/s13321-016-0167-x.

IEEE

L. Chaput, J. Martinez‐Sanz, N. Saettel, and L. Mouawad, “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance,” Journal of Cheminformatics, vol. 8, no. 1, p. 56, 2016, doi: 10.1186/s13321-016-0167-x.

BibTeX

@article{chaput2016benchmark,
  title     = {{Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance}},
  author    = {Chaput, Ludovic and Martinez‐Sanz, Juan and Saettel, Nicolas and Mouawad, Liliane},
  journal   = {Journal of Cheminformatics},
  year      = {2016},
  volume    = {8},
  number    = {1},
  pages     = {56},
  doi       = {10.1186/s13321-016-0167-x},
  url       = {https://doi.org/10.1186/s13321-016-0167-x}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201766
20181111
201999
20202020
20211414
20221515
202399
20241515
20251010
20261313

Its field-weighted citation impact is 3.86: it has been cited 3.86 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods

  • structure-based virtual screening
  • DUD-E
  • glides
  • gold
  • FlexX
  • benchmark bias
  • protein-ligand docking
  • hit identification

Work with this paper

Most-cited papers in Pharmacology, Toxicology and Pharmaceutics

All highly cited Pharmacology, Toxicology and Pharmaceutics papers

Questions about this paper

How do I cite this paper in APA style?

Chaput, L., Martinez‐Sanz, J., Saettel, N., & Mouawad, L. (2016). Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance. Journal of Cheminformatics, 8(1), 56. https://doi.org/10.1186/s13321-016-0167-x

How many times has this paper been cited?

122 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Journal of Cheminformatics.

Who wrote this paper?

Ludovic Chaput, Juan Martinez‐Sanz, Nicolas Saettel, Liliane Mouawad.

What is the DOI of this paper?

10.1186/s13321-016-0167-x. The permanent link is https://doi.org/10.1186/s13321-016-0167-x.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.