Journal article · 2016 · Open access
Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance
Journal of Cheminformatics, 8(1), 56 · Published 17 October 2016 · DOI 10.1186/s13321-016-0167-x
In brief
“Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance” is a 2016 journal article by Ludovic Chaput and 3 co-authors, published in Journal of Cheminformatics. OpenAlex counts 122 citations as of 15 November 2026, which puts it in the top 2% of works published in 2016 by citations. It is open access under a CC BY licence: the full text is free to read at Journal of Cheminformatics.
- Citations
- 122
- Most cited in
- 2020 (20)
- Field-weighted impact
- 3.86
- References
- 36
- Authors
- 4
Abstract
BACKGROUND: In a structure-based virtual screening, the choice of the docking program is essential for the success of a hit identification. Benchmarks are meant to help in guiding this choice, especially when undertaken on a large variety of protein targets. Here, the performance of four popular virtual screening programs, Gold, Glide, Surflex and FlexX, is compared using the Directory of Useful Decoys-Enhanced database (DUD-E), which includes 102 targets with an average of 224 ligands per target and 50 decoys per ligand, generated to avoid biases in the benchmarking. Then, a relationship between these program performances and the properties of the targets or the small molecules was investigated. RESULTS: The comparison was based on two metrics, with three different parameters each. The BEDROC scores with α = 80.5, indicated that, on the overall database, Glide succeeded (score > 0.5) for 30 targets, Gold for 27, FlexX for 14 and Surflex for 11. The performance did not depend on the hydrophobicity nor the openness of the protein cavities, neither on the families to which the proteins belong. However, despite the care in the construction of the DUD-E database, the small differences that remain between the actives and the decoys likely explain the successes of Gold, Surflex and FlexX. Moreover, the similarity between the actives of a target and its crystal structure ligand seems to be at the basis of the good performance of Glide. When all targets with significant biases are removed from the benchmarking, a subset of 47 targets remains, for which Glide succeeded for only 5 targets, Gold for 4 and FlexX and Surflex for 2. CONCLUSION: The performance dramatic drop of all four programs when the biases are removed shows that we should beware of virtual screening benchmarks, because good performances may be due to wrong reasons. Therefore, benchmarking would hardly provide guidelines for virtual screening experiments, despite the tendency that is maintained, i.e., Glide and Gold display better performance than FlexX and Surflex. We recommend to always use several programs and combine their results. Graphical AbstractSummary of the results obtained by virtual screening with the four programs, Glide, Gold, Surflex and FlexX, on the 102 targets of the DUD-E database. The percentage of targets with successful results, i.e., with BDEROC(α = 80.5) > 0.5, when the entire database is considered are in Blue, and when targets with biased chemical libraries are removed are in Red.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Chaput, L., Martinez‐Sanz, J., Saettel, N., & Mouawad, L. (2016). Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance. Journal of Cheminformatics, 8(1), 56. https://doi.org/10.1186/s13321-016-0167-x
MLA 9
Chaput, Ludovic, et al. “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance.” Journal of Cheminformatics, vol. 8, no. 1, 2016, p. 56. https://doi.org/10.1186/s13321-016-0167-x.
Chicago
Chaput, Ludovic, Juan Martinez‐Sanz, Nicolas Saettel, and Liliane Mouawad. 2016. “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance.” Journal of Cheminformatics 8 (1): 56. https://doi.org/10.1186/s13321-016-0167-x.
Harvard
Chaput, L. et al. (2016) ‘Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance’, Journal of Cheminformatics, 8(1), p. 56. doi:10.1186/s13321-016-0167-x.
IEEE
L. Chaput, J. Martinez‐Sanz, N. Saettel, and L. Mouawad, “Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance,” Journal of Cheminformatics, vol. 8, no. 1, p. 56, 2016, doi: 10.1186/s13321-016-0167-x.
BibTeX
@article{chaput2016benchmark,
title = {{Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance}},
author = {Chaput, Ludovic and Martinez‐Sanz, Juan and Saettel, Nicolas and Mouawad, Liliane},
journal = {Journal of Cheminformatics},
year = {2016},
volume = {8},
number = {1},
pages = {56},
doi = {10.1186/s13321-016-0167-x},
url = {https://doi.org/10.1186/s13321-016-0167-x}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 6 | |
| 2018 | 11 | |
| 2019 | 9 | |
| 2020 | 20 | |
| 2021 | 14 | |
| 2022 | 15 | |
| 2023 | 9 | |
| 2024 | 15 | |
| 2025 | 10 | |
| 2026 | 13 |
Its field-weighted citation impact is 3.86: it has been cited 3.86 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- structure-based virtual screening
- DUD-E
- glides
- gold
- FlexX
- benchmark bias
- protein-ligand docking
- hit identification
Work with this paper
Most-cited papers in Pharmacology, Toxicology and Pharmaceutics
- AutoDock Vina: Improving the speed and accuracy of docking with a new scoring function, efficient optimization, and multithreadingOleg Trott, Arthur J. Olson · Journal of Computational Chemistry · 2009 · 39,860 citations
- AutoDock4 and AutoDockTools4: Automated docking with selective receptor flexibilityGarrett M. Morris, Ruth Huey, William Lindstrom and 4 more · Journal of Computational Chemistry · 2009 · 26,508 citations
- Development and testing of a general amber force fieldJunmei Wang, Romain M. Wolf, James W. Caldwell and 2 more · Journal of Computational Chemistry · 2004 · 20,080 citations
- Experimental and computational approaches to estimate solubility and permeability in drug discovery and development settings 1PII of original article: S0169-409X(96)00423-1. The article was originally published in Advanced Drug Delivery Reviews 23 (1997) 3–25. 1Christopher A. Lipinski, Franco Lombardo, Beryl W. Dominy and 1 more · Advanced Drug Delivery Reviews · 2001 · 19,638 citations
- SwissADME: a free web tool to evaluate pharmacokinetics, drug-likeness and medicinal chemistry friendliness of small moleculesAntoine Daina, Olivier Alain Michielin, Vincent Zoete · Scientific Reports · 2017 · 19,557 citations
All highly cited Pharmacology, Toxicology and Pharmaceutics papers
Questions about this paper
How do I cite this paper in APA style?
Chaput, L., Martinez‐Sanz, J., Saettel, N., & Mouawad, L. (2016). Benchmark of four popular virtual screening programs: construction of the active/decoy dataset remains a major determinant of measured performance. Journal of Cheminformatics, 8(1), 56. https://doi.org/10.1186/s13321-016-0167-x
How many times has this paper been cited?
122 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Journal of Cheminformatics.
Who wrote this paper?
Ludovic Chaput, Juan Martinez‐Sanz, Nicolas Saettel, Liliane Mouawad.
What is the DOI of this paper?
10.1186/s13321-016-0167-x. The permanent link is https://doi.org/10.1186/s13321-016-0167-x.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.