Journal article · 2022 · Open access
On the Cross-Validation Bias due to Unsupervised Preprocessing
Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502 · Published 14 June 2022 · DOI 10.1111/rssb.12537
In brief
“On the Cross-Validation Bias due to Unsupervised Preprocessing” is a 2022 journal article by Amit Moscovich and Saharon Rosset, published in Journal of the Royal Statistical Society Series B (Statistical Methodology). OpenAlex counts 69 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Journal of the Royal Statistical Society Series B (Statistical Methodology).
- Citations
- 69
- Most cited in
- 2026 (45)
- Field-weighted impact
- 1.26
- References
- 68
- Authors
- 2
Abstract
Cross-validation is the de facto standard for predictive model evaluation and selection. In proper use, it provides an unbiased estimate of a model's predictive performance. However, data sets often undergo various forms of data-dependent preprocessing, such as mean-centring, rescaling, dimensionality reduction and outlier removal. It is often believed that such preprocessing stages, if done in an unsupervised manner (that does not incorporate the class labels or response values) are generally safe to do prior to cross-validation. In this paper, we study three commonly practised preprocessing procedures prior to a regression analysis: (i) variance-based feature selection; (ii) grouping of rare categorical features; and (iii) feature rescaling. We demonstrate that unsupervised preprocessing can, in fact, introduce a substantial bias into cross-validation estimates and potentially hurt model selection. This bias may be either positive or negative and its exact magnitude depends on all the parameters of the problem in an intricate manner. Further research is needed to understand the real-world impact of this bias across different application domains, particularly when dealing with small sample sizes and high-dimensional data.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Moscovich, A., & Rosset, S. (2022). On the Cross-Validation Bias due to Unsupervised Preprocessing. Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502. https://doi.org/10.1111/rssb.12537
MLA 9
Moscovich, Amit, and Saharon Rosset. “On the Cross-Validation Bias due to Unsupervised Preprocessing.” Journal of the Royal Statistical Society Series B (Statistical Methodology), vol. 84, no. 4, 2022, pp. 1474–1502. https://doi.org/10.1111/rssb.12537.
Chicago
Moscovich, Amit and Saharon Rosset. 2022. “On the Cross-Validation Bias due to Unsupervised Preprocessing.” Journal of the Royal Statistical Society Series B (Statistical Methodology) 84 (4): 1474–1502. https://doi.org/10.1111/rssb.12537.
Harvard
Moscovich, A. and Rosset, S. (2022) ‘On the Cross-Validation Bias due to Unsupervised Preprocessing’, Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), pp. 1474–1502. doi:10.1111/rssb.12537.
IEEE
A. Moscovich and S. Rosset, “On the Cross-Validation Bias due to Unsupervised Preprocessing,” Journal of the Royal Statistical Society Series B (Statistical Methodology), vol. 84, no. 4, pp. 1474–1502, 2022, doi: 10.1111/rssb.12537.
BibTeX
@article{moscovich2022cross,
title = {{On the Cross-Validation Bias due to Unsupervised Preprocessing}},
author = {Moscovich, Amit and Rosset, Saharon},
journal = {Journal of the Royal Statistical Society Series B (Statistical Methodology)},
year = {2022},
volume = {84},
number = {4},
pages = {1474--1502},
doi = {10.1111/rssb.12537},
url = {https://doi.org/10.1111/rssb.12537}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 2 | |
| 2022 | 1 | |
| 2023 | 8 | |
| 2024 | 5 | |
| 2025 | 8 | |
| 2026 | 45 |
Its field-weighted citation impact is 1.26: it has been cited 1.26 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- model selection
- regression analysis
- high-dimensional data
- small sample size
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Moscovich, A., & Rosset, S. (2022). On the Cross-Validation Bias due to Unsupervised Preprocessing. Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502. https://doi.org/10.1111/rssb.12537
How many times has this paper been cited?
69 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Journal of the Royal Statistical Society Series B (Statistical Methodology): sign in and open the full text from this page.
Who wrote this paper?
Amit Moscovich, Saharon Rosset.
What is the DOI of this paper?
10.1111/rssb.12537, permanently at https://doi.org/10.1111/rssb.12537. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.