Journal article · 2022 · Open access

On the Cross-Validation Bias due to Unsupervised Preprocessing

Amit Moscovich, Saharon Rosset

Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502 · Published 14 June 2022 · DOI 10.1111/rssb.12537

Open full textCite this paper

In brief

“On the Cross-Validation Bias due to Unsupervised Preprocessing” is a 2022 journal article by Amit Moscovich and Saharon Rosset, published in Journal of the Royal Statistical Society Series B (Statistical Methodology). OpenAlex counts 69 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Journal of the Royal Statistical Society Series B (Statistical Methodology).

Citations
69
Most cited in
2026 (45)
Field-weighted impact
1.26
References
68
Authors
2

Abstract

Cross-validation is the de facto standard for predictive model evaluation and selection. In proper use, it provides an unbiased estimate of a model's predictive performance. However, data sets often undergo various forms of data-dependent preprocessing, such as mean-centring, rescaling, dimensionality reduction and outlier removal. It is often believed that such preprocessing stages, if done in an unsupervised manner (that does not incorporate the class labels or response values) are generally safe to do prior to cross-validation. In this paper, we study three commonly practised preprocessing procedures prior to a regression analysis: (i) variance-based feature selection; (ii) grouping of rare categorical features; and (iii) feature rescaling. We demonstrate that unsupervised preprocessing can, in fact, introduce a substantial bias into cross-validation estimates and potentially hurt model selection. This bias may be either positive or negative and its exact magnitude depends on all the parameters of the problem in an intricate manner. Further research is needed to understand the real-world impact of this bias across different application domains, particularly when dealing with small sample sizes and high-dimensional data.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Moscovich, A., & Rosset, S. (2022). On the Cross-Validation Bias due to Unsupervised Preprocessing. Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502. https://doi.org/10.1111/rssb.12537

MLA 9

Moscovich, Amit, and Saharon Rosset. “On the Cross-Validation Bias due to Unsupervised Preprocessing.” Journal of the Royal Statistical Society Series B (Statistical Methodology), vol. 84, no. 4, 2022, pp. 1474–1502. https://doi.org/10.1111/rssb.12537.

Chicago

Moscovich, Amit and Saharon Rosset. 2022. “On the Cross-Validation Bias due to Unsupervised Preprocessing.” Journal of the Royal Statistical Society Series B (Statistical Methodology) 84 (4): 1474–1502. https://doi.org/10.1111/rssb.12537.

Harvard

Moscovich, A. and Rosset, S. (2022) ‘On the Cross-Validation Bias due to Unsupervised Preprocessing’, Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), pp. 1474–1502. doi:10.1111/rssb.12537.

IEEE

A. Moscovich and S. Rosset, “On the Cross-Validation Bias due to Unsupervised Preprocessing,” Journal of the Royal Statistical Society Series B (Statistical Methodology), vol. 84, no. 4, pp. 1474–1502, 2022, doi: 10.1111/rssb.12537.

BibTeX

@article{moscovich2022cross,
  title     = {{On the Cross-Validation Bias due to Unsupervised Preprocessing}},
  author    = {Moscovich, Amit and Rosset, Saharon},
  journal   = {Journal of the Royal Statistical Society Series B (Statistical Methodology)},
  year      = {2022},
  volume    = {84},
  number    = {4},
  pages     = {1474--1502},
  doi       = {10.1111/rssb.12537},
  url       = {https://doi.org/10.1111/rssb.12537}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202122
202211
202388
202455
202588
20264545

Its field-weighted citation impact is 1.26: it has been cited 1.26 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • model selection
  • regression analysis
  • high-dimensional data
  • small sample size

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Moscovich, A., & Rosset, S. (2022). On the Cross-Validation Bias due to Unsupervised Preprocessing. Journal of the Royal Statistical Society Series B (Statistical Methodology), 84(4), 1474–1502. https://doi.org/10.1111/rssb.12537

How many times has this paper been cited?

69 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Journal of the Royal Statistical Society Series B (Statistical Methodology): sign in and open the full text from this page.

Who wrote this paper?

Amit Moscovich, Saharon Rosset.

What is the DOI of this paper?

10.1111/rssb.12537, permanently at https://doi.org/10.1111/rssb.12537. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.