Journal article · 2014 · Open access
Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature
Geoscientific model development, 7(3), 1247–1250 · Published 30 June 2014 · DOI 10.5194/gmd-7-1247-2014
In brief
“Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature” is a 2014 journal article by Tianfeng Chai and Roland R. Draxler, published in Geoscientific model development. OpenAlex counts 7,992 citations as of 15 November 2026, which puts it in the top 1% of works published in 2014 by citations. It is open access under a CC BY licence: the full text is free to read at Geoscientific model development.
- Citations
- 7,992
- Most cited in
- 2026 (1,452)
- Field-weighted impact
- 90.39
- References
- 12
- Authors
- 2
Abstract
Both the root mean square error (RMSE) and the mean absolute error (MAE) are regularly employed in model evaluation studies. Willmott and Matsuura (2005) have suggested that the RMSE is not a good indicator of average model performance and might be a misleading indicator of average error, and thus the MAE would be a better metric for that purpose. While some concerns over using RMSE raised by Willmott and Matsuura (2005) and Willmott et al. (2009) are valid, the proposed avoidance of RMSE in favor of MAE is not the solution. Citing the aforementioned papers, many researchers chose MAE over RMSE to present their model evaluation statistics when presenting or adding the RMSE measures could be more beneficial. In this technical note, we demonstrate that the RMSE is not ambiguous in its meaning, contrary to what was claimed by Willmott et al. (2009). The RMSE is more appropriate to represent model performance than the MAE when the error distribution is expected to be Gaussian. In addition, we show that the RMSE satisfies the triangle inequality requirement for a distance metric, whereas Willmott et al. (2009) indicated that the sums-of-squares-based statistics do not satisfy this rule. In the end, we discussed some circumstances where using the RMSE will be more beneficial. However, we do not contend that the RMSE is superior over the MAE. Instead, a combination of metrics, including but certainly not limited to RMSEs and MAEs, are often required to assess model performance.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Chai, T., & Draxler, R. R. (2014). Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature. Geoscientific model development, 7(3), 1247–1250. https://doi.org/10.5194/gmd-7-1247-2014
MLA 9
Chai, Tianfeng, and Roland R. Draxler. “Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature.” Geoscientific model development, vol. 7, no. 3, 2014, pp. 1247–1250. https://doi.org/10.5194/gmd-7-1247-2014.
Chicago
Chai, Tianfeng and Roland R. Draxler. 2014. “Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature.” Geoscientific model development 7 (3): 1247–1250. https://doi.org/10.5194/gmd-7-1247-2014.
Harvard
Chai, T. and Draxler, R. R. (2014) ‘Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature’, Geoscientific model development, 7(3), pp. 1247–1250. doi:10.5194/gmd-7-1247-2014.
IEEE
T. Chai and R. R. Draxler, “Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature,” Geoscientific model development, vol. 7, no. 3, pp. 1247–1250, 2014, doi: 10.5194/gmd-7-1247-2014.
BibTeX
@article{chai2014root,
title = {{Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature}},
author = {Chai, Tianfeng and Draxler, Roland R.},
journal = {Geoscientific model development},
year = {2014},
volume = {7},
number = {3},
pages = {1247--1250},
doi = {10.5194/gmd-7-1247-2014},
url = {https://doi.org/10.5194/gmd-7-1247-2014}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 243 | |
| 2018 | 333 | |
| 2019 | 421 | |
| 2020 | 553 | |
| 2021 | 699 | |
| 2022 | 772 | |
| 2023 | 901 | |
| 2024 | 1,052 | |
| 2025 | 1,306 | |
| 2026 | 1,452 |
Its field-weighted citation impact is 90.39: it has been cited 90.39 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- root mean square error
- mean absolute error
- model evaluation metrics
- error metrics
- distance measures
- triangle inequality
- Gaussian error distribution
- model evaluation
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
Chai, T., & Draxler, R. R. (2014). Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature. Geoscientific model development, 7(3), 1247–1250. https://doi.org/10.5194/gmd-7-1247-2014
How many times has this paper been cited?
7,992 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at Geoscientific model development.
Who wrote this paper?
Tianfeng Chai, Roland R. Draxler.
What is the DOI of this paper?
10.5194/gmd-7-1247-2014. The permanent link is https://doi.org/10.5194/gmd-7-1247-2014.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.