Preprint · 2022 · Open access
WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models
arXiv (Cornell University) · Published 2 May 2022 · DOI 10.48550/arxiv.2205.00865
In brief
“WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models” is a 2022 preprint by Sagar Garg and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 47 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 47
- Most cited in
- 2023 (23)
- References
- 20
- Authors
- 3
Abstract
WeatherBench is a benchmark dataset for medium-range weather forecasting of geopotential, temperature and precipitation, consisting of preprocessed data, predefined evaluation metrics and a number of baseline models. WeatherBench Probability extends this to probabilistic forecasting by adding a set of established probabilistic verification metrics (continuous ranked probability score, spread-skill ratio and rank histograms) and a state-of-the-art operational baseline using the ECWMF IFS ensemble forecast. In addition, we test three different probabilistic machine learning methods -- Monte Carlo dropout, parametric prediction and categorical prediction, in which the probability distribution is discretized. We find that plain Monte Carlo dropout severely underestimates uncertainty. The parametric and categorical models both produce fairly reliable forecasts of similar quality. The parametric models have fewer degrees of freedom while the categorical model is more flexible when it comes to predicting non-Gaussian distributions. None of the models are able to match the skill of the operational IFS model. We hope that this benchmark will enable other researchers to evaluate their probabilistic approaches.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Garg, S., Rasp, S., & Thuerey, N. (2022). WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2205.00865
MLA 9
Garg, Sagar, et al. “WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models.” arXiv (Cornell University), 2022. https://doi.org/10.48550/arxiv.2205.00865.
Chicago
Garg, Sagar, Stephan Rasp, and Nils Thuerey. 2022. “WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2205.00865.
Harvard
Garg, S., Rasp, S. and Thuerey, N. (2022) ‘WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models’, arXiv (Cornell University). doi:10.48550/arxiv.2205.00865.
IEEE
S. Garg, S. Rasp, and N. Thuerey, “WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models,” arXiv (Cornell University), 2022, doi: 10.48550/arxiv.2205.00865.
BibTeX
@misc{garg2022weatherbench,
title = {{WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models}},
author = {Garg, Sagar and Rasp, Stephan and Thuerey, Nils},
howpublished = {arXiv (Cornell University)},
year = {2022},
doi = {10.48550/arxiv.2205.00865},
url = {https://doi.org/10.48550/arxiv.2205.00865}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 3 | |
| 2023 | 23 | |
| 2024 | 6 | |
| 2025 | 3 | |
| 2026 | 12 |
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- probabilistic weather forecasting
- medium-range weather forecasting
- benchmark dataset
- continuous ranked probability score
- rank histograms
- Monte Carlo dropout
- uncertainty quantification
- geopotential
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
Garg, S., Rasp, S., & Thuerey, N. (2022). WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2205.00865
How many times has this paper been cited?
47 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Sagar Garg, Stephan Rasp, Nils Thuerey.
What is the DOI of this paper?
10.48550/arxiv.2205.00865. The permanent link is https://doi.org/10.48550/arxiv.2205.00865.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.