Paper · 2023 · Open access
Creating skillful and reliable probabilistic forecasts using machine learning
Published 6 July 2023 · DOI 10.5194/ems2023-199
In brief
“Creating skillful and reliable probabilistic forecasts using machine learning” is a 2023 paper by Mariana Clare and Thomas Haiden. OpenAlex counts 0 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 0
- Authors
- 2
Abstract
Machine learning techniques are increasingly used in weather forecasting, to either improve results from numerical weather prediction (NWP) models or emulate some aspects of the forward integration part of NWP models using a purely data-driven approach. So far most of the techniques presented have focused on producing deterministic forecasts, as many standard machine learning techniques lack the ability to express uncertainty. Whilst methods that attempt to fully emulate NWP models are both very complex and computationally expensive, in this talk I will show how much simpler and computationally cheaper techniques can be used to create a probabilistic forecast from a single global high-resolution forecast by post-processing. Specifically, I will focus on the relatively novel technique of a Bayesian Neural Network and show how it can predict the distribution of the forecast error relative to its own analysis. By adding these error distributions to the original forecast, we can create a probabilistic forecast. Time permitting, I will discuss how more advanced techniques can be applied to take these distributions and generate spatially consistent ensemble members. This methodology is particularly useful for NWP models at very high resolutions where running an ensemble is too computationally expensive and for machine learning approaches where no uncertainty information is available. In this talk, I will show how this methodology can be successfully applied to both ECMWF’s high-resolution forecast and a purely data-driven weather forecast model being run at ECMWF, for both the surface variable of 2m temperature and the atmospheric variable of Z500. These probabilistic forecasts have been verified using standard metrics and, in the case of the high-resolution numerical forecast, have as good as or better CRPS scores than the ECMWF ensemble forecast for the lead times tested. Moreover, these probabilistic forecasts are reliable with spread-skill ratios close to one. Hence, this novel machine learning post-processing technique has the potential to produce probabilistic forecasts that are valuable and useful to forecasters.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Clare, M., & Haiden, T. (2023). Creating skillful and reliable probabilistic forecasts using machine learning. https://doi.org/10.5194/ems2023-199
MLA 9
Clare, Mariana, and Thomas Haiden. “Creating skillful and reliable probabilistic forecasts using machine learning.” 2023. https://doi.org/10.5194/ems2023-199.
Chicago
Clare, Mariana and Thomas Haiden. 2023. “Creating skillful and reliable probabilistic forecasts using machine learning.” https://doi.org/10.5194/ems2023-199.
Harvard
Clare, M. and Haiden, T. (2023) ‘Creating skillful and reliable probabilistic forecasts using machine learning’. doi:10.5194/ems2023-199.
IEEE
M. Clare and T. Haiden, “Creating skillful and reliable probabilistic forecasts using machine learning,” 2023, doi: 10.5194/ems2023-199.
BibTeX
@article{clare2023creating,
title = {{Creating skillful and reliable probabilistic forecasts using machine learning}},
author = {Clare, Mariana and Haiden, Thomas},
year = {2023},
doi = {10.5194/ems2023-199},
url = {https://doi.org/10.5194/ems2023-199}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- probabilistic weather forecasting
- Bayesian neural networks
- forecast error distribution
- forecast uncertainty
- numerical weather prediction
- forecast post-processing
- ensemble generation
- ECMWF forecasts
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
Clare, M., & Haiden, T. (2023). Creating skillful and reliable probabilistic forecasts using machine learning. https://doi.org/10.5194/ems2023-199
How many times has this paper been cited?
0 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text.
Who wrote this paper?
Mariana Clare, Thomas Haiden.
What is the DOI of this paper?
10.5194/ems2023-199. The permanent link is https://doi.org/10.5194/ems2023-199.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.