Paper · 2023 · Open access

Creating skillful and reliable probabilistic forecasts using machine learning

Mariana Clare, Thomas Haiden

Published 6 July 2023 · DOI 10.5194/ems2023-199

Read the free full textCite this paper

In brief

“Creating skillful and reliable probabilistic forecasts using machine learning” is a 2023 paper by Mariana Clare and Thomas Haiden. OpenAlex counts 0 citations as of 16 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
0
Authors
2

Abstract

Machine learning techniques are increasingly used in weather forecasting, to either improve results from numerical weather prediction (NWP) models or emulate some aspects of the forward integration part of NWP models using a purely data-driven approach. So far most of the techniques presented have focused on producing deterministic forecasts, as many standard machine learning techniques lack the ability to express uncertainty. Whilst methods that attempt to fully emulate NWP models are both very complex and computationally expensive, in this talk I will show how much simpler and computationally cheaper techniques can be used to create a probabilistic forecast from a single global high-resolution forecast by post-processing. Specifically, I will focus on the relatively novel technique of a Bayesian Neural Network and show how it can predict the distribution of the forecast error relative to its own analysis. By adding these error distributions to the original forecast, we can create a probabilistic forecast. Time permitting, I will discuss how more advanced techniques can be applied to take these distributions and generate spatially consistent ensemble members. This methodology is particularly useful for NWP models at very high resolutions where running an ensemble is too computationally expensive and for machine learning approaches where no uncertainty information is available. In this talk, I will show how this methodology can be successfully applied to both ECMWF’s high-resolution forecast and a purely data-driven weather forecast model being run at ECMWF, for both the surface variable of 2m temperature and the atmospheric variable of Z500. These probabilistic forecasts have been verified using standard metrics and, in the case of the high-resolution numerical forecast, have as good as or better CRPS scores than the ECMWF ensemble forecast for the lead times tested. Moreover, these probabilistic forecasts are reliable with spread-skill ratios close to one. Hence, this novel machine learning post-processing technique has the potential to produce probabilistic forecasts that are valuable and useful to forecasters.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Clare, M., & Haiden, T. (2023). Creating skillful and reliable probabilistic forecasts using machine learning. https://doi.org/10.5194/ems2023-199

MLA 9

Clare, Mariana, and Thomas Haiden. “Creating skillful and reliable probabilistic forecasts using machine learning.” 2023. https://doi.org/10.5194/ems2023-199.

Chicago

Clare, Mariana and Thomas Haiden. 2023. “Creating skillful and reliable probabilistic forecasts using machine learning.” https://doi.org/10.5194/ems2023-199.

Harvard

Clare, M. and Haiden, T. (2023) ‘Creating skillful and reliable probabilistic forecasts using machine learning’. doi:10.5194/ems2023-199.

IEEE

M. Clare and T. Haiden, “Creating skillful and reliable probabilistic forecasts using machine learning,” 2023, doi: 10.5194/ems2023-199.

BibTeX

@article{clare2023creating,
  title     = {{Creating skillful and reliable probabilistic forecasts using machine learning}},
  author    = {Clare, Mariana and Haiden, Thomas},
  year      = {2023},
  doi       = {10.5194/ems2023-199},
  url       = {https://doi.org/10.5194/ems2023-199}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations

  • probabilistic weather forecasting
  • Bayesian neural networks
  • forecast error distribution
  • forecast uncertainty
  • numerical weather prediction
  • forecast post-processing
  • ensemble generation
  • ECMWF forecasts

Work with this paper

Most-cited papers in Earth and Planetary Sciences

All highly cited Earth and Planetary Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Clare, M., & Haiden, T. (2023). Creating skillful and reliable probabilistic forecasts using machine learning. https://doi.org/10.5194/ems2023-199

How many times has this paper been cited?

0 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text.

Who wrote this paper?

Mariana Clare, Thomas Haiden.

What is the DOI of this paper?

10.5194/ems2023-199. The permanent link is https://doi.org/10.5194/ems2023-199.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.