Conference paper · 2026 · Open access

ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events

Amy McGovern, Taylor S Mandelbaum, Daniel Rothenberg

EGU General Assembly Conference Abstracts · Published 14 March 2026 · DOI 10.5194/egusphere-egu26-21878

Read the free full textCite this paper

In brief

“ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events” is a 2026 conference paper by Amy McGovern and 2 co-authors, published in EGU General Assembly Conference Abstracts. OpenAlex counts 0 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at EGU General Assembly Conference Abstracts.

Citations
0
Authors
3

Abstract

Properly evaluating AI and NWP models before deployment will help to ensure that the final models are trustworthy. Currently, most evaluation is done at a global scale, such as with WeatherBench, rather than focusing on high-impact events. While this global evaluation is important, it can obscure the results of how a model performs on high-impact events. For example, a heat wave may be poorly forecast by one model but the model may look promising overall when examining global Root Mean Squared Error. Only by examining specific case studies do we get the bigger picture of how the model performs on phenomena that impact humanity around the world.We introduce Extreme Weather Bench (EWB), a new community driven benchmarking suite with almost 300 case studies of high-impact weather events across the globe. EWB facilitates model validation and verification on a variety of high-impact hazards that matter to people around the globe. EWB provides a standard set of case studies (spanning multiple spatial and temporal scales and different parts of the weather spectrum), observational data, impact-based metrics, and open-source code for users to evaluate their models. The case studies include tropical cyclones, atmospheric rivers, convective weather outbreaks, heat waves and major freeze events. To facilitate ease-of-use, EWB is distributed as a pure Python package, and integrates with either local data or data saved on the cloud.EWB will help to drive the science forward for all weather models, enabling true comparisons across models and enabling people to evaluate their models on specific high-impact phenomena while diving deeply into case studies. EWB is a free open-source community-driven system and will be adding additional phenomena, test cases and metrics in collaboration with the worldwide weather and forecast verification community.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

McGovern, A., Mandelbaum, T. S., & Rothenberg, D. (2026). ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events. EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-21878

MLA 9

McGovern, Amy, et al. “ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events.” EGU General Assembly Conference Abstracts, 2026. https://doi.org/10.5194/egusphere-egu26-21878.

Chicago

McGovern, Amy, Taylor S Mandelbaum, and Daniel Rothenberg. 2026. “ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events.” EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-21878.

Harvard

McGovern, A., Mandelbaum, T. S. and Rothenberg, D. (2026) ‘ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events’, EGU General Assembly Conference Abstracts. doi:10.5194/egusphere-egu26-21878.

IEEE

A. McGovern, T. S. Mandelbaum, and D. Rothenberg, “ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events,” EGU General Assembly Conference Abstracts, 2026, doi: 10.5194/egusphere-egu26-21878.

BibTeX

@inproceedings{mcgovern2026extremeweatherbench,
  title     = {{ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events}},
  author    = {McGovern, Amy and Mandelbaum, Taylor S and Rothenberg, Daniel},
  booktitle = {EGU General Assembly Conference Abstracts},
  year      = {2026},
  doi       = {10.5194/egusphere-egu26-21878},
  url       = {https://doi.org/10.5194/egusphere-egu26-21878}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations

  • extreme weather events
  • benchmarking
  • tropical cyclones
  • atmospheric rivers
  • heat waves
  • freeze events
  • numerical weather prediction
  • model validation

Work with this paper

Most-cited papers in Earth and Planetary Sciences

All highly cited Earth and Planetary Sciences papers

Questions about this paper

How do I cite this paper in APA style?

McGovern, A., Mandelbaum, T. S., & Rothenberg, D. (2026). ExtremeWeatherBench 1.0: A Flexible Evaluation Framework for Extreme Weather Events. EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-21878

How many times has this paper been cited?

0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at EGU General Assembly Conference Abstracts.

Who wrote this paper?

Amy McGovern, Taylor S Mandelbaum, Daniel Rothenberg.

What is the DOI of this paper?

10.5194/egusphere-egu26-21878. The permanent link is https://doi.org/10.5194/egusphere-egu26-21878.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.