Preprint · 2026 · Open access

Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather

Amy McGovern, Taylor S Mandelbaum, Daniel Rothenberg, Nicholas Loveday, Corey Potvin, Montgomery L. Flora, Linus Magnusson, Eric Gilleland, John T. Allen

arXiv (Cornell University) · Published 1 May 2026 · DOI 10.48550/arxiv.2605.01126

Free PDFView at the publisherCite this paper

In brief

“Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather” is a 2026 preprint by Amy McGovern and 8 co-authors, published in arXiv (Cornell University). OpenAlex counts 7 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
7
Most cited in
2026 (7)
References
41
Authors
9

Abstract

Forecasting the wide variety of high-impact weather events experienced globally is a challenge for both Artificial Intelligence (AI) and Numerical Weather Prediction (NWP) models and it is critical that such models be properly verified before deployment. Although AI weather models are rapidly evolving, much of their evaluation is currently done either with a global-scale evaluation or by hand-picking a small number of case studies or a region. A widely-used open-source benchmark suite focusing on high-impact weather will help to drive the science forward for all scales of weather models, as it has for other AI fields. Here we introduce Extreme Weather Bench (EWB), a new community-driven benchmark suite that facilitates model validation and verification on a variety of high-impact hazards that matter to people around the globe. EWB provides a standard set of case studies (spanning across multiple spatial and temporal scales and different parts of the weather spectrum), observational data, impact-based metrics, and open-source code for users to evaluate their models. Verifying that a model works against a standard set of case studies, especially events that are high-impact for the general public, is a key piece of improving the trustworthiness of AI models. EWB will help to drive the science forward for all weather models, enabling true comparisons across models and evaluating models on specific high-impact phenomena through the use of case studies. EWB is a free open-source community-driven system and will continue to evolve to include additional phenomena, test cases and metrics in collaboration with the worldwide weather and forecast verification community.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

McGovern, A., Mandelbaum, T. S., Rothenberg, D., Loveday, N., Potvin, C., Flora, M. L., Magnusson, L., Gilleland, E., & Allen, J. T. (2026). Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2605.01126

MLA 9

McGovern, Amy, et al. “Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather.” arXiv (Cornell University), 2026. https://doi.org/10.48550/arxiv.2605.01126.

Chicago

McGovern, Amy, Taylor S Mandelbaum, Daniel Rothenberg, Nicholas Loveday, Corey Potvin, Montgomery L. Flora, Linus Magnusson, Eric Gilleland, and John T. Allen. 2026. “Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2605.01126.

Harvard

McGovern, A. et al. (2026) ‘Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather’, arXiv (Cornell University). doi:10.48550/arxiv.2605.01126.

IEEE

A. McGovern et al., “Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather,” arXiv (Cornell University), 2026, doi: 10.48550/arxiv.2605.01126.

BibTeX

@misc{mcgovern2026extreme,
  title     = {{Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather}},
  author    = {McGovern, Amy and Mandelbaum, Taylor S and Rothenberg, Daniel and Loveday, Nicholas and Potvin, Corey and Flora, Montgomery L. and Magnusson, Linus and Gilleland, Eric and Allen, John T.},
  howpublished = {arXiv (Cornell University)},
  year      = {2026},
  doi       = {10.48550/arxiv.2605.01126},
  url       = {https://doi.org/10.48550/arxiv.2605.01126}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations

  • high-impact weather
  • benchmark suite
  • model verification
  • numerical weather prediction
  • case studies
  • open source software
  • forecast verification

Work with this paper

Most-cited papers in Earth and Planetary Sciences

All highly cited Earth and Planetary Sciences papers

Questions about this paper

How do I cite this paper in APA style?

McGovern, A., Mandelbaum, T. S., Rothenberg, D., Loveday, N., Potvin, C., Flora, M. L., Magnusson, L., Gilleland, E., & Allen, J. T. (2026). Extreme Weather Bench: A framework and benchmark for evaluation of high-impact weather. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2605.01126

How many times has this paper been cited?

7 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at arXiv (Cornell University).

Who wrote this paper?

Amy McGovern, Taylor S Mandelbaum, Daniel Rothenberg, Nicholas Loveday, Corey Potvin, Montgomery L. Flora, Linus Magnusson, Eric Gilleland, John T. Allen.

What is the DOI of this paper?

10.48550/arxiv.2605.01126. The permanent link is https://doi.org/10.48550/arxiv.2605.01126.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.