Conference paper · 2026 · Open access
Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.
EGU General Assembly Conference Abstracts · Published 14 March 2026 · DOI 10.5194/egusphere-egu26-11765
In brief
“Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.” is a 2026 conference paper by Soufiane Karmouche and 3 co-authors, published in EGU General Assembly Conference Abstracts. OpenAlex counts 0 citations as of 20 November 2026. It is open access under a CC BY licence: the full text is free to read at EGU General Assembly Conference Abstracts.
- Citations
- 0
- Authors
- 4
Abstract
Standard scores such as the root mean squared error provide limited insight into whether Machine-learning (ML) weather prediction systems reproduce the physically consistent dynamical structures that underpin high-impact weather. Here, we present a multi-faceted assessment of the physical realism of ECMWF’s Artificial Intelligence Forecasting System (AIFS), combining case-study diagnostics of severe extratropical storms with conditional verification based on large-scale circulation.We first examine two North Atlantic storms: Storm Amy (October 2025) and Storm Eowyn (January 2025). Using diagnostics inspired by Charlton-Perez et al. (2024), we analyse frontal structure, vorticity, and surface and upper-air wind fields in AIFS-Single and AIFS Ensemble Control forecasts, benchmarked against the IFS Control and analysis. While ML systems capture storm tracks and large-scale frontal geometry well, they systematically smooth sharp gradients, compact vorticity cores, and localized wind maxima, leading to underestimation of extreme winds. Probabilistic training in the ensemble configuration improves realism but does not fully overcome these structural limitations.We then present ongoing work assessing the physical consistency of ML forecasts using diagnostics of the ageostrophic-to-geostrophic wind ratio at multiple pressure levels. These reveal systematic differences between ML-based and physics-based models, particularly in dynamically active midlatitude regions.Finally, we present regime-based verification results highlighting improved AIFS performance for 2-m temperature forecasts during persistent wintertime anticyclonic conditions, illustrating ML strengths in stable large-scale regimes where physics-based forecasts suffer from long-standing systematic biases.Overall, our results highlight the importance of moving beyond general verification scores toward diagnostic and physically interpretable evaluation frameworks when assessing AI-based weather forecasts, especially for high-impact weather events.This work is funded by the Destination Earth project.REFERENCES:Charlton-Perez, A.J., Dacre, H.F., Driscoll, S. et al. Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciarán. npj Clim Atmos Sci 7, 93 (2024). https://doi.org/10.1038/s41612-024-00638-w
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Karmouche, S., Magnusson, L., Hewson, T., & Haiden, T. (2026). Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics. EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-11765
MLA 9
Karmouche, Soufiane, et al. “Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.” EGU General Assembly Conference Abstracts, 2026. https://doi.org/10.5194/egusphere-egu26-11765.
Chicago
Karmouche, Soufiane, Linus Magnusson, Tim Hewson, and Thomas Haiden. 2026. “Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.” EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-11765.
Harvard
Karmouche, S. et al. (2026) ‘Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.’, EGU General Assembly Conference Abstracts. doi:10.5194/egusphere-egu26-11765.
IEEE
S. Karmouche, L. Magnusson, T. Hewson, and T. Haiden, “Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.,” EGU General Assembly Conference Abstracts, 2026, doi: 10.5194/egusphere-egu26-11765.
BibTeX
@inproceedings{karmouche2026assessing,
title = {{Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics.}},
author = {Karmouche, Soufiane and Magnusson, Linus and Hewson, Tim and Haiden, Thomas},
booktitle = {EGU General Assembly Conference Abstracts},
year = {2026},
doi = {10.5194/egusphere-egu26-11765},
url = {https://doi.org/10.5194/egusphere-egu26-11765}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- extratropical cyclones
- frontal structure
- vorticity
- anticyclonic conditions
- high-impact weather
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
Karmouche, S., Magnusson, L., Hewson, T., & Haiden, T. (2026). Assessing the physical realism of AI-based weather forecasts: insights from extratropical storms and large-scale flow diagnostics. EGU General Assembly Conference Abstracts. https://doi.org/10.5194/egusphere-egu26-11765
How many times has this paper been cited?
0 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at EGU General Assembly Conference Abstracts: sign in and open the full text from this page.
Who wrote this paper?
Soufiane Karmouche, Linus Magnusson, Tim Hewson, Thomas Haiden.
What is the DOI of this paper?
10.5194/egusphere-egu26-11765, permanently at https://doi.org/10.5194/egusphere-egu26-11765. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.