Journal article · 2025 · Open access
An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models
Artificial Intelligence for the Earth Systems, 4(4) · Published 8 August 2025 · DOI 10.1175/aies-d-24-0085.1
In brief
“An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models” is a 2025 journal article by Mark DeMaria and 6 co-authors, published in Artificial Intelligence for the Earth Systems. OpenAlex counts 47 citations as of 20 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 47
- Most cited in
- 2026 (36)
- Field-weighted impact
- 13.00
- References
- 26
- Authors
- 7
Abstract
In just the past few years, multiple data-driven Artificial Intelligence Weather Prediction (AIWP) models have been developed. NHC verification procedures are used to evaluate 7-day track and intensity predictions for Northern Hemisphere tropical cyclones (TCs) from May to November 2023. Four open-source AIWP models initialized 4 times per day with GFS initial conditions are considered (FourCastNetv1, FourCastNetv2-small, GraphCast-operational, and Pangu-Weather). The AIWP track forecast errors and detection rates are comparable to those from the best-performing operational forecast models. However, the AIWP intensity forecast errors are larger than those of even the simplest intensity forecasts based on climatology and persistence. The AIWP models almost always reduce the TC intensity resulting in a substantial low bias. An idealized Rankine vortex was used to illustrate how minimizing RMS errors in the AIWP models contributes to this bias. The contribution of the AIWP models to the NHC model consensus was also evaluated. For track, adding the AIWP models improves the consensus by up to 11% at the longer time periods. This represents more than a 5-yr gain in accuracy based on the historical track forecast improvement of about 2% yr −1 . In contrast, the AIWP models did not improve the intensity consensus. A preliminary evaluation of the impact of the AIWP model initial conditions was performed by comparing forecasts initialized with GFS and ECMWF-Integrated Forecasting System (IFS) initial conditions for Northern Hemisphere cases in 2022–23. With the ECMWF-IFS initial conditions, the AIWP track forecasts significantly improved, but there was little improvement in the intensity forecasts. Significance Statement Weather prediction (WP) models based on artificial intelligence (AI) have proliferated over just the past few years. Once trained, these models run very quickly, making them appealing for operational forecasting. This study is one of the first to apply operational verification procedures to multiple open-source AIWP models to determine their applicability for operational forecasting. The track forecast errors are found to be comparable to those from the best operational models. However, the intensity forecasts have no skill relative to the simplest statistical models, due to a substantial low bias. Thus, the tropical cyclone (TC) track forecasts can be used directly as guidance, but postprocessing bias corrections or AIWP model architecture and training data modifications may be needed for useful TC intensity forecasts.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
DeMaria, M., Franklin, J. L., Chirokova, G., Radford, J. T., DeMaria, R., Musgrave, K. D., & Ebert‐Uphoff, I. (2025). An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models. Artificial Intelligence for the Earth Systems, 4(4). https://doi.org/10.1175/aies-d-24-0085.1
MLA 9
DeMaria, Mark, et al. “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models.” Artificial Intelligence for the Earth Systems, vol. 4, no. 4, 2025. https://doi.org/10.1175/aies-d-24-0085.1.
Chicago
DeMaria, Mark, James L. Franklin, Galina Chirokova, Jacob T. Radford, Robert DeMaria, Kate D. Musgrave, and Imme Ebert‐Uphoff. 2025. “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models.” Artificial Intelligence for the Earth Systems 4 (4). https://doi.org/10.1175/aies-d-24-0085.1.
Harvard
DeMaria, M. et al. (2025) ‘An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models’, Artificial Intelligence for the Earth Systems, 4(4). doi:10.1175/aies-d-24-0085.1.
IEEE
M. DeMaria et al., “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models,” Artificial Intelligence for the Earth Systems, vol. 4, no. 4, 2025, doi: 10.1175/aies-d-24-0085.1.
BibTeX
@article{demaria2025operations,
title = {{An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models}},
author = {DeMaria, Mark and Franklin, James L. and Chirokova, Galina and Radford, Jacob T. and DeMaria, Robert and Musgrave, Kate D. and Ebert‐Uphoff, Imme},
journal = {Artificial Intelligence for the Earth Systems},
year = {2025},
volume = {4},
number = {4},
doi = {10.1175/aies-d-24-0085.1},
url = {https://doi.org/10.1175/aies-d-24-0085.1}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Tropical and Extratropical Cyclones Research
- tropical cyclone track forecasting
- tropical cyclone intensity forecasting
- FourCastNet
- GraphCast
- Pangu-Weather
- model consensus
- Rankine vortex
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
DeMaria, M., Franklin, J. L., Chirokova, G., Radford, J. T., DeMaria, R., Musgrave, K. D., & Ebert‐Uphoff, I. (2025). An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models. Artificial Intelligence for the Earth Systems, 4(4). https://doi.org/10.1175/aies-d-24-0085.1
How many times has this paper been cited?
47 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Mark DeMaria, James L. Franklin, Galina Chirokova, Jacob T. Radford, Robert DeMaria, Kate D. Musgrave, Imme Ebert‐Uphoff.
What is the DOI of this paper?
10.1175/aies-d-24-0085.1, permanently at https://doi.org/10.1175/aies-d-24-0085.1. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.