Journal article · 2025 · Open access

An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models

Mark DeMaria, James L. Franklin, Galina Chirokova, Jacob T. Radford, Robert DeMaria, Kate D. Musgrave, Imme Ebert‐Uphoff

Artificial Intelligence for the Earth Systems, 4(4) · Published 8 August 2025 · DOI 10.1175/aies-d-24-0085.1

Open PDFView at the publisherCite this paper

In brief

“An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models” is a 2025 journal article by Mark DeMaria and 6 co-authors, published in Artificial Intelligence for the Earth Systems. OpenAlex counts 47 citations as of 20 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
47
Most cited in
2026 (36)
Field-weighted impact
13.00
References
26
Authors
7

Abstract

In just the past few years, multiple data-driven Artificial Intelligence Weather Prediction (AIWP) models have been developed. NHC verification procedures are used to evaluate 7-day track and intensity predictions for Northern Hemisphere tropical cyclones (TCs) from May to November 2023. Four open-source AIWP models initialized 4 times per day with GFS initial conditions are considered (FourCastNetv1, FourCastNetv2-small, GraphCast-operational, and Pangu-Weather). The AIWP track forecast errors and detection rates are comparable to those from the best-performing operational forecast models. However, the AIWP intensity forecast errors are larger than those of even the simplest intensity forecasts based on climatology and persistence. The AIWP models almost always reduce the TC intensity resulting in a substantial low bias. An idealized Rankine vortex was used to illustrate how minimizing RMS errors in the AIWP models contributes to this bias. The contribution of the AIWP models to the NHC model consensus was also evaluated. For track, adding the AIWP models improves the consensus by up to 11% at the longer time periods. This represents more than a 5-yr gain in accuracy based on the historical track forecast improvement of about 2% yr −1 . In contrast, the AIWP models did not improve the intensity consensus. A preliminary evaluation of the impact of the AIWP model initial conditions was performed by comparing forecasts initialized with GFS and ECMWF-Integrated Forecasting System (IFS) initial conditions for Northern Hemisphere cases in 2022–23. With the ECMWF-IFS initial conditions, the AIWP track forecasts significantly improved, but there was little improvement in the intensity forecasts. Significance Statement Weather prediction (WP) models based on artificial intelligence (AI) have proliferated over just the past few years. Once trained, these models run very quickly, making them appealing for operational forecasting. This study is one of the first to apply operational verification procedures to multiple open-source AIWP models to determine their applicability for operational forecasting. The track forecast errors are found to be comparable to those from the best operational models. However, the intensity forecasts have no skill relative to the simplest statistical models, due to a substantial low bias. Thus, the tropical cyclone (TC) track forecasts can be used directly as guidance, but postprocessing bias corrections or AIWP model architecture and training data modifications may be needed for useful TC intensity forecasts.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

DeMaria, M., Franklin, J. L., Chirokova, G., Radford, J. T., DeMaria, R., Musgrave, K. D., & Ebert‐Uphoff, I. (2025). An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models. Artificial Intelligence for the Earth Systems, 4(4). https://doi.org/10.1175/aies-d-24-0085.1

MLA 9

DeMaria, Mark, et al. “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models.” Artificial Intelligence for the Earth Systems, vol. 4, no. 4, 2025. https://doi.org/10.1175/aies-d-24-0085.1.

Chicago

DeMaria, Mark, James L. Franklin, Galina Chirokova, Jacob T. Radford, Robert DeMaria, Kate D. Musgrave, and Imme Ebert‐Uphoff. 2025. “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models.” Artificial Intelligence for the Earth Systems 4 (4). https://doi.org/10.1175/aies-d-24-0085.1.

Harvard

DeMaria, M. et al. (2025) ‘An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models’, Artificial Intelligence for the Earth Systems, 4(4). doi:10.1175/aies-d-24-0085.1.

IEEE

M. DeMaria et al., “An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models,” Artificial Intelligence for the Earth Systems, vol. 4, no. 4, 2025, doi: 10.1175/aies-d-24-0085.1.

BibTeX

@article{demaria2025operations,
  title     = {{An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models}},
  author    = {DeMaria, Mark and Franklin, James L. and Chirokova, Galina and Radford, Jacob T. and DeMaria, Robert and Musgrave, Kate D. and Ebert‐Uphoff, Imme},
  journal   = {Artificial Intelligence for the Earth Systems},
  year      = {2025},
  volume    = {4},
  number    = {4},
  doi       = {10.1175/aies-d-24-0085.1},
  url       = {https://doi.org/10.1175/aies-d-24-0085.1}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Tropical and Extratropical Cyclones Research

  • tropical cyclone track forecasting
  • tropical cyclone intensity forecasting
  • FourCastNet
  • GraphCast
  • Pangu-Weather
  • model consensus
  • Rankine vortex

Work with this paper

Most-cited papers in Earth and Planetary Sciences

All highly cited Earth and Planetary Sciences papers

Questions about this paper

How do I cite this paper in APA style?

DeMaria, M., Franklin, J. L., Chirokova, G., Radford, J. T., DeMaria, R., Musgrave, K. D., & Ebert‐Uphoff, I. (2025). An Operations-Based Evaluation of Tropical Cyclone Track and Intensity Forecasts from Artificial Intelligence Weather Prediction Models. Artificial Intelligence for the Earth Systems, 4(4). https://doi.org/10.1175/aies-d-24-0085.1

How many times has this paper been cited?

47 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Mark DeMaria, James L. Franklin, Galina Chirokova, Jacob T. Radford, Robert DeMaria, Kate D. Musgrave, Imme Ebert‐Uphoff.

What is the DOI of this paper?

10.1175/aies-d-24-0085.1, permanently at https://doi.org/10.1175/aies-d-24-0085.1. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.