Preprint · 2023 · Open access
ClimaX: A foundation model for weather and climate
arXiv (Cornell University) · Published 24 January 2023 · DOI 10.48550/arxiv.2301.10343
In brief
“ClimaX: A foundation model for weather and climate” is a 2023 preprint by Tung Thanh Nguyen and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 804 citations as of 20 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 804
- Most cited in
- 2026 (294)
- References
- 101
- Authors
- 5
Abstract
Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon at a fine-grained spatial and temporal resolution. Recent data-driven approaches based on machine learning instead aim to directly solve a downstream forecasting or projection task by learning a data-driven functional mapping using deep neural networks. However, these networks are trained using curated and homogeneous climate datasets for specific spatiotemporal tasks, and thus lack the generality of numerical models. We develop and demonstrate ClimaX, a flexible and generalizable deep learning model for weather and climate science that can be trained using heterogeneous datasets spanning different variables, spatio-temporal coverage, and physical groundings. ClimaX extends the Transformer architecture with novel encoding and aggregation blocks that allow effective use of available compute while maintaining general utility. ClimaX is pre-trained with a self-supervised learning objective on climate datasets derived from CMIP6. The pre-trained ClimaX can then be fine-tuned to address a breadth of climate and weather tasks, including those that involve atmospheric variables and spatio-temporal scales unseen during pretraining. Compared to existing data-driven baselines, we show that this generality in ClimaX results in superior performance on benchmarks for weather forecasting and climate projections, even when pretrained at lower resolutions and compute budgets. The source code is available at https://github.com/microsoft/ClimaX.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Nguyen, T. T., Brandstetter, J., Kapoor, A., Gupta, J. K., & Grover, A. (2023). ClimaX: A foundation model for weather and climate. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343
MLA 9
Nguyen, Tung Thanh, et al. “ClimaX: A foundation model for weather and climate.” arXiv (Cornell University), 2023. https://doi.org/10.48550/arxiv.2301.10343.
Chicago
Nguyen, Tung Thanh, J. Brandstetter, Ashish Kapoor, Jayesh K. Gupta, and Aditya Grover. 2023. “ClimaX: A foundation model for weather and climate.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343.
Harvard
Nguyen, T. T. et al. (2023) ‘ClimaX: A foundation model for weather and climate’, arXiv (Cornell University). doi:10.48550/arxiv.2301.10343.
IEEE
T. T. Nguyen, J. Brandstetter, A. Kapoor, J. K. Gupta, and A. Grover, “ClimaX: A foundation model for weather and climate,” arXiv (Cornell University), 2023, doi: 10.48550/arxiv.2301.10343.
BibTeX
@misc{nguyen2023climax,
title = {{ClimaX: A foundation model for weather and climate}},
author = {Nguyen, Tung Thanh and Brandstetter, J. and Kapoor, Ashish and Gupta, Jayesh K. and Grover, Aditya},
howpublished = {arXiv (Cornell University)},
year = {2023},
doi = {10.48550/arxiv.2301.10343},
url = {https://doi.org/10.48550/arxiv.2301.10343}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 79 | |
| 2024 | 192 | |
| 2025 | 238 | |
| 2026 | 294 |
Topic and keywords
Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations
- climax
- weather forecasting
- climate change projections
- foundation models
- transformer models
- self-supervised pre-training
- CMIP6
- meteorological parameters
Work with this paper
Most-cited papers in Earth and Planetary Sciences
- The ERA5 global reanalysisHans Hersbach, Bill Bell, Paul Berrisford and 40 more · Quarterly Journal of the Royal Meteorological Society · 2020 · 35,424 citations
- The NCEP/NCAR 40-Year Reanalysis ProjectEugenia Kalnay, Masao Kanamitsu, Robert E. Kistler and 19 more · Bulletin of the American Meteorological Society · 1996 · 28,486 citations
- Chemical and isotopic systematics of oceanic basalts: implications for mantle composition and processesShen‐Su Sun, W. F. McDonough · Geological Society London Special Publications · 1989 · 26,603 citations
- The ERA‐Interim reanalysis: configuration and performance of the data assimilation systemDick P. Dee, Sakari M. Uppala, A. J. Simmons and 33 more · Quarterly Journal of the Royal Meteorological Society · 2011 · 25,245 citations
- PAST: PALEONTOLOGICAL STATISTICAL SOFTWARE PACKAGE FOR EDUCATION AND DATA ANALYSISØyvind Hammer, David A. T. Harper, Paul D. Ryan · 2001 · 17,871 citations
Questions about this paper
How do I cite this paper in APA style?
Nguyen, T. T., Brandstetter, J., Kapoor, A., Gupta, J. K., & Grover, A. (2023). ClimaX: A foundation model for weather and climate. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343
How many times has this paper been cited?
804 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Tung Thanh Nguyen, J. Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover.
What is the DOI of this paper?
10.48550/arxiv.2301.10343, permanently at https://doi.org/10.48550/arxiv.2301.10343. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.