Preprint · 2023 · Open access

ClimaX: A foundation model for weather and climate

Tung Thanh Nguyen, J. Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover

arXiv (Cornell University) · Published 24 January 2023 · DOI 10.48550/arxiv.2301.10343

Open PDFView at the publisherCite this paper

In brief

“ClimaX: A foundation model for weather and climate” is a 2023 preprint by Tung Thanh Nguyen and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 804 citations as of 20 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
804
Most cited in
2026 (294)
References
101
Authors
5

Abstract

Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon at a fine-grained spatial and temporal resolution. Recent data-driven approaches based on machine learning instead aim to directly solve a downstream forecasting or projection task by learning a data-driven functional mapping using deep neural networks. However, these networks are trained using curated and homogeneous climate datasets for specific spatiotemporal tasks, and thus lack the generality of numerical models. We develop and demonstrate ClimaX, a flexible and generalizable deep learning model for weather and climate science that can be trained using heterogeneous datasets spanning different variables, spatio-temporal coverage, and physical groundings. ClimaX extends the Transformer architecture with novel encoding and aggregation blocks that allow effective use of available compute while maintaining general utility. ClimaX is pre-trained with a self-supervised learning objective on climate datasets derived from CMIP6. The pre-trained ClimaX can then be fine-tuned to address a breadth of climate and weather tasks, including those that involve atmospheric variables and spatio-temporal scales unseen during pretraining. Compared to existing data-driven baselines, we show that this generality in ClimaX results in superior performance on benchmarks for weather forecasting and climate projections, even when pretrained at lower resolutions and compute budgets. The source code is available at https://github.com/microsoft/ClimaX.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Nguyen, T. T., Brandstetter, J., Kapoor, A., Gupta, J. K., & Grover, A. (2023). ClimaX: A foundation model for weather and climate. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343

MLA 9

Nguyen, Tung Thanh, et al. “ClimaX: A foundation model for weather and climate.” arXiv (Cornell University), 2023. https://doi.org/10.48550/arxiv.2301.10343.

Chicago

Nguyen, Tung Thanh, J. Brandstetter, Ashish Kapoor, Jayesh K. Gupta, and Aditya Grover. 2023. “ClimaX: A foundation model for weather and climate.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343.

Harvard

Nguyen, T. T. et al. (2023) ‘ClimaX: A foundation model for weather and climate’, arXiv (Cornell University). doi:10.48550/arxiv.2301.10343.

IEEE

T. T. Nguyen, J. Brandstetter, A. Kapoor, J. K. Gupta, and A. Grover, “ClimaX: A foundation model for weather and climate,” arXiv (Cornell University), 2023, doi: 10.48550/arxiv.2301.10343.

BibTeX

@misc{nguyen2023climax,
  title     = {{ClimaX: A foundation model for weather and climate}},
  author    = {Nguyen, Tung Thanh and Brandstetter, J. and Kapoor, Ashish and Gupta, Jayesh K. and Grover, Aditya},
  howpublished = {arXiv (Cornell University)},
  year      = {2023},
  doi       = {10.48550/arxiv.2301.10343},
  url       = {https://doi.org/10.48550/arxiv.2301.10343}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
20237979
2024192192
2025238238
2026294294

Topic and keywords

Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Meteorological Phenomena and Simulations

  • climax
  • weather forecasting
  • climate change projections
  • foundation models
  • transformer models
  • self-supervised pre-training
  • CMIP6
  • meteorological parameters

Work with this paper

Most-cited papers in Earth and Planetary Sciences

All highly cited Earth and Planetary Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Nguyen, T. T., Brandstetter, J., Kapoor, A., Gupta, J. K., & Grover, A. (2023). ClimaX: A foundation model for weather and climate. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2301.10343

How many times has this paper been cited?

804 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Tung Thanh Nguyen, J. Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover.

What is the DOI of this paper?

10.48550/arxiv.2301.10343, permanently at https://doi.org/10.48550/arxiv.2301.10343. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.