Conference paper · 2024 · Open access
ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability
International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–11 · Published 17 November 2024 · DOI 10.1109/sc41406.2024.00007
In brief
“ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability” is a 2024 conference paper by Xiao Wang and 10 co-authors, published in International Conference for High Performance Computing, Networking, Storage and Analysis (SC). OpenAlex counts 34 citations as of 15 November 2026, which puts it in the top 7% of works published in 2024 by citations. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 34
- Most cited in
- 2025 (18)
- Field-weighted impact
- 7.59
- References
- 24
- Authors
- 11
Abstract
Earth system predictability is challenged by the complexity of environmental dynamics and the multitude of variables involved. Current AI foundation models, although advanced by leveraging large and heterogeneous data, are often constrained by their size and data integration, limiting their effectiveness in addressing the full range of Earth system prediction challenges. To overcome these limitations, we introduce the Oak Ridge Base Foundation Model for Earth System Predictability (ORBIT), an advanced vision transformer model that scales up to 113 billion parameters using a novel hybrid tensor-data orthogonal parallelism technique. As the largest model of its kind, ORBIT surpasses the current climate AI foundation model size by a thousandfold. Performance scaling tests conducted on the Frontier supercomputer have demonstrated that ORBIT achieves 684 petaFLOPS to 1.6 exaFLOPS sustained throughput, with scaling efficiency maintained at 41% to 85% across 49,152 AMD GPUs. These breakthroughs establish new advances in AIdriven climate modeling and demonstrate promise to significantly improve the Earth system predictability.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wang, X., Liu, S., Tsaris, A., Choi, J. Y., Aji, A. M., Fan, M., Zhang, W., Yin, J., Ashfaq, M., Lu, D., & Balaprakash, P. (2024). ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability. International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–11. https://doi.org/10.1109/sc41406.2024.00007
MLA 9
Wang, Xiao, et al. “ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability.” International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2024, pp. 1–11. https://doi.org/10.1109/sc41406.2024.00007.
Chicago
Wang, Xiao, Siyan Liu, Aristeidis Tsaris, Jong Youl Choi, Ashwin M. Aji, Ming Fan, Wei Zhang, et al. 2024. “ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability.” International Conference for High Performance Computing, Networking, Storage and Analysis (SC): 1–11. https://doi.org/10.1109/sc41406.2024.00007.
Harvard
Wang, X. et al. (2024) ‘ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability’, International Conference for High Performance Computing, Networking, Storage and Analysis (SC), pp. 1–11. doi:10.1109/sc41406.2024.00007.
IEEE
X. Wang et al., “ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability,” International Conference for High Performance Computing, Networking, Storage and Analysis (SC), pp. 1–11, 2024, doi: 10.1109/sc41406.2024.00007.
BibTeX
@inproceedings{wang2024orbit,
title = {{ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability}},
author = {Wang, Xiao and Liu, Siyan and Tsaris, Aristeidis and Choi, Jong Youl and Aji, Ashwin M. and Fan, Ming and Zhang, Wei and Yin, Junqi and Ashfaq, Moetasim and Lu, Dan and Balaprakash, Prasanna},
booktitle = {International Conference for High Performance Computing, Networking, Storage and Analysis (SC)},
year = {2024},
pages = {1--11},
doi = {10.1109/sc41406.2024.00007},
url = {https://doi.org/10.1109/sc41406.2024.00007}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 2 | |
| 2025 | 18 | |
| 2026 | 14 |
Its field-weighted citation impact is 7.59: it has been cited 7.59 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques
- vision transformer
- foundation models
- climate modeling
- supercomputer performance
- orbit
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wang, X., Liu, S., Tsaris, A., Choi, J. Y., Aji, A. M., Fan, M., Zhang, W., Yin, J., Ashfaq, M., Lu, D., & Balaprakash, P. (2024). ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability. International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–11. https://doi.org/10.1109/sc41406.2024.00007
How many times has this paper been cited?
34 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Xiao Wang, Siyan Liu, Aristeidis Tsaris, Jong Youl Choi, Ashwin M. Aji, Ming Fan, Wei Zhang, Junqi Yin, Moetasim Ashfaq, Dan Lu, Prasanna Balaprakash.
What is the DOI of this paper?
10.1109/sc41406.2024.00007. The permanent link is https://doi.org/10.1109/sc41406.2024.00007.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.