Journal article · 2026 · Open access
Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy
ACM Computing Surveys · Published 28 October 2026 · DOI 10.1145/3857910
In brief
“Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy” is a 2026 journal article by Cheng Wang and 4 co-authors, published in ACM Computing Surveys. OpenAlex counts 1 citations as of 16 November 2026, which puts it in the top 9% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at ACM Computing Surveys.
- Citations
- 1
- Most cited in
- 2026 (1)
- Field-weighted impact
- 1.40
- References
- 216
- Authors
- 5
Abstract
In recent years, there has been a notable surge in research dedicated to data-driven paradigms, which use existing data to train models capable of applying learned principles to real-world tasks. As the scale effects of the model are empirically confirmed, the importance of the data-driven paradigm becomes more apparent. However, scaling up also entails increased costs, necessitating theoretical estimations to provide reasonable guidance. This underscores the importance of foundational theoretical work on scaling laws of models. Despite the wealth of research exploring scaling laws of models from various perspectives, there lacks a comprehensive framework to integrate these findings. This work systematically summarizes and classifies existing theoretical work through the construction of a model triangular pyramid, considering data, computation, and algorithms as the three key factors. By organizing and categorizing these theories systematically, our aim is to provide a cohesive framework for navigating the complex and evolving landscape of scaling laws within the realm of data-driven models.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wang, C., Wang, Y., Li, Z., Jia, Q., & Liu, W. (2026). Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy. ACM Computing Surveys. https://doi.org/10.1145/3857910
MLA 9
Wang, Cheng, et al. “Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy.” ACM Computing Surveys, 2026. https://doi.org/10.1145/3857910.
Chicago
Wang, Cheng, Yi Wang, Zhiwei Li, Qilong Jia, and Wei Liu. 2026. “Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy.” ACM Computing Surveys. https://doi.org/10.1145/3857910.
Harvard
Wang, C. et al. (2026) ‘Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy’, ACM Computing Surveys. doi:10.1145/3857910.
IEEE
C. Wang, Y. Wang, Z. Li, Q. Jia, and W. Liu, “Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy,” ACM Computing Surveys, 2026, doi: 10.1145/3857910.
BibTeX
@article{wang2026scaling,
title = {{Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy}},
author = {Wang, Cheng and Wang, Yi and Li, Zhiwei and Jia, Qilong and Liu, Wei},
journal = {ACM Computing Surveys},
year = {2026},
doi = {10.1145/3857910},
url = {https://doi.org/10.1145/3857910}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- scaling laws
- data-driven machine learning
- model scaling
- training costs
- dataset size
- computation
- algorithms
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wang, C., Wang, Y., Li, Z., Jia, Q., & Liu, W. (2026). Scaling Laws of Data-Driven Machine Learning Models: A Survey and Taxonomy. ACM Computing Surveys. https://doi.org/10.1145/3857910
How many times has this paper been cited?
1 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at ACM Computing Surveys: sign in and open the full text from this page.
Who wrote this paper?
Cheng Wang, Yi Wang, Zhiwei Li, Qilong Jia, Wei Liu.
What is the DOI of this paper?
10.1145/3857910, permanently at https://doi.org/10.1145/3857910. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.