Journal article · 2026 · Open access
General scales unlock AI evaluation with explanatory and predictive power
Nature, 652(8108), 58–67 · Published 1 April 2026 · DOI 10.1038/s41586-026-10303-2
In brief
“General scales unlock AI evaluation with explanatory and predictive power” is a 2026 journal article by Lexin Zhou and 25 co-authors, published in Nature. OpenAlex counts 22 citations as of 16 November 2026, which puts it in the top 1% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at Nature.
- Citations
- 22
- Most cited in
- 2026 (22)
- Field-weighted impact
- 30.69
- References
- 85
- Authors
- 26
Abstract
Ensuring safe and effective use of artificial intelligence (AI) requires understanding and anticipating its performance on new tasks, from advanced scientific challenges to transformed workplace activities 1–3 . So far, benchmarking has guided progress in AI but has offered limited explanatory and predictive power for general-purpose AI systems 4–8 , attributed to limited transferability across specific tasks 9–11 . Here we introduce general scales for AI evaluation that elicit demand profiles explaining what capabilities common AI benchmarks truly measure, extract ability profiles quantifying the general strengths and limits of AI systems and robustly predict AI performance for new task instances. Our fully automated methodology builds on 18 rubrics, capturing a broad range of cognitive and intellectual demands, which place different task instances on the same general scales, illustrated on 15 large language models (LLMs) and 63 tasks. Both the demand and the ability profiles on these scales bring new insights such as construct validity through benchmark sensitivity and specificity and explain conflicting claims about whether AI has reasoning capabilities. Ultimately, high predictive power at the instance level becomes possible using the general scales, providing superior estimates over strong black-box baseline predictors, especially in out-of-distribution settings (new tasks and benchmarks). The scales, rubrics, battery, techniques and results presented here constitute a solid foundation for a science of AI evaluation, underpinning the reliable deployment of AI in the years ahead.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhou, L., Pacchiardi, L., Martínez‐Plumed, F., Collins, K. M., Moros-Daval, Y., Zhang, S., Zhao, Q., Huang, Y., Sun, L., Prunty, J. E., Li, Z., Sánchez-García, P., Jiang-Chen, K., Casares, P. A. M., Zu, J., Burden, J., Mehrbakhsh, B., Stillwell, D. J., Cebrián, M., . . . Hernández-Orallo, J. (2026). General scales unlock AI evaluation with explanatory and predictive power. Nature, 652(8108), 58–67. https://doi.org/10.1038/s41586-026-10303-2
MLA 9
Zhou, Lexin, et al. “General scales unlock AI evaluation with explanatory and predictive power.” Nature, vol. 652, no. 8108, 2026, pp. 58–67. https://doi.org/10.1038/s41586-026-10303-2.
Chicago
Zhou, Lexin, Lorenzo Pacchiardi, Fernando Martínez‐Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, et al. 2026. “General scales unlock AI evaluation with explanatory and predictive power.” Nature 652 (8108): 58–67. https://doi.org/10.1038/s41586-026-10303-2.
Harvard
Zhou, L. et al. (2026) ‘General scales unlock AI evaluation with explanatory and predictive power’, Nature, 652(8108), pp. 58–67. doi:10.1038/s41586-026-10303-2.
IEEE
L. Zhou et al., “General scales unlock AI evaluation with explanatory and predictive power,” Nature, vol. 652, no. 8108, pp. 58–67, 2026, doi: 10.1038/s41586-026-10303-2.
BibTeX
@article{zhou2026general,
title = {{General scales unlock AI evaluation with explanatory and predictive power}},
author = {Zhou, Lexin and Pacchiardi, Lorenzo and Martínez‐Plumed, Fernando and Collins, Katherine M. and Moros-Daval, Yael and Zhang, Seraphina and Zhao, Qinlin and Huang, Yitian and Sun, Luning and Prunty, Jonathan E. and Li, Zongqian and Sánchez-García, Pablo and Jiang-Chen, Kexin and Casares, Pablo A. M. and Zu, Jiyun and Burden, John and Mehrbakhsh, Behzad and Stillwell, David J. and Cebrián, Manuel and Wang, Jindong and Henderson, Peter and Wu, Tongshuang and Kyllonen, Patrick C. and Cheke, Lucy G. and Xie, Xing and Hernández-Orallo, José},
journal = {Nature},
year = {2026},
volume = {652},
number = {8108},
pages = {58--67},
doi = {10.1038/s41586-026-10303-2},
url = {https://doi.org/10.1038/s41586-026-10303-2}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- AI evaluation
- demand profiles
- ability profiles
- large language models
- benchmarking
- transferability
- out-of-distribution prediction
- construct validity
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Zhou, L., Pacchiardi, L., Martínez‐Plumed, F., Collins, K. M., Moros-Daval, Y., Zhang, S., Zhao, Q., Huang, Y., Sun, L., Prunty, J. E., Li, Z., Sánchez-García, P., Jiang-Chen, K., Casares, P. A. M., Zu, J., Burden, J., Mehrbakhsh, B., Stillwell, D. J., Cebrián, M., . . . Hernández-Orallo, J. (2026). General scales unlock AI evaluation with explanatory and predictive power. Nature, 652(8108), 58–67. https://doi.org/10.1038/s41586-026-10303-2
How many times has this paper been cited?
22 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Nature: sign in and open the full text from this page.
Who wrote this paper?
Lexin Zhou, Lorenzo Pacchiardi, Fernando Martínez‐Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García and 14 more.
What is the DOI of this paper?
10.1038/s41586-026-10303-2, permanently at https://doi.org/10.1038/s41586-026-10303-2. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.