Journal article · 2026 · Open access

General scales unlock AI evaluation with explanatory and predictive power

Lexin Zhou, Lorenzo Pacchiardi, Fernando Martínez‐Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García and 14 more

Nature, 652(8108), 58–67 · Published 1 April 2026 · DOI 10.1038/s41586-026-10303-2

Open full textCite this paper

In brief

“General scales unlock AI evaluation with explanatory and predictive power” is a 2026 journal article by Lexin Zhou and 25 co-authors, published in Nature. OpenAlex counts 22 citations as of 16 November 2026, which puts it in the top 1% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at Nature.

Citations
22
Most cited in
2026 (22)
Field-weighted impact
30.69
References
85
Authors
26

Abstract

Ensuring safe and effective use of artificial intelligence (AI) requires understanding and anticipating its performance on new tasks, from advanced scientific challenges to transformed workplace activities 1–3 . So far, benchmarking has guided progress in AI but has offered limited explanatory and predictive power for general-purpose AI systems 4–8 , attributed to limited transferability across specific tasks 9–11 . Here we introduce general scales for AI evaluation that elicit demand profiles explaining what capabilities common AI benchmarks truly measure, extract ability profiles quantifying the general strengths and limits of AI systems and robustly predict AI performance for new task instances. Our fully automated methodology builds on 18 rubrics, capturing a broad range of cognitive and intellectual demands, which place different task instances on the same general scales, illustrated on 15 large language models (LLMs) and 63 tasks. Both the demand and the ability profiles on these scales bring new insights such as construct validity through benchmark sensitivity and specificity and explain conflicting claims about whether AI has reasoning capabilities. Ultimately, high predictive power at the instance level becomes possible using the general scales, providing superior estimates over strong black-box baseline predictors, especially in out-of-distribution settings (new tasks and benchmarks). The scales, rubrics, battery, techniques and results presented here constitute a solid foundation for a science of AI evaluation, underpinning the reliable deployment of AI in the years ahead.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhou, L., Pacchiardi, L., Martínez‐Plumed, F., Collins, K. M., Moros-Daval, Y., Zhang, S., Zhao, Q., Huang, Y., Sun, L., Prunty, J. E., Li, Z., Sánchez-García, P., Jiang-Chen, K., Casares, P. A. M., Zu, J., Burden, J., Mehrbakhsh, B., Stillwell, D. J., Cebrián, M., . . . Hernández-Orallo, J. (2026). General scales unlock AI evaluation with explanatory and predictive power. Nature, 652(8108), 58–67. https://doi.org/10.1038/s41586-026-10303-2

MLA 9

Zhou, Lexin, et al. “General scales unlock AI evaluation with explanatory and predictive power.” Nature, vol. 652, no. 8108, 2026, pp. 58–67. https://doi.org/10.1038/s41586-026-10303-2.

Chicago

Zhou, Lexin, Lorenzo Pacchiardi, Fernando Martínez‐Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, et al. 2026. “General scales unlock AI evaluation with explanatory and predictive power.” Nature 652 (8108): 58–67. https://doi.org/10.1038/s41586-026-10303-2.

Harvard

Zhou, L. et al. (2026) ‘General scales unlock AI evaluation with explanatory and predictive power’, Nature, 652(8108), pp. 58–67. doi:10.1038/s41586-026-10303-2.

IEEE

L. Zhou et al., “General scales unlock AI evaluation with explanatory and predictive power,” Nature, vol. 652, no. 8108, pp. 58–67, 2026, doi: 10.1038/s41586-026-10303-2.

BibTeX

@article{zhou2026general,
  title     = {{General scales unlock AI evaluation with explanatory and predictive power}},
  author    = {Zhou, Lexin and Pacchiardi, Lorenzo and Martínez‐Plumed, Fernando and Collins, Katherine M. and Moros-Daval, Yael and Zhang, Seraphina and Zhao, Qinlin and Huang, Yitian and Sun, Luning and Prunty, Jonathan E. and Li, Zongqian and Sánchez-García, Pablo and Jiang-Chen, Kexin and Casares, Pablo A. M. and Zu, Jiyun and Burden, John and Mehrbakhsh, Behzad and Stillwell, David J. and Cebrián, Manuel and Wang, Jindong and Henderson, Peter and Wu, Tongshuang and Kyllonen, Patrick C. and Cheke, Lucy G. and Xie, Xing and Hernández-Orallo, José},
  journal   = {Nature},
  year      = {2026},
  volume    = {652},
  number    = {8108},
  pages     = {58--67},
  doi       = {10.1038/s41586-026-10303-2},
  url       = {https://doi.org/10.1038/s41586-026-10303-2}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling

  • AI evaluation
  • demand profiles
  • ability profiles
  • large language models
  • benchmarking
  • transferability
  • out-of-distribution prediction
  • construct validity

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Zhou, L., Pacchiardi, L., Martínez‐Plumed, F., Collins, K. M., Moros-Daval, Y., Zhang, S., Zhao, Q., Huang, Y., Sun, L., Prunty, J. E., Li, Z., Sánchez-García, P., Jiang-Chen, K., Casares, P. A. M., Zu, J., Burden, J., Mehrbakhsh, B., Stillwell, D. J., Cebrián, M., . . . Hernández-Orallo, J. (2026). General scales unlock AI evaluation with explanatory and predictive power. Nature, 652(8108), 58–67. https://doi.org/10.1038/s41586-026-10303-2

How many times has this paper been cited?

22 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Nature: sign in and open the full text from this page.

Who wrote this paper?

Lexin Zhou, Lorenzo Pacchiardi, Fernando Martínez‐Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García and 14 more.

What is the DOI of this paper?

10.1038/s41586-026-10303-2, permanently at https://doi.org/10.1038/s41586-026-10303-2. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.