Journal article · 2026 · Open access
Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance
ACM Computing Surveys · Published 19 October 2026 · DOI 10.1145/3856819
In brief
“Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance” is a 2026 journal article by Jonathan Frez and 3 co-authors, published in ACM Computing Surveys. OpenAlex counts 0 citations as of 17 November 2026. It is open access under a CC BY licence: the full text is free to read at ACM Computing Surveys.
- Citations
- 0
- References
- 136
- Authors
- 4
Abstract
Explainable AI (XAI) is often evaluated through claims about trust, reliance, understanding, and performance, yet studies measure these constructs differently and frequently overlook confounding factors. This PRISMA-guided systematic review with narrative synthesis examines human-centered XAI evaluation across these four constructs. The review covers publications from 2015 to 2025. A merged search combined an OpenAlex-informed DOI/title catalog, prior surveys, citation chasing, and a Scopus coverage-completion stage identifying 9,026 records. A targeted revision update added two eligible publications, yielding 119 validated full-text publications. The synthesis highlights three patterns: trust and reliance can diverge; perceived understanding can exceed objective understanding; and interface salience or perceived accuracy can confound explanation effects. Aggregate advice acceptance, for example, cannot distinguish beneficial reliance from automation bias. We therefore recommend measuring acceptance separately for correct and incorrect AI outputs, testing understanding beyond self-report, documenting study context and interface conditions, and evaluating explanations under uncertainty or model failure. The review contributes construct definitions, a synthesis across designs and domains, an analysis of evaluation measures, and practical reporting guidelines. It also examines generated explanations and citation-based interfaces, supporting more reproducible and interpretable human-centered XAI evaluations.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Frez, J., Baloian, N. A., Ahumada, L., & Harutyunyan, A. N. (2026). Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance. ACM Computing Surveys. https://doi.org/10.1145/3856819
MLA 9
Frez, Jonathan, et al. “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance.” ACM Computing Surveys, 2026. https://doi.org/10.1145/3856819.
Chicago
Frez, Jonathan, Nelson A. Baloian, Luciano Ahumada, and Ashot N. Harutyunyan. 2026. “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance.” ACM Computing Surveys. https://doi.org/10.1145/3856819.
Harvard
Frez, J. et al. (2026) ‘Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance’, ACM Computing Surveys. doi:10.1145/3856819.
IEEE
J. Frez, N. A. Baloian, L. Ahumada, and A. N. Harutyunyan, “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance,” ACM Computing Surveys, 2026, doi: 10.1145/3856819.
BibTeX
@article{frez2026evaluating,
title = {{Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance}},
author = {Frez, Jonathan and Baloian, Nelson A. and Ahumada, Luciano and Harutyunyan, Ashot N.},
journal = {ACM Computing Surveys},
year = {2026},
doi = {10.1145/3856819},
url = {https://doi.org/10.1145/3856819}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- explainable AI
- human-centered evaluation
- trust in AI
- AI reliance
- perceived understanding
- advice acceptance
- automation bias
- evaluation metrics
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Frez, J., Baloian, N. A., Ahumada, L., & Harutyunyan, A. N. (2026). Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance. ACM Computing Surveys. https://doi.org/10.1145/3856819
How many times has this paper been cited?
0 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at ACM Computing Surveys: sign in and open the PDF from this page.
Who wrote this paper?
Jonathan Frez, Nelson A. Baloian, Luciano Ahumada, Ashot N. Harutyunyan.
What is the DOI of this paper?
10.1145/3856819, permanently at https://doi.org/10.1145/3856819. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.