Journal article · 2026 · Open access

Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance

Jonathan Frez, Nelson A. Baloian, Luciano Ahumada, Ashot N. Harutyunyan

ACM Computing Surveys · Published 19 October 2026 · DOI 10.1145/3856819

Open PDFView at the publisherCite this paper

In brief

“Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance” is a 2026 journal article by Jonathan Frez and 3 co-authors, published in ACM Computing Surveys. OpenAlex counts 0 citations as of 17 November 2026. It is open access under a CC BY licence: the full text is free to read at ACM Computing Surveys.

Citations
0
References
136
Authors
4

Abstract

Explainable AI (XAI) is often evaluated through claims about trust, reliance, understanding, and performance, yet studies measure these constructs differently and frequently overlook confounding factors. This PRISMA-guided systematic review with narrative synthesis examines human-centered XAI evaluation across these four constructs. The review covers publications from 2015 to 2025. A merged search combined an OpenAlex-informed DOI/title catalog, prior surveys, citation chasing, and a Scopus coverage-completion stage identifying 9,026 records. A targeted revision update added two eligible publications, yielding 119 validated full-text publications. The synthesis highlights three patterns: trust and reliance can diverge; perceived understanding can exceed objective understanding; and interface salience or perceived accuracy can confound explanation effects. Aggregate advice acceptance, for example, cannot distinguish beneficial reliance from automation bias. We therefore recommend measuring acceptance separately for correct and incorrect AI outputs, testing understanding beyond self-report, documenting study context and interface conditions, and evaluating explanations under uncertainty or model failure. The review contributes construct definitions, a synthesis across designs and domains, an analysis of evaluation measures, and practical reporting guidelines. It also examines generated explanations and citation-based interfaces, supporting more reproducible and interpretable human-centered XAI evaluations.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Frez, J., Baloian, N. A., Ahumada, L., & Harutyunyan, A. N. (2026). Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance. ACM Computing Surveys. https://doi.org/10.1145/3856819

MLA 9

Frez, Jonathan, et al. “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance.” ACM Computing Surveys, 2026. https://doi.org/10.1145/3856819.

Chicago

Frez, Jonathan, Nelson A. Baloian, Luciano Ahumada, and Ashot N. Harutyunyan. 2026. “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance.” ACM Computing Surveys. https://doi.org/10.1145/3856819.

Harvard

Frez, J. et al. (2026) ‘Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance’, ACM Computing Surveys. doi:10.1145/3856819.

IEEE

J. Frez, N. A. Baloian, L. Ahumada, and A. N. Harutyunyan, “Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance,” ACM Computing Surveys, 2026, doi: 10.1145/3856819.

BibTeX

@article{frez2026evaluating,
  title     = {{Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance}},
  author    = {Frez, Jonathan and Baloian, Nelson A. and Ahumada, Luciano and Harutyunyan, Ashot N.},
  journal   = {ACM Computing Surveys},
  year      = {2026},
  doi       = {10.1145/3856819},
  url       = {https://doi.org/10.1145/3856819}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)

  • explainable AI
  • human-centered evaluation
  • trust in AI
  • AI reliance
  • perceived understanding
  • advice acceptance
  • automation bias
  • evaluation metrics

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Frez, J., Baloian, N. A., Ahumada, L., & Harutyunyan, A. N. (2026). Evaluating Explainable AI with Humans: Trust, Reliance, Understanding, and Performance. ACM Computing Surveys. https://doi.org/10.1145/3856819

How many times has this paper been cited?

0 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at ACM Computing Surveys: sign in and open the PDF from this page.

Who wrote this paper?

Jonathan Frez, Nelson A. Baloian, Luciano Ahumada, Ashot N. Harutyunyan.

What is the DOI of this paper?

10.1145/3856819, permanently at https://doi.org/10.1145/3856819. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.