Paper · 2015 · Open access
Kappa coefficient: a popular measure of rater agreement.
PubMed Central, 27(1), 62–67 · Published 25 February 2015 · DOI 10.11919/j.issn.1002-0829.215010
In brief
“Kappa coefficient: a popular measure of rater agreement.” is a 2015 paper by Wan Tang and 4 co-authors, published in PubMed Central. OpenAlex counts 331 citations as of 15 November 2026, which puts it in the top 7% of works published in 2015 by citations. It is open access under a CC BY-NC-SA licence: the full text is free to read at PubMed Central.
- Citations
- 331
- Most cited in
- 2022 (50)
- Field-weighted impact
- 4.27
- References
- 8
- Authors
- 5
Abstract
In mental health and psychosocial studies it is often necessary to report on the between-rater agreement of measures used in the study. This paper discusses the concept of agreement, highlighting its fundamental difference from correlation. Several examples demonstrate how to compute the kappa coefficient - a popular statistic for measuring agreement - both by hand and by using statistical software packages such as SAS and SPSS. Real study data are used to illustrate how to use and interpret this coefficient in clinical research and practice. The article concludes with a discussion of the limitations of the coefficient.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Tang, W., Hu, J., Zhang, H., Wu, P., & He, H. (2015). Kappa coefficient: a popular measure of rater agreement. PubMed Central, 27(1), 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010
MLA 9
Tang, Wan, et al. “Kappa coefficient: a popular measure of rater agreement.” PubMed Central, vol. 27, no. 1, 2015, pp. 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010.
Chicago
Tang, Wan, Jun Hu, Hui Zhang, Pan Wu, and Hua He. 2015. “Kappa coefficient: a popular measure of rater agreement.” PubMed Central 27 (1): 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010.
Harvard
Tang, W. et al. (2015) ‘Kappa coefficient: a popular measure of rater agreement.’, PubMed Central, 27(1), pp. 62–67. doi:10.11919/j.issn.1002-0829.215010.
IEEE
W. Tang, J. Hu, H. Zhang, P. Wu, and H. He, “Kappa coefficient: a popular measure of rater agreement.,” PubMed Central, vol. 27, no. 1, pp. 62–67, 2015, doi: 10.11919/j.issn.1002-0829.215010.
BibTeX
@article{tang2015kappa,
title = {{Kappa coefficient: a popular measure of rater agreement.}},
author = {Tang, Wan and Hu, Jun and Zhang, Hui and Wu, Pan and He, Hua},
journal = {PubMed Central},
year = {2015},
volume = {27},
number = {1},
pages = {62--67},
doi = {10.11919/j.issn.1002-0829.215010},
url = {https://doi.org/10.11919/j.issn.1002-0829.215010}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2017 | 7 | |
| 2018 | 18 | |
| 2019 | 22 | |
| 2020 | 29 | |
| 2021 | 34 | |
| 2022 | 50 | |
| 2023 | 43 | |
| 2024 | 37 | |
| 2025 | 50 | |
| 2026 | 34 |
Its field-weighted citation impact is 4.27: it has been cited 4.27 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- kappa statistic
- interobserver agreement
- inter-rater reliability
- categorical ratings
- mental health assessment
- psychosocial assessment
- clinical research
Work with this paper
Most-cited papers in Decision Sciences
- The PRISMA 2020 statement: an updated guideline for reporting systematic reviewsMatthew James Page, Joanne E. McKenzie, Patrick M. Bossuyt and 23 more · BMJ · 2021 · 144,919 citations
- Evaluating Structural Equation Models with Unobservable Variables and Measurement ErrorClaes Fornell, David F. Larcker · Journal of Marketing Research · 1981 · 118,336 citations
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesLi‐tze Hu, Peter M. Bentler · Structural Equation Modeling A Multidisciplinary Journal · 1999 · 117,461 citations
- Common method biases in behavioral research: A critical review of the literature and recommended remedies.Philip M. Podsakoff, SCOTT B. MACKENZIE, Jeong Yeon Lee and 1 more · Journal of Applied Psychology · 2003 · 89,248 citations
- Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statementDavid Moher, Alessandro Liberati, Jennifer Tetzlaff and 2 more · BMJ · 2009 · 85,524 citations
Questions about this paper
How do I cite this paper in APA style?
Tang, W., Hu, J., Zhang, H., Wu, P., & He, H. (2015). Kappa coefficient: a popular measure of rater agreement. PubMed Central, 27(1), 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010
How many times has this paper been cited?
331 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at PubMed Central.
Who wrote this paper?
Wan Tang, Jun Hu, Hui Zhang, Pan Wu, Hua He.
What is the DOI of this paper?
10.11919/j.issn.1002-0829.215010. The permanent link is https://doi.org/10.11919/j.issn.1002-0829.215010.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.