Paper · 2015 · Open access

Kappa coefficient: a popular measure of rater agreement.

Wan Tang, Jun Hu, Hui Zhang, Pan Wu, Hua He

PubMed Central, 27(1), 62–67 · Published 25 February 2015 · DOI 10.11919/j.issn.1002-0829.215010

Free PDFView at the publisherCite this paper

In brief

“Kappa coefficient: a popular measure of rater agreement.” is a 2015 paper by Wan Tang and 4 co-authors, published in PubMed Central. OpenAlex counts 331 citations as of 15 November 2026, which puts it in the top 7% of works published in 2015 by citations. It is open access under a CC BY-NC-SA licence: the full text is free to read at PubMed Central.

Citations
331
Most cited in
2022 (50)
Field-weighted impact
4.27
References
8
Authors
5

Abstract

In mental health and psychosocial studies it is often necessary to report on the between-rater agreement of measures used in the study. This paper discusses the concept of agreement, highlighting its fundamental difference from correlation. Several examples demonstrate how to compute the kappa coefficient - a popular statistic for measuring agreement - both by hand and by using statistical software packages such as SAS and SPSS. Real study data are used to illustrate how to use and interpret this coefficient in clinical research and practice. The article concludes with a discussion of the limitations of the coefficient.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Tang, W., Hu, J., Zhang, H., Wu, P., & He, H. (2015). Kappa coefficient: a popular measure of rater agreement. PubMed Central, 27(1), 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010

MLA 9

Tang, Wan, et al. “Kappa coefficient: a popular measure of rater agreement.” PubMed Central, vol. 27, no. 1, 2015, pp. 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010.

Chicago

Tang, Wan, Jun Hu, Hui Zhang, Pan Wu, and Hua He. 2015. “Kappa coefficient: a popular measure of rater agreement.” PubMed Central 27 (1): 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010.

Harvard

Tang, W. et al. (2015) ‘Kappa coefficient: a popular measure of rater agreement.’, PubMed Central, 27(1), pp. 62–67. doi:10.11919/j.issn.1002-0829.215010.

IEEE

W. Tang, J. Hu, H. Zhang, P. Wu, and H. He, “Kappa coefficient: a popular measure of rater agreement.,” PubMed Central, vol. 27, no. 1, pp. 62–67, 2015, doi: 10.11919/j.issn.1002-0829.215010.

BibTeX

@article{tang2015kappa,
  title     = {{Kappa coefficient: a popular measure of rater agreement.}},
  author    = {Tang, Wan and Hu, Jun and Zhang, Hui and Wu, Pan and He, Hua},
  journal   = {PubMed Central},
  year      = {2015},
  volume    = {27},
  number    = {1},
  pages     = {62--67},
  doi       = {10.11919/j.issn.1002-0829.215010},
  url       = {https://doi.org/10.11919/j.issn.1002-0829.215010}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201777
20181818
20192222
20202929
20213434
20225050
20234343
20243737
20255050
20263434

Its field-weighted citation impact is 4.27: it has been cited 4.27 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement

  • kappa statistic
  • interobserver agreement
  • inter-rater reliability
  • categorical ratings
  • mental health assessment
  • psychosocial assessment
  • clinical research

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Tang, W., Hu, J., Zhang, H., Wu, P., & He, H. (2015). Kappa coefficient: a popular measure of rater agreement. PubMed Central, 27(1), 62–67. https://doi.org/10.11919/j.issn.1002-0829.215010

How many times has this paper been cited?

331 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at PubMed Central.

Who wrote this paper?

Wan Tang, Jun Hu, Hui Zhang, Pan Wu, Hua He.

What is the DOI of this paper?

10.11919/j.issn.1002-0829.215010. The permanent link is https://doi.org/10.11919/j.issn.1002-0829.215010.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.