Paper · 2009

More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters

Michael P. Cunningham

Published 1 January 2009

View at the publisherCite this paper

In brief

“More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters” is a 2009 paper by Michael P. Cunningham. OpenAlex counts 88 citations as of 18 November 2026. The publisher's version is not open access, and OpenAlex records no free legal copy.

Citations
88
Most cited in
2018 (10)
Field-weighted impact
2.16
References
12
Authors
1

Abstract

The kappa coefficient is a widely used statistic for measuring the degree of reliability between raters. SAS ® procedures and macros exist for calculating kappa with two or more raters, but none address situations when the kappa coefficient alone does not sufficiently describe the level of reliability. When the prevalence of a rating in the… Read the full abstract at the publisher.

Excerpt. This paper is not open access.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Cunningham, M. P. (2009). More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters. https://support.sas.com/resources/papers/proceedings09/242-2009.pdf

MLA 9

Cunningham, Michael P. “More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters.” 2009. https://support.sas.com/resources/papers/proceedings09/242-2009.pdf.

Chicago

Cunningham, Michael P. 2009. “More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters.” https://support.sas.com/resources/papers/proceedings09/242-2009.pdf.

Harvard

Cunningham, M. P. (2009) ‘More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters’. Available at: https://support.sas.com/resources/papers/proceedings09/242-2009.pdf.

IEEE

M. P. Cunningham, “More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters,” 2009.

BibTeX

@article{cunningham2009more,
  title     = {{More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters}},
  author    = {Cunningham, Michael P.},
  year      = {2009},
  url       = {https://support.sas.com/resources/papers/proceedings09/242-2009.pdf}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201677
201788
20181010
201955
202044
202166
202255
202322
202444
202622

Its field-weighted citation impact is 2.16: it has been cited 2.16 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement

  • inter-rater reliability
  • kappa statistic
  • 2x2 contingency tables
  • SAS macro
  • observer agreement

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Cunningham, M. P. (2009). More than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability between Two Raters. https://support.sas.com/resources/papers/proceedings09/242-2009.pdf

How many times has this paper been cited?

88 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.

Who wrote this paper?

Michael P. Cunningham.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.