Journal article · 1983

Rater agreement for complex assessments

Lawrence J. Hubert, Reginald G. Golledge

British Journal of Mathematical and Statistical Psychology, 36(2), 207–216 · Published 1 November 1983 · DOI 10.1111/j.2044-8317.1983.tb01126.x

View at the publisherCite this paper

In brief

“Rater agreement for complex assessments” is a 1983 journal article by Lawrence J. Hubert and Reginald G. Golledge, published in British Journal of Mathematical and Statistical Psychology. OpenAlex counts 10 citations as of 18 November 2026. The publisher's version is not open access, and OpenAlex records no free legal copy.

Citations
10
Most cited in
2015 (1)
Field-weighted impact
1.02
Authors
2

Abstract

A general strategy is proposed for measuring and testing the agreement between two raters who use some common scheme for assessing each of n objects. As long as a numerical measure of correspondence or proximity can be obtained between any two assessments, an agreement index can be defined and tested for significance under a null… Read the full abstract at the publisher.

Excerpt. This paper is not open access.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hubert, L. J., & Golledge, R. G. (1983). Rater agreement for complex assessments. British Journal of Mathematical and Statistical Psychology, 36(2), 207–216. https://doi.org/10.1111/j.2044-8317.1983.tb01126.x

MLA 9

Hubert, Lawrence J., and Reginald G. Golledge. “Rater agreement for complex assessments.” British Journal of Mathematical and Statistical Psychology, vol. 36, no. 2, 1983, pp. 207–216. https://doi.org/10.1111/j.2044-8317.1983.tb01126.x.

Chicago

Hubert, Lawrence J. and Reginald G. Golledge. 1983. “Rater agreement for complex assessments.” British Journal of Mathematical and Statistical Psychology 36 (2): 207–216. https://doi.org/10.1111/j.2044-8317.1983.tb01126.x.

Harvard

Hubert, L. J. and Golledge, R. G. (1983) ‘Rater agreement for complex assessments’, British Journal of Mathematical and Statistical Psychology, 36(2), pp. 207–216. doi:10.1111/j.2044-8317.1983.tb01126.x.

IEEE

L. J. Hubert and R. G. Golledge, “Rater agreement for complex assessments,” British Journal of Mathematical and Statistical Psychology, vol. 36, no. 2, pp. 207–216, 1983, doi: 10.1111/j.2044-8317.1983.tb01126.x.

BibTeX

@article{hubert1983rater,
  title     = {{Rater agreement for complex assessments}},
  author    = {Hubert, Lawrence J. and Golledge, Reginald G.},
  journal   = {British Journal of Mathematical and Statistical Psychology},
  year      = {1983},
  volume    = {36},
  number    = {2},
  pages     = {207--216},
  doi       = {10.1111/j.2044-8317.1983.tb01126.x},
  url       = {https://doi.org/10.1111/j.2044-8317.1983.tb01126.x}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement

  • rater agreement
  • inter-rater reliability
  • index of agreement
  • weighted kappa
  • complex assessment
  • significance testing

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Hubert, L. J., & Golledge, R. G. (1983). Rater agreement for complex assessments. British Journal of Mathematical and Statistical Psychology, 36(2), 207–216. https://doi.org/10.1111/j.2044-8317.1983.tb01126.x

How many times has this paper been cited?

10 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.

Who wrote this paper?

Lawrence J. Hubert, Reginald G. Golledge.

What is the DOI of this paper?

10.1111/j.2044-8317.1983.tb01126.x, permanently at https://doi.org/10.1111/j.2044-8317.1983.tb01126.x. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.