Journal article · 1981

Estimating Scorer Agreement for Nominal Categorization Systems

Nancy W. Burton

Educational and Psychological Measurement, 41(4), 953–962 · Published 1 December 1981 · DOI 10.1177/001316448104100403

View at the publisherCite this paper

In brief

“Estimating Scorer Agreement for Nominal Categorization Systems” is a 1981 journal article by Nancy W. Burton, published in Educational and Psychological Measurement. OpenAlex counts 12 citations as of 15 November 2026. The publisher's version is not open access, and OpenAlex records no free legal copy.

Citations
12
Most cited in
2019 (2)
Field-weighted impact
0.46
References
15
Authors
1

Abstract

National Assessment has devised a scoring system that involves using nominal classifications of responses as well as an overall evaluation of whether responses provide acceptable evidence that an educational objective has been met. This study was concerned with selecting a measure of scorer agreement for an ongoing quality-control program. The purpose of the agreement statistic… Read the full abstract at the publisher.

Excerpt. This paper is not open access.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Burton, N. W. (1981). Estimating Scorer Agreement for Nominal Categorization Systems. Educational and Psychological Measurement, 41(4), 953–962. https://doi.org/10.1177/001316448104100403

MLA 9

Burton, Nancy W. “Estimating Scorer Agreement for Nominal Categorization Systems.” Educational and Psychological Measurement, vol. 41, no. 4, 1981, pp. 953–962. https://doi.org/10.1177/001316448104100403.

Chicago

Burton, Nancy W. 1981. “Estimating Scorer Agreement for Nominal Categorization Systems.” Educational and Psychological Measurement 41 (4): 953–962. https://doi.org/10.1177/001316448104100403.

Harvard

Burton, N. W. (1981) ‘Estimating Scorer Agreement for Nominal Categorization Systems’, Educational and Psychological Measurement, 41(4), pp. 953–962. doi:10.1177/001316448104100403.

IEEE

N. W. Burton, “Estimating Scorer Agreement for Nominal Categorization Systems,” Educational and Psychological Measurement, vol. 41, no. 4, pp. 953–962, 1981, doi: 10.1177/001316448104100403.

BibTeX

@article{burton1981estimating,
  title     = {{Estimating Scorer Agreement for Nominal Categorization Systems}},
  author    = {Burton, Nancy W.},
  journal   = {Educational and Psychological Measurement},
  year      = {1981},
  volume    = {41},
  number    = {4},
  pages     = {953--962},
  doi       = {10.1177/001316448104100403},
  url       = {https://doi.org/10.1177/001316448104100403}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement

  • inter-rater reliability
  • Cohen's kappa
  • item difficulty
  • scoring system
  • national assessment
  • quality control

Work with this paper

Most-cited papers in Decision Sciences

All highly cited Decision Sciences papers

Questions about this paper

How do I cite this paper in APA style?

Burton, N. W. (1981). Estimating Scorer Agreement for Nominal Categorization Systems. Educational and Psychological Measurement, 41(4), 953–962. https://doi.org/10.1177/001316448104100403

How many times has this paper been cited?

12 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.

Who wrote this paper?

Nancy W. Burton.

What is the DOI of this paper?

10.1177/001316448104100403. The permanent link is https://doi.org/10.1177/001316448104100403.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.