Table of Contents
Advances in Statistics
Volume 2014, Article ID 853090, 5 pages
http://dx.doi.org/10.1155/2014/853090
Research Article

On Agreement Tables with Constant Kappa Values

Institute of Psychology, Unit Methodology and Statistics, Leiden University, P.O. Box 9555, 2300 RB Leiden, The Netherlands

Received 8 July 2014; Accepted 14 August 2014; Published 24 August 2014

Academic Editor: Chin-Shang Li

Copyright © 2014 Matthijs J. Warrens. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. U. Jakobsson and A. Westergren, “Statistical methods for assessing agreement for ordinal data,” Scandinavian Journal of Caring Sciences, vol. 19, no. 4, pp. 427–431, 2005. View at Publisher · View at Google Scholar · View at Scopus
  2. M. Maclure and W. C. Willett, “Misinterpretation and misuse of the Kappa statistic,” The American Journal of Epidemiology, vol. 126, no. 2, pp. 161–169, 1987. View at Google Scholar · View at Scopus
  3. A. Agresti, “Modelling patterns of agreement and disagreement,” Statistical Methods in Medical Research, vol. 1, no. 2, pp. 201–218, 1992. View at Publisher · View at Google Scholar · View at Scopus
  4. A. Agresti, Categorical Data Analysis, Wiley, Hoboken, NJ, USA, 2002.
  5. J. Cohen, “A coefficient of agreement for nominal scales,” Educational and Psychological Measurement, vol. 20, pp. 37–46, 1960. View at Google Scholar
  6. L. M. Hsu and R. Field, “Interrater agreement measures: comments on Kappan, Cohen's Kappa, Scott's π, and Aickin's α,” Understanding Statistics, vol. 2, no. 3, pp. 205–219, 2003. View at Publisher · View at Google Scholar
  7. M. J. Warrens, “Cohen's kappa can always be increased and decreased by combining categories,” Statistical Methodology, vol. 7, no. 6, pp. 673–677, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  8. J. Cohen, “Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit,” Psychological Bulletin, vol. 70, no. 4, pp. 213–220, 1968. View at Publisher · View at Google Scholar · View at Scopus
  9. J. L. Fleiss and J. Cohen, “The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability,” Educational and Psychological Measurement, vol. 33, pp. 613–619, 1973. View at Google Scholar
  10. S. Vanbelle and A. Albert, “A note on the linearly weighted kappa coefficient for ordinal scales,” Statistical Methodology, vol. 6, no. 2, pp. 157–163, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  11. M. J. Warrens, “Some paradoxical results for the quadratically weighted kappa,” Psychometrika, vol. 77, no. 2, pp. 315–323, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  12. M. J. Warrens, “Conditional inequalities between Cohen's kappa and weighted kappas,” Statistical Methodology, vol. 10, pp. 14–22, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  13. H. J. A. Schouten, “Nominal scale agreement among observers,” Psychometrika, vol. 51, no. 3, pp. 453–466, 1986. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  14. A. Agresti, Categorical Data Analysis, Wiley, New York, NY, USA, 1990. View at MathSciNet
  15. Y. M. M. Bishop, S. E. Fienberg, and P. W. Holland, Discrete Multivariate Analysis: Theory and Practice, The MIT Press, Cambridge, Mass, USA, 1975. View at MathSciNet
  16. J. L. Fleiss, J. Cohen, and B. S. Everitt, “Large sample standard errors of kappa and weighted kappa,” Psychological Bulletin, vol. 72, no. 5, pp. 323–327, 1969. View at Publisher · View at Google Scholar · View at Scopus
  17. D. Cicchetti and T. Allison, “A new procedure for assessing reliability of scoring EEG sleep recordings,” The American Journal of EEG Technology, vol. 11, pp. 101–109, 1971. View at Google Scholar
  18. C. Schuster, “A note on the interpretation of weighted kappa and its relations to other rater agreement statistics for metric scales,” Educational and Psychological Measurement, vol. 64, no. 2, pp. 243–253, 2004. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  19. P. Graham and R. Jackson, “The analysis of ordinal agreement data: beyond weighted kappa,” Journal of Clinical Epidemiology, vol. 46, no. 9, pp. 1055–1062, 1993. View at Publisher · View at Google Scholar · View at Scopus