REFERENCES
- Bennett , E. M. , Alpert , R. and Goldstein , A. C. 1954 . Communications through limited response questioning . Public Opinion Quarterly , 18 : 303 – 308 .
- Bloch , D. A. and Kraemer , H. C. 1989 . 2 × 2 kappa coefficients: Measures of agreement or association . Biometrics , 45 : 269 – 287 .
- Brennan , R. L. and Prediger , D. J. 1981 . Coefficient kappa: Some uses, misuses, and alternatives . Educational and Psychological Measurement , 41 : 687 – 699 .
- Cohen , J. 1960 . A coefficient of agreement for nominal scales . Educational and Psychological Measurement , 20 : 37 – 46 .
- Cronbach , L. J. 1951 . Coefficient alpha and the internal structure of tests . Psychometrika , 16 : 297 – 334 .
- Goodman , L. A. and Kruskal , W. H. 1954 . Measures of association for cross classifications . Journal of the American Statistical Association , 49 : 732 – 764 .
- Hayes , A. F. and Krippendorff , K. 2007 . Answering the call for a standard reliability measure for coding data . Communication Methods and Measures , 1 : 77 – 89 .
- Krippendorff , K. 1978 . Reliability of binary attribute data . Biometrics , 34 : 142 – 144 .
- Krippendorff, K. (1993). Computing Krippendorff's alpha reliability. http://repository.upenn.edu/asc_papers/43/ (http://repository.upenn.edu/asc_papers/43/)
- Krippendorff , K. 2004 . Content analysis: An introduction to its methodology , 2nd , Thousand Oaks, CA : Sage .
- Krippendorff , K. 2008 . Systematic and random disagreement and the reliability of nominal data . Communication Methods and Measures , 2 : 323 – 338 .
- Lin , L. I. 1989 . A concordance correlation coefficient to evaluate reproducibility . Biometrics , 45 : 255 – 268 .
- Nunnally , J. C. and Bernstein , I. H. 1994 . Psychometric theory , 3rd , New York, NY : McGraw-Hill .
- Pearson , K. 1901 . Mathematical contributions to the theory of evolution. IX: On the principle of homotyposis and its relation to heredity, to variability of the individual, and to that of race. Part I: Homotyposis in the vegetable kingdom . Philosophical Transactions of The Royal Society of London, Series A , 197 : 285 – 379 .
- Scott , W. A. 1955 . Reliability of content analysis: The case of nominal scale coding . Public Opinion Quarterly , 19 : 321 – 325 .
- Tinsley , H. E. A. and Weiss , D. J. 2000 . “ Interrater reliability and agreement ” . In Handbook of applied multivariate statistics and mathematical modeling , Edited by: Tinsley , H. E. and Brown , S. D. 94 – 124 . New York, NY : Academic Press .
- Zwick , R. 1988 . Another look at interrater agreement . Psychological Bulletin , 103 : 347 – 387 .