Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha

REFERENCES

• Aiken, L. S., West, S. G., Sechrest, L., Reno, R. R., with Roediger, H. L., Scarr, S., Kazdin, A. E., & Sherman, S. J. (1990). The training in statistics, methodology, and measurement in psychology. American Psychologist, 45, 721–734.
   Web of Science ®Google Scholar
• Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Monterey, CA: Brooks/Cole.
   Google Scholar
• Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Bagozzi, R. P., Forneil, C., & Larcker, D. F. (1981). Canonical correlation analysis as a special case of a structural relations model. Multivariate Behavioral Research, 16, 437–454.
   PubMed Web of Science ®Google Scholar
• Caruso, J. C. (2000). Reliability generalization of the NEO personality scales. Educational and Psychological Measurement, 60, 236–254.
   Web of Science ®Google Scholar
• Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70, 426–443.
   Web of Science ®Google Scholar
• Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304–1312.
   Web of Science ®Google Scholar
• Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003.
   Web of Science ®Google Scholar
• Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Chicago: Holt, Rinehart & Winston.
   Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
   Web of Science ®Google Scholar
• Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
   Google Scholar
• Dawson, T. E. (1999). Relating variance portioning in measurement analyses to the exact same process in substantive analyses. In B. Thompson (Ed.), Advances in social science methodology (Vol. 5, pp. 101–110). Stamford, CT: JAI Press.
   Google Scholar
• Elmore, P. B., Ekstrom, R., & Diamond, E. E. (1993). Counselors' test use practices: Indicators on the adequacy of measurement training. Measurement and Evaluation in Counseling and Development, 26, 116–124.
   Web of Science ®Google Scholar
• Gronlund, N. E., & Linn, R. L. (1990). Measurement and evaluation in teaching (6th ed.). New York: Macmillan.
   Google Scholar
• Gulliksen, H. (1950). Theory of mental tests. New York: Wiley.
   Google Scholar
• Henson, R. K. (2000). Demystifying parametric analyses: Illustrating canonical correlation as the multivariate general linear model. Multiple Linear Regression Viewpoints, 26(1), 11–19.
   Google Scholar
• Henson, R. K., Kogan, L. R., & Vacha-Haase, T. (2001). A reliability generalization study of the Teacher Efficacy Scale and related instruments. Educational and Psychological Measurement, 61, 404–420.
   Web of Science ®Google Scholar
• Henson, R. K., & Smith, A. D. (2000). State of the art in statistical significance and effect size reporting: A review of the APA task force report and current trends. Journal of Research and Development in Education, 33, 285–296.
   Google Scholar
• Henson, R. K., & Thompson, B. (2001, April). Characterizing measurement error in test scores across studies: A tutorial on conducting “reliability generalization” analyses. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
   Google Scholar
• Hogan, T. P., Benjamin, A., & Brezinski, K. L. (2000). Reliability methods: A note on the frequency of use of various types. Educational and Psychological Measurement, 60, 523–531.
   Web of Science ®Google Scholar
• Hopkins, K. D. (1998). Educational and psychological measurement and evaluation (8th ed.). Boston: Allyn & Bacon.
   Google Scholar
• Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
   Google Scholar
• Kieffer, K. M. (1999). Why generalizability theory is essential and classical test theory is often inadequate. In B. Thompson (Ed.), Advances in social science methodology (Vol. 5, pp. 149–170). Stamford, CT: JAI Press.
   Google Scholar
• Knapp, T. R. (1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410–416.
   Web of Science ®Google Scholar
• Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151–160.
   Web of Science ®Google Scholar
• Loo, R. (2001). Motivational orientations toward work: An evaluation of the Work Preference Inventory (Student Form). Measurement and Evaluation in Counseling and Development, 33, 222–233.
   Web of Science ®Google Scholar
• Lord, F. M., & Novick, M. R. (1968). Statistical theory of mental test scores. Reading, MA: Addison-Wesley.
   Google Scholar
• McCarthy, C. J., Moller, N. P., & Fouladi, R. T. (2001). Continued attachment to parents: Its relationship to affect regulation and perceived stress among college students. Measurement and Evaluation in Counseling and Development, 33, 198–213.
   Web of Science ®Google Scholar
• Mittag, K. C., & Thompson, B. (2000). A national survey of AERA members' perceptions of statistical significance tests and other statistical issues. Educational Researcher, 29(4), 14–20.
   Google Scholar
• Nunnally, J. C. (1967). Psychometric theory. New York: McGraw-Hill.
   Google Scholar
• Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
   Google Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
   Google Scholar
• Onwuegbuzie, A. J., & Daniel, L. G. (2000, November). Reliability generalization: The importance of considering sample specificity, confidence intervals, and subgroup differences. Paper presented at the annual meeting of the Mid-South Educational Research Association, Bowling Green, KY.
   Google Scholar
• Oosterhof, A. (2001). Classroom applications of educational measurement (3rd ed.). Upper Saddle River, NJ: Merrill/Prentice Hall.
   Google Scholar
• Pajares, F., Hartley, J., & Valiante, G. (2001). Response format in writing self-efficacy assessment: Greater discrimination increases prediction. Measurement and Evaluation in Counseling and Development, 33, 214–221.
   Web of Science ®Google Scholar
• Pedhazur, E. J., & Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Erlbaum.
   Google Scholar
• Popham, W. J. (2000). Modern educational measurement: Practical guidelines for educational leaders (3rd ed.). Boston: Allyn & Bacon.
   Google Scholar
• Reinhardt, B. (1996). Factors affecting coefficient alpha: A mini Monte Carlo study. In B. Thompson (Ed.), Advances in social science methodology (Vol. 4, pp. 3–20). Greenwich, CT: JAI Press.
   Google Scholar
• Sawilowsky, S. S. (2000a). Psychometrics versus datametrics: Comment on Vacha-Haase's “reliability generalization” method and some EPM editorial policies. Educational and Psychological Measurement, 60, 157–173.
   Web of Science ®Google Scholar
• Sawilowsky, S. S. (2000b). Reliability: Rejoinder to Thompson and Vacha-Haase. Educational and Psychological Measurement, 60, 196–200.
   Web of Science ®Google Scholar
• Sax, G. (1974). Principles of educational measurement and evaluation. Belmont, CA: Wadsworth.
   Google Scholar
• Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529–540.
   Web of Science ®Google Scholar
• Shavelson, R., & Webb, N. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
   Google Scholar
• Stanley, J. C. (1971). Reliability. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 356–442). Washington, DC: American Council on Education.
   Google Scholar
• Thompson, B. (1991). A primer on the logic and use of canonical correlation analysis. Measurement and Evaluation in Counseling and Development, 24, 80–95.
   Web of Science ®Google Scholar
• Thompson, B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837–847.
   Google Scholar
• Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25, 26–30.
   Google Scholar
• Thompson, B. (1999, February). Understanding coefficient alpha, really. Paper presented at the annual meeting of the Educational Research Exchange, College Station, TX.
   Google Scholar
• Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. Educational and Psychological Measurement, 60, 174–195.
   Web of Science ®Google Scholar
• Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement (pp. 560–620). Washington, DC: American Council on Education.
   Google Scholar
• Tymofievich, M., & Leroux, J. A. (2000). Counselors' competencies in using assessments. Measurement and Evaluation in Counseling and Development, 33, 50–59.
   Web of Science ®Google Scholar
• Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20.
   Web of Science ®Google Scholar
• Vacha-Haase, T., Ness, C., Nilsson, J., & Reetz, D. (1999). Practices regarding reporting of reliability coefficients: A review of three journals. Journal of Experimental Education, 67, 335–341.
   Web of Science ®Google Scholar
• Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory & Psychology, 10, 413–425.
   Web of Science ®Google Scholar
• Viswesvaran, C., & Ones, D. S. (2000). Measurement error in “Big Five Factors” personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement, 60, 224–235.
   Web of Science ®Google Scholar
• Wilkinson, L., & American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604.
   Web of Science ®Google Scholar
• Yin, P., & Fan, X. (2000). Assessing the reliability of Beck Depression Inventory scores: Reliability generalization across studies. Educational and Psychological Measurement, 60, 201–223.
   Web of Science ®Google Scholar