Reliability Estimates for Undergraduate Grade Point Average

References

• ACT. (2010). National collegiate retention and persistence to degree rates. Iowa City, IA: Author.
   Google Scholar
• ACT. (2014). The ACT technical manual. Iowa City, IA: Author.
   Google Scholar
• Allen, J. (2013). Updating the ACT College Readiness Benchmarks ( ACT Research Report No. 2013-6). Iowa City, IA: ACT, Inc.
   Google Scholar
• Allen, J., & Sconing, J. (2005). Using ACT Assessment scores to set benchmarks for college readiness ( ACT Research Report No. 2005-3). Iowa City, IA: ACT, Inc.
   Google Scholar
• Angoff, W. H. (1953). Test reliability and effective test length. Psychometrika, 18, 1–14. doi:10.1007/BF02289023
   Google Scholar
• Association of American Medical Colleges. (2016). The MCAT® Exam: Year at a glance 2015. Washington, DC: Author. Retrieved from https://www.aamc.org/download/454206/data/mcatatglance2015.pdf
   Google Scholar
• Bacon, D. R., & Bean, B. (2006). GPA in research studies: An invaluable but overlooked opportunity. Journal of Marketing Education, 28(1), 35–42. doi:10.1177/0273475305284638
   Google Scholar
• Barritt, L. S. (1966). The consistency of first-semester grade point average. Journal of Educational Measurement, 3(3), 261–262.
   Web of Science ®Google Scholar
• Beatty, A. S., Walmsley, P. T., Sackett, P. R., Kuncel, N. R., & Koch, A. J. (2015). The reliability of college grades. Educational Measurement: Issues & Practices, 34(4), 31–40. doi:10.1111/emip.12096
   Web of Science ®Google Scholar
• Bendig, A. W. (1953). The reliability of letter grades. Educational and Psychological Measurement, 13(2), 311–321. doi:10.1177/001316445301300215
   Web of Science ®Google Scholar
• Bloom, B. S. (1971). Mastery learning. In J. H. Block (Ed.), Mastery learning: Theory and practice (pp. 47–63). New York, NY: Holt, Rinehart & Winston.
   Google Scholar
• Board, C. (2015). Test characteristics of the SAT: Reliability, difficulty levels, completion rates, January 2014-December 2014. New York, NY: The College Board. Retrieved from https://secure-media.collegeboard.org/digitalServices/pdf/sat/sat-characteristics-reliability-difficulty-completion-rates-2015.pdf
   Google Scholar
• Brennan, R. L. (2001a). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement, 38, 295–317. doi:10.1111/jedm.2001.38.issue-4
   Web of Science ®Google Scholar
• Brennan, R. L. (2001b). Generalizability Theory. New York, NY: Springer-Verlag.
   Google Scholar
• Bridgeman, B., Pollack, J., & Burton, N. (2008). Predicting grades in different types of college courses ( College Board Research Report 2008-1, ETS RR-08-06). New York, NY: The College Board.
   Google Scholar
• Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. S., … Welsh, M. E. (2015). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803–848. doi:10.3102/0034654316672069
   Web of Science ®Google Scholar
• Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3(3), 296–322.
   Google Scholar
• Callender, J. C., & Osburn, H. G. (1977). A method for maximizing split-half reliability coefficients. Educational and Psychological Measurement, 37(4), 819–825. doi:10.1177/001316447703700402
   Web of Science ®Google Scholar
• Callender, J. C., & Osburn, H. G. (1979). An empirical comparison of coefficient alpha, Guttman’s Lambda‐2, and MSPLIT maximized split-half reliability estimates. Journal of Educational Measurement, 16(2), 89–99. doi:10.1111/jedm.1979.16.issue-2
   Web of Science ®Google Scholar
• Caulkins, J. P., Larkey, P. D., & Wei, J. (1996). Adjusting GPA to reflect course difficulty ( Working paper). Pittsburgh, PA: Heinz School of Public Policy and Management, Carnegie Mellon University.
   Google Scholar
• Clark, E. L. (1964). Reliability of grade point averages. The Journal of Educational Research, 57(8), 428–430. doi:10.1080/00220671.1964.10883112
   Web of Science ®Google Scholar
• Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 96–104. doi:10.1037/0021-9010.78.1.98
   Web of Science ®Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal consistency of tests. Psychometrika, 16(3), 297–334. doi:10.1007/BF02310555
   Web of Science ®Google Scholar
• Cronbach, L. J. (1971). Test Validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443–507). Washington, DC: American Council on Education.
   Google Scholar
• Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16, 137–163. doi:10.1111/j.2044-8317.1963.tb00206.x
   Web of Science ®Google Scholar
• Cronbach, L. J., Schoenemann, P., & McKie, D. (1965). Alpha coefficients for stratified parallel tests. Educational and Psychological Measurement, 25, 291–312. doi:10.1177/001316446502500201
   Web of Science ®Google Scholar
• Educational Testing Service. (2017). GRE guide to the use of scores, 2017-2018. Princeton, NJ: Author.
   Google Scholar
• Elliott, R., & Strenta, A. C. (1988). Effects of improving the reliability of the GPA on prediction generally and on comparative predictions for gender and race. Journal of Educational Measurement, 25(4), 333–347. doi:10.1111/j.1745-3984.1988.tb00312.x
   Web of Science ®Google Scholar
• Etaugh, A. F., Etaugh, C. F., & Hurd, D. E. (1972). Reliability of college grades and grade point averages: Some implications for the prediction of academic performance. Educational and Psychological Measurement, 32(4), 1045–1050. doi:10.1177/001316447203200421
   Web of Science ®Google Scholar
• Feldt, L. S. (1975). Estimation of the reliability of a test divided into two parts of unequal length. Psychometrika, 40, 557–561. doi:10.1007/BF02291556
   Web of Science ®Google Scholar
• Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105–146). New York: American Council on Education and Macmillan.
   Google Scholar
• Feldt, L. S., & Charter, R. A. (2003). Estimating the reliability of a test split into two parts of equal or unequal length. Psychological Methods, 8(1), 102. doi:10.1037/1082-989X.8.1.102
   PubMed Web of Science ®Google Scholar
• Feldt, L. S., & Charter, R. A. (2006). Averaging internal consistency reliability coefficients. Educational and Psychological Measurement, 66(2), 215–227. doi:10.1177/0013164404273947
   Web of Science ®Google Scholar
• Forsyth, R. A., & Feldt, L. S. (1969). An investigation of empirical sampling distributions of correlation coefficients corrected for attenuation. Educational and Psychological Measurement, 29, 61–71. doi:10.1177/001316446902900104
   Web of Science ®Google Scholar
• Gilmer, J. S., & Feldt, L. S. (1983). Reliability estimation for a test with parts of unknown lengths. Psychometrika, 48, 99–111. doi:10.1007/BF02314679
   Web of Science ®Google Scholar
• Glaser, R. (1963). Instructional technology and the measurement of learning outcomes: Some questions. American Psychologist, 18, 519–521. doi:10.1037/h0049294
   Web of Science ®Google Scholar
• Goldman, R. D., & Hewitt, B. N. (1975). Adaption-level as an explanation for differential standards in college grading. Journal of Educational Measurement, 12, 149–161. doi:10.1111/j.1745-3984.1975.tb01017.x
   Web of Science ®Google Scholar
• Goldman, R. D., & Widawski, M. H. (1976). A within-subjects technique for comparing college grading standards: Implications in the validity of the evaluation of college achievement. Educational and Psychological Measurement, 36, 381–390. doi:10.1177/001316447603600217
   Web of Science ®Google Scholar
• Graduate Management Admission Council. (2017). Validity, Reliability & Fairness. The results are in: The GMAT^® exam more accurately predicts success in your program than grade point averages (GPAs). Retrieved from http://www.gmac.com/gmat-other-assessments/about-the-gmat-exam/validity-reliability-fairness.aspx
   Google Scholar
• Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977). Limitations of coefficient alpha as an index of test unidimensionality1. Educational and Psychological Measurement, 37(4), 827–838. doi:10.1177/001316447703700403
   Web of Science ®Google Scholar
• Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155–167. doi:10.1007/s11336-008-9099-3
   Web of Science ®Google Scholar
• Guttman, L. A. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10, 255–282. doi:10.1007/BF02288892
   PubMed Web of Science ®Google Scholar
• Haertel, E. H. (2006). Reliability. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 65–110). West Port, CT: American Council on Education, Praeger.
   Google Scholar
• Hoyt, C. (1941). Test reliability estimated by analysis of variance. Psychometrika, 6, 153–160. doi:10.1007/BF02289270
   Google Scholar
• Humphreys, L. G. (1968). The fleeting nature of the prediction of college academic success. Journal of Educational Psychology, 59, 375–380. doi:10.1037/h0026234
   PubMed Web of Science ®Google Scholar
• Humphreys, L. G., & Taber, T. (1973). Postdiction study of the GRE and eight semesters of college grades. Journal of Educational Measurement, 10, 179–184. doi:10.1111/j.1745-3984.1973.tb00795.x
   Web of Science ®Google Scholar
• Imose, R., & Barber, L. K. (2015). Using undergraduate grade point average as a selection tool: A synthesis of the literature. The Psychologist-Manager Journal, 18(1), 1–11. doi:10.1037/mgr0000025
   Web of Science ®Google Scholar
• Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36(2), 109–133. doi:10.1007/BF02291393
   Web of Science ®Google Scholar
• Keiser, H. N., Sackett, P. R., Kuncel, N. R., & Brothen, T. (2016). Why women perform better in college than admission scores would predict: Exploring the roles of conscientiousness and course-taking patterns. Journal of Applied Psychology, 101(4), 569–581. doi:10.1037/apl0000069
   PubMed Web of Science ®Google Scholar
• Kobrin, J. L., Patterson, B. F., Shaw, E. J., Mattern, K. D., & Barbuti, S. M. (2008). The validity of the SAT for predicting first-year college grade point average ( College Board Research Report 2008-5). New York, NY: The College Board.
   Google Scholar
• Law School Admission Council. (2017). LSAT scores as predictors of law school performance. Retrieved from http://www.lsac.org/jd/lsat/your-score/law-school-performance.
   Google Scholar
• Lei, P. W., Bassiri, D., & Schultz, E. M. (2001). Alternatives to the Grade Point Average as a Measure of Academic Achievement in College ( ACT Research Report 2001-4). Iowa City, IA: ACT.
   Google Scholar
• Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison Wesley.
   Google Scholar
• Masters, H. V., & Upshall, C. C. (1934). Reliability of objective classroom tests and course grades at the college level. Education Administration and Supervision, 20, 533–540.
   Google Scholar
• Mattern, K. D., & Patterson, B. F. (2011). Validity of the SAT for predicting fourth-year grades: 2006 SAT validity sample ( College Board Statistical Report 2011-7). New York, NY: The College Board.
   Google Scholar
• Mattern, K. D., & Patterson, B. F. (2013). Test of slope and intercept bias in college admissions: A response to Aguinis, Culpepper, and Pierce (2010). Journal of Applied Psychology, 98, 134–147. doi:10.1037/a0030610
   PubMed Web of Science ®Google Scholar
• Mattern, K. D., & Patterson, B. F. (2014). Synthesis of recent SAT validity findings: Trend data over time and cohorts ( College Board Research in Review 2014-1). New York, NY: The College Board.
   Google Scholar
• Millman, J., Slovacek, S. P., Kulick, E., & Mitchell, K. J. (1983). Does grade inflation affect the reliability of grades? Research in Higher Education, 19(4), 423–429. doi:10.1007/BF01418444
   Web of Science ®Google Scholar
• Osburn, H. G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological Methods, 5, 343–355. doi:10.1037/1082-989X.5.3.343
   PubMed Web of Science ®Google Scholar
• Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Pennock-Roman, M. (1994). College major and gender differences in the prediction of college grades ( College Board Report No. 94-2). New York, NY: The College Board.
   Google Scholar
• Ployhart, R. E., Schneider, B., & Schmitt, N. (2006). Staffing organizations: Contemporary practice and theory. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Rajaratnam, N., Cronbach, L. J., & Gleser, G. C. (1965). Generalizability of stratified-parallel tests. Psychometrika, 30, 39–56. doi:10.1007/BF02289746
   PubMed Web of Science ®Google Scholar
• Ramist, L., Lewis, C., & McCamley, L. (1990). Implications of using freshman GPA as the criterion for the predictive validity of the SAT. In W. W. Willingham, C. Lewis, R. Morgan, & L. Ramist (Eds.), Predicting college grades: An analysis of institutional trends over two decades (pp. 253–288). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Raykov, T., & Shrout, P. E. (2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9(2), 195–212. doi:10.1207/S15328007SEM0902_3
   Web of Science ®Google Scholar
• Reuterberg, S. E., & Gustafsson, J. E. (1992). Confirmatory factor analysis and reliability: Testing measurement model assumptions. Educational and Psychological Measurement, 52, 795–811. doi:10.1177/0013164492052004001
   Web of Science ®Google Scholar
• Rodriguez, M. C., & Maeda, Y. (2006). Meta-analysis of coefficient alpha. Psychological Methods, 11(3), 306–322. doi:10.1037/1082-989X.11.3.306
   PubMed Web of Science ®Google Scholar
• Rogers, H. H. (1937). The reliability of college grades. School and Society, 45, 758–760.
   Google Scholar
• Rojstaczer, S., & Healy, C. (2012). Where A is ordinary: The evolution of American college and university grading, 1940–2009. Teachers College Record, 114(7), 1–23.
   Web of Science ®Google Scholar
• Roth, B., Becker, N., Romeyke, S., Schafer, S., Domnick, F., & Spinath, F. M. (2015). Intelligence and school grades: A meta-analysis. Intelligence, 53, 118–137. doi:10.1016/j.intell.2015.09.002
   Web of Science ®Google Scholar
• Roth, P. L., BeVier, C. A., Switzer, F. S., & Schippmann, J. S. (1996). Meta-analyzing the relationship between grades and job performance. Journal of Applied Psychology, 81(5), 548–556. doi:10.1037/0021-9010.81.5.548
   Web of Science ®Google Scholar
• Rulon, P. J. (1939). A simplified procedure for determining the reliability of a test by split-halves. Harvard Educational Review, 9(1), 99–103.
   Google Scholar
• Sackett, P. R., Kuncel, N. R., Arneson, J. J., Cooper, S. R., & Waters, S. D. (2009). Does socioeconomic status explain the relationship between admission tests and post-secondary academic performance? Psychological Bulletin, 135(1), 1–22. doi:10.1037/a0013978
   PubMed Web of Science ®Google Scholar
• Saupe, J. L., & Eimers, M. T. (2012). Alternative estimates of the reliability of college grade point averages. Annual Forum of the Association for Institutional Research. New Orleans, LA. Retrieved June 2-6, 2012 from http://ir.missouri.edu/reports-presentations/SaupeEimers_BestPaperSubmission_06-20-2012.
   Google Scholar
• Sawyer, R. (2007). Indicators of usefulness of test scores. Applied Measurement in Education, 20(3), 255–271. doi:10.1080/08957340701431245
   Web of Science ®Google Scholar
• Schmidt, F. L., & Hunter, J. E. (2014). Methods of meta-analysis (3rd ed.). Los Angeles, CA: Sage.
   Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. doi:10.1037/0033-2909.86.2.420
   PubMed Web of Science ®Google Scholar
• Singleton, R., & Smith, E. R. (1978). Does grade inflation decrease the reliability of grades? Journal of Educational Measurement, 15(1), 37–41. doi:10.1111/jedm.1978.15.issue-1
   Web of Science ®Google Scholar
• Spearman, C. (1904). The proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72–101. doi:10.2307/1412159
   Google Scholar
• Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3(3), 271–295.
   Google Scholar
• Stanley, J. C. (1971). Reliability. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 356–442). Washington, DC: American Council on Education.
   Google Scholar
• Strenta, A. C., & Elliott, R. (1987). Differential grading revisited. Journal of Educational Measurement, 24(4), 281–291. doi:10.1111/j.1745-3984.1987.tb00280.x
   Web of Science ®Google Scholar
• Stricker, L. J., & Rock, D. A. (1995). Examinee background characteristics and GRE general test performance. Intelligence, 21, 49–67. doi:10.1016/0160-2896(95)90038-1
   Web of Science ®Google Scholar
• Stricker, L. J., Rock, D. A., Burton, N. W., Muraki, E., & Jirele, T. J. (1994). Adjusting grade point average criteria for variations in grading standards: A comparison of methods. Journal of Applied Psychology, 79, 178–183. doi:10.1037/0021-9010.79.2.178
   Web of Science ®Google Scholar
• Thompson, B. (2003). Guidelines for authors reporting score reliability estimates. In B. Thompson (Ed.), Score reliability: Contemporary thinking on reliability issues (pp. 91–101). Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement (pp. 560–620). Washington, DC: American Council on Education.
   Google Scholar
• Traub, R. E. (1994). Reliability for the social sciences: Theory and application. Thousand Oaks, CA: Sage Publications.
   Google Scholar
• Westrick, P. A., Le, H., Robbins, S. B., Radunzel, J. M. R., & Schmidt, F. L. (2015). College performance and retention: A meta-analysis of the predictive validities of ACT scores, high school grades, and SES. Educational Assessment, 20(1), 23–45. doi:10.1080/10627197.2015.997614
   Web of Science ®Google Scholar
• Willingham, W. W. (1985). Success in college. New York, NY: College Entrance Examination Board.
   Google Scholar
• Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39(1), 1–37. doi:10.1111/jedm.2002.39.issue-1
   Web of Science ®Google Scholar
• Yang, Y., & Green, S. B. (2011). Coefficient alpha: A reliability coefficient for the 21st century? Journal of Psychoeducational Assessment, 29(4), 377–392. doi:10.1177/0734282911406668
   Web of Science ®Google Scholar
• Young, J. W. (1990). Adjusting the cumulative GPA using item response theory. Journal of Educational Measurement, 27, 175–186. doi:10.1111/jedm.1990.27.issue-2
   Web of Science ®Google Scholar
• Zwick, R. (2006). Higher Education Admission Testing. In R. Brennen (Ed.), Educational Measurement (4th ed., pp. 647–679). Westport, CT: American Council on Education, Praeger.
   Google Scholar