Does students’ evaluation of teaching improve teaching quality? Improvement versus the reversal effect

References

• Bavishi, A., M. R. Hebl, and J. M. Madera. 2010. “The Effect of Professor Ethnicity and Gender on Student Evaluations: Judged before Met.” Journal of Diversity in Higher Education 3 (4): 245–256. doi:10.1037/a0020763.
   Web of Science ®Google Scholar
• Berezvai, Z., G. D. Lukáts, and R. Molontay. 2021. “Can Professors Buy Better Evaluation with Lenient Grading? The Effect of Grade Inflation on Student Evaluation of Teaching.” Assessment & Evaluation in Higher Education 46 (5): 793–808. doi:10.1080/02602938.2020.1821866.
   Web of Science ®Google Scholar
• Blair, E., and K. V. Noel. 2014. “Improving Higher Education Practice through Student Evaluation Systems: Is the Student Voice Being Heard?” Assessment & Evaluation in Higher Education 39 (7): 879–894. doi:10.1080/02602938.2013.875984.
   Web of Science ®Google Scholar
• Boring, A. 2017. “Gender Biases in Student Evaluations of Teaching.” Journal of Public Economics 145: 27–41. doi:10.1016/j.jpubeco.2016.11.006.
   Web of Science ®Google Scholar
• Boring, A., K. Ottoboni, and P. Stark. 2016. Student Evaluations of Teaching (Mostly) Do Not Measure Teaching Effectiveness. Science Open Research.
   Google Scholar
• Braga, M., M. Paccagnella, and M. Pellizzari. 2014. “Evaluating Students’ Evaluations.” Economics of Education Review 41: 71–88. doi:10.1016/j.econedurev.2014.04.002.
   Web of Science ®Google Scholar
• Carpenter, S. K., A. E. Witherby, and S. K. Tauber. 2020. “On Students’ (Mis) Judgments of Learning and Teaching Effectiveness.” Journal of Applied Research in Memory and Cognition 9 (2): 137–151. doi:10.1016/j.jarmac.2019.12.009.
   Web of Science ®Google Scholar
• Carrell, S. E., and J. E. West. 2010. “Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors.” Journal of Political Economy 118 (3): 409–432. doi:10.1086/653808.
   Web of Science ®Google Scholar
• Cho, D., W. Baek, and J. Cho. 2015. “Why Do Good Performing Students Highly Rate Their Instructors? Evidence from a Natural Experiment.” Economics of Education Review 49: 172–179. doi:10.1016/j.econedurev.2015.10.001.
   Web of Science ®Google Scholar
• Clayson, D. 2022. “The Student Evaluation of Teaching and Likability: What the Evaluations Actually Measure.” Assessment & Evaluation in Higher Education 47 (2): 313–326. doi:10.1080/02602938.2021.1909702.
   Web of Science ®Google Scholar
• Cook-Sather, A. 2006. “Sound, Presence, and Power: ‘Student Voice’ in Educational Research and Reform.” Curriculum Inquiry 36 (4): 359–390. doi:10.1111/j.1467-873X.2006.00363.x.
   Web of Science ®Google Scholar
• Eagly, A., and S. J. Karau. 2002. “Role Congruity Theory of Prejudice toward Female Leaders.” Psychological Review 109 (3): 573–598. doi:10.1037/0033-295x.109.3.573.
   PubMed Web of Science ®Google Scholar
• Fan, Y., L. Shepherd, D. Slavich, D. Waters, M. Stone, R. Abel, and E. Johnston. 2019. “Gender and Cultural Bias in Student Evaluations: Why Representation Matters.” PloS One 14 (2): e0209749. doi:10.1371/journal.pone.0209749.
   PubMed Web of Science ®Google Scholar
• Feistauer, D., and T. Richter. 2017. “How Reliable Are Students’ Evaluations of Teaching Quality? A Variance Components Approach.” Assessment & Evaluation in Higher Education 42 (8): 1263–1279. doi:10.1080/02602938.2016.1261083.
   Web of Science ®Google Scholar
• Freng, S., and D. Webber. 2009. “Turning up the Heat on Online Teaching Evaluations: Does “Hotness.” Teaching of Psychology 36 (3): 189–193. doi:10.1080/00986280902959739.
   Web of Science ®Google Scholar
• Galbraith, C., G. Merrill, and D. Kline. 2012. “Are Student Evaluations of Teaching Effectiveness Valid for Measuring Student Learning Outcomes in Business Related Classes? A Neural Network and Bayesian Analyses.” Research in Higher Education 53 (3): 353–374. doi:10.1007/s11162-011-9229-0.
   Web of Science ®Google Scholar
• Ginns, P., M. Prosser, and S. Barrie. 2007. “Students’ Perceptions of Teaching Quality in Higher Education: The Perspective of Currently Enrolled Students.” Studies in Higher Education 32 (5): 603–615. doi:10.1080/03075070701573773.
   Web of Science ®Google Scholar
• Griffin, B. W. 2004. “Grading Leniency, Grade Discrepancy, and Student Ratings of Instruction.” Contemporary Educational Psychology 29 (4): 410–425. doi:10.1016/j.cedpsych.2003.11.001.
   Web of Science ®Google Scholar
• Hammonds, F., G. J. Mariano, G. Ammons, and S. Chambers. 2017. “Student Evaluations of Teaching: Improving Teaching Quality in Higher Education.” Perspectives: Policy and Practice in Higher Education 21 (1): 26–33.
   Google Scholar
• Heffernan, T. 2022. “Sexism, Racism, Prejudice, and Bias: A Literature Review and Synthesis of Research Surrounding Student Evaluations of Courses and Teaching.” Assessment & Evaluation in Higher Education 47 (1): 144–154. doi:10.1080/02602938.2021.1888075.
   Web of Science ®Google Scholar
• Hellman, C. M. 1998. “Faculty Evaluation by Students: A Comparison between Full-Time and Adjunct Faculty.” Journal of Applied Research in the Community College 6 (1): 45–50.
   Google Scholar
• Hessler, M., D. M. Pöpping, H. Hollstein, H. Ohlenburg, P. H. Arnemann, C. Massoth, L. M. Seidel, A. Zarbock, and M. Wenk. 2018. “Availability of Cookies during an Academic Course Session Affects Evaluation of Teaching.” Medical Education 52 (10): 1064–1072. doi:10.1111/medu.13627.
   PubMed Web of Science ®Google Scholar
• Johnston, R. J. 1994. “Is There a Correlation between Department Research and Teaching Quality?” Environment and Planning A: Economy and Space 26 (10): 1491–1496. doi:10.1068/a261491.
   Web of Science ®Google Scholar
• Lakeman, R., R. Coutts, M. Hutchinson, D. Massey, D. Nasrawi, J. Fielden, and M. Lee. 2022. “Playing the SET Game: How Teachers View the Impact of Student Evaluation on the Experience of Teaching and Learning.” Assessment & Evaluation in Higher Education. doi:10.1080/02602938.2022.2126430.
   Web of Science ®Google Scholar
• MacNell, L., A. Driscoll, and A. Hunt. 2015. “What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching.” Innovative Higher Education 40 (4): 291–303. doi:10.1007/s10755-014-9313-4.
   Web of Science ®Google Scholar
• Marsh, H. W., and M. Bailey. 1993. “Multidimensional Students’ Evaluations of Teaching Effectiveness: A Profile Analysis.” The Journal of Higher Education 64 (1): 1–18.
   Web of Science ®Google Scholar
• McPherson, M. A., R. T. Jewell, and M. Kim. 2009. “What Determines Student Evaluation Scores? A Random Effects Analysis of Undergraduate Economics Classes.” Eastern Economic Journal 35 (1): 37–51. doi:10.1057/palgrave.eej.9050042.
   Google Scholar
• Meshkani, Z., and A. F. Hossein. 2003. “The Effect of Contextual Factors on Results of Teaching Evaluation in College of Medicine, Tehran University of Medical Sciences.” Journal of Medical Education 6: 117–121.
   Google Scholar
• Otto, J., D. A. Sanford, and D. N. Ross. 2008. “Does Ratemyprofessor.com Really Rate My Professor?” Assessment & Evaluation in Higher Education 33 (4): 355–368. doi:10.1080/02602930701293405.
   Web of Science ®Google Scholar
• Palmer, S. 2012. “Student Evaluation of Teaching: Keeping in Touch with Reality.” Quality in Higher Education 18 (3): 297–311. doi:10.1080/13538322.2012.730336.
   Google Scholar
• Park, B., and J. Cho. 2022. “How Does Grade Inflation Affect Student Evaluation of Teaching?” Assessment & Evaluation in Higher Education. doi:10.1080/02602938.2022.2126429.
   Web of Science ®Google Scholar
• Ragan, J. F., and B. Walia. 2010. “Differences in Student Evaluations of Principles and Other Economic Courses and the Allocation of Faculty across Courses.” The Journal of Economic Education 41 (4): 335–352. doi:10.1080/00220485.2010.510389.
   Web of Science ®Google Scholar
• Rantanen, P. 2013. “The Number of Feedbacks Needed for Reliable Evaluation: A Multilevel Analysis of the Reliability, Stability and Generalisability of Students’ Evaluation of Teaching.” Assessment & Evaluation in Higher Education 38 (2): 224–239. doi:10.1080/02602938.2011.625471.
   Web of Science ®Google Scholar
• Read, W. J., D. V. Rama, and K. Raghunandan. 2001. “The Relationship between Student Evaluations of Teaching and Faculty Evaluations.” Journal of Education for Business 76 (4): 189–192. doi:10.1080/08832320109601309.
   Google Scholar
• Richardson, J., J. Slater, and J. Wilson. 2007. “The National Student Survey: Development, Findings and Implications.” Studies in Higher Education 32 (5): 557–580. doi:10.1080/03075070701573757.
   Web of Science ®Google Scholar
• Spooren, P. 2010. “On the Credibility of the Judge: A Cross-Classified Multilevel Analysis on Students’ Evaluation of Teaching.” Studies in Educational Evaluation 36 (4): 121–131. doi:10.1016/j.stueduc.2011.02.001.
   Google Scholar
• Stonebraker, R. J., and G. S. Stone. 2015. “Too Old to Teach? The Effect of Age on College and University Professors.” Research in Higher Education, 2015 56 (8): 793–812.
   Google Scholar
• Storage, D., Z. Horne, A. Cimpian, and S. J. Leslie. 2016. “The Frequency of ‘Brilliant’ and ‘Genius’ in Teaching Evaluations Predicts the Representation of Women and African Americans across Fields.” PloS One 11 (3): e0150194–17. doi:10.1371/journal.pone.0150194.
   Web of Science ®Google Scholar
• Stroebe, W. 2016. “Why Good Teaching Evaluations May Reward Bad Teaching: On Grade Inflation and Other Unintended Consequences of Student Evaluations.” Perspectives on Psychological Science : A Journal of the Association for Psychological Science 11 (6): 800–816. doi:10.1177/1745691616650284.
   PubMedGoogle Scholar
• Stroebe, W. 2020. “Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation: A Theoretical and Empirical Analysis.” Basic and Applied Social Psychology 42 (4): 276–294. doi:10.1080/01973533.2020.1756817.
   Web of Science ®Google Scholar
• Ting, K. 2000. “A Multilevel Perspective on Student Ratings of Instruction: Lessons from the Chinese Experience.” Research in Higher Education 141 (5): 637–661.
   Web of Science ®Google Scholar
• Uttl, B., C. A. White, and D. W. Gonzalez. 2017. “Meta-Analysis of Faculty’s Teaching Effectiveness: Student Evaluation of Teaching Ratings and Student Learning Are Not Related.” Studies in Educational Evaluation 54: 22–42. doi:10.1016/j.stueduc.2016.08.007.
   Web of Science ®Google Scholar
• Valencia, E. 2020. “Acquiescence, Instructor’s Gender Bias and Validity of Student Evaluation of Teaching.” Assessment & Evaluation in Higher Education 45 (4): 483–495. doi:10.1080/02602938.2019.1666085.
   Web of Science ®Google Scholar
• Wallace, S. L., A. K. Lewis, and M. D. Allen. 2019. “The State of the Literature on Student Evaluations of Teaching and an Exploratory Analysis of Written Comments: Who Benefits Most?” College Teaching 67 (1): 1–14. doi:10.1080/87567555.2018.1483317.
   Google Scholar
• Worthington, A. 2002. “The Impact of Student Perceptions and Characteristics on Teaching Evaluations: A Case Study in Finance Education.” Assessment & Evaluation in Higher Education 27 (1): 49–64. doi:10.1080/02602930120105054.
   Google Scholar
• Zhao, J., and D. J. Gallant. 2012. “Student Evaluation of Instruction in Higher Education: Exploring Issues of Validity and Reliability.” Assessment & Evaluation in Higher Education 37 (2): 227–235. doi:10.1080/02602938.2010.523819.
   Web of Science ®Google Scholar