Prediction-Based Student Evaluations of Teaching as an Alternative to Traditional Opinion-Based Evaluations

References

• Adams, M. J., and P. D. Umbach. 2012. “Nonresponse and online student evaluations of teaching: Understanding the influence of salience, fatigue, and academic environments.” Research in Higher Education 53 (5): 576–591. doi: 10.1007/s11162-011-9240-5.
   Web of Science ®Google Scholar
• Altbach, P. 2015. “Perspectives on internationalizing higher education.” International Higher Education 27.
   Google Scholar
• Anderson, K. H., and J. J. Siegfried. 1997. “Gender differences in rating the teaching of economics.” Eastern Economic Journal 23 (3): 347–357.
   Google Scholar
• Annisette, M. 2003. “The colour of accountancy: examining the salience of race in a professionalisation project.” Accounting, Organizations and Society 28 (7): 639–674. doi: 10.1016/S0361-3682(02)00030-2.
   Web of Science ®Google Scholar
• Bacon, D. R., C. J. Johnson, and K. A. Stewart. 2016. “Nonresponse Bias in Student Evaluations of Teaching”. Marketing Education Review 26 (2): 93–104. doi: 10.1080/10528008.2016.1166442.
   Google Scholar
• Badri, M. A., M. Abdulla, M. A. Kamali, and H. Dodeen. 2006. “Identifying potential biasing variables in student evaluation of teaching in a newly accredited business program in the UAE.” International Journal of Educational Management 20 (1): 43–59. doi: 10.1108/09513540610639585.
   Google Scholar
• Basow, S. A. 1995. “Student evaluations of college professors: When gender matters.” Journal of Educational Psychology 87: 656–665. doi: 10.1037/0022-0663.87.4.656.
   Web of Science ®Google Scholar
• Basow, S. A. 2000. “Best and worst professors: Gender patterns in students' choices.” Sex roles 43 (5-6): 407–417. doi: 10.1023/A:1026655528055.
   Web of Science ®Google Scholar
• Basow, S., S. Codos, and J. Martin. 2013. “The effects of professors' race and gender on student evaluations and performance.” College Student Journal 47 (2): 352–363.
   Google Scholar
• Basow, S. A., J. E. Phelan, and L. Capotosto. 2006. Gender patterns in college students’ choices of their best and worse professors. Psychology of Women Quarterly 30 (1): 25–35. doi: 10.1111/j.1471-6402.2006.00259.x.
   Web of Science ®Google Scholar
• Becker, W. E., W. Bosshardt, and M. Watts. 2012. “How departments of economics evaluate teaching.” The Journal of Economic Education 43 (3): 325–333. doi: 10.1080/00220485.2012.686826.
   Web of Science ®Google Scholar
• Beleche, T., D. Fairris, and M. Marks. 2012. “Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test.” Economics of Education Review 31 (5): 709–719. doi: 10.1016/j.econedurev.2012.05.001.
   Web of Science ®Google Scholar
• Cartledge, P., M. Miller, and B. Phillips. 2013. “The use of social-networking sites in medical education.” Medical Teacher 35 (10): 847–857. doi: 10.3109/0142159X.2013.804909.
   PubMed Web of Science ®Google Scholar
• Centra, J. A., and N. B. Gaubatz. 2000. “Is there gender bias in student evaluations of teaching?” Journal of Higher Education 71: 17–33. doi: 10.2307/2649280.
   Web of Science ®Google Scholar
• Chen, C., S. Lee, and H. W. Stevenson. 1995. “Response style and cross-cultural comparisons of rating scales among East Asian and North American students.” Psychological Science 6 (3): 170–175. doi: 10.1111/j.1467-9280.1995.tb00327.x.
   Web of Science ®Google Scholar
• Cheston, C. C., T. E. Flickinger, and M. S. Chisolm. 2013. “Social media use in medical education: a systematic review.” Academic Medicine 88 (6): 893–901. doi: 10.1097/ACM.0b013e31828ffc23.
   PubMed Web of Science ®Google Scholar
• Cho, D., W. Baek, and J. Cho. 2015. “Why do good performing students highly rate their instructors? Evidence from a natural experiment.” Economics of Education Review 49: 172–179. doi: 10.1016/j.econedurev.2015.10.001.
   Web of Science ®Google Scholar
• Cleveland, M., M. Laroche, and N. Papadopoulos. 2015. “You are what you speak? Globalization, multilingualism, consumer dispositions and consumption.” Journal of Business Research 68 (3): 542–552. doi: 10.1016/j.jbusres.2014.09.008.
   Web of Science ®Google Scholar
• Coetzee, S. A., C. Janse van Rensburg, and A. Schmulian. 2016. “Differences in students’ reading comprehension of international financial reporting standards: a South African case.” Accounting Education 25 (4): 306–326. doi: 10.1080/09639284.2016.1191269.
   Web of Science ®Google Scholar
• Cohen-Schotanus, J., J. Schönrock-Adema, and H. G. Schmidt. 2010. “Quality of courses evaluated by ‘predictions’ rather than opinions: Fewer respondents needed for similar results.” Medical teacher 32 (10): 851–856. doi: 10.3109/01421591003697465.
   PubMed Web of Science ®Google Scholar
• Cronjé, F. 2016. “Race: What South Africans really think.” Politicsweb. Accessed November 6, 2018. https://www.politicsweb.co.za/news-and-analysis/race-what-south-africans-really-think
   Google Scholar
• Davis, A. 2006. Consistency, understanding and truth in educational research. Journal of philosophy of education, 40 (4): 487–500. doi: 10.1111/j.1467-9752.2006.00518.x.
   Web of Science ®Google Scholar
• De Beuckelaer, A., F. Lievens, and J. Bücker. 2012. “The role of faculty members' cross-cultural competencies in their perceived teaching quality: evidence from culturally-diverse classes in four European countries.” The Journal of Higher Education 83 (2): 217–248. doi: 10.1353/jhe.2012.0007.
   Web of Science ®Google Scholar
• Dolnicar, S., and B. Grün. 2009. “Response style contamination of student evaluation data.” Journal of Marketing Education 31 (2): 160–172. doi: 10.1177/0273475309335267.
   Google Scholar
• Eisner, E. 1992. Objectivity in educational research. Curriculum inquiry, 22 (1): 9–15. doi: 10.1080/03626784.1992.11075389.
   Web of Science ®Google Scholar
• Estelami, H. 2015. “The effects of survey timing on student evaluation of teaching measures obtained using online surveys.” Journal of Marketing Education 37 (1): 54–64. doi: 10.1177/0273475314552324.
   Web of Science ®Google Scholar
• Evans, J. 2015. “Evolving approaches to election forecasting.” Italian Journal of Applied Statistics 25 (2): 105–121.
   Google Scholar
• Feldman, K. A. 2007. “Identifying Exemplary Teachers and Teaching: Evidence from Student Ratings.” The scholarship of teaching and learning in higher education: An evidence-based perspective. 93–143. Springer Netherlands.
   Google Scholar
• Fernandez, J., and M. A. Mateo. 1997. “Student and faculty gender in ratings of university teaching quality.” Sex Roles 37 (11-12): 997–1003. doi: 10.1007/BF02936351.
   Web of Science ®Google Scholar
• Fraile, R., and F. Bosch-Morell. 2015. “Considering teaching history and calculating confidence intervals in student evaluations of teaching quality.” Higher Education 70 (1): 55–72. doi: 10.1007/s10734-014-9823-0.
   Web of Science ®Google Scholar
• Gehrt, K., T. A. Louie, and A. Osland. 2015. “Student and Professor Similarity: Exploring the Effects of Gender and Relative Age.” Journal of Education for Business 90 (1): 1–9. doi: 10.1080/08832323.2014.968514.
   Web of Science ®Google Scholar
• Georgantzis, N., E. Vasileiou, and I. Kotzaivazoglou. 2017. “Peer norm guesses and self-reported attitudes towards performance-related pay.” PloS one 12(4): e0174724. doi: 10.1371/journal.pone.0174724.
   PubMed Web of Science ®Google Scholar
• Goos, M., and A. Salomons. 2017. “Measuring teaching quality in higher education: assessing selection bias in course evaluations.” Research in Higher Education 58 (4): 341–364. doi: 10.1007/s11162-016-9429-8.
   Web of Science ®Google Scholar
• Hammond, T., B. M. Clayton, and P. J. Arnold. 2009. “South Africa’s transition from apartheid: The role of professional closure in the experiences of black chartered accountants.” Accounting, Organizations and Society 34 (6): 705–721. doi: 10.1016/j.aos.2008.09.002.
   Web of Science ®Google Scholar
• Heckert, T. M., A. Latier, A. Ringwald, and B. Silvey. 2006. “Relation of course, instructor, and student characteristics to dimensions of student ratings of teaching effectiveness.” College Student Journal 40 (1): 195.
   Google Scholar
• Ho, A. K., L. Thomsen, and J. Sidanius. 2009. “Perceived academic competence and overall job evaluations: Students' evaluations of African American and European American professors.” Journal of Applied Social Psychology 39 (2): 389–406. doi: 10.1111/j.1559-1816.2008.00443.x.
   Web of Science ®Google Scholar
• Hofstede, G., and G. J. Hofstede. 2005. Cultures and Organizations, Software of the Mind: Intercultural Cooperation and Its Importance for Survival, McGraw-Hill: London, New Delhi, New York.
   Google Scholar
• Hofstee, W. K. B., and H. Schaapman. 1990. “Bets beat polls: Averaged predictions of election outcomes.” Acta Politica 25 (3): 194–207.
   Google Scholar
• Isely, P., and H. Singh. 2005. “Do higher grades lead to favorable student evaluations?” The Journal of Economic Education 36 (1): 29–42. doi: 10.3200/JECE.36.1.29-42.
   Web of Science ®Google Scholar
• Jackling, B., and M. Keneley. 2009. “Influences on the supply of accounting graduates in Australia: a focus on international students.” Accounting & Finance 49 (1): 141–159. doi: 10.1111/j.1467-629X.2008.00273.x.
   Web of Science ®Google Scholar
• Janse van Rensburg, C., S. A. Coetzee, and A. Schmulian. 2014. “South African financial reporting students' reading comprehension of the IASB Conceptual Framework.” Journal of Accounting Education 32 (4): 1–15. doi: 10.1016/j.jaccedu.2014.10.003.
   Google Scholar
• Jones, E. E., and R. E. Nisbett. 1972. “The actor and the observer: Divergent perceptions of the causes of the behavior.” In EE Jones, DE Kanouse, HH Kelley, RE Nisbett, S. Valins and B. Weiner (eds.), Attribution: Perceiving the causees of behaviour: 79–94. Morristown.
   Google Scholar
• Kember, D., D. Y. P. Leung, and K. Kwan. 2002. “Does the use of student feedback questionnaires improve the overall quality of teaching?” Assessment & Evaluation in Higher Education 27 (5): 411–425. doi: 10.1080/0260293022000009294.
   Google Scholar
• Kite, M. E., P. C. Subedi, and K. B. Bryant-Lees. 2015. “Students’ perceptions of the teaching evaluation process.” Teaching of Psychology 42 (4): 307–314. doi: 10.1177/0098628315603062.
   Web of Science ®Google Scholar
• Kohn, J., and L. Hatfield. 2006. “The role of gender in teaching effectiveness ratings of faculty.” Academy of Educational Leadership Journal 10 (3): 121.
   Google Scholar
• Kreiter, C. D., and V. Lakshman. 2005. “Investigating the use of sampling for maximising the efficiency of student‐generated faculty teaching evaluations.” Medical education 39 (2): 171–175. doi: 10.1111/j.1365-2929.2004.02066.x.
   PubMed Web of Science ®Google Scholar
• Macfadyen, L. P., S. Shane, S. Prest, and D. Gašević. 2016. “Whose feedback? A multilevel analysis of student completion of end-of-term teaching evaluations.” Assessment & Evaluation in Higher Education 41 (6): 821–839. doi: 10.1080/02602938.2015.1044421.
   Web of Science ®Google Scholar
• MacNell, L., A. Driscoll, and A. N. Hunt. 2015. “What’s in a name: exposing gender bias in student ratings of teaching.” Innovative Higher Education 40 (4): 291–303. doi: 10.1007/s10755-014-9313-4.
   Web of Science ®Google Scholar
• Marin, G., R. J. Gamba, and B. V. Marin. 1992. “Extreme response style and acquiescence among Hispanics: The role of acculturation and education.” Journal of cross-cultural psychology 23 (4): 498–509. doi: 10.1177/0022022192234006.
   Web of Science ®Google Scholar
• Marsh, H. W. 2007. “Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness.” The scholarship of teaching and learning in higher education: An evidence-based perspective. 319–383. Springer Netherlands.
   Google Scholar
• Mastro, D. 2015. "Why the media's role in issues of race and ethnicity should be in the spotlight." Journal of Social Issues 71 (1): 1–16. doi: 10.1111/josi.12093.
   Web of Science ®Google Scholar
• Mastro, D., and R. Tukachinsky. 2012. "The influence of media exposure on the formation, activation, and application of racial/ethnic stereotypes." The international encyclopedia of media studies.
   Google Scholar
• Mitchell, J. P., C. N. Macrae, and M. R. Banaji. 2006. "Dissociable medial prefrontal contributions to judgments of similar and dissimilar others." Neuron 50 (4): 655–663. doi: 10.1016/j.neuron.2006.03.040.
   PubMed Web of Science ®Google Scholar
• Mitchell, J. P., M. R. Banaji, and C. N. MacRae. 2005. “The link between social cognition and self-referential thought in the medial prefrontal cortex.” Journal of cognitive neuroscience 17(8): 1306–1315. doi: 10.1162/0898929055002418.
   PubMed Web of Science ®Google Scholar
• Mortelmans, D., and P. Spooren. 2009. “A revalidation of the SET37 questionnaire for student evaluations of teaching.” Educational Studies 35 (5): 547–552. doi: 10.1080/03055690902880299.
   Web of Science ®Google Scholar
• Nasser, F., and B. Fresko. 2002. “Faculty views of student evaluation of college teaching.” Assessment & Evaluation in Higher Education 27 (2): 187–198. doi: 10.1080/02602930220128751.
   Google Scholar
• O’Brien, E., and P. C. Ellsworth. 2012. "More than skin deep: Visceral states are not projected onto dissimilar others." Psychological Science 23 (4): 391–396. doi: 10.1177/0956797611432179.
   PubMed Web of Science ®Google Scholar
• Onwuegbuzie, A. J., A. E. Witcher, K. M. T. Collins, J. D. Filer, C. D. Wiedmaier, and C. W. Moore. 2007. “Students’ perceptions of characteristics of effective college teachers: A validity study of a teaching evaluation form using a mixed-methods analysis.” American Educational Research Journal 44 (1): 113–160. doi: 10.3102/0002831206298169.
   Web of Science ®Google Scholar
• Oon, P. T., B. Spencer, and C. C. S. Kam. 2017. “Psychometric quality of a student evaluation of teaching survey in higher education.” Assessment & Evaluation in Higher Education 42 (5): 788–800. doi: 10.1080/02602938.2016.1193119.
   Web of Science ®Google Scholar
• Porter, S. R., M. E. Whitcomb, and W. H. Weitzer. 2004. “Multiple surveys of students and survey fatigue.” New Directions for Institutional Research 121: 63–73. doi: 10.1002/ir.101.
   Google Scholar
• Prentice, D.A. and D.T. Miller. 1996. “Pluralistic ignorance and the perpetuation of social norms by unwitting actors.” Advances in experimental social psychology 28: 161–209. Academic Press.
   Google Scholar
• Pronin, E. 2008. “How we see ourselves and how we see others.” Science 320 (5880): 1177–1180. doi: 10.1126/science.1154199.
   PubMed Web of Science ®Google Scholar
• Pronin, E., T. Gilovich, and L. Ross. 2004. “Objectivity in the eye of the beholder: divergent perceptions of bias in self versus others.” Psychological review 111 (3): 781. doi: 10.1037/0033-295X.111.3.781.
   PubMed Web of Science ®Google Scholar
• Richardson, J. T. E. 2012. “The role of response biases in the relationship between students’ perceptions of their courses and their approaches to studying in higher education.” British Educational Research Journal 38 (3): 399–418. doi: 10.1080/01411926.2010.548857.
   Web of Science ®Google Scholar
• Saxe, R. 2005. “Against simulation: the argument from error.” Trends in cognitive sciences 9 (4): 174–179. doi: 10.1016/j.tics.2005.01.012.
   PubMed Web of Science ®Google Scholar
• Schmulian, A. and S. Coetzee. 2011. Class absenteeism: reasons for non-attendance and the effect on academic performance. Accounting Research Journal 24 (2): 178–194. doi: 10.1108/10309611111163718.
   Google Scholar
• Schönrock‐Adema, J., S. Lubarsky, C. Chalk, Y. Steinert, and J. Cohen-Schotanus. 2013. “What would my classmates say? An international study of the prediction‐based method of course evaluation.” Medical education 47 (5): 453–462. doi: 10.1111/medu.12126.
   PubMed Web of Science ®Google Scholar
• Shao, L. P., L. P. Anderson, and M. Newsome. 2007. “Evaluating teaching effectiveness: Where we are and where we should be.” Assessment & Evaluation in Higher Education 32 (3): 355–371. doi: 10.1080/02602930600801886.
   Google Scholar
• Spooren, P. 2010. “On the credibility of the judge: A cross-classified multilevel analysis on students’ evaluation of teaching.” Studies in educational evaluation 36 (4): 121–131. doi: 10.1016/j.stueduc.2011.02.001.
   Google Scholar
• Spooren, P., B. Brockx, and D. Mortelmans. 2013. “On the validity of student evaluation of teaching: The state of the art.” Review of Educational Research 83 (4): 598–642. doi: 10.3102/0034654313496870.
   Web of Science ®Google Scholar
• Spooren, P., and F. Van Loon. 2012. “Who participates (not)? A non-response analysis on students’ evaluations of teaching.” Procedia-Social and Behavioral Sciences 69: 990–996. doi: 10.1016/j.sbspro.2012.12.025.
   Google Scholar
• Sprinkle, J. E. 2008. “Student perceptions of effectiveness: An examination of the influence of student biases.” College Student Journal 42 (2): 276.
   Google Scholar
• Surgenor, P. W. G. 2013. “Obstacles and opportunities: addressing the growing pains of summative student evaluation of teaching.” Assessment & Evaluation in Higher Education 38 (3): 363–376. doi: 10.1080/02602938.2011.635247.
   Web of Science ®Google Scholar
• Tatro, C. N. 1995. “Gender effects on student evaluations of faculty.” Journal of Research & Development in Education.
   Google Scholar
• Uijtdehaage, S., and C. O'Neal. 2015. “A curious case of the phantom professor: mindless teaching evaluations by medical students.” Medical education 49 (9): 928–932. doi: 10.1111/medu.12647.
   PubMed Web of Science ®Google Scholar
• Uhlmann, E. L. and G. L. Cohen. 2005. “Constructed criteria: Redefining merit to justify discrimination.” Psychological Science 16 (6): 474–480.
   PubMed Web of Science ®Google Scholar
• Van Herk, H., Y. H. Poortinga, and T. M. M. Verhallen. 2004. “Response styles in rating scales: Evidence of method bias in data from six EU countries.” Journal of Cross-Cultural Psychology 35 (3): 346–360. doi: 10.1177/0022022104264126.
   Web of Science ®Google Scholar
• Wong, W. Y., and K. Moni. 2014. “Teachers’ perceptions of and responses to student evaluation of teaching: purposes and uses in clinical education.” Assessment & Evaluation in Higher Education 39 (4): 397–411. doi: 10.1080/02602938.2013.844222.
   Web of Science ®Google Scholar
• Worthington, A. C. 2002. “The impact of student perceptions and characteristics on teaching evaluations: a case study in finance education.” Assessment & Evaluation in Higher Education 27 (1): 49–64. doi: 10.1080/02602930120105054.
   Google Scholar
• Young, S., L. Rush, and D. Shaw. 2009. “Evaluating gender bias in ratings of university instructors’ teaching effectiveness.” International Journal for the Scholarship of Teaching and Learning 3 (2): 19.
   Google Scholar
• Zhao, J., and D. J. Gallant. 2012. “Student evaluation of instruction in higher education: Exploring issues of validity and reliability.” Assessment & Evaluation in Higher Education 37 (2): 227–235. doi: 10.1080/02602938.2010.523819.
   Web of Science ®Google Scholar