Do university students really need to be taught by the best instructors to learn?

References

• Abrami, P. C. , d’Apollonia, S. , & Rosenfield, S. (2007). The dimensionality of student ratings of instruction: What we know and what we do not. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 385–445). Dordrecht: Springer. doi:10.1007/1-4020-5742-3
   Google Scholar
• Ainley, M. (2006). Connecting with learning: Motivation, affect and cognition in interest processes. Educational Psychology Review , 18 (4), 391–405. doi:10.1007/s10648-006-9033-0
   Web of Science ®Google Scholar
• Alderman, L. , Towers, S. , & Bannah, S. (2012). Student feedback systems in higher education: A focused literature review and environmental scan. Quality in Higher Education , 18 (3), 261–280. doi:10.1080/13538322.2012.730714
   Google Scholar
• Benton, S. L. , & Cashin, W. E. (2012). Student ratings of teaching: A summary of research and literature (IDEA Paper # 50). IDEA Center, Kansas State University.
   Google Scholar
• Benton, S. L. , Duchon, D. , & Pallett, W. H. (2013). Validity of student self-reported ratings of learning. Assessment & Evaluation in Higher Education , 38 (4), 377–388. doi:10.1080/02602938.2011.636799
   Web of Science ®Google Scholar
• Borden, V. M. H. (1995). Segmenting student markets with a student satisfaction and priorities survey. Research in Higher Education , 36 (1), 73–88. doi:10.1007/BF02207767
   Web of Science ®Google Scholar
• Boring, A. (2015). Gender biases in student evaluations of teachers (working paper). OFCE-PRESAGE-SCIENCES PO and LEDa-DIAL.
   Google Scholar
• Boring, A. , Ottoboni, K. , & Stark, P. B. (2016). Student evaluations of teaching (mostly) do not measure teaching effectiveness. Science Open Research . doi:10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1
   Google Scholar
• Boysen, G. A. (2016). Using student evaluations to improve teaching: Evidence-based recommendations. Scholarship of Teaching and Learning in Psychology , 2 (4), 273–284. doi:10.1037/stl0000069
   Google Scholar
• Braskamp, L. A. , & Ory, J. C. (1994). Assessing faculty work: Enhancing individual and institutional performance . San Francisco, CA: Jossey-Bass. doi:10.1080/2F00221546.1995.11774794
   Google Scholar
• Brint, S. , Cantwell, A. M. , & Hanneman, R. A. (2008). The two cultures of undergraduate academic engagement. Research in Higher Education , 49 (5), 383–402. doi:10.1007/s11162-008-9090-y
   Web of Science ®Google Scholar
• Cashin, W. E. (1995). Student ratings of teaching: The research revisited (IDE Paper No. 32). Manhattan, KS: Center for Faculty Evaluation and Development, Kansas State University.
   Google Scholar
• Carroll, J. B. (1963). A model of school learning. Teachers College Record , 64 , 723–733.
   Web of Science ®Google Scholar
• Centra, J. A. (1977). Student Ratings of Instruction and Their Relationship to Student Learning. American Educational Research Journal , 14 (1), 17–24. doi:10.1002/j.2333-8504.1976.tb01092.x
   Web of Science ®Google Scholar
• Centra, J. A. (1993). Reflective faculty evaluation . San Francisco, CA: Jossey-Bass. doi:10.1177/109821409601700213
   Google Scholar
• Chan, C. K. Y. , Luk, L. Y. Y. , & Zeng, M. (2014). Teachers’ perceptions of student evaluations of teaching. Educational Research and Evaluation , 20 (4), 275–289. doi:10.1080/13803611.2014.932698
   Google Scholar
• Chapman, D. W. , & Lindner, S. (2016). Degrees of integrity: The threat of corruption in higher education. Studies in Higher Education , 41 (2), 247–268. doi:10.1080/03075079.2014.927854
   Web of Science ®Google Scholar
• Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education , 31 (1), 16–30. doi:10.1177/0273475308324086
   Google Scholar
• Cole, J. S. , & Gonyea, R. M. (2010). Accuracy of self-reported SAT and ACT test scores: Implications for research. Research in Higher Education , 51 (4), 305–319. doi:10.1007/s11162-009-9160-9
   Web of Science ®Google Scholar
• Costin, F. (1968). A graduate course in the teaching of psychology: Description and evaluation. Journal of Teacher Education , 19 (4), 425–432. doi:10.1177/002248716801900405
   Web of Science ®Google Scholar
• Delaney, J. , Johnson, A. , Johnson, T. , & Treslan, D. (2009). Students’ perceptions of effective teaching in higher education . Paper presented at the 26th Annual Conference on Distance Teaching and Learning, Madison, WI.
   Google Scholar
• Donaldson, J. F. , Flannery, D. , & Ross-Gordon, J. (1993). A triangulated study comparing adult college students’ perceptions of effective teaching with those of traditional students. Continuing Higher Education Review , 57 (3), 147–165.
   Google Scholar
• Donnon, T. , Delver, H. , & Beran, T. (2010). Student and teaching characteristics related to ratings of instruction in medical sciences graduate programs. Medical Teacher , 32 (4), 327–332. doi:10.3109/01421590903480097
   PubMed Web of Science ®Google Scholar
• Dunn, K. A. , Hooks, K. L. , & Kohlbeck, M. J. (2016). Preparing future accounting faculty members to teach. Issues in Accounting Education , 31 , 155–170.
   Web of Science ®Google Scholar
• Erdle, S. , Murray, H. G. , & Rushton, J. P. (1985). Personality, classroom behavior, and student ratings of college teaching effectiveness: A path analysis. Journal of Educational Psychology , 77 (4), 394–407. doi:10.1037/0022-0663.77.4.394
   Web of Science ®Google Scholar
• Feldman, K. A. (1989). Instructional effectiveness of college teachers as judged by teachers themselves, current and former students, colleagues, administrators, and external (neutral) observers. Research in Higher Education , 30 (2), 137–194. doi:10.1007/BF00992716
   Web of Science ®Google Scholar
• Feldman, K. A. (1997). Identifying exemplary teaching: Using data from course and teacher evaluations. New Directions for Teaching and Learning , 65 , 41–50. doi:10.1002/tl.37219966509
   Google Scholar
• Golding, C. , & Adam, L. (2016). Evaluate to improve: Useful approaches to student evaluation. Assessment & Evaluation in Higher Education , 41 (1), 1–14. doi:10.1080/02602938.2014.976810
   Web of Science ®Google Scholar
• Greenwald, A. G. , & Gillmore, G. M. (1997). Grading leniency is a removable contaminant of student ratings. American Psychologist , 52 (11), 1209–1217. doi:10.1037/0003-066X.52.11.1209
   PubMed Web of Science ®Google Scholar
• Grimes, P. W. (2002). The overconfident principles of economics student: An examination of a metacognitive skill. The Journal of Economic Education , 33 (1), 15–30. doi:10.1080/00220480209596121
   Web of Science ®Google Scholar
• Hirschfeld, G. H. F. , & Brown, G. T. L. (2009). Students’ conceptions of assessment: Factorial and structural invariance of the SCoA across sex, age, and ethnicity. European Journal of Psychological Assessment , 25 (1), 30–38. doi:10.1027/1015-5759.25.1.30
   Web of Science ®Google Scholar
• Hirst, P. (1973). What is teaching. In R. S. Peters (Ed.), The philosophy of education (pp. 163–177). Oxford: Oxford University Press.
   Google Scholar
• Hornstein, H. A. (2017). Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance. Cogent Education , 4 , 1–8. doi:10.1080/2331186X.2017.1304016
   Web of Science ®Google Scholar
• Houston, D. , Meyer, L. , & Paewai, S. (2006). Academic staff workloads and job satisfaction: Expectations and values in academics. Journal of Higher Education Policy and Management , 28 (1), 17–30. doi:10.1080/13600800500283734
   Google Scholar
• Jöreskog, K. G. , & Sorbom, D. (1999). LISREL 8.30 for Windows [Computer software]. Skokie, IL: Scientific Software International Inc.
   Google Scholar
• Kalender, I. (2011). Contaminating factors in university students’ evaluation of instructors. Education and Science , 36 (162), 56–65. doi:10.1080/10705519909540118
   Web of Science ®Google Scholar
• Kalender, I. (2014). Profiling instructional effectiveness to reveal its relationship to learning. The Asia-Pacific Education Researcher , 23 (3), 717–726. doi:10.1007/s40299-013-0145-2
   Web of Science ®Google Scholar
• Kalender, I. (2015). Measurement invariance of student evaluation of teaching across groups defined by course-related variables. International Online Journal of Educational Sciences , 7 (4), 69–79. doi:10.15345/iojes.2015.04.006
   Google Scholar
• Kline, R. B. (2005). Principles and practices of structural equation modeling (2nd ed.). New York, NY: Guilford Press. doi:10.1111/insr.12011_25
   Google Scholar
• Kohlan, R. G. (1973). A comparison of faculty evaluations early and late in the course. The Journal of Higher Education , 44 (8), 587–595.10.1080/00221546.1973.11776893
   Web of Science ®Google Scholar
• Kornell, N. , & Hausman, H. (2016). Do the best teachers get the best ratings? Frontiers in Psychology , 7 , 1–8. doi:10.3389/fpsyg.2016.00570
   PubMed Web of Science ®Google Scholar
• Langbein, L. (2008). Management by results: Student evaluation of faculty teaching and the mis-measurement of performance. Economics of Education Review , 27 (4), 417–428. doi:10.1016/j.econedurev.2006.12.003
   Web of Science ®Google Scholar
• Marks, R. B. (2000). Determinants of student evaluations of global measures of instructor and course value. Journal of Marketing Education , 22 (2), 108–119. doi:10.1177/0273475300222005
   Google Scholar
• Marsh, H. W. (1984). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and utility. Journal of Educational Psychology , 76 (5), 707–754. doi:10.1037/0022-0663.76.5.707
   Web of Science ®Google Scholar
• Marsh, H. W. (1987). Students’ evaluations of University teaching: Research findings, methodological issues, and directions for future research. International Journal of Educational Research , 11 (3), 253–388. doi:10.1016/0883-0355(87)90001-2
   Google Scholar
• Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319–383). Dordrecht: Springer. doi:10.1007/1-4020-5742-3
   Google Scholar
• Marsh, H. W. , & Bailey, M. (1993). Multidimensional students’ evaluations of teaching effectiveness: A profile analysis. The Journal of Higher Education , 64 (1), 1–18. doi:10.2307/2959975
   Web of Science ®Google Scholar
• Marsh, H. W. , & Hocevar, D. (1991). The multidimensionality of students' evaluations of teaching effectiveness: The generality of factor structures across academic discipline, instructor level, and course level. Teaching and Teacher Education , 7 (1), 9–18. doi:10.1016/0742-051X(91)90054-S
   Web of Science ®Google Scholar
• Marsh, H. W. , & Roche, L. A. (2000). Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology , 92 (1), 202–228. doi:10.1037/0022-0663.92.1.202
   Web of Science ®Google Scholar
• McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist , 52 (11), 1218–1225. doi:10.1037/0003-066X.52.11.1218
   Web of Science ®Google Scholar
• McPherson, M. A. , & Jewell, R. T. (2007). Leveling the playing field: Should student evaluation scores be adjusted? Social Science Quarterly , 88 (3), 868–881. doi:10.1111/j.1540-6237.2007.00487.x
   Web of Science ®Google Scholar
• McPherson, M. A. , Jewell, R. T. , & Kim, M. (2009). What determines student evaluation scores? A random effects analysis of undergraduate economics classes. Eastern Economic Journal , 35 (1), 37–51. doi:10.1057/palgrave.eej.9050042
   Google Scholar
• Miles, P. , & House, D. (2015). The tail wagging the dog; an overdue examination of student teaching evaluations. International Journal of Higher Education , 4 (2), 116–126. doi:10.5430/ijhe.v4n2p116
   Google Scholar
• Murray, H. G. (1983). Low-inference classroom teaching behaviors and student ratings of college teaching effectiveness. Journal of Educational Psychology , 71 , 856–865. doi:10.1007/1-4020-5742-3_6
   Google Scholar
• Murray, H. G. (1985). Classroom teaching behaviors related to college teaching effectiveness. New Directions for Teaching and Learning , 1985 (23), 21–34. doi:10.1002/tl.37219852305
   Google Scholar
• Murray, H. G. (2007). Low-inference teaching behaviors and college teaching effectiveness: Recent developments and controversies. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 145–200). Dordrecht: Springer. doi:10.1007/1-4020-5742-3_6
   Google Scholar
• Murray, H. G. , Rushton, J. P. , & Paunonen, S. V. (1990). Teacher personality traits and student instructional ratings in six types of university courses. Journal of Educational Psychology , 82 (2), 250–261. doi:10.1037/0022-0663.82.2.250
   Web of Science ®Google Scholar
• Nargundkar, S. , & Shrikhande, M. (2014). Norming of student evaluations of instruction: Impact of noninstructional factors. Decision Sciences Journal of Innovative Education , 12 (1), 55–72. doi:10.1111/dsji.12023
   Google Scholar
• Oravec, J. A. (2015). The moral imagination in an era of “gaming academia”: Implications of emerging reputational issues in scholarly activities for knowledge organization practices. Knowledge Organization , 42 (5), 316–323.
   Web of Science ®Google Scholar
• Pascarella, E. , Edison, M. , Nora, A. , Hagedorn, L. , & Braxton, J. (1996). Effects of teacher organization/preparation and teacher skill/clarity on general cognitive skills in college. Journal of College Student Development , 37 (1), 7–19.
   Web of Science ®Google Scholar
• Pascarella, E. T. , Seifert, T. A. , & Blaich, C. (2010). How effective are the NSSE benchmarks in predicting important educational outcomes? Change: The Magazine of Higher Learning , 42 (1), 16–22.
   Google Scholar
• Peters, R. S. (Ed.). (1967). The concept of education . London: Routledge & Kegan Paul.
   Google Scholar
• Peterson, R. L. , Berenson, M. L. , Misra, R. B. , & Radosevich, D. J. (2008). An evaluation of factors regarding students’ assessment of faculty in a business school. Decision Sciences Journal of Innovative Education , 6 (2), 375–402. doi:10.1111/j.1540-4609.2008.00182.x
   Google Scholar
• Pollio, H. R. , & Beck, H. P. (2000). When the tail wags the dog: Perceptions of learning and grade orientation in, and by, contemporary college students and faculty. Journal of Higher Education , 71 (1), 84–102. doi:10.2307/2649283
   Web of Science ®Google Scholar
• Pritchard, R. E. , & Potter, G. C. (2011). Adverse changes in faculty behavior resulting from use of student evaluations of teaching: A Case Study. College Teaching , 8 (1), 1–8. doi:10.19030/tlc.v8i1.980
   Google Scholar
• Sailor, P. , Worthen, B. , & Shin, E. H. (1997). Class level as a possible mediator of the relationship between grades and student ratings of teaching. Assessment & Evaluation in Higher Education , 22 (3), 261–268. doi:10.1080/0260293970220301
   Google Scholar
• Scheffler, I. (1960). The language of education . Springfield, IL: Charles C. Thomas.
   Google Scholar
• Scherr, F. C. , & Scherr, S. S. (1990). Bias in student evaluation of teacher effectiveness. Journal of Education for Business , 65 (8), 356–358.
   Google Scholar
• Soh, K. (2014). Test language effect in international achievement comparisons: An example from PISA 2009. Cogent Education , 1 (1), 1–10. doi:10.1080/2331186X.2014.955247
   Google Scholar
• Sonquist, J. A. , & Morgan, J. N. (1964). The detection of interaction effects: A report on a computer program for the selection of optimal combinations of explanatory variables (Monograph no: 35). Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan.
   Google Scholar
• Stehle, S. , Spinath, B. , & Kadmon, M. (2012). Measuring teaching effectiveness: Correspondence between students’ evaluations of teaching and different measures of student learning. Research in Higher Education , 53 (8), 888–904. doi:10.1007/s11162-012-9260-9
   Web of Science ®Google Scholar
• Strong, M. , Gargani, J. , & Hacifazlioğlu, Ö. (2011). Do we know a successful teacher when we see one? experiments in the identification of effective teachers. Journal of Teacher Education , 62 (4), 367–382. doi:10.1177/0022487110390221
   Web of Science ®Google Scholar
• Trivedi, S. , Pardos, Z. A. , & Heffernan, N. T. (2011). Clustering students to generate an ensemble to improve standard test score predictions . In Proceedings of the 15th International Conference on Artificial Intelligence in Education, Auckland.
   Google Scholar
• West, S. G. , Finch, J. F. , & Curran, P. J. (1995). Structural equation models with non-normal variables: Problems and remedies. In R. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 56–75). Newbury Park, CA: Sage.
   Google Scholar
• Wilson, K. , & Alloway, T. (2013). Expecting the unexpected: Engaging diverse young people in conversations around science. The Australian Educational Researcher , 40 (2), 195–206. doi:10.1007/s13384-012-0084-6
   Web of Science ®Google Scholar
• Wolbring, T. (2012). Class attendance and students’ evaluations of teaching: Do no-shows bias course ratings and rankings? Evaluation Review , 36 (1), 72–96. doi:10.1177/0193841X12441355
   PubMed Web of Science ®Google Scholar
• Wolbring, T. , & Treischl, E. (2016). Selection bias in students’ evaluation of teaching. Research in Higher Education , 57 (1), 51–71. doi:10.1007/s11162-015-9378-7
   Web of Science ®Google Scholar
• Young, S. M. , & Shaw, D. G. (1999). Profiles of effective college and university teachers. The Journal of Higher Education , 70 (6), 670–686. doi:10.2307/2649170
   Web of Science ®Google Scholar
• Zohar, A. , & Dori, Y. J. (2003). Higher order thinking skills and low achieving students: Are they mutually exclusive? Journal of the Learning Sciences , 12 , 145–181. doi:10.1207/S15327809JLS1202_1
   Web of Science ®Google Scholar