Setting out SET: a situational mapping of student evaluation of teaching in Australian higher education

References

• Adams, M. J. D., and P. D. Umbach. 2012. “Nonresponse and Online Student Evaluations of Teaching: Understanding the Influence of Salience, Fatigue and Academic Environments.” Research in Higher Education 53 (5): 576–591. doi:10.1007/s11162-011-9240-5.
   Web of Science ®Google Scholar
• Addison, W. E., J. Best, and J. D. Warrington. 2006. “Students’ Perceptions of Course Difficulty and Their Ratings of the Instructor.” College Student Journal 40 (2): 409–416.
   Google Scholar
• Aldrich, R., and D. L. Rudman. 2016. “Situational Analysis: A Visual Analytic Approach That Unpacks the Complexity of Occupation.” Journal of Occupational Science 23 (1): 51–66. doi:10.1080/14427591.2015.1045014.
   Web of Science ®Google Scholar
• Aleamoni, L. M. 1999. “Student Ratings Myths versus Research Facts from 1924 to 1998.” Journal of Personnel Evaluation in Education 13 (2): 153–166. https://ir.stlawu.edu/sites/stlawu.edu.ir/crseval/studentratingmythscarnegiemellon.pdf. doi:10.1023/A:1008168421283.
   Google Scholar
• Arcario, P., B. Eynon, M. Klages, and B. A. Polnariev. 2013. “Closing the Loop: How we Better Serve Our Students through a.” Comprehensive Assessment Process.” Metropolitan Universities Journal 24 (2): 21–37. https://journals.iupui.edu/index.php/muj/articl. e/view/20545.
   Google Scholar
• Bacon, D. R., C. J. Johnson, and K. A. Stewart. 2016. “Nonresponse Bias in Student Evaluations of Teaching.” Marketing Education Review 26 (2): 93–104. doi:10.1080/10528008.2016.1166442.
   Google Scholar
• Benton, S. L., and W. E. Cashin. 2012. “Student Ratings of Teaching: A Summary of Research and Literature” (IDEA Paper #50). https://www.ideaedu.org/idea_papers/student-ratings-of-teaching-a-summary-of-research-and-literature.
   Google Scholar
• Beran, T. N., and J. L. Rokosh. 2009. “Instructors’ Perspectives on the Utility of Student Ratings of Instruction.” Instructional Science 37 (2): 171–184. doi:10.1007/s11251-007-9045-2.
   Web of Science ®Google Scholar
• Blash, A., and B. Schneller. 2021. “Finding Value in the Mid-semester Review of Teaching: Insights from Faculty.” The Scholarly Teacher. https://www.scholarlyteacher.com/post/finding-value-in-the-mid-semester-review-of-teaching-insights-from-faculty.
   Google Scholar
• Brown, G., D. A. A. M. Wood, R. S. Ogden, and J. Maltby. 2015. “Do Student Evaluations of University Reflect Inaccurate Beliefs or Actual Experience? A Relative Rank Model.” Journal of Behavioral Decision Making 28 (1): 14–26. doi:10.1002/bdm.1827.
   PubMed Web of Science ®Google Scholar
• Chatelain, A. M. 2015. “The Effect of Academics’ Dress and Gender on Student Perceptions of Instructor Approachability and Likeability.” Journal of Higher Education Policy and Management 37 (4): 413–423. doi:10.1080/1360080X.2015.1056598.
   Web of Science ®Google Scholar
• Clarke, A. E. 2005. Situational Analysis: Grounded Theory after the Postmodern Turn. Thousand Oaks: Sage.
   Google Scholar
• Clarke, A., and K. Charmaz. 2019. “Grounded Theory and Situational Analysis.” In Sage Research Methods. edited by P. Atkinson, S. Delamont, A. Cernat, J. W. Sakshaug. and R. A. Williams. London: SAGE Publications. doi:10.4135/9781526421036825838.
   Google Scholar
• Clayson, D. E., T. F. Frost, and M. J. Sheffet. 2006. “Grades and Student Evaluation of Instruction: A Test of the Reciprocity Effect.” Academy of Management Learning & Education 5 (1): 52–65. doi:10.5465/amle.2006.20388384.
   Web of Science ®Google Scholar
• Clayson, D. E., and D. A. Haley. 2011. “Are Students Telling Us the Truth? A Critical Look at the Student Evaluation of Teaching.” Marketing Education Review 21 (2): 101–112. doi:10.2753/MER1052-8008210201.
   Google Scholar
• Craig, M. 2007. “Facilitated Student Discussions for Evaluating Teaching.” Paper Presented at SIGCSE ‘07: Proceedings of the 38th SIGCSE Technical Symposium on Computer Science Education, Covington, KY, March 07–11. doi:10.1145/1227310.1227376.
   Google Scholar
• Cunningham-Nelson, S., M. Laundon, and A. Cathcart. 2021. “Beyond Satisfaction Scores: Visualising Student Comments for Whole-of-Course Evaluation.” Assessment & Evaluation in Higher Education 46 (5): 685–700. doi:10.1080/02602938.2020.1805409.
   Web of Science ®Google Scholar
• Dean, A., and P. Gibbs. 2015. “Student Satisfaction or Happiness? A Preliminary Rethink of What is Important in the Student Experience.” Quality Assurance in Education 23 (1): 5–19. doi:10.1108/QAE-10-2013-0044.
   Web of Science ®Google Scholar
• den Outer, B., K. Handley, and M. Price. 2013. “Situational Analysis and Mapping for Use in Education Research: A Reflexive Methodology?” Studies in Higher Education 38 (10): 1504–1521. doi:10.1080/03075079.2011.641527.
   Web of Science ®Google Scholar
• Elias, T. 2021. “Mapping ‘a Situation of Open Education’: Using Collaborative Relational Mapping to Explore Motivations and Constraint among Open Educators.” Journal of Interactive Media in Education 2021 (1): 1–9. doi:10.5334/jime.671.
   Web of Science ®Google Scholar
• Esarey, J., and N. Valdes. 2020. “Unbiased, Reliable and Valid Student Evaluations Can Still Be Unfair.” Assessment & Evaluation in Higher Education 45 (8): 1106–1120. doi:10.1080/02602938.2020.1724875.
   Web of Science ®Google Scholar
• Estelami, H. 2015. “The Effects of Survey Timing on Student Evaluation of Teaching Measures Obtained Using Online Surveys.” Journal of Marketing Education 37 (1): 54–64. doi:10.1177/0273475314552324.
   Web of Science ®Google Scholar
• Freeman, R., and K. Dobbins. 2013. “Are we Serious about Enhancing Courses? Using the Principles of Assessment for Learning to Enhance Course Evaluation.” Assessment & Evaluation in Higher Education 38 (2): 142–151. doi:10.1080/02602938.2011.611589.
   Web of Science ®Google Scholar
• Gapp, R., and R. Fisher. 2006. “Achieving Excellence through Innovative Approaches to Student Involvement in Course Evaluation within the Tertiary Education Sector.” Quality Assurance in Education 14 (2): 156–166. doi:10.1108/09684880610662033.
   Google Scholar
• Gehrke, P. 2018. Ecological validity. In The SAGE encyclopedia of educational research, measurement, and evaluation, edited by B. Frey, 564–565. SAGE Publications. https://dx.doi.org/10.4135/9781506326139.n219
   Google Scholar
• Glaser, B. G., and A. L. Strauss. 1967. The Discovery of Grounded Theory: Strategies for Qualitative Research. Chicago: Aldine.
   Google Scholar
• Heffernan, T. 2022. “Sexism, Racism, Prejudice, and Bias: A Literature Review and Synthesis of Research Surrounding Student Evaluations of Courses and Teaching.” Assessment & Evaluation in Higher Education 47 (1): 144–154. doi:10.1080/02602938.2021.1888075.
   Web of Science ®Google Scholar
• Hoel, A., and T. I. Dahl. 2019. “Why Bother? Student Motivation to Participate in Student Evaluations of Teaching.” Assessment & Evaluation in Higher Education 44 (3): 361–378. doi:10.1080/02602938.2018.1511969.
   Web of Science ®Google Scholar
• Jones, B. D., Y. Miyazaki, M. Li, and S. Biscotte. 2022. “Motivational Climate Predicts Student Evaluations of Teaching: Relationships between Students’ Course Perceptions, Ease of Course, and Evaluations of Teaching.” AERA Open 8 (1): 233285842110731–233285842110717. doi:10.1177/23328584211073167.
   Web of Science ®Google Scholar
• Kayas, O. G., C. Assimakopoulos, and T. Hines. 2022. “Student Evaluations of Teaching: Emerging Surveillance and Resistance.” Studies in Higher Education 47 (1): 1–12. doi:10.1080/03075079.2020.1725875.
   Web of Science ®Google Scholar
• Knopp, P. 2021. “Mapping Temporalities and Processes with Situational Analysis: Methodological Issues and Advances.” Forum Qualitative Sozialforschung/Forum: Qualitative Social Research 22 (3) Art. 4. doi:10.17169/fqs-22.3.3661.
   Google Scholar
• Lakeman, R., R. Coutts, M. Hutchinson, M. Lee, D. Massey, D. Nasrawi, and J. Fielden. 2021. “Appearance, Insults, Allegations, Blame and Threats: An Analysis of Anonymous Non-Constructive Student Evaluation of Teaching in Australia.” Assessment & Evaluation in Higher Education: 1–14. doi:10.1080/02602938.2021.2012643.
   Web of Science ®Google Scholar
• Lakeman, R., D. Massey, D. Nasrawi, J. Fieden, M. Hutchinson, M. Lee, and R. Coutts. 2022, January 10. “‘Lose some Weight’, ‘Stupid old Hag’: Universities should no longer ask Students for Anonymous Feedback on their Teachers.” The Conversation. https://theconversation.com/lose-some-weight-stupid-old-hag-universities-should-no-longer-ask-students-for-anonymous-feedback-on-their-teachers-173911.
   Google Scholar
• Latour, B. 1988. “Mixing Human and Nonhumans Together: The Sociology of a Door-Closer.” Social Problems 35 (3): 298–310.
   Web of Science ®Google Scholar
• Lee, M., R. Coutts, J. Fielden, M. Hutchinson, R. Lakeman, B. Mathisen, D. Nasrawi, and N. Phillips. 2022. “Occupational Stress in University Academics in Australia and New Zealand.” Journal of Higher Education Policy and Management 44 (1): 57–71. doi:10.1080/1360080X.2021.1934246.
   Web of Science ®Google Scholar
• Mainey, L., C. O’Mullan, and K. Reid-Searl. 2022. “Unfit for Purpose: A Situational Analysis of Abortion Care and Gender-Based Violence.” Collegian 29 (5): 557–565. doi:10.1016/j.colegn.2022.01.003.
   Web of Science ®Google Scholar
• McClain, L., A. Gulbis, and D. Hays. 2018. “Honesty on Student Evaluations of Teaching: Effectiveness, Purpose, and Timing Matter!.” Assessment & Evaluation in Higher Education 43 (3): 369–385. doi:10.1080/02602938.2017.1350828.
   Web of Science ®Google Scholar
• Messick, S. 1995. “Validity of Psychological Assessment: Validation of Inferences from Persons’ Responses and Performances as Scientific Inquiry into Score Meaning.” American Psychologist 50 (9): 741–749. doi:10.1037/0003-066X.50.9.741.
   Web of Science ®Google Scholar
• Mittal, S., R. Gera, and D. K. Batra. 2015. “Evaluating the Validity of Student Evaluation of Teaching Effectiveness (SET) in India.” Education + Training 57 (6): 623–638. doi:10.1108/ET-06-2013-0072.
   Web of Science ®Google Scholar
• Nederhand, M., J. Auer, B. Giesbers, A. Scheepers, and E. van der Gaag. 2022. “Improving Student Participation in SET: Effects of Increased Transparency on the Use of Student Feedback in Practice.” Assessment & Evaluation in Higher Education 1–14. doi:10.1080/02602938.2022.2052800.
   Web of Science ®Google Scholar
• NTEU (National Tertiary Education Union). 2018. Staff Experience of Student Evaluation of Teaching and Subjects/Units. Melbourne: Policy and Research Unit. https://www.nteu.org.au/library/download/id/9058.
   Google Scholar
• Oliver, S., B. Marder, A. Erz, and J. Kietzmann. 2022. “Fitted: The Impact of Academics’ Attire on Students’ Evaluations and Intentions.” Assessment & Evaluation in Higher Education 47 (3): 390–410. doi:10.1080/02602938.2021.1921105.
   Web of Science ®Google Scholar
• Patrick, C. L. 2011. “Student Evaluations of Teaching: Effects of the Big Five Personality Traits, Grades and the Validity Hypothesis.” Assessment & Evaluation in Higher Education 36 (2): 239–249. doi:10.1080/02602930903308258.
   Web of Science ®Google Scholar
• Ross, J. 2022, March 13. “UNSW ruling sparks debate on publishing course evaluation data.” THE. https://www.timeshighereducation.com/news/unsw-ruling-sparks-debate-publishing-course-evaluation-data.
   Google Scholar
• Shah, M., M. Cheng, and R. Fitzgerald. 2017. “Closing the Loop on Student Feedback: The Case of Australian and Scottish Universities.” Higher Education 74 (1): 115–129. doi:10.1007/s10734-016-0032-x.
   Web of Science ®Google Scholar
• Sigudardottir, M. S., G. L. Rafnsdottir, A. H. Jónsdóttir, and D. M. Kristofersson. 2022. “Student Evaluation of Teaching: Gender Bias in a Country at the Forefront of Gender Equality.” Higher Education Research & Development 1–14. doi:10.1080/07294360.2022.2087604.
   Web of Science ®Google Scholar
• Stein, S. J., A. Goodchild, A. Moskal, S. Terry, and J. McDonald. 2021. “Student Perceptions of Student Evaluations: Enabling Student Voice and Meaningful Engagement.” Assessment & Evaluation in Higher Education 46 (6): 837–851. doi:10.1080/02602938.2020.1824266.
   Web of Science ®Google Scholar
• Stein, S. J., D. Spiller, S. Terry, T. Harris, L. Deaker, and J. Kennedy. 2013. “Tertiary Teachers and Student Evaluations: Never the Twain Shall Meet?” Assessment & Evaluation in Higher Education 38 (7): 892–904. doi:10.1080/02602938.2013.767876.
   Web of Science ®Google Scholar
• Stroebe, W. 2020. “Student Evaluations of Teaching Encourages Poor Teaching and Contributes to Grade Inflation: A Theoretical and Empirical Analysis.” Basic and Applied Social Psychology 42 (4): 276–294. doi:10.1080/01973533.2020.1756817.
   Web of Science ®Google Scholar
• TEQSA (Tertiary Education Quality and Standards Agency). 2021. Higher Education Framework Standards 2021. https://www.teqsa.gov.au/higher-education-standards-framework-2021
   Google Scholar
• Thielsch, M. T., B. Brinkmöller, and B. Forthmann. 2018. “Reasons for Responding in Student Evaluation of Teaching.” Studies in Educational Evaluation 56: 189–196. doi:10.1016/j.stueduc.2017.11.008.
   Web of Science ®Google Scholar
• Zyngier, D. 2008. “(Re) Conceptualizing Student Engagement: Doing Education Not Doing Time.” Teaching and Teacher Education 24 (7): 1765–1776. doi:10.1016/j.tate.2007.09.004.
   Web of Science ®Google Scholar