Questions that matter: using Q methodology to identify student priorities in module level experience

References

• Biggs, J.B., 1988, ‘Assessing student approaches to learning’, Australian Psychologist, 23(2), pp. 197–206.
   Web of Science ®Google Scholar
• Biggs, J.B., 1999, ‘What the student does: teaching for enhanced learning’, Higher Education Research & Development, 18(1), pp. 57–75.
   Google Scholar
• Borch, I., Sandvoll, R. & Risør, T., 2020, ‘Discrepancies in purposes of student course evaluations: what does it mean to be satisfied?’, Education Assessment, Evaluation and Accountability, 32, pp. 83–102.
   Web of Science ®Google Scholar
• Brown, M., 2004, ‘Illuminating patterns of perception: an overview of Q Methodology’. Available at https://apps.dtic.mil/sti/pdfs/ADA443484.pdf (accessed 13 June 2022).
   Google Scholar
• Brown, S.R., 1980, Political subjectivity (New Haven, CT, Yale University Press).
   Google Scholar
• Brown, S.R., 1993, ‘A primer on Q Methodology’, Operant Subjectivity, 16(3/4), pp. 91–138.
   Google Scholar
• Brown, S.R., 1996, ‘Q Methodology and qualitative research’, Qualitative Health Research, 6(4), pp. 561–67.
   Web of Science ®Google Scholar
• Brown, S.R., 2019, ‘Subjectivity in the human sciences’, The Psychological Record, 69(4), pp. 565–79.
   Web of Science ®Google Scholar
• Chan, C.K.C., Luk, L.Y.Y. & Zeng, M., 2014, ‘Teachers’ perceptions of student evaluations of teaching’, Educational Research and Evaluation, 20(4), pp. 275–89.
   Google Scholar
• Chen, Y. & Hoshower, L., 2003, ‘Student evaluation of teaching effectiveness: an assessment of student perception and motivation’, Assessment & Evaluation in Higher Education, 28, pp. 71–88.
   Google Scholar
• Coates, H., 2005, ‘The value of student engagement for higher education quality assurance’, Quality in Higher Education, 11(1), pp. 25–36.
   Google Scholar
• Cordingley, M.E., Webb, C. & Hillier, V., 1997, ‘Q Methodology’, Nurse Researcher, 4, pp. 31–45.
   PubMedGoogle Scholar
• Culver, K., Bowman, N. & Pascarella, E., 2021, ‘How students’ intellectual orientations and cognitive reasoning abilities may shape their perceptions of good teaching practices’, Research in Higher Education, 62, pp. 765–88.
   Web of Science ®Google Scholar
• Edström, K., 2008, ‘Doing course evaluation as if learning matters most’, Higher Education Research and Development, 27(2), pp. 95–106.
   Web of Science ®Google Scholar
• Esarey, J. & Valdes, N., 2020, ‘Unbiased, reliable, and valid student evaluations can still be unfair’, Assessment & Evaluation in Higher Education, 45(8), pp. 1106–20.
   Web of Science ®Google Scholar
• Gibbs, G., 2010, Dimensions of Quality (York, Higher Education Academy). Available at: https://www.heacademy.ac.uk/sites/default/files/dimensions_of_quality.pdf (accessed 13 June 2022).
   Google Scholar
• Gravestock, P. & Gregor-Greenleaf, E., 2008, Student Course Evaluations: Research, models and trends (Toronto, Higher Education Quality Council of Ontario). Available at https://teaching.pitt.edu/wp-content/uploads/2018/12/OMET-Student-Course-Evaluations.pdf (accessed 13 June 2022).
   Google Scholar
• Haggis, T., 2003, ‘Constructing images of ourselves? A critical investigation into 'approaches to learning' research in higher education’, British Educational Research Journal, 29(1), pp. 89–104.
   Web of Science ®Google Scholar
• Harvey, L., 2002, ‘Evaluation for what?’, Teaching in Higher Education, 7(3), pp. 245–63.
   Google Scholar
• Harvey, L., 2003, ‘Student feedback’, Quality in Higher Education, 9(1), pp. 3–20.
   Google Scholar
• Harvey, L., 2011, ‘The nexus of feedback and improvement’, in Nair, C.S, Patil, A. & Mertova, P. (Eds.), 2011, Student Feedback: The cornerstone to an effective quality assurance system in higher education, pp. 3–26 (Cambridge, Woodhead).
   Google Scholar
• Harvey, L. & Green, D., 1993, ‘Defining quality’, Assessment & Evaluation in Higher Education, 18(1), pp. 9–34.
   Google Scholar
• Huxham, M., Laybourn, P., Cairncross, S., Gray, M., Brown, N., Goldfinch, J. & Earl, S., 2008, ‘Collecting student feedback: a comparison of questionnaire and other methods’, Assessment & Evaluation in Higher Education, 33(6), pp. 675–86.
   Web of Science ®Google Scholar
• Isaeva, R., Eisenschmidt, E., Vanari, K, & Kumpas-Lenk, K., 2020, ‘Students’ views on dialogue: improving student engagement in the quality assurance process’, Quality in Higher Education, 26(1), pp. 80–97.
   Web of Science ®Google Scholar
• Jungblut, J., Vukasovic, M. & Stensaker, B., 2015, ‘Student perspectives on quality in higher education’, European Journal of Higher Education, 5(2), pp. 157–80.
   Google Scholar
• Kline, P., 1994, An Easy Guide to Factor Analysis (New York, NY, Routledge).
   Google Scholar
• Klooster P.M., Visser M. & de Jong M.D., 2008, ‘Comparing two image research instruments: the Q-sort method versus the Likert attitude questionnaire’, Food Quality and Preference, 19(5), pp. 511–18.
   Web of Science ®Google Scholar
• Lagrosen, S., Seyyed-Hashemi, R. & Leitner, M., 2004, ‘Examination of the dimensions of quality in higher education’, Quality Assurance in Education, 12(2), pp. 61–9.
   Google Scholar
• Leathwood, C. & Phillips, D., 2000, ‘Developing curriculum evaluation research in higher education: process, politics and practicalities’, Higher Education, 40, pp. 313–30.
   Web of Science ®Google Scholar
• Malone, T.W. & Lepper, M.R., 1987, ‘Making learning fun: a taxonomy of intrinsic motivations for learning’, in Snow, R.E. & Farr, M.J. (Eds.), 1987, Aptitude, Learning, and Instruction, Volume 3: Conative and affective process analyses, pp. 223–53 (Hillsdale, NJ, Lawrence Erlbaum Associates).
   Google Scholar
• Mengel, F., Sauermann, J. & Zölitz, U., 2019, ‘Gender bias in teaching evaluations’, Journal of the European Economic Association, 17(2), pp. 535–66.
   Web of Science ®Google Scholar
• Mullen, R.F., Fleming, A., McMillan, L. & Kydd, A., 2022, Q Methodology: Quantitative aspects of data analysis in a study of student nurse perceptions of dignity in care (London, SAGE).
   Google Scholar
• Nasser, F. & Fresko, B., 2002, ‘Faculty views of student evaluation of college teaching’, Assessment & Evaluation in Higher Education, 27, pp. 187–98.
   Google Scholar
• Newton, J., 2000, ‘Feeding the beast or improving quality? Academics' perceptions of quality assurance and quality monitoring’, Quality in Higher Education, 6(2), pp. 153–63.
   Google Scholar
• Pastore, S., Manuti, A., Scardigno, F., Curci, A. & Pentassuglia, M., 2019, ‘Students’ feedback in mid-term surveys: an explorative contribution in the Italian university context’, Quality in Higher Education, 25(1), pp. 21–37.
   Web of Science ®Google Scholar
• Patton, M.Q., 2008, Utilization-focused Evaluation, fourth edition. (Thousand Oaks, CA, Sage).
   Google Scholar
• Porter, S., 2004, ‘Raising response rates: what works?’, New Directions for Institutional Research, (121), pp. 5–21.
   Google Scholar
• Radchenko, N., 2020, ‘Student evaluations of teaching: unidimensionality, subjectivity, and biases’, Education Economics, 28(6), pp. 549–66.
   Web of Science ®Google Scholar
• Ramsden, P., 1988, ‘Context and strategy: situational influences on learning’, in Schmeck, R.R. (Ed.), 1988, Learning Strategies and Learning Styles, pp. 159–84, (New York, Plenum Press).
   Google Scholar
• Schmolk, P., 2014, PQ Method Manual. Available at http://schmolck.userweb.mwn.de/qmethod/pqmanual.htm (accessed 13 June 2022).
   Google Scholar
• Shah, M. & Nair, C.S., 2012, ‘The changing nature of teaching and unit evaluations in Australian universities’, Quality Assurance in Education, 20(3), pp. 274–88.
   Google Scholar
• Spooren, P., Brockx, B. & Mortelmans, D., 2013, ‘On the validity of student evaluation of teaching: the state of the art’, Review of Educational Research, 83(4), pp. 598–642.
   Web of Science ®Google Scholar
• Spooren, P. & Christiaens, W., 2017, ‘I like your course because I believe in (the power of) student evaluations of teaching (SET). Students’ perceptions of a teaching evaluation process and their relationships with SET scores’, Studies in Educational Evaluation, 54, pp. 43–9.
   Web of Science ®Google Scholar
• Spurgeon, L., Humphreys, G., James, G.& Sackley, C., 2012, ‘A Q-methodology study of patients' subjective experiences of TIA’, Stroke Research and Treatment, Article ID 486261.
   PubMedGoogle Scholar
• Stein, S.J., Goodchild, A., Moskal, A., Terry, S. & McDonald, J., 2020, ‘Student perceptions of student evaluations: enabling student voice and meaningful engagement’, Assessment & Evaluation in Higher Education, 46(6), pp. 837–51.
   Web of Science ®Google Scholar
• Taylor, M., Su, Y., Barry, K. & Mustillo, S., 2021, ‘Using structural topic modelling to estimate gender bias in student evaluations of teaching’, in Zaitseva, E., Tucker, B. & Santhanam, E. (Eds.), 2021, Analysing Students Feedback in Higher Education: Using text mining to interpret student voice, pp. 51–67 (London, Routledge).
   Google Scholar
• Tucker, Β., Jones, S., Straker, L. & Cole, J., 2003, ‘Course evaluation on the web: facilitating student and teacher reflection to improve learning’, New Directions for Teaching and Learning, 96, pp. 81–94.
   Google Scholar
• Uttl, B. & Smibert, D., 2017, ‘Student evaluations of teaching: teaching quantitative courses can be hazardous to one’s career’. PeerJ, 5, e3299. Available at: https://peerj.com/articles/3299/ (accessed 13 June 2022).
   PubMed Web of Science ®Google Scholar
• Wiley, C., 2019, ‘Standardised module evaluation surveys in UK higher education: establishing students’ perspectives’, Studies in Educational Evaluation, 61, pp. 55–65.
   Web of Science ®Google Scholar
• Williams, J. & Cappuccini‐Ansfield, G., 2007, ‘Fitness for purpose? National and institutional approaches to publicising the student voice’, Quality in Higher Education, 13(2), pp. 159–72.
   Google Scholar
• Winchester, M.K. & Winchester, T.M., 2012, ‘If you build it will they come? Exploring the student perspective of weekly student evaluations of teaching’, Assessment & Evaluation in Higher Education, 37(6), pp. 671–82.
   Web of Science ®Google Scholar
• Zaitseva, E. & Law, A., 2020a, Student Question Bank. Available at https://doi.org/10.6084/m9.figshare.17391470 (accessed 6 July 2022).
   Google Scholar
• Zaitseva, E. & Law, A., 2020b, Q methodology calculations. Available at https://doi.org/10.6084/m9.figshare.17390939 (accessed 6 July 2022).
   Google Scholar