Lost in translation: from the university’s quality assurance system to student evaluation practice

References

• Alkin, M. C., & Taut, S. M. (2003). Unbundling evaluation use. Studies in Educational Evaluation, 29(1), 1–12. http://doi.org/10.1016/S0191-491X(03)90001-0
   Google Scholar
• Bamber, V., & Anderson, S. (2012). Evaluating learning and teaching: Institutional needs and individual practices. International Journal for Academic Development, 17(1), 5–18. http://doi.org/10.1080/1360144X.2011.586459
   Google Scholar
• Beran, T., & Rokosh, J. (2009). Instructors’ perspectives on the utility of student ratings of instruction. Instructional Science: An International Journal of the Learning Sciences, 37(2), 171–184. http://doi.org/10.1007/s11251-007-9045-2
   Web of Science ®Google Scholar
• Beran, T., Violato, C., Kline, D., & Frideres, J. (2005). The utility of student ratings of instruction for students, faculty, and administrators: A “consequential validity” study. Canadian Journal of Higher Education, 35(2), 49–70.
   Google Scholar
• Borch, I., Sandvoll, R., & Torsten, R. (2020). Discrepancies in purposes of student course evaluations: What does it mean to be “satisfied”? Educational Assessment, Evaluation and Accountability, 32(1), 83–102. http://doi.org/10.1007/s11092-020-09315-x
   Web of Science ®Google Scholar
• Bourgeois, I., & Bradley Cousins, J. (2013). Understanding dimensions of organizational evaluation capacity. American Journal of Evaluation, 34(3), 299–319. 10.1177/1098214013477235
   Web of Science ®Google Scholar
• Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. http://doi.org/10.3316/QRJ0902027
   Google Scholar
• Bradley, C. J., Goh, S. C., Elliott, C. J., & Bourgeois, I. (2014). Framing the capacity to do and use evaluation. New Directions for Evaluation, 2014(141), 7–23. http://doi.org/10.1002/ev.20076
   Google Scholar
• Burden, P. (2008). Does the use of end of semester evaluation forms represent teachers’ views of teaching in a tertiary education context in Japan? Teaching and Teacher Education: An International Journal of Research and Studies, 24(6), 1463–1475. http://doi.org/10.1016/j.tate.2007.11.012
   Web of Science ®Google Scholar
• Cooren, F. (2004). Textual agency: How texts do things in organizational settings. Organization, 11(3), 373–393. http://doi.org/10.1177/1350508404041998
   Web of Science ®Google Scholar
• Cousins, J. B. (2003). Utilization effects of participatory evaluation. In D. Kellaghan, L. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 245–265). Springer.
   Google Scholar
• Cuthbert, R. (2011). Failing the challenge of institutional evaluation: How and why managerialism flourishes. In M. Saunders, P. Trowler, & R. Bamber (Eds.), Reconceptualising evaluation in higher education: The practice turn (pp. 133–138). McGraw-Hill Education.
   Google Scholar
• Czarniawska, B., & Joerges, B. (1996). Travel of ideas. In B. Czarniawska & G. Savon (Eds.), Translating organizational change (pp. 13–48). Walter de Gruyter.
   Google Scholar
• Dahler-Larsen, P. (2006). Evalueringskultur: Et begreb bliver til (2 ed.). Syddansk Universitetsforlag.
   Google Scholar
• Dahler-Larsen, P. (2011). The evaluation society. Stanford University Press.
   Google Scholar
• Darwin, S. (2016). Student evaluation in higher education: Reconceptualising the student voice. Springer International Publishing.
   Google Scholar
• DiMaggio, P. J., & Powell, W. W. (1991). Introduction. In P. J. DiMaggio & W. W. Powell (Eds.), The new institutionalism in organizational analysis (pp. 1–38). University of Chicago Press.
   Google Scholar
• Douglas, J., & Douglas, A. (2006). Evaluating teaching quality. Quality in Higher Education, 12(1), 3–13. http://doi.org/10.1080/13538320600685024
   Google Scholar
• Edström, K. (2008). Doing course evaluation as if learning matters most. Higher Education Research and Development, 27(2), 95–106. http://doi.org/10.1080/07294360701805234
   Web of Science ®Google Scholar
• EHEA. (2015). Standards and guidelines for quality assurance in the European higher education area (ESG). Brussels.
   Google Scholar
• Eriksson-Zetterquist, U. (2009). Institutionell teori: Idéer, moden, förändring. Liber.
   Google Scholar
• Haji, F., Morin, M. P., & Parker, K. (2013). Rethinking programme evaluation in health professions education: Beyond “did it work?”. Medical Education, 47(4), 342–351. 10.1111/medu.12091
   PubMed Web of Science ®Google Scholar
• Harvey, L. (2002). Evaluation for what? Teaching in Higher Education, 7(3), 245–263. 10.1080/13562510220144761
   Google Scholar
• Hendry, G. D., Lyon, P. M., & Henderson‐Smart, C. (2007). Teachers’ approaches to teaching and responses to student evaluation in a problem‐based medical program. Assessment & Evaluation in Higher Education, 32(2), 143–157. http://doi.org/10.1080/02602930600801894
   Google Scholar
• Henry, G. T., & Mark, M. M. (2003). Beyond use: Understanding evaluation’s influence on attitudes and actions. American Journal of Evaluation, 24(3), 293–314. http://doi.org/10.1177/109821400302400302
   Web of Science ®Google Scholar
• Højlund, S. (2014). Evaluation use in the organizational context–changing focus to improve theory. Evaluation, 20(1), 26–43. http://doi.org/10.1177/1356389013516053
   Web of Science ®Google Scholar
• Hornstein, H. A. (2017). Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance. Cogent Education, 4(1), 1304016. http://doi.org/10.1080/2331186X.2017.1304016
   Google Scholar
• Johnson, K., Greenseid, L. O., Toal, S. A., King, J. A., Lawrenz, F., & Volkov, B. (2009). Research on evaluation use: A review of the empirical literature from 1986 to 2005. American Journal of Evaluation, 30(3), 377–410. http://doi.org/10.1177/1098214009341660
   Web of Science ®Google Scholar
• Justesen, L., & Mik-Meyer, N. (2010). Kvalitative metoder i organisations- og ledelsesstudier. Hans Reitzel.
   Google Scholar
• Kember, D., Leung, D. Y. P., & Kwan, K. P. (2002). Does the use of student feedback questionnaires improve the overall quality of teaching? Assessment & Evaluation in Higher Education, 27(5), 411–425. http://doi.org/10.1080/0260293022000009294
   Google Scholar
• Little, B., & Williams, R. (2010). Students’ roles in maintaining quality and in enhancing learning: Is there a tension? Quality in Higher Education, 16(2), 115–127. 10.1080/13538322.2010.485740
   Google Scholar
• Lovdata. (2005). Lov om universiteter og høyskoler [Act relating to Universities and University Colleges Section 1-6].
   Google Scholar
• March, J. G., & Olsen, J. P. (1996). Institutional perspectives on political institutions. Governance, 9(3), 247–264. http://doi.org/10.1111/j.1468-0491.1996.tb00242.x
   Web of Science ®Google Scholar
• Meld. St. 16. (2016-2017). Kultur for kvalitet i høyere utdanning. Kunnskapsdepartement.
   Google Scholar
• Meld. St. 27. (2000-2001). Kvalitetsreform av høyere utdanning, Gjør din plikt, krev din rett. Kirke-, utdannings- og forskningsdepartementet.
   Google Scholar
• Meld. St. 7. (2007-2008). Statusrapport for Kvalitetsreformen i høgre utdanning. Kunnskapsdepartementet.
   Google Scholar
• Mercer, J. (2007). The challenges of insider research in educational institutions: Wielding a double‐edged sword and resolving delicate dilemmas. Oxford Review of Education, 33(1), 1–17. http://doi.org/10.1080/03054980601094651
   Web of Science ®Google Scholar
• Meyer, J. W., & Rowan, B. (1977). Institutionalized organizations: Formal structure as myth and ceremony. American Journal of Sociology, 83(2), 340–363. 10.1086/226550
   Web of Science ®Google Scholar
• Moskal, A. C. M., Stein, S. J., & Golding, C. (2016). Can you increase teacher engagement with evaluation simply by improving the evaluation system? Assessment & Evaluation in Higher Education, 41(2), 1–15. http://doi.org/10.1080/02602938.2015.1007838
   Web of Science ®Google Scholar
• Neumann, R. (2000). Communicating student evaluation of teaching results: Rating interpretation guides (RIGs). Assessment & Evaluation in Higher Education, 25(2), 121–134. : http://doi.org/10.1080/02602930050031289
   Google Scholar
• Newton, J. (2000). Feeding the beast or improving quality? Academics’ perceptions of quality assurance and quality monitoring. Quality in Higher Education, 6(2), 153–163. http://doi.org/10.1080/713692740
   Google Scholar
• Ory, J. C., Ryan, K., Theall, M., Abrami, P. C., & Mets, L. A. (2001). How do student ratings measure up to a new validity framework? New Directions for Institutional Research, 2001(109), 27–44. http://doi.org/10.1002/ir.2
   Google Scholar
• Ottoson, J. M. (2009). Knowledge‐for‐action theories in evaluation: Knowledge utilization, diffusion, implementation, transfer, and translation. New Directions for Evaluation, 2009(124), 7–20. http://doi.org/10.1002/ev.310
   Google Scholar
• Patton, M. Q. (1997). Utilization-focused evaluation: The new century text (3rd ed.). Sage.
   Google Scholar
• Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Sage.
   Google Scholar
• Penny, A. R., & Coe, R. (2004). Effectiveness of consultation on student ratings feedback: A meta-analysis. Review of Educational Research, 74(2), 215–253. http://doi.org/10.3102/00346543074002215
   Web of Science ®Google Scholar
• Piccinin, S., Cristi, C., & Marcia, M. (1999). The impact of individual consultation on student ratings of teaching. The International Journal for Academic Development, 4(2), 75–88. http://doi.org/10.1080/1360144032000071323
   Google Scholar
• Preskill, H., & Boyle, S. (2008). A multidisciplinary model of evaluation capacity building. American Journal of Evaluation, 29(4), 443–459. http://doi.org/10.1177/1098214008324182
   Web of Science ®Google Scholar
• Preskill, H., & Caracelli, V. (1997). Current and developing conceptions of use: Evaluation use TIG survey results. Evaluation Practice, 18(3), 209–225. http://doi.org/10.1177/109821409701800303
   Google Scholar
• Richardson, J. T. E. (2005). Instruments for obtaining student feedback: A review of the literature. Assessment & Evaluation in Higher Education, 30(4), 387–415. http://doi.org/10.1080/02602930500099193
   Google Scholar
• Røvik, K. A. (2007). Trender og translasjoner: Ideer som former det 21. århundrets organisasjon. Universitetsforlaget.
   Google Scholar
• Røvik, K. A. (2011). From fashion to virus: An alternative theory of organizations’ handling of management ideas. Organization Studies, 32(5), 631–653. http://doi.org/10.1177/0170840611405426
   Web of Science ®Google Scholar
• Røvik, K. A. (2013). Den besværlige implementeringen: Når reformideer skal løftes inn i klasserommet. In Å. Danielsen, T. Bull, & P. Arbo (Eds.), Utdanningssamfunnet og livslang læring (pp. 82–93). Gyldendal Norsk Forlag.
   Google Scholar
• Røvik, K. A. (2016). Knowledge transfer as translation: Review and elements of an instrumental theory. International Journal of Management Reviews, 18(3), 290–310. http://doi.10.1111/ijmr.12097
   Web of Science ®Google Scholar
• Røvik, K.-A. (2019). Instrumental understanding of management ideas. In A. Sturdy, S. Heusinkveld, T. Reay, & D. Strang (Eds.), The Oxford handbook of management ideas (pp. 121–137). Oxford University Press.
   Google Scholar
• Saldaña, J. (2013). The coding manual for qualitative researchers (2nd ed.). Sage.
   Google Scholar
• Saunders, M. (2011). Setting the scene: The four domains of evaluative practice in higher education. In M. Saunders, P. Trowler, & R. Bamber (Eds.), Reconceptualizing evaluation in higher education: The practice turn (pp. 1–17). McGraw-Hill Education: ProQuest Ebook Central.
   Google Scholar
• Scott, W. R. (2014). Institutions and Organizations: Ideas, Interests, and Identities. (4th ed.) Thousand Oaks, California: Sage.
   Google Scholar
• Silverman, D. (2011). Qualitative research: Issues of theory, method and practice (3rd ed.). Sage.
   Google Scholar
• Spooren, P., Brockx, B., & Mortelmans, D. (2013). On the validity of student evaluation of teaching. Review of Educational Research, 83(4), 598–642. http://doi.org/10.3102/0034654313496870
   Web of Science ®Google Scholar
• Stein, S. J., Spiller, D., Terry, S., Harris, T., Deaker, L., & Kennedy, J. (2012). Unlocking the impact of tertiary teachers’ perceptions of student evaluations of teaching. Ako Aotearoa.
   Google Scholar
• Stein, S. J., Spiller, D., Terry, S., Harris, T., Deaker, L., & Kennedy, J. (2013). Tertiary teachers and student evaluations: Never the Twain shall meet? Assessment & Evaluation in Higher Education, 38(7), 892–904. http://doi.org/10.1080/02602938.2013.767876
   Web of Science ®Google Scholar
• Stensaker, B. (2006). Governmental policy, organisational ideals and institutional adaptation in Norwegian higher education. Studies in Higher Education, 31(1), 43–56. http://doi.org/10.1080/03075070500392276
   Web of Science ®Google Scholar
• Trowler, P. R. (2011). The higher education policy context of evaluative practices. In M. Saunders, R. Bamber, & P. Trowler (Eds.), Reconceptualising evaluation in higher education: The practice turn (pp. 18–31). ProQuest Ebook Central.
   Google Scholar
• Universitetet i Tromsø. (2012). Kvalitetssystem for utdanningsvirksomheten ved Universitetet i Tromsø.
   Google Scholar
• Vedung, E. (2010). Four waves of evaluation diffusion. Evaluation, 16(3), 263–277. 10.1177/1356389010372452
   Google Scholar
• Werr, A., & Walgenbach, P. (2019). Management techniques. In A. Sturdy, S. Heusinkveld, T. Reay, and D. Strang (Eds.), The Oxford handbook of management ideas (pp. 104–120). Oxford University Press.
   Google Scholar
• Westerheijden, D. F., & Kohoutek, J. (2014). Implementation and translation: From European standards and guidelines for quality assurance to education quality work in higher education institutions. In H. Eggins (Ed.), Drivers and barriers to achieving quality in higher education (pp. 1–11). Sense Publishers.
   Google Scholar
• Wright, S. L., & Jenkins-Guarnieri, M. A. (2012). Student evaluations of teaching: Combining the meta-analyses and demonstrating further evidence for effective use. Assessment & Evaluation in Higher Education, 37(6), 683–699. http://doi.org/10.1080/02602938.2011.563279
   Web of Science ®Google Scholar