The interplay of user beliefs and situated characteristics in explaining school performance feedback use

References

• Abrams, L. M., Varier, D., & Mehdi, T. (2021). The intersection of school context and teachers’ data use practice: Implications for an integrated approach to capacity building. Studies in Educational Evaluation, 69, Article 100868. https://doi.org/10.1016/j.stueduc.2020.100868
   Web of Science ®Google Scholar
• Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T
   Web of Science ®Google Scholar
• Ajzen, I. (2002). Constructing a TpB questionnaire: Conceptual and methodological considerations. https://pdfs.semanticscholar.org/6074/b33b529ea56c175095872fa40798f8141867.pdf
   Google Scholar
• Ajzen, I. (2011). The theory of planned behaviour: Reactions and reflections. Psychology & Health, 26(9), 1113–1127. https://doi.org/10.1080/08870446.2011.613995
   PubMed Web of Science ®Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
   Google Scholar
• Armitage, C. J., & Conner, M. (2001). Efficacy of the theory of planned behaviour: A meta-analytic review. British Journal of Social Psychology, 40(4), 471–499. https://doi.org/10.1348/014466601164939
   PubMed Web of Science ®Google Scholar
• Bandura, A. (1997). Self-efficacy: The exercise of control. W.H. Freeman.
   Google Scholar
• Brown, T. A. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
   Google Scholar
• Bryk, A. S. (2010). Organizing schools for improvement. Phi Delta Kappan, 91(7), 23–30. https://doi.org/10.1177/003172171009100705
   Web of Science ®Google Scholar
• Coburn, C. E., & Talbert, J. E. (2006). Conceptions of evidence use in school districts: Mapping the terrain. American Journal of Education, 112(4), 469–495. https://doi.org/10.1086/505056
   Web of Science ®Google Scholar
• Coburn, C. E., & Turner, E. O. (2011). Research on data use: A framework and analysis. Measurement: Interdisciplinary Research and Perspectives, 9(4), 173–206. https://doi.org/10.1080/15366367.2011.626729
   Google Scholar
• Coburn, C. E., & Turner, E. O. (2012). The practice of data use: An introduction. American Journal of Education, 118(2), 99–111. https://doi.org/10.1086/663272
   Web of Science ®Google Scholar
• Datnow, A., & Hubbard, L. (2016). Teacher capacity for and beliefs about data-driven decision making: A literature review of international research. Journal of Educational Change, 17(1), 7–28. https://doi.org/10.1007/s10833-015-9264-2
   Web of Science ®Google Scholar
• Datnow, A., & Park, V. (2018). Opening or closing doors for students? Equity and data use in schools. Journal of Educational Change, 19(2), 131–152. https://doi.org/10.1007/s10833-018-9323-6
   Web of Science ®Google Scholar
• Dolle, J., White, M. E., Evans-Santiago, B., Flushman, T., Guise, M., Hegg, S., Myhre, O., Ramirez, E., & Won, N. (2018). Improvement science in teacher preparation at California State university: How teacher preparation partnerships are building capacity to learn to improve. SRI International and WestEd.
   Google Scholar
• Dowd, A. C. (2005). Data don’t drive: Building a practitioner-driven culture of inquiry to assess community college performance. Lumina Foundation for Education. https://eric.ed.gov/?id=ED499777
   Google Scholar
• Dunn, K. E., Airola, D. T., & Garrison, M. (2013). Concerns, knowledge, and efficacy: An application of the teacher change model to data driven decision-making professional development. Creative Education, 4(10), 673–682. https://doi.org/10.4236/ce.2013.410096
   Google Scholar
• Dunn, K. E., Airola, D. T., Lo, W.-J., & Garrison, M. (2013a). Becoming data driven: The influence of teachers’ sense of efficacy on concerns related to data-driven decision making. The Journal of Experimental Education, 81(2), 222–241. https://doi.org/10.1080/00220973.2012.699899
   Web of Science ®Google Scholar
• Dunn, K. E., Airola, D. T., Lo, W.-J., & Garrison, M. (2013b). What teachers think about what they can do with data: Development and validation of the data driven decision-making efficacy and anxiety inventory. Contemporary Educational Psychology, 38(1), 87–98. https://doi.org/10.1016/j.cedpsych.2012.11.002
   Web of Science ®Google Scholar
• Dunn, K. E., Skutnik, A., Patti, C., & Sohn, B. (2019). Disdain to acceptance: Future teachers’ conceptual change related to data-driven decision making. Action in Teacher Education, 41(3), 193–211. https://doi.org/10.1080/01626620.2019.1582116
   Google Scholar
• Earl, L., & Fullan, M. (2003). Using data in leadership for learning. Cambridge Journal of Education, 33(3), 383–394. https://doi.org/10.1080/0305764032000122023
   Google Scholar
• Francis, J. J., Eccles, M. P., Johnston, M., Walker, A., Grimshaw, J., Foy, R., Kaner, E. F. S., Smith, L., & Bonetti, D. (2004). Constructing questionnaires based on the theory of planned behaviour: A manual for health services researchers. Centre for Health Services Research, University of Newcastle upon Tyne. https://openaccess.city.ac.uk/id/eprint/1735
   Google Scholar
• Geddes, D., & Linnehan, F. (1996). Exploring the dimensionality of positive and negative performance feedback. Communication Quarterly, 44(3), 326–344. https://doi.org/10.1080/01463379609370021
   Google Scholar
• Hamilton, L., Halverson, R., Jackson, S. S., Mandinach, E., Supovitz, J. A., Wayman, J. C., Pickens, C., Martin, E., & Steele, J. L. (2009). Using student achievement data to support instructional decision making. United States Department of Education, https://repository.upenn.edu/gse_pubs/279
   Google Scholar
• Hellrung, K., & Hartig, J. (2013). Understanding and using feedback – A review of empirical studies concerning feedback from external evaluations to teachers. Educational Research Review, 9, 174–190. https://doi.org/10.1016/j.edurev.2012.09.001
   Web of Science ®Google Scholar
• Hendriks, M. A., Doolaard, S., & Bosker, R. J. (2002). Using school effectiveness as a knowledge base for self-evaluation in Dutch schools: The ZEBO-project. In A. J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 115–142). Swets & Zeitinger.
   Google Scholar
• Hoogland, I., Schildkamp, K., van der Kleij, F., Heitink, M., Kippers, W., Veldkamp, B., & Dijkstra, A. M. (2016). Prerequisites for data-based decision making in the classroom: Research evidence and practical illustrations. Teaching and Teacher Education, 60, 377–386. https://doi.org/10.1016/j.tate.2016.07.012
   Web of Science ®Google Scholar
• Hulpia, H., & Valcke, M. (2004). The use of performance indicators in a school improvement policy: The theoretical and empirical context. Evaluation & Research in Education, 18(1–2), 102–119. https://doi.org/10.1080/09500790408668311
   Google Scholar
• Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979). Consequences of individual feedback on behavior in organizations. Journal of Applied Psychology, 64(4), 349–371. https://doi.org/10.1037/0021-9010.64.4.349
   Web of Science ®Google Scholar
• Jimerson, J. B. (2014). Thinking about data: Exploring the development of mental models for “data use” among teachers and school leaders. Studies in Educational Evaluation, 42, 5–14. https://doi.org/10.1016/j.stueduc.2013.10.010
   Web of Science ®Google Scholar
• Jimerson, J. B., Garry, V., Poortman, C. L., & Schildkamp, K. (2021). Implementation of a collaborative data use model in a United States context. Studies in Educational Evaluation, 69, Article 100866. https://doi.org/10.1016/j.stueduc.2020.100866
   Google Scholar
• Jimerson, J. B., & Wayman, J. C. (2015). Professional learning for using data: Examining teacher needs and supports. Teachers College Record, 117(4), 1–36.
   Web of Science ®Google Scholar
• Ketelaar, E., Beijaard, D., Boshuizen, H. P. A., & den Brok, P. J. (2012). Teachers’ positioning towards an educational innovation in the light of ownership, sense-making and agency. Teaching and Teacher Education, 28(2), 273–282. https://doi.org/10.1016/j.tate.2011.10.004
   Web of Science ®Google Scholar
• Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. https://doi.org/10.1037/0033-2909.119.2.254
   Web of Science ®Google Scholar
• Lechermeier, J., & Fassnacht, M. (2018). How do performance feedback characteristics influence recipients’ reactions? A state-of-the-art review on feedback source, timing, and valence effects. Management Review Quarterly, 68(2), 145–193. https://doi.org/10.1007/s11301-018-0136-8
   Google Scholar
• LeMahieu, P. G., Grunow, A., Baker, L., Nordstrum, L. E., & Gomez, L. M. (2017). Networked improvement communities: The discipline of improvement science meets the power of networks. Quality Assurance in Education, 25(1), 5–25. https://doi.org/10.1108/QAE-12-2016-0084
   Web of Science ®Google Scholar
• Lockton, M., Weddle, H., & Datnow, A. (2020). When data don’t drive: Teacher agency in data use efforts in low-performing schools. School Effectiveness and School Improvement, 31(2), 243–265. https://doi.org/10.1080/09243453.2019.1647442
   Web of Science ®Google Scholar
• Maier, U. (2010). Accountability policies and teachers’ acceptance and usage of school performance feedback – A comparative study. School Effectiveness and School Improvement, 21(2), 145–165. https://doi.org/10.1080/09243450903354913
   Web of Science ®Google Scholar
• Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71–85. https://doi.org/10.1080/00461520.2012.667064
   Web of Science ®Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30–37. https://doi.org/10.3102/0013189X12459803
   Web of Science ®Google Scholar
• Mandinach, E. B., & Gummer, E. S. (2016). What does it mean for teachers to be data literate: Laying out the skills, knowledge, and dispositions. Teaching and Teacher Education, 60, 366–376. https://doi.org/10.1016/j.tate.2016.07.011
   Web of Science ®Google Scholar
• Mandinach, E. B., Gummer, E. S., & Muller, R. D. (2011). The complexities of integrating data-driven decision making into professional preparation in schools of education: It’s harder than you think. CNA Education, Education Northwest, and WestEd.
   Google Scholar
• Mandinach, E. B., & Schildkamp, K. (2021a). The complexity of data-based decision making: An introduction to the special issue. Studies in Educational Evaluation, 69, Article 100906. https://doi.org/10.1016/j.stueduc.2020.100906
   Google Scholar
• Mandinach, E. B., & Schildkamp, K. (2021b). Misconceptions about data-based decision making in education: An exploration of the literature. Studies in Educational Evaluation, 69, Article 100842. https://doi.org/10.1016/j.stueduc.2020.100842
   Web of Science ®Google Scholar
• Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48.
   PubMed Web of Science ®Google Scholar
• Mitzel, G. H., Lewis, D. M., Patz, R. J., & Green, D. R. (2001). The bookmark procedure: Psychological perspectives. In G. J. Cizek (Ed.), Setting performance standards. Concepts, methods, and perspectives (pp. 249–281). Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Nichols, S. L., & Berliner, D. C. (2007). Collateral damage: How high-stakes testing corrupts America’s schools. Harvard Education Press.
   Google Scholar
• Nichols, S. L., Glass, G. V., & Berliner, D. C. (2006). High-stakes testing and student achievement: Does accountability pressure increase student learning? Education Policy Analysis Archives, 14(1). https://doi.org/10.14507/epaa.v14n1.2006
   Google Scholar
• Nichols, S. L., Glass, G. V, & Berliner, D. C. (2012). High-stakes testing and student achievement: Updated analyses with NAEP data. Education Policy Analysis Archives, 20(20). https://doi.org/10.14507/epaa.v20n20.2012
   Google Scholar
• Nichols, S. L., & Harris, L. R. (2016). Accountability assessment’s effects on teachers and schools. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 40–56). Routledge.
   Google Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
   Google Scholar
• Organisation for Economic Co-operation and Development. (2017). Education policy outlook: Belgium. www.oecd.org/edu/profiles.htm
   Google Scholar
• Pierce, R., Chick, H., & Gordon, I. (2013). Teachers’ perceptions of the factors influencing their engagement with statistical reports on student achievement data. Australian Journal of Education, 57(3), 237–255. https://doi.org/10.1177/0004944113496176
   Web of Science ®Google Scholar
• Prenger, R., & Schildkamp, K. (2018). Data-based decision making for teacher and student learning: A psychological perspective on the role of the teacher. Educational Psychology, 38(6), 734–752. https://doi.org/10.1080/01443410.2018.1426834
   Web of Science ®Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach. (7th ed.). SAGE Publications.
   Google Scholar
• Sanbonmatsu, D. M., & Fazio, R. H. (1990). The role of attitudes in memory-based decision making. Journal of Personality and Social Psychology, 59(4), 614–622. https://doi.org/10.1037/0022-3514.59.4.614
   PubMed Web of Science ®Google Scholar
• Schildkamp, K. (2019). Data-based decision-making for school improvement: Research insights and gaps. Educational Research, 61(3), 257–273. https://doi.org/10.1080/00131881.2019.1625716
   Web of Science ®Google Scholar
• Schildkamp, K., Karbautzki, L., & Vanhoof, J. (2014). Exploring data use practices around Europe: Identifying enablers and barriers. Studies in Educational Evaluation, 42, 15–24. https://doi.org/10.1016/j.stueduc.2013.10.007
   Web of Science ®Google Scholar
• Schildkamp, K., & Kuiper, W. (2010). Data-informed curriculum reform: Which data, what purposes, and promoting and hindering factors. Teaching and Teacher Education, 26(3), 482–496. https://doi.org/10.1016/j.tate.2009.06.007
   Web of Science ®Google Scholar
• Schildkamp, K., Poortman, C. L., Ebbeler, J., & Pieters, J. M. (2019). How school leaders can build effective data teams: Five building blocks for a new wave of data-informed decision making. Journal of Educational Change, 20(3), 283–325. https://doi.org/10.1007/s10833-019-09345-3
   Web of Science ®Google Scholar
• Schildkamp, K., Poortman, C. L., Luyten, H., & Ebbeler, J. (2017). Factors promoting and hindering data-based decision making in schools. School Effectiveness and School Improvement, 28(2), 242–258. https://doi.org/10.1080/09243453.2016.1256901
   Web of Science ®Google Scholar
• Schildkamp, K., & Teddlie, C. (2008). School performance feedback systems in the USA and in The Netherlands: A comparison. Educational Research and Evaluation, 14(3), 255–282. https://doi.org/10.1080/13803610802048874
   Google Scholar
• Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338. https://doi.org/10.3200/JOER.99.6.323-338
   Web of Science ®Google Scholar
• Sutherland, S. (2004). Creating a culture of data use for continuous improvement: A case study of an Edison Project school. The American Journal of Evaluation, 25(3), 277–293. https://doi.org/10.1016/j.ameval.2004.05.009
   Web of Science ®Google Scholar
• Uiterwijk-Luijk, L., Krüger, M., Zijlstra, B., & Volman, M. (2017). The relationship between psychological factors and inquiry-based working by primary school teachers. Educational Studies, 43(2), 147–164. https://doi.org/10.1080/03055698.2016.1248901
   Web of Science ®Google Scholar
• van der Kleij, F. M., & Eggen, T. J. H. M. (2013). Interpretation of the score reports from the Computer Program LOVS by teachers, internal support teachers and principals. Studies in Educational Evaluation, 39(3), 144–152. https://doi.org/10.1016/j.stueduc.2013.04.002
   Web of Science ®Google Scholar
• Van Gasse, R., Vanhoof, J., Mahieu, P., & Van Petegem, P. (2015). Informatiegebruik door schoolleiders en leerkrachten [Information use by school leaders and teachers]. Garant.
   Google Scholar
• Van Gasse, R., Vanlommel, K., Vanhoof, J., & Van Petegem, P. (2017). The impact of collaboration on teachers’ individual data use. School Effectiveness and School Improvement, 28(3), 489–504. https://doi.org/10.1080/09243453.2017.1321555
   Web of Science ®Google Scholar
• Vanhoof, J., Vanlommel, K., Thijs, S., & Vanderlocht, H. (2014). Data use by Flemish school principals: Impact of attitude, self-efficacy and external expectations. Educational Studies, 40(1), 48–62. https://doi.org/10.1080/03055698.2013.830245
   Web of Science ®Google Scholar
• Vanhoof, J., Verhaeghe, G., Van Petegem, P., & Valcke, M. (2012). Flemish primary teachers’ use of school performance feedback and the relationship with school characteristics. Educational Research, 54(4), 431–449. https://doi.org/10.1080/00131881.2012.734726
   Web of Science ®Google Scholar
• Vanhoof, J., Verhaeghe, G., Verhaeghe, J. P., Valcke, M., & van Petegem, P. (2011). The influence of competences and support on school performance feedback use. Educational Studies, 37(2), 141–154. https://doi.org/10.1080/03055698.2010.482771
   Web of Science ®Google Scholar
• Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017). Teachers’ decision-making: Data based or intuition driven? International Journal of Educational Research, 83, 75–83. https://doi.org/10.1016/j.ijer.2017.02.013
   Web of Science ®Google Scholar
• Vanlommel, K., Vanhoof, J., & Van Petegem, P. (2016). Data use by teachers: The impact of motivation, decision-making style, supportive relationships and reflective capacity. Educational Studies, 42(1), 36–53. https://doi.org/10.1080/03055698.2016.1148582
   Web of Science ®Google Scholar
• Verhaeghe, G., Vanhoof, J., Valcke, M., & Van Petegem, P. (2010). Using school performance feedback: Perceptions of primary school principals. School Effectiveness and School Improvement, 21(2), 167–188. https://doi.org/10.1080/09243450903396005
   Web of Science ®Google Scholar
• Visscher, A. J. (2021). On the value of data-based decision making in education: The evidence from six intervention studies. Studies in Educational Evaluation, 69, Article 100899. https://doi.org/10.1016/j.stueduc.2020.100899
   Google Scholar
• Visscher, A. J., & Coe, R. (2003). School performance feedback systems: Conceptualisation, analysis, and reflection. School Effectiveness and School Improvement, 14(3), 321–349. https://doi.org/10.1076/sesi.14.3.321.15842
   Web of Science ®Google Scholar
• Wayman, J. C., Cho, V., Mandinach, E. B., Supovitz, J. A., & Wilkerson, S. B. (2017). Teacher data use survey: Teacher version. REL Appalachia and the Institute of Educational Sciences, U.S. Department of Education.
   Google Scholar
• Wu, J., & Lederer, A. (2009). A meta-analysis of the role of environment-based voluntariness in information technology acceptance. MIS Quarterly, 33(2), 419–432. https://doi.org/10.2307/20650298
   Web of Science ®Google Scholar