Unravelling the challenges of the data-based approach to teaching improvement

References

• Allen, J. P., Pianta, R. C., Gregory, A., Mikami, A. Y., & Lun, J. (2011). An interaction-based approach to enhancing secondary school instruction and student achievement. Science, 333(6045), 1034–1037. https://doi.org/https://doi.org/10.1126/science.1207998
   PubMed Web of Science ®Google Scholar
• Baumert, J., Kunter, M., Blum, W., Klusmann, U., Krauss, S., & Neubrand, M. (2013). Professional competence of teachers, cognitively activating instruction, and the development of students’ mathematical literacy (COACTIV): A research program. In M. Kunter, J. Baumert, W. Blum, U. Klusmann, S. Krauss, & M. Neubrand (Eds.), Mathematics teacher education: Vol. 8. Cognitive activation in the mathematics classroom and professional competence of teachers (pp. 1–21). Springer. https://doi.org/https://doi.org/10.1007/978-1-4614-5149-5_1
   Google Scholar
• Bell, C. A. (2012, September 13). Validation of professional practice components of teacher evaluation systems. [Paper presentation]. 14th annual Reidy Interactive Lecture Series, Boston, MA, United States.
   Google Scholar
• Bell, C. A., Dobbelaer, M. J., Klette, K., & Visscher, A. (2019). Qualities of classroom observation systems. School Effectiveness and School Improvement, 30(1), 3–29. https://doi.org/https://doi.org/10.1080/09243453.2018.1539014
   Web of Science ®Google Scholar
• Bijlsma, H. J. E., Glas, C. A. W., & Visscher, A. J. (2020). Factors related to differences in digitally measured student perceptions of teaching quality [Manuscript submitted for publication]. Faculty of Behavioural, Management and Social Sciences, University of Twente.
   Google Scholar
• Bijlsma, H. J. E., Visscher, A. J., Dobbelaer, M. J., & Veldkamp, B. P. (2019). Does smartphone-assisted student feedback affect teachers’ teaching quality? Technology, Pedagogy and Education, 28(2), 217–236. https://doi.org/https://doi.org/10.1080/1475939X.2019.1572534
   Web of Science ®Google Scholar
• Bill & Melinda Gates Foundation. (2018). Measures of effective teaching project FAQs. https://k12education.gatesfoundation.org/blog/measures-of-effective-teaching-project-faqs/
   Google Scholar
• Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3–15. https://doi.org/https://doi.org/10.3102/0013189X033008003
   Google Scholar
• Borman, G. D., Slavin, R. E., Cheung, A. C. K., Chamberlain, A. M., Madden, N. A., & Chambers, B. (2007). Final reading outcomes of the national randomized field trial of Success for All. American Educational Research Journal, 44(3), 701–731. https://doi.org/https://doi.org/10.3102/0002831207306743
   Web of Science ®Google Scholar
• Brophy, J., & Good, T. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). Macmillan.
   Google Scholar
• Creemers, B. P. M. (1994). The effective classroom. Cassell.
   Google Scholar
• Danielson, C. (2013). The framework for teaching: Evaluation instrument, 2013 edition. The Danielson Group LLC.
   Google Scholar
• Darling-Hammond, L. (2015). Can value added add value to teacher evaluation? Educational Researcher, 44(2), 132–137. https://doi.org/https://doi.org/10.3102/0013189X15575346
   Web of Science ®Google Scholar
• Day, C. (2004). A passion for teaching. RoutledgeFalmer.
   Google Scholar
• Day, C. (2008). Committed for life? Variations in teachers’ work, lives and effectiveness. Journal of Educational Change, 9(3), 243–260. https://doi.org/https://doi.org/10.1007/s10833-007-9054-6
   Google Scholar
• den Brok, P. J. (2001). Teaching and student outcomes: A study on teachers’ thoughts and actions from an interpersonal and a learning activities perspective. W.C.C.
   Google Scholar
• den Brok, P., Brekelmans, M., & Wubbels, T. (2004). Interpersonal teacher behaviour and student outcomes. School Effectiveness and School Improvement, 15(3–4), 407–442. https://doi.org/https://doi.org/10.1080/09243450512331383262
   Web of Science ®Google Scholar
• Dobbelaer, M. J. (2019). The quality and qualities of classroom observation systems [Doctoral dissertation, University of Twente]. Ipskamp Printing.
   Google Scholar
• Ellis, E. S., & Worthington, L. A. (1994). Research synthesis on effective teaching principles and the design of quality tools for educators (Technical Report No. 5). National Center to Improve the Tools of Educators, University of Oregon.
   Google Scholar
• Ericsson, K. A. (2006). The influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson, N. Charness, R. R. Hoffman, & P. J. Feltovich (Eds.), The Cambridge handbook of expertise and expert performance (pp. 685–705). Cambridge University Press.
   Google Scholar
• Eva, K. W., & Regehr, G. (2005). Self-assessment in the health professions: A reformulation and research agenda. Academic Medicine: Journal of the Association of American Medical Colleges, 80(10), S46–S54.
   PubMed Web of Science ®Google Scholar
• Faber, J., Luyten, H., & Visscher, A. J. (2017). The effects of a digital formative assessment tool on mathematics achievement and student motivation: Results of a randomized experiment. Computers & Education, 106, 83–96. https://doi.org/https://doi.org/10.1016/j.compedu.2016.12.001
   Web of Science ®Google Scholar
• Ferguson, R. F. (2012). Can student surveys measure teaching quality? Phi Delta Kappan, 94(3), 24–28. https://doi.org/https://doi.org/10.1177/003172171209400306
   Web of Science ®Google Scholar
• Fessler, R., & Christensen, J. C. (1992). The teacher career cycle: Understanding and guiding the professional development of teachers. Allyn and Bacon.
   Google Scholar
• Gess-Newsome, J. (2015). A model of teacher professional knowledge and skill including PCK: Results of the thinking from the PCK Summit. In A. Berry, P. Friedrichsen, & J. Loughran (Eds.), Re-examining pedagogical content knowledge in science education (pp. 28–42). Routledge.
   Google Scholar
• Gitomer, D. H., & Bell, C. A. (2013). Evaluating teachers and teaching. In K. F. Geisinger, B. A. Bracken, J. F. Carlson, J.-I. C. Hansen, N. R. Kuncel, S. P. Reise, & M. C. Rodriguez (Eds.), APA handbook of testing and assessment in psychology: Vol. 3. Testing and assessment in school psychology and education (pp. 415–444). American Psychological Association. https://doi.org/https://doi.org/10.1037/14049-020
   Google Scholar
• Gitomer, D., Bell, C., Qi, Y., McCaffrey, D., Hamre B. K., & Pianta, R. C. (2014). The instructional challenge in improving teaching quality: Lessons from a classroom observation protocol. Teachers College Record, 116(6), 1–32.
   Web of Science ®Google Scholar
• Haertel, E. H. (2013). Reliability and validity of inferences about teachers based on student test scores. Educational Testing Service Research & Development, Center for Research on Human Capital and Education.
   Google Scholar
• Hanushek, E. A., & Rivkin, S. G. (2012). The distribution of teacher quality and implications for policy. Annual Review of Economics, 4, 131–157. https://doi.org/https://doi.org/10.1146/annurev-economics-080511-111001
   Web of Science ®Google Scholar
• Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.
   Google Scholar
• Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/https://doi.org/10.3102/003465430298487
   Web of Science ®Google Scholar
• Hill, H. C., Charalambous, C. Y., & Kraft, M. A. (2012). When rater reliability is not enough: Teacher observation systems and a case for the generalizability study. Educational Researcher, 41(2), 56–64. https://doi.org/https://doi.org/10.3102/0013189X12437203
   Web of Science ®Google Scholar
• Hu, Y., & van Veen, K. (2020a). Decomposing the observation-based coaching process: The role of coaches in supporting teacher learning. Teachers and Teaching, 26(3–4), 280–294. https://doi.org/https://doi.org/10.1080/13540602.2020.1823828
   Web of Science ®Google Scholar
• Hu, Y., & van Veen, K. (2020b). How features of the implementation process shape the success of an observation-based coaching program: Perspectives of teachers and coaches. The Elementary School Journal, 121(2), 283–310. https://doi.org/https://doi.org/10.1086/711070
   Web of Science ®Google Scholar
• Inspectie van het Onderwijs. (2013). Professionalisering als gerichte opgave: Verkennend onderzoek naar het leren van leraren [Deliberate professionalization: An explorative study into teacher learning].
   Google Scholar
• Kennedy, M. M. (2016). How does professional development improve teaching? Review of Educational Research, 86(4), 945–980. https://doi.org/https://doi.org/10.3102/0034654315626800
   Web of Science ®Google Scholar
• Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. https://doi.org/https://doi.org/10.1037/0033-2909.119.2.254
   Web of Science ®Google Scholar
• Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own imcompetence lead to inflated self-assessments. Journal of Personality & Social Psychology, 77(6), 1121–1134. https://doi.org/https://doi.org/10.1037/0022-3514.77.6.1121
   PubMed Web of Science ®Google Scholar
• Levine, D. U., & Lezotte, L. W. (1995). Effective schools research. In J. A. Banks & C. A. M. Banks (Eds.), Handbook of research on multicultural education (pp. 525–547). Macmillan.
   Google Scholar
• Marzano, R. J., Pickering, D. J., & Pollock, J. E. (2008). Wat werkt in de klas? [What works in the classroom?]. Bazalt Educatieve Uitgaven.
   Google Scholar
• Maulana, R. (2012). Teacher-student relationships during the first year of secondary education: Exploration of change and link with motivational outcomes in The Netherlands and Indonesia. [Unpublished doctoral dissertation]. University of Groningen.
   Google Scholar
• Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2013). Changes in teachers’ involvement versus rejection and links with academic motivation during the first year of secondary education: A multilevel growth curve analysis. Journal of Youth and Adolescence, 42(9), 1348–1371. https://doi.org/https://doi.org/10.1007/s10964-013-9921-9
   PubMed Web of Science ®Google Scholar
• McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003). Evaluating value-added models for teacher accountability. RAND Corporation.
   Google Scholar
• Messick, S. (1989). Validity. In R. L. Linn (Ed.), The American Council on Education/Macmillan series on higher education. Educational measurement (pp. 13–103). Macmillan Publishing Co.
   Google Scholar
• Mintzberg, H. (1979). The structuring of organizations: A synthesis of the research. Prentice Hall.
   Google Scholar
• Muijs, D., & Reynolds, D. (2001). Effective teaching: Evidence and practice. SAGE Publications.
   Google Scholar
• Nye, B., Konstantopoulos, S., & Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26(3), 237–257. https://doi.org/https://doi.org/10.3102/01623737026003237
   Web of Science ®Google Scholar
• Pianta, R. C., & Hamre, B. K. (2009). Classroom processes and positive youth development: Conceptualizing, measuring, and improving the capacity of interactions between teachers and students. New Directions for Youth Development, 2009(121), 33–46. https://doi.org/https://doi.org/10.1002/yd.295
   PubMedGoogle Scholar
• Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. The Elementary School Journal, 83(4), 427–452. https://doi.org/https://doi.org/10.1086/461325
   Web of Science ®Google Scholar
• Rosenholtz, S. J. (1989). Workplace conditions that affect teacher quality and commitment: Implications for teacher induction programs. The Elementary School Journal, 89(4), 420–439. https://doi.org/https://doi.org/10.1086/461584
   Web of Science ®Google Scholar
• Rosenshine, B. (2012). Principles of instruction: Research-based strategies that all teachers should know. American Educator, 36(1), 12–19.
   Google Scholar
• Sammons, P., Hillman, J., & Mortimore, P. (1995). Key characteristics of effective schools: A review of school effectiveness research. Institute of Education, University of London.
   Google Scholar
• Scheerens, J. (1992). Effective schooling: Research theory and practice. Cassell.
   Google Scholar
• Scheerens, J. (2016). Educational effectiveness and ineffectiveness: A critical review of the knowledge base. Springer. https://doi.org/https://doi.org/10.1007/978-94-017-7459-8
   Google Scholar
• Scheerens, J., & Bosker, R. J. (1997). The foundations of educational effectiveness. Elsevier Science.
   Google Scholar
• Scheerens, J., Seidel, T., Witziers, B., Hendriks, M. A., & Doornekamp, B. G. (2005). Positioning and validating the supervision framework. University of Twente.
   Google Scholar
• Schildkamp, K., & Kuiper, W. (2010). Data-informed curriculum reform: Which data, what purposes, and promoting and hindering factors. Teaching and Teacher Education, 26(3), 482–496. https://doi.org/https://doi.org/10.1016/j.tate.2009.06.007
   Web of Science ®Google Scholar
• Schön, D. A. (1988). From technical rationality to reflection-in-action. In J. Dowie & A. S. Elstein (Eds.), Professional judgment: A reader in clinical decision making (pp. 60–77). Cambridge University Press.
   Google Scholar
• Shepard, L. A. (1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16(2), 5–24. https://doi.org/https://doi.org/10.1111/j.1745-3992.1997.tb00585.x
   Google Scholar
• Simpson, A. (2018). Princesses are bigger than elephants: Effect size as a category error in evidence-based education. British Educational Research Journal, 44(5), 897–913. https://doi.org/https://doi.org/10.1002/berj.3474
   Web of Science ®Google Scholar
• Strauss, S. (2005). Teaching as a natural cognitive ability: Implications for classroom practice and teacher education. In D. B. Pillemer & S. H. White (Eds.), Developmental psychology and social change: Research, history and policy (pp. 368–388). Cambridge University Press.
   Google Scholar
• Timmermans, A. C. (2012). Value added in educational accountability: Possible, fair and useful? [Doctoral dissertation, University of Groningen]. GION, Gronings Instituut voor Onderzoek van Onderwijs, Rijksuniversiteit Groningen.
   Google Scholar
• Trochim, W. M. K. (2006). Introduction to validity. http://www.socialresearchmethods.net/kb/introval.php
   Google Scholar
• Troman, G., & Woods, P. (2001). Primary teachers’ stress. RoutledgeFalmer.
   Google Scholar
• Tschannen-Moran, M., Woolfolk Hoy, A., & Hoy, W. K. (1998). Teacher efficacy: Its meaning and measure. Review of Educational Research, 68(2), 202–248. https://doi.org/https://doi.org/10.3102/00346543068002202
   Web of Science ®Google Scholar
• van der Lans, R. M., van de Grift, W. J. C. M., van Veen, K., & Fokkens-Bruinsma, M. (2016). Once is not enough: Establishing reliability criteria for feedback and evaluation decisions based on classroom observations. Studies in Educational Evaluation, 50, 88–95. https://doi.org/https://doi.org/10.1016/j.stueduc.2016.08.001
   Web of Science ®Google Scholar
• van der Lans, R. M., van de Grift, W. J. C. M., & van Veen, K. (2015). Developing a teacher evaluation instrument to provide formative feedback using student ratings of teaching acts. Educational Measurement: Issues and Practice, 34(3), 18–27. https://doi.org/https://doi.org/10.1111/emip.12078
   Web of Science ®Google Scholar
• van der Scheer, E. A., Bijlsma, H. J. E., & Glas, C. A. W. (2019). Validity and reliability of student perceptions of teaching quality in primary education. School Effectiveness and School Improvement, 30(1), 30–50. https://doi.org/https://doi.org/10.1080/09243453.2018.1539015
   Web of Science ®Google Scholar
• van Geel, M., Keuning, T., Visscher, A. J., & Fox, J.-P.(2016). Assessing the effects of a school-wide data-based decision-making intervention on student achievement growth in primary schools. American Educational Research Journal, 53(2), 360–394. https://doi.org/https://doi.org/10.3102/0002831216637346
   Web of Science ®Google Scholar
• van Merriënboer, J. J. G., & Kirschner, P. A. (2007). Ten steps to complex learning: A systematic approach to four-component instructional design. Lawrence Erlbaum Associates.
   Google Scholar
• van Tartwijk, J., Brekelmans, M., Wubbels, T., Fisher, D. L., & Fraser, B. J. (1998). Students’ perceptions of teacher interpersonal style: The front of the classroom as the teacher’s stage. Teaching and Teacher Education, 14(6), 607–617. https://doi.org/https://doi.org/10.1016/S0742-051X(98)00011-0
   Web of Science ®Google Scholar
• Visscher, A. J. (2015). Over de zin van opbrengstgericht werken in het onderwijs [On the value of databased decision-making in education]. GION onderzoek/onderwijs.
   Google Scholar
• Visscher, A. J. (2021). On the value of data-based decision making in education: The evidence from six intervention studies. Studies in Educational Evaluation, 69, Article 100899. https://doi.org/https://doi.org/10.1016/j.stueduc.2020.100899
   Google Scholar
• Visscher, A. J., & Coe, R. (2003). School performance feedback systems: Conceptualisation, analysis, and reflection. School Effectiveness and School Improvement, 14(3), 321–349. https://doi.org/https://doi.org/10.1076/sesi.14.3.321.15842
   Web of Science ®Google Scholar
• Walberg, H. J., & Haertel, G. D. (1992). Educational psychology’s first century. Journal of Educational Psychology, 84(1), 6–19. https://doi.org/https://doi.org/10.1037/0022-0663.84.1.6
   Web of Science ®Google Scholar
• Ward, J. R., & McCotter, S. S. (2004). Reflection as a visible outcome for preservice teachers. Teaching and Teacher Education, 20(3), 243–257. https://doi.org/https://doi.org/10.1016/j.tate.2004.02.004
   Web of Science ®Google Scholar
• Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The Widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness: Executive summary, second edition. New Teacher Project.
   Google Scholar
• Weiss, C. H. (1998). Improving the use of evaluations: Whose job is it anyway? In A. J. Reynolds & H. J. Walberg (Eds.), Advances in educational productivity (Vol. 7, pp. 263–276). JAI Press.
   Google Scholar
• Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3–14. https://doi.org/https://doi.org/10.1016/j.stueduc.2011.03.001
   Google Scholar