Drawing on Siedentop’s Legacy to Revisit Systematic Observation of Teaching: Identifying and Addressing Key Validity and Reliability Questions

References

• Barquero-Ruiz, C., Arias-Estero, J. L., & Kirk, D. (2020). Assessment for tactical learning in games: A systematic review. European Physical Education Review, 26(4), 827–847. https://doi.org/10.1177/1356336X19889649
   Web of Science ®Google Scholar
• Bell, C., Dobbelaer, M., Klette, K., & Visscher, A. (2019). Qualities of classroom observation systems. School Effectiveness and School Improvement, 30(1), 3–29. https://doi.org/10.1080/09243453.2018.1539014
   Web of Science ®Google Scholar
• Bell, C., Qi, Y., Croft, A. J., Leusner, D., McCaffrey, D. F., Gitomer, D. H., & Pianta, R. C. (2014). Improving observational score quality: Challenges in observer thinking. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems: New guidance from the measures of effective teaching project (pp. 50–97). Jossey-Bass. https://doi.org/10.1002/9781119210856.ch3
   Google Scholar
• Berliner, D. C. (2005). The near impossibility of testing for teacher quality. Journal of Teacher Education, 56(3), 205–213. https://doi.org/10.1177/0022487105275904
   Web of Science ®Google Scholar
• Brophy, J., & Good, T. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 376–391). McMillan.
   Google Scholar
• Casabianca, J. M., McCaffrey, D. F., Gitomer, D. H., Bell, C. A., Hamre, B. K., & Pianta, R. C. (2013). Effect of observation mode on measures of secondary mathematics teaching. Educational and Psychological Measurement, 73(5), 757–783. https://doi.org/10.1177/0013164413486987
   Web of Science ®Google Scholar
• Charalambous, C. Y., & Kyriakides, E. (2017). Working at the nexus of generic and content-specific teaching practices: An exploratory study based on TIMSS secondary analyses. The Elementary School Journal, 117(3), 423–454. https://doi.org/10.1086/690221
   Web of Science ®Google Scholar
• Charalambous, C. Y., Kyriakides, E., Tsangaridou, N., & Kyriakides, L. (2017). Exploring the reliability of generic and content-specific instructional aspects in physical education lessons. School Effectiveness and School Improvement, 28(4), 555–577. https://doi.org/10.1080/09243453.2017.1311929
   Web of Science ®Google Scholar
• Charalambous, C. Y., & Praetorius, A. K. (2018). Studying mathematics instruction through different lenses: Setting the ground for understanding instructional quality more comprehensively. ZDM, 50(3), 355–366. https://doi.org/10.1007/s11858-018-0914-8
   Google Scholar
• Chen, W., Hendricks, K., & Archibald, K. (2011). Assessing preservice teachers’ quality teaching practices. Educational Research and Evaluation, 17(1), 13–32. https://doi.org/10.1080/13803611.2011.578008
   Google Scholar
• Chen, W., Zhu, W., Mason, S., Hammond Bennett, A., & Colombo-Dougovito, A. (2016). Effectiveness of quality physical education in improving students’ manipulative skill competency. Journal of Sport and Health Science, 5(2), 231–238. https://doi.org/10.1016/j.jshs.2015.04.005
   PubMed Web of Science ®Google Scholar
• Cope, E., Partington, M., & Harvey, S. (2017). A review of the use of a systematic observation method in coaching research between 1997 and 2016. Journal of Sports Sciences, 35(20), 2042–2050. https://doi.org/10.1080/02640414.2016.1252463
   PubMed Web of Science ®Google Scholar
• Darst, P. W., Zakrajsek, D., & Mancini, V. H. (Eds.). (1989). Analyzing physical education and sport instruction (2nd ed.). Human Kinetics.
   Google Scholar
• Graham, G., Locke, L., & Siedentop, D. (1981). Research on teaching physical education: A discussion with Larry Locke and Daryl siedentop. Journal of Teaching in Physical Education, 1(1), 3–15. https://doi.org/10.1123/jtpe.1.1.3
   Google Scholar
• Grossman, P. (2018). Teaching core practices in teacher education. Harvard Education Press. http://hepg.org/hep-home/books/teaching-core-practices-in-teacher-education
   Google Scholar
• Grossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2013). Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers’ value-added scores. American Journal of Education, 119(3), 445–470. https://doi.org/10.1086/669901
   Web of Science ®Google Scholar
• Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–38). Lawrence Erlbaum Associates.
   Google Scholar
• Hill, H. C., Charalambous, C. Y., & Kraft, M. A. (2012). When rater reliability is not enough teacher observation systems and a case for the generalizability study. Educational Researcher, 41(2), 56–64. https://doi.org/10.3102/0013189X12437203
   Web of Science ®Google Scholar
• Hill, H. C., & Grossman, P. (2013). Learning from teacher observations: Challenges and opportunities posed by new teacher evaluation systems. Harvard Educational Review, 83(2), 371–384. https://doi.org/10.17763/haer.83.2.d11511403715u376
   Web of Science ®Google Scholar
• Kyriakides, L., & Tsangaridou, N. (2008). Towards the development of generic and differentiated models of educational effectiveness: Α study on school and teacher effectiveness in physical education. British Educational Research Journal, 34(6), 807–838. https://doi.org/10.1080/01411920802041467
   Web of Science ®Google Scholar
• Kyriakides, E., Tsangaridou, N., Charalambous, C. Y., & Kyriakides, L. (2021). Toward a more comprehensive picture of physical education teaching quality: Combining generic and content-specific practices. Journal of Teaching in Physical Education, 40(2), 256–266. https://doi.org/10.1123/jtpe.2019-0162
   Web of Science ®Google Scholar
• Marttinen, R., Landi, D., Novak, D., & Silverman, S. (2020). A systematic analysis of research on teaching in physical education: Two decades of progress. Journal of Teaching in Physical Education, 39(4), 545–554. https://doi.org/10.1123/jtpe.2019-0106
   Web of Science ®Google Scholar
• McKenzie, T. (2010). 2009 C. H. McCloy lecture seeing is believing. Research Quarterly for Exercise and Sport, 81(2), 113–122. https://doi.org/10.1080/02701367.2010.10599656
   PubMed Web of Science ®Google Scholar
• McKenzie, T., & van der Mars, H. (2015). Top 10 research questions related to assessing physical activity and its contexts using systematic observation. Research Quarterly for Exercise and Sport, 86(1), 13–29. https://doi.org/10.1080/02701367.2015.991264
   PubMed Web of Science ®Google Scholar
• Nilsen, T., Gustafsson, J. -E., & Blömeke, S. (2016). Conceptual framework and methodology of this report. In T. Nilsen & J.-E. Gustafsson (Eds.), Teacher quality, instructional quality and student outcomes: Relationships across countries, cohorts, and time (pp. 1–19). Springer.
   Google Scholar
• O’Sullivan, M. (2002). Good data are all you have: The legacy of a PETE scholar. Journal of Teaching in Physical Education, 21(4), 441–453. https://doi.org/10.1123/jtpe.21.4.441
   Web of Science ®Google Scholar
• Parker, M., & O’Sullivan, M. (1983). Modifying ALT-PE for game play contexts and other reflections [Monograph]. Journal of Teaching in Physical Education, 2(4), 8–10.
   Google Scholar
• Praetorius, A. K., & Charalambous, C. Y. (2018). Classroom observation frameworks for studying instructional quality: Looking back and looking forward. ZDM, 50(3), 535–553. https://doi.org/10.1007/s11858-018-0946-0
   Google Scholar
• Praetorius, A. K., Pauli, C., Reusser, K., Rakoczy, K., & Klieme, E. (2014). One lesson is all you need? Stability of instructional quality across lessons. Learning and Instruction, 31, 2–12. https://doi.org/10.1016/j.learninstruc.2013.12.002
   Web of Science ®Google Scholar
• Rasmussen, J. F., Scrabis-Fletcher, K., & Silverman, S. (2014). Relationships among tasks, time, and student practice in elementary physical education. Physical Educator, 71(1), 114–131. https://js.sagamorepub.com/pe/article/view/2819
   Google Scholar
• Rink, J. E. (2013). Measuring teacher effectiveness in physical education. Research Quarterly for Exercise and Sport, 84(4), 407–418. https://doi.org/10.1080/02701367.2013.844018
   PubMed Web of Science ®Google Scholar
• Rink, J. E. (2020). Teaching physical education for learning (8th ed.). McGraw-Hill.
   Google Scholar
• Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Sage.
   Google Scholar
• Siedentop, D. (1981). The Ohio state university supervision research program summary report. Journal of Teaching in Physical Education, 1(s1), 30–38. https://doi.org/10.1123/JTPE.1.s1.30
   Google Scholar
• Siedentop, D. (1983). Academic learning time: Reflections and prospects [Monograph]. Journal of Teaching in Physical Education, 2(4), 3–7.
   Google Scholar
• Siedentop, D. (2002). Ecological perspectives in teaching research. Journal of Teaching in Physical Education, 21(4), 427–440. https://doi.org/10.1123/jtpe.21.4.427
   Web of Science ®Google Scholar
• Siedentop, D. (2005). The effective physical educator: Then and now avec les homages de l’auteur. In F. C. da Costa, M. Cloes, & M. G. Valeiro (Eds.), The art and science of teaching in physical education and sport. Homege to maurice pieron (pp. 89–105). Faculdade de Motricidade Humana.
   Google Scholar
• Siedentop, D., & Tannehill, D. (2000). Developing teaching skills in physical education (4th ed.). Mayfield.
   Google Scholar
• Subramaniam, R. P., & Wuest, A. D. (2017). Measurement of teaching in physical education. In C. Ennis (Ed.), Routledge handbook of physical pedagogies (pp. 387–398). Routledge Taylor & Francis Group.
   Google Scholar
• Tousignant, M. (2005). Observational research on teaching in physical education. In F. C. da Costa, M. Cloes, & M. G. Valeiro (Eds.), The art and science of teaching in physical education and sport. Homege to maurice pieron (pp. 249–256). Faculdade de Motricidade Humana.
   Google Scholar
• van der Mars, H. (1989). Systematic observation: An introduction. In P. W. Darst, D. B. Zakrajsek, & V. H. Mancini (Eds.), Analyzing physical and sport instruction (2nd ed., pp. 3–18). Human Kinetics.
   Google Scholar
• Veal, M. L., & Anderson, W. G. (2011). Analysis of teaching and learning in physical education. Jones & Bartlett Publishers.
   Google Scholar
• Ward, P. (2021). Core practices for teaching physical education: Recommendations for teacher education. Journal of Teaching in Physical Education, 40(1), 98–108. https://doi.org/10.1123/jtpe.2019-0114
   Web of Science ®Google Scholar
• White, M. (2021). Validity framework for the design and analysis of studies using standardized observation systems. In M. Blikstad Balas, K. Klette, & M. Tengberg (Eds.), Ways of analyzing teaching quality: Potentials and pitfalls (pp. 89–120). Scandinavian University Press. https://doi.org/10.18261/9788215045054-2021-03
   Google Scholar
• White, M., Maher, B., & Rowan, B. (2022). A framework for addressing instrumentation biases when using observation systems as outcome measures in instructional interventions. Journal of Research on Educational Effectiveness, 1–27. https://doi.org/10.1080/19345747.2022.2081275
   Web of Science ®Google Scholar