Are teachers consistently effective across subject matters? Revisiting the issue of differential teacher effectiveness

References

• Andrich, D. (1988). A general form of Rasch’s extended logistic model for partial credit scoring. Applied Measurement in Education, 1(4), 363–378. doi: 10.1207/s15324818ame0104_7
   Google Scholar
• Azigwe, J. B., Kyriakides, L., Panayiotou, A., & Creemers, B. P. M. (2016). The impact of effective teaching characteristics in promoting student achievement in Ghana. International Journal of Educational Development, 51, 51–61. doi: 10.1016/j.ijedudev.2016.07.004
   Web of Science ®Google Scholar
• Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2–3), 62–87. doi: 10.1080/10627197.2012.715014
   Google Scholar
• Bond, T. G., & Fox, C. M. (2012). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). New York, NY: Routledge.
   Google Scholar
• Brophy, J. E. (1973). Stability of teacher effectiveness. American Educational Research Journal, 10(3), 245–252. doi: 10.2307/1161888
   Web of Science ®Google Scholar
• Campbell, J., Kyriakides, L., Muijs, D., & Robinson, W. (2004). Assessing teacher effectiveness: Developing a differentiated model. New York, NY: RoutledgeFalmer.
   Google Scholar
• Charalambous, C. Y., & Kyriakides, E. (2017). Working at the nexus of generic and content-specific teaching practices: An exploratory study based on TIMSS secondary analyses. Elementary School Journal, 117(3), 423–454. doi: 10.1086/690221
   Web of Science ®Google Scholar
• Charalambous, C. Y., Kyriakides, E., Tsangaridou, N., & Kyriakides, L. (2017). Exploring the reliability of generic and content-specific instructional aspects in physical education lessons. School Effectiveness and School Improvement, 28(4), 555–577. doi: 10.1080/09243453.2017.1311929
   Web of Science ®Google Scholar
• Cheng, Y. C., & Tsui, K. T. (1999). Multimodels of teacher effectiveness: Implications for research. Journal of Educational Research, 92(3), 141–150. doi: 10.1080/00220679909597589
   Web of Science ®Google Scholar
• Cohen, J. (2018). Practices that cross disciplines?: Revisiting explicit instruction in elementary mathematics and English language arts. Teaching and Teacher Education, 69, 324–335. doi: 10.1016/j.tate.2017.10.021
   Web of Science ®Google Scholar
• Cohen, J., & Goldhaber, D. (2016). Observations on evaluating teacher performance: Assessing the strengths and weaknesses of classroom observations and value-added measures. In J. A. Grissom & P. Youngs (Eds.), Improving teacher evaluation systems: Making the most of multiple measures (pp. 8–21). New York, NY: Teachers College Press.
   Google Scholar
• Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Abingdon: Routledge.
   Google Scholar
• Darling-Hammond, L. (2013). Getting teacher evaluation right: What really matters for effectiveness and improvement. New York, NY: Teachers College Press.
   Google Scholar
• Dee, T. S., & Cohodes, S. R. (2008). Out-of-field teachers and student achievement: Evidence from matched-pairs comparisons. Public Finance Review, 36(1), 7–32. doi: 10.1177/1091142106289330
   Google Scholar
• Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• European Commission/EACEA/Eurydice. (2013). Physical education and sport at school in Europe: Eurydice report. Luxembourg: Publications Office of the European Union. Retrieved from https://eurydice.org.pl/wp-content/uploads/2014/11/150EN.pdf
   Google Scholar
• Fauth, B., Decristan, J., Rieser, S., Klieme, E., & Buttner, G. (2014). Student ratings of teaching quality in primary school: Dimensions and prediction of student outcomes. Learning and Instruction, 29, 1–9. doi: 10.1016/j.learninstruc.2013.07.001
   Web of Science ®Google Scholar
• Fenstermacher, G. D., & Richardson, V. (2005). On making determinations of quality in teaching. Teachers College Record, 107(1), 186–213.
   Web of Science ®Google Scholar
• Gitomer, D., & Bell, C. (2013). Evaluating teaching and teachers. In K. F. Geisinger (Ed.), APA handbook of testing and assessment in psychology: Vol. 3: Testing and assessment in school psychology and education (pp. 415–444). Washington, DC: American Psychological Association.
   Google Scholar
• Goldhaber, D., Cowan, J., & Walch, J. (2013). Is a good elementary teacher always good? Assessing teacher performance estimates across subjects. Economics of Education Review, 36, 216–228. doi: 10.1016/j.econedurev.2013.06.010
   Web of Science ®Google Scholar
• Graeber, A. O., Newton, K. J., & Chambliss, M. J. (2012). Crossing the borders again: Challenges in comparing the quality instruction in mathematics and reading. Teachers College Record, 114(4), 1–30.
   Web of Science ®Google Scholar
• Graham, G., & Holt/Hale, S. A., & Parker, M. (2013). Children moving: A reflective approach to teaching physical education (9th ed.). Boston, MA: McGraw-Hill Higher Education.
   Google Scholar
• Griggs, G., & Petrie, K. (Eds.). (2018). Routledge handbook of primary physical education. New York, NY: Routledge.
   Google Scholar
• Grossman, P., Cohen, J., Ronfeldt, M., & Brown, L. (2014). The test matters: The relationship between classroom observation scores and teacher value added on multiple types of assessment. Educational Researcher, 43(6), 293–303. doi: 10.3102/0013189X14544542
   Web of Science ®Google Scholar
• Grossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2013). Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers’ value-added scores. American Journal of Education, 119(3), 445–470. doi: 10.1086/669901
   Web of Science ®Google Scholar
• Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
   Google Scholar
• Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., . . . Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 113(4), 461–487. doi: 10.1086/669616
   PubMed Web of Science ®Google Scholar
• Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. New York, NY: Routledge.
   Google Scholar
• Herlihy, C., Karger, E., Pollard, C., Hill, H. C., Kraft, M. A., Williams, M., & Howard, S. (2014). State and local efforts to investigate the validity and reliability of scores from teacher evaluation systems. Teachers College Record, 116(1), 1–28.
   Web of Science ®Google Scholar
• Hill, H. C., Charalambous, C. Y., & Kraft, M. A. (2012). When rater reliability is not enough: Teacher observation systems and a case for the generalizability study. Educational Researcher, 41(2), 56–64. doi: 10.3102/0013189X12437203
   Web of Science ®Google Scholar
• Hill, H. C., Kapitula, L., & Umland, K. (2011). A validity argument approach to evaluating value-added scores. American Educational Research Journal, 48(3), 794–831. doi: 10.3102/0002831210387916
   Web of Science ®Google Scholar
• Kraft, M. A., & Gilmour, A. F. (2016). Can principals promote teacher development as evaluators? A case study of principals’ views and experiences. Educational Administration Quarterly, 52(5), 711–753. doi: 10.1177/0013161X16653445
   PubMed Web of Science ®Google Scholar
• Kyriakides, E. (2016). Combining generic and content-specific practices in exploring teaching quality in physical education and its impact on student learning (Unpublished doctoral dissertation). University of Cyprus, Nicosia.
   Google Scholar
• Kyriakides, L., & Creemers, B. P. M. (2008). A longitudinal study on the stability over time of school and teacher effects on student learning outcomes. Oxford Review of Education, 34(5), 521–545. doi: 10.1080/03054980701782064
   Web of Science ®Google Scholar
• Kyriakides, L., Creemers, B. P. M., & Antoniou, P. (2009). Teacher behaviour and student outcomes: Suggestions for research on teacher training and professional development. Teaching and Teacher Education, 25(1), 12–23. doi: 10.1016/j.tate.2008.06.001
   Web of Science ®Google Scholar
• Kyriakides, L., & Tsangaridou, N. (2008). Towards the development of generic and differentiated models of educational effectiveness: A study on school and teacher effectiveness in physical education. British Educational Research Journal, 34(6), 807–838. doi: 10.1080/01411920802041467
   Web of Science ®Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. doi: 10.2307/2529310
   PubMed Web of Science ®Google Scholar
• Lipowsky, F. (2005). A model of differentiated teacher effectiveness: Theoretical framework and empirical research. School Effectiveness and School Improvement, 16(2), 217–227. doi: 10.1080/09243450500114140
   Web of Science ®Google Scholar
• Little, O., Goe, L., & Bell, C. (2009). A practical guide to evaluating teacher effectiveness. Washington, DC: National Comprehensive Center for Teacher Quality.
   Google Scholar
• Loeb, S., & Candelaria, C. A. (2013). How stable are value-added estimates across years, subjects, and student groups? Retrieved from http://www.carnegieknowledgenetwork.org/briefs/value-added/value-added-stability/
   Google Scholar
• Loeb, S., Kalogrides, D., & Béteille, T. (2012). Effective schools: Teacher hiring, assignment, development, and retention. Education Finance and Policy, 7(3), 269–304. doi: 10.1162/EDFP_a_00068
   Web of Science ®Google Scholar
• McConney, A., & Price, A (2009). Teaching out-of-field in Western Australia. Australian Journal of Teacher Education, 34(6), 86–100. doi: 10.14221/ajte.2009v34n6.6
   Google Scholar
• McGuinn, P. (2012). The state of teacher evaluation reform (CPRE Research Report). Retrieved from http://repository.upenn.edu/cpre_researchreports/70
   Google Scholar
• Muijs, D., Campbell, J., Kyriakides, L., & Robinson, W. (2005). Making the case for differentiated teacher effectiveness: An overview of research in four key areas. School Effectiveness and School Improvement, 16(1), 51–70. doi: 10.1080/09243450500113985
   Web of Science ®Google Scholar
• Muijs, D., Kyriakides, L., Van der Werf, G., Creemers, B., Timperley, H., & Earl, L. (2014). State of the art – Teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25(2), 231–256. doi: 10.1080/09243453.2014.885451
   Web of Science ®Google Scholar
• Muijs, D., & Reynolds, D. (2011). Effective teaching: Evidence and practice (3rd ed.). London: Sage.
   Google Scholar
• Naumann, A., Rieser, S., Musow, S., Hochweber, J., & Hartig, J. (2019). Sensitivity of test items to teaching quality. Learning and Instruction, 60, 41–53. doi: 10.1016/j.learninstruc.2018.11.002
   Web of Science ®Google Scholar
• Panayiotou, A., Kyriakides, L., Creemers, B. P. M., McMahon, L., Vanlaar, G., Pfeifer, M., . . . Bren, M. (2014). Teacher behavior and student outcomes: Results of a European study. Educational Assessment, Evaluation and Accountability, 26(1), 73–93. doi: 10.1007/s11092-013-9182-x
   Web of Science ®Google Scholar
• Papay, J. P. (2011). Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Educational Research Journal, 48(1), 163–193. doi: 10.3102/0002831210362589
   Web of Science ®Google Scholar
• Patton, K., & Parker, M. (2015). “I learned more at lunchtime”: Guideposts for reimagining professional development. Journal of Physical Education, Recreation and Dance, 86(1), 23–29. doi: 10.1080/07303084.2014.978421
   Web of Science ®Google Scholar
• Praetorius, A.-K., & Charalambous, C. Y. (2018). Classroom observation frameworks for studying instructional quality: looking back and looking forward. ZDM Mathematics Education, 50(3), 535–553. doi: 10.1007/s11858-018-0946-0
   Google Scholar
• Praetorius, A.-K., Pauli, C., Reusser, K., Rakoczy, K., & Klieme, E. (2014). One lesson is all you need? Stability of instructional quality across lessons. Learning and Instruction, 31, 2–12. doi: 10.1016/j.learninstruc.2013.12.002
   Web of Science ®Google Scholar
• Praetorius, A.-K., Vieluf, S., Saß, S., Bernholt, A., & Klieme, E. (2016). The same in German as in English? Investigating the subject-specificity of teaching quality. Zeitschrift für Erziehungswissenschaft, 19(1), 191–209. doi: 10.1007/s11618-015-0660-4
   Web of Science ®Google Scholar
• Reynolds, D., Chapman, C., Clarke, P., Muijs, D., Sammons, P., & Teddlie, C. (2016). Conclusions: The future of educational effectiveness and improvement research, and some suggestions and speculations. In C. Chapman, D. Muijs, D. Reynolds, P. Sammons, & C. Teddlie (Eds.), The Routledge international handbook of educational effectiveness and improvement: Research, policy, and practice (pp. 408–439). New York, NY: Routledge.
   Google Scholar
• Rink, J. E. (2013). Measuring teacher effectiveness in physical education. Research Quarterly for Exercise and Sport, 84(4), 407–418. doi: 10.1080/02701367.2013.844018
   PubMed Web of Science ®Google Scholar
• Ríordáin, M. N., & Hannigan, A. (2011). Who teaches mathematics at second level in Ireland? Irish Educational Studies, 30(3), 289–304. doi: 10.1080/03323315.2011.569117
   Web of Science ®Google Scholar
• Rosenshine, B. (1970). The stability of teacher effects upon student achievement. Review of Educational Research, 40(5), 647–662. doi: 10.3102/00346543040005647
   Web of Science ®Google Scholar
• Rowan, B., & Correnti, R. (2009). Studying reading instruction with teacher logs: Lessons from the Study of Instructional Improvement. Educational Researcher, 38(2), 120–131. doi: 10.3102/0013189X09332375
   Web of Science ®Google Scholar
• Rowan, B., Correnti, R., & Miller, R. J. (2002). What large-scale, survey research tells us about teacher effects on student achievement: Insights from the Prospects study of elementary schools. Teachers College Record, 104(8), 1525–1567. doi: 10.1111/1467-9620.00212
   Web of Science ®Google Scholar
• Scheerens, J. (2013). The use of theory in school effectiveness research revisited. School Effectiveness and School Improvement, 24(1), 1–38. doi: 10.1080/09243453.2012.691100
   Google Scholar
• Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. New York, NY: Pergamon.
   Google Scholar
• Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. doi: 10.3102/0034654307310317
   Web of Science ®Google Scholar
• Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14. doi: 10.3102/0013189X015002004
   Google Scholar
• Stodolsky, S. S. (1988). The subject matters: Classroom activity in math and social studies. Chicago, IL: University of Chicago Press.
   Google Scholar
• United Nations Educational, Scientific and Cultural Organization. (2014). World-wide survey of school physical education: Final Report 2013. Retrieved from http://unesdoc.unesco.org/images/0022/002293/229335e.pdf
   Google Scholar
• Walkington, C., & Marder, M. (2014). Classroom observation and value-added models give complementary information about quality of mathematics teaching. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems: New guidance from the Measures of Effective Teaching project (pp. 234–277). San Francisco, CA: John Wiley & Sons.
   Google Scholar
• Weisberg, D., Sexton, S., Mulhern, J., & Keeling, D. (2009). The Widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness. Brooklyn, NY: The New Teacher Project. Retrieved from https://tntp.org/assets/documents/TheWidgetEffect_execsummary_2nd_ed.pdf
   Google Scholar