Investigating differential teacher effectiveness: searching for the impact of classroom context factors

References

• Andrich, D. (1988). A general form of Rasch’s extended logistic model for partial credit scoring. Applied Measurement in Education, 1(4), 363–378. https://doi.org/10.1207/s15324818ame0104_7
   Google Scholar
• Azigwe, J. B., Kyriakides, L., Panayiotou, A., & Creemers, B. P. M. (2016). The impact of effective teaching characteristics in promoting student achievement in Ghana. International Journal of Educational Development, 51, 51–61. https://doi.org/10.1016/j.ijedudev.2016.07.004
   Web of Science ®Google Scholar
• Bamburg, J. D. (1994). Raising expectations to improve student learning. North Central Regional Educational Lab.
   Google Scholar
• Belfi, B., Goos, M., De Fraine, B., & Van Damme, J. (2012). The effect of class composition by gender and ability on secondary school students’ school well-being and academic self-concept: A literature review. Educational Research Review, 7(1), 62–74. https://doi.org/10.1016/j.edurev.2011.09.002
   Web of Science ®Google Scholar
• Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., & Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17(2–3), 62–87. https://doi.org/10.1080/10627197.2012.715014
   Google Scholar
• Blatchford, P., Bassett, P., & Brown, P. (2011). Examining the effect of class size on classroom engagement and teacher–pupil interaction: Differences in relation to pupil prior attainment and primary vs. secondary schools. Learning and Instruction, 21(6), 715–730. https://doi.org/10.1016/j.learninstruc.2011.04.001
   Web of Science ®Google Scholar
• Braun, H. I. (2005). Using student progress to evaluate teachers: A primer on value-added models. Educational Testing Service.
   Google Scholar
• Brophy, J., & Good, T. L. (1986). Teacher behavior and student achievement. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 328–375). Macmillan.
   Google Scholar
• Campbell, R. J., Kyriakides, L., Muijs, R. D., & Robinson, W. (2003). Differential teacher effectiveness: Towards a model for research and teacher appraisal. Oxford Review of Education, 29(3), 347–362. https://doi.org/10.1080/03054980307440
   Web of Science ®Google Scholar
• Campbell, R. J., Kyriakides, L., Muijs, R. D., & Robinson, W. (2004). Assessing teacher effectiveness: Developing a differentiated model. RoutledgeFalmer.
   Google Scholar
• Caro, D. H., Kyriakides, L., & Televantou, I. (2018). Addressing omitted prior achievement bias in international assessments: An applied example using PIRLS-NPD matched data. Assessment in Education: Principles, Policy & Practice, 25(1), 5–27. https://doi.org/10.1080/0969594X.2017.1353950
   Web of Science ®Google Scholar
• Chaplin, D., Gill, B., Thompkins, A., & Miller, H. (2014). Professional practice, student surveys, and value-added: Multiple measures of teacher effectiveness in the Pittsburgh Public Schools (REL 2014–024) (ED545232). ERIC. https://files.eric.ed.gov/fulltext/ED545232.pdf
   Google Scholar
• Charalambous, C. Y., Kyriakides, E., Kyriakides, L., & Tsangaridou, N. (2019). Are teachers consistently effective across subject matters? Revisiting the issue of differential teacher effectiveness. School Effectiveness and School Improvement, 30(4), 353–379. https://doi.org/10.1080/09243453.2019.1618877
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
   Google Scholar
• Cohen, J., Ruzek, E., & Sandilos, L. (2018). Does teaching quality cross subjects? Exploring consistency in elementary teacher practice across subjects. AERA Open, 4(3), 1–16. https://doi.org/10.1177/2332858418794492
   Web of Science ®Google Scholar
• Creemers, B. P. M. (1994). The effective classroom. Cassell.
   Google Scholar
• Creemers, B. P. M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Routledge.
   Google Scholar
• Creemers, B. P. M., & Kyriakides, L. (2012). Improving quality in education: Dynamic approaches to school improvement. Routledge.
   Google Scholar
• Curby, T. W., Stuhlman, M., Grimm, K., Mashburn, A., Chomat-Mooney, L., Downer, J., Hamre, B., & Pianta, R. C. (2011). Within-day variability in the quality of classroom interactions during third and fifth grade: Implications for children’s experiences and conducting classroom observations. The Elementary School Journal, 112(1), 16–37. https://doi.org/10.1086/660682
   Web of Science ®Google Scholar
• Dimosthenous, A., Kyriakides, L., & Panayiotou, A. (2020). Short-and long-term effects of the home learning environment and teachers on student achievement in mathematics: A longitudinal study. School Effectiveness and School Improvement, 31(1), 50–79. https://doi.org/10.1080/09243453.2019.1642212
   Web of Science ®Google Scholar
• Flanders, N. A. (1970). Analyzing teaching behavior. Addison-Wesley.
   Google Scholar
• Goe, L., Bell, C., & Little, O. (2008). Approaches to evaluating teacher effectiveness: A research synthesis (ED521228). ERIC. https://files.eric.ed.gov/fulltext/ED521228.pdf
   Google Scholar
• Goldstein, H., & McDonald, R. P. (1988). A general model for the analysis of multilevel data. Psychometrika, 53(4), 455–467. https://doi.org/10.1007/BF02294400
   Web of Science ®Google Scholar
• Göllner, R., Fauth, B., Lenske, G., Praetorius, A.–K., & Wagner, W. (2020). Do student ratings of classroom management tell us more about teachers or about classroom composition? Zeitschrift für Pädagogik. Beiheft, 66(1), 156–172.
   Google Scholar
• Grossman, P., Cohen, J., & Brown, L. (2014). Understanding instructional quality in English language arts: Variations in PLATO scores by context and context. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems: New guidance from the Measures of Effective Teaching project (pp. 303–331). Jossey-Bass.
   Google Scholar
• Heck, R. H., & Moriyama, K. (2010). Examining relationships among elementary schools’ contexts, leadership, instructional practices, and added-year outcomes: A regression discontinuity approach. School Effectiveness and School Improvement, 21(4), 377–408. https://doi.org/10.1080/09243453.2010.500097
   Web of Science ®Google Scholar
• Hox, J. J., Moerbeek, M., Kluytmans, A., & van de Schoot, R. (2014). Analyzing indirect effects in cluster randomized trials. The effect of estimation method, number of groups and group sizes on accuracy and power. Frontiers in Psychology, 5, Article 78. https://doi.org/10.3389/fpsyg.2014.00078
   Google Scholar
• Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
   Web of Science ®Google Scholar
• Kalogrides, D., & Loeb, S. (2013). Different teachers, different peers: The magnitude of student sorting within schools. Educational Researcher, 42(6), 304–316. https://doi.org/10.3102/0013189X13495087
   Web of Science ®Google Scholar
• Kalogrides, D., Loeb, S., & Béteille, T. (2013). Systematic sorting: Teacher characteristics and class assignments. Sociology of Education, 86(2), 103–123. https://doi.org/10.1177/0038040712456555
   Web of Science ®Google Scholar
• Keeves, J. P., & Alagumalai, S. (1999). New approaches to measurement. In G. N. Masters & J. P. Keeves (Eds.), Advances in measurement in educational research and assessment (pp. 23–42). Pergamon.
   Google Scholar
• Kokkinou, E. (2019). Assessing teacher effectiveness: Developing a model that takes into account the classroom context effects in measuring quality of teaching [Unpublished doctoral dissertation]. University of Cyprus.
   Google Scholar
• Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices (2nd ed.). Springer.
   Google Scholar
• Kyriakides, L. (2005). Evaluating school policy on parents working with their children in class. The Journal of Educational Research, 98(5), 281–298. https://doi.org/10.3200/JOER.98.5.281-298
   Web of Science ®Google Scholar
• Kyriakides, L. (2007). Generic and differentiated models of educational effectiveness: Implications for the improvement of educational practice. In T. Townsend (Ed.), International handbook of school effectiveness and improvement (pp. 41–56). Springer. https://doi.org/10.1007/978-1-4020-5747-2_3
   Google Scholar
• Kyriakides, L., Christoforou, C., & Charalambous, C. Y. (2013). What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching. Teaching and Teacher Education, 36, 143–152. https://doi.org/10.1016/j.tate.2013.07.010
   Web of Science ®Google Scholar
• Kyriakides, L., & Creemers, B. P. M. (2008). Using a multidimensional approach to measure the impact of classroom-level factors upon student achievement: A study testing the validity of the dynamic model. School Effectiveness and School Improvement, 19(2), 183–205. https://doi.org/10.1080/09243450802047873
   Web of Science ®Google Scholar
• Kyriakides, L., Creemers, B. P. M., Antoniou, P., Demetriou, D., & Charalambous, C. Y. (2015). The impact of school policy and stakeholders’ actions on student learning: A longitudinal study. Learning and Instruction, 36, 113–124. https://doi.org/10.1016/j.learninstruc.2015.01.004
   Web of Science ®Google Scholar
• Kyriakides, L., Creemers, B. P. M., & Charalambous, E. (2019). Searching for differential teacher and school effectiveness in terms of student socioeconomic status and gender: Implications for promoting equity. School Effectiveness and School Improvement, 30(3), 286–308. https://doi.org/10.1080/09243453.2018.1511603
   Web of Science ®Google Scholar
• Kyriakides, L., Creemers, B. P. M., Panayiotou, A., & Charalambous, E. (2021). Quality and equity in education: Revisiting theory and research on educational effectiveness and improvement. Routledge.
   Google Scholar
• Ladson-Billings, G. (2009). Opportunity to teach: Teacher quality in context. In D. H. Gitomer (Ed.), Measurement issues and assessment for teaching quality (pp. 206–222). Sage Publications.
   Google Scholar
• Lazarev, V., & Newman, D. (2015). How teacher evaluation is affected by class characteristics: Are observations biased? (ED558567). ERIC. https://eric.ed.gov/?id=ED558567
   Google Scholar
• MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104. https://doi.org/10.1037/1082-989X.7.1.83
   PubMed Web of Science ®Google Scholar
• Marcoulides, G. A., & Kyriakides, L. (2010). Using generalizability theory. In B. P. M. Creemers, L. Kyriakides, & P. Sammons (Eds.), Methodological advances in educational effectiveness research (pp. 219–245). Routledge.
   Google Scholar
• Marsh, H. W., & Craven, R. G. (2006). Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science, 1(2), 133–163. https://doi.org/10.1111/j.1745-6916.2006.00010.x
   Web of Science ®Google Scholar
• Marsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & Nagengast, B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44(6), 764–802. https://doi.org/10.1080/00273170903333665
   PubMed Web of Science ®Google Scholar
• Marsh, H. W., & Parker, J. W. (1984). Determinants of student self-concept: Is it better to be a large fish in a small pond even if you don’t learn to swim as well? Journal of Personality and Social Psychology, 47(1), 213–231. https://doi.org/10.1037/0022-3514.47.1.213
   Web of Science ®Google Scholar
• Martínez, J. F. (2012). Consequences of omitting the classroom in multilevel models of schooling: An illustration using opportunity to learn and reading achievement. School Effectiveness and School Improvement, 23(3), 305–326. https://doi.org/10.1080/09243453.2012.678864
   Web of Science ®Google Scholar
• McCaffrey, D. F., Lockwood, J. R., Koretz, D., Louis, T. A., & Hamilton, L. (2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29(1), 67–101. https://doi.org/10.3102/10769986029001067
   PubMed Web of Science ®Google Scholar
• Mihaly, K., & McCaffrey, D. F. (2014). Grade-level variation in observational measures of teacher effectiveness. In T. J. Kane, K. A. Kerr, & R. C. Pianta (Eds.), Designing teacher evaluation systems: New guidance from the Measures of Effective Teaching project (pp. 9–49). Jossey-Bass.
   Google Scholar
• Muijs, D., Campbell, J., Kyriakides, L., & Robinson, W. (2005). Making the case for differentiated teacher effectiveness: An overview of research in four key areas. School Effectiveness and School Improvement, 16(1), 51–70. https://doi.org/10.1080/09243450500113985
   Web of Science ®Google Scholar
• Muijs, D., Kyriakides, L., van der Werf, G., Creemers, B., Timperley, H., & Earl, L. (2014). State of the art – Teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25(2), 231–256. https://doi.org/10.1080/09243453.2014.885451
   Web of Science ®Google Scholar
• Muijs, D., & Reynolds, D. (2001). Effective teaching: Evidence and practice. Sage Publications.
   Google Scholar
• Muthén, B. O., & Satorra, A. (1989). Multilevel aspects of varying parameters in structural models. In R. D. Bock (Eds.), Multilevel analysis of educational data (pp. 87–99). Academic Press.
   Google Scholar
• Muthén, L. K., & Muthén, B. O. (2001). Mplus: Statistical analysis with latent variables: User’s guide (2nd ed.).
   Google Scholar
• Nurmi, J.-E., Viljaranta, J., Tolvanen, A., & Aunola, K. (2012). Teachers adapt their instruction according to students’ academic performance. Educational Psychology, 32(5), 571–588. https://doi.org/10.1080/01443410.2012.675645
   Web of Science ®Google Scholar
• Olkin, I., & Finn, J. D. (1995). Correlations redux. Psychological Bulletin, 118(1), 155–164. https://doi.org/10.1037/0033-2909.118.1.155
   Web of Science ®Google Scholar
• Opdenakker, M.-C., Van Damme, J., De Fraine, B., Van Landeghem, G., & Onghena, P. (2002). The effect of schools and classes on mathematics achievement. School Effectiveness and School Improvement, 13(4), 399–427. https://doi.org/10.1076/sesi.13.4.399.10283
   Web of Science ®Google Scholar
• Pacheco, A. (2009). Mapping the terrain of teacher quality. In D. H. Gitomer (Ed.), Measurement issues and assessment for teaching quality (pp. 160–178). Sage Publications.
   Google Scholar
• Panayiotou, A., Herbert, B., Sammons, P., & Kyriakides, L. (2021). Conceptualizing and exploring the quality of teaching using generic frameworks: A way forward. Studies in Educational Evaluation, 70, Article 101028. https://doi.org/10.1016/j.stueduc.2021.101028
   Google Scholar
• Panayiotou, A., Kyriakides, L., Creemers, B. P. M., McMahon, L., Vanlaar, G., Pfeifer, M., Rekalidou, G., & Bren, M. (2014). Teacher behavior and student outcomes: Results of a European study. Educational Assessment, Evaluation and Accountability, 26(1), 73–93. https://doi.org/10.1007/s11092-013-9182-x
   Web of Science ®Google Scholar
• Preacher, K. J. (2011). Multilevel SEM strategies for evaluating mediation in three-level data. Multivariate Behavioral Research, 46(4), 691–731. https://doi.org/10.1080/00273171.2011.589280
   PubMed Web of Science ®Google Scholar
• Reynolds, D., Sammons, P., De Fraine, B., Van Damme, J., Townsend, T., Teddlie, C., & Stringfield, S. (2014). Educational effectiveness research (EER): A state-of-the-art review. School Effectiveness and School Improvement, 25(2), 197–230. https://doi.org/10.1080/09243453.2014.885450
   Web of Science ®Google Scholar
• Ritzema, E. S., Deunk, M. I., & Bosker, R. J. (2016). Differentiation practices in Grade 2 and 3: Variations in teacher behavior in mathematics and reading comprehension lessons. Journal of Classroom Interaction, 51(2), 50–72.
   Google Scholar
• Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417–458. https://doi.org/10.1111/j.1468-0262.2005.00584.x
   Web of Science ®Google Scholar
• Sammons, P. (2009). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. School Effectiveness and School Improvement, 20(1), 123–129. https://doi.org/10.1080/09243450802664321
   Web of Science ®Google Scholar
• Scharenberg, K., Rollett, W., & Bos, W. (2019). Do differences in classroom composition provide unequal opportunities for academic learning and social participation of SEN students in inclusive classes in primary school? School Effectiveness and School Improvement, 30(3), 309–327. https://doi.org/10.1080/09243453.2019.1590423
   Web of Science ®Google Scholar
• Scheerens, J. (1992). Effective schooling: Research, theory and practice. Cassell.
   Google Scholar
• Scheerens, J. (2013). The use of theory in school effectiveness research revisited. School Effectiveness and School Improvement, 24(1), 1–38. https://doi.org/10.1080/09243453.2012.691100
   Google Scholar
• Scheerens, J. (2016). Educational effectiveness and ineffectiveness: A critical review of the knowledge base. Springer. https://doi.org/10.1007/978-94-017-7459-8
   Google Scholar
• Scheerens, J., & Bosker, R. J. (1997). The foundations of educational effectiveness. Pergamon.
   Google Scholar
• Scherer, R., & Nilsen, T. (2019). Closing the gaps? Differential effectiveness and accountability as a road to school improvement. School Effectiveness and School Improvement, 30(3), 255–260. https://doi.org/10.1080/09243453.2019.1623450
   Web of Science ®Google Scholar
• Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. https://doi.org/10.3102/0034654307310317
   Web of Science ®Google Scholar
• Shavelson, R. J., Webb, N. M., & Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44(6), 922–932. https://doi.org/10.1037/0003-066X.44.6.922
   Web of Science ®Google Scholar
• Smylie, M. A., Miller. C. L., & Westbrook, K. P. (2008). The work of teachers. In T. L. Good (Ed.), 21st century education: A reference handbook (Vol.1, pp. 3–11). SAGE Publications.
   Google Scholar
• Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). SAGE Publications.
   Google Scholar
• Steinberg, M. P., & Garrett, R. (2016). Classroom composition and measured teacher performance: What do teacher observation scores really measure? Educational Evaluation and Policy Analysis, 38(2), 293–317. https://doi.org/10.3102/0162373715616249
   Web of Science ®Google Scholar
• Televantou, I., Marsh, H. W., Dicke, T., & Nicolaides, C. (2021). Phantom and big-fish-little-pond-effects on academic self-concept and academic achievement: Evidence from English early primary schools. Learning and Instruction, 71, Article 101399. https://doi.org/10.1016/j.learninstruc.2020.101399
   Google Scholar
• Tomlinson, C. A. (1999). The differentiated classroom: Responding to the needs of all learners. Association for Supervision and Curriculum Development.
   Google Scholar
• Turner, J. C., & Meyer, D. K. (2000). Studying and understanding the instructional contexts of classrooms: Using our past to forge our future. Educational Psychologist, 35(2), 69–85. https://doi.org/10.1207/S15326985EP3502_2
   Web of Science ®Google Scholar
• Whitehurst, G. J., Chingos, M. M., & Lindquist, K. M. (2014). Evaluating teachers with classroom observations: Lessons learned in four districts. Brown Center on Education Policy at Brookings.
   Google Scholar
• Wright, B. D. (1985). Additivity in psychological measurement. In E. E. Roskam (Ed.), Measurement and personality assessment (pp. 101–112). Elsevier Science Publishers.
   Google Scholar
• Wright, S. P., Horn, S. P., & Sanders, W. L. (1997). Teacher and classroom context effects on student achievement: Implications for teacher evaluation. Journal of Personnel Evaluation in Education, 11(1), 57–67. https://doi.org/10.1023/A:1007999204543
   Google Scholar