Investigating applicability of ratings of indicators of the CLASS Pre-K instrument

References

• Bejar, I.I., 2012. Rater cognition: implications for validity. Journal of educational measurement, 31 (3), 2–9. doi:10.1111/j.1745-3992.2012.00238.x.
   Google Scholar
• Bell, C.A., et al., 2012. An argument approach to observation protocol validity. Educational assessment, 17 (2-3), 62–87. doi:10.1080/10627197.2012.715014.
   Google Scholar
• Bell, C.A., et al., 2014. Improving observational score quality: challenges in observer thinking. In: K. Kerr, R. Pianta, and T. Kane, eds. Designing teacher evaluation systems: new guidance from the measures of effective teaching project. San Francisco, CA: Jossey-Bass, 50–97.
   Google Scholar
• Brennan, R.L., 2011. Generalizability theory and classical test theory. Applied measurement in education, 24 (1), 1–21. doi:10.1080/08957347.2011.532417.
   Web of Science ®Google Scholar
• Brown, J.L., et al., 2010. Improving classroom quality: teacher influences and experimental impacts of the 4Rs program. Journal of educational psychology, 102 (1), 153–167. doi:10.1037/a0018160.
   Web of Science ®Google Scholar
• Burchinal, M., et al., 2010. Threshold analysis of associations between child care quality and child outcomes for low-income children in pre-kindergarten programs. Early childhood research quarterly, 25, 166–176. doi:10.1016/j.ecresq.2009.10.004.
   Web of Science ®Google Scholar
• Cadima, J., Leal, T., and Burchinal, M., 2010. The quality of teacher–student interactions: associations with first graders’ academic and behavioral outcomes. Journal of school psychology, 48 (6), 457–482. doi:10.1016/j.jsp.2010.09.001.
   PubMed Web of Science ®Google Scholar
• Casabianca, J.M., et al., 2013. Effect of observation mode on measures of secondary mathematics teaching. Educational and psychological measurement, 73 (5), 757–783. doi:10.1177/0013164413486987.
   Web of Science ®Google Scholar
• Casabianca, J.M., Lockwood, J.R., and McCaffrey, D.F., 2015. Trends in classroom observation scores. Educational and psychological measurement, 75 (2), 311–337. doi:10.1177/0013164414539163.
   PubMed Web of Science ®Google Scholar
• Cash, A.H., et al., 2012. Rater calibration when observational assessment occurs at large scale: degree of calibration and characteristics of raters associated with calibration. Early childhood research quarterly, 27 (3), 529–542. doi:10.1016/j.ecresq.2011.12.006.
   Web of Science ®Google Scholar
• Cohen, J., 1968. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological bulletin, 70 (4), 213–220. doi:10.1037/h0026256.
   PubMed Web of Science ®Google Scholar
• Cronbach, L.J., et al., 1972. The dependability of behavioral measurements: theory of generalizability for scores and profiles. New York, NY: Wiley.
   Google Scholar
• Curby, T.W., et al., 2016. Live versus video observations: comparing the reliability and validity of two methods of assessing classroom quality. Journal of psychoeducational assessment, 34 (8), 765–781. doi:10.1177/0734282915627115.
   Web of Science ®Google Scholar
• Curby, T.W., Rimm-Kaufman, S.E., and Ponitz, C.C., 2009. Teacher–child interactions and children’s achievement trajectories across kindergarten and first grade. Journal of educational psychology, 101 (4), 912–925. doi:10.1037/a0016647.
   Web of Science ®Google Scholar
• Dobbs-Oates, J., et al., 2011. Effective behavior management in preschool classrooms and children’s task orientation: enhancing emergent literacy and language development. Early childhood research quarterly, 26 (4), 420–429. doi:10.1016/j.ecresq.2011.02.003.
   Web of Science ®Google Scholar
• Downer, J.T., et al., 2012. Observations of teacher-child interactions in classrooms serving Latinos and dual language learners: applicability of the classroom assessment scoring system in diverse settings. Early childhood research quarterly, 27 (1), 21–32. doi:10.1016/j.ecresq.2011.07.005.
   Web of Science ®Google Scholar
• Gitomer, D.H., et al., 2014. The instructional challenge in improving teaching quality: lessons from a classroom observation protocol. Teachers college record, 116, 1–32. doi:10.1177/016146811411600607.
   Web of Science ®Google Scholar
• Hamre, B.K., et al., 2013. Teaching through interactions – testing a developmental framework for understanding teacher effectiveness in over 4,000 U.S. early childhood and elementary classrooms. The elementary school journal, 113 (4), 461–487. doi:10.1086/669616.
   PubMed Web of Science ®Google Scholar
• Hamre, B.K., et al., 2014. Evidence for general and domain-specific elements of teacher–child interactions: associations with preschool children’s development. Child development, 85 (3), 1257–1274. doi:10.1111/cdev.12184.
   PubMed Web of Science ®Google Scholar
• Hill, H.C., Charalambous, C.Y., and Kraft, M.A., 2012. When rater reliability is not enough: teacher observation systems and a case for the generalizability study. Educational researcher, 41 (2), 56–64. doi:10.3102/0013189X12437203.
   Web of Science ®Google Scholar
• Hu, B.Y., et al., 2016. Applicability of the classroom assessment scoring system in Chinese preschools based on psychometric evidence. Early education and development, 27 (5), 1–21. doi:10.1080/10409289.2016.1113069.
   Web of Science ®Google Scholar
• Jensen, B., et al., 2020. An ecological analysis of the classroom assessment scoring system in K-1 Mexican classrooms. Early years, 40 (4-5), 514–533. doi:10.1080/09575146.2020.1749035.
   Web of Science ®Google Scholar
• Leyva, D., et al., 2015. Teacher–child interactions in chile and their associations with prekindergarten outcomes. Child development, 86 (3), 781–799. doi:10.1111/cdev.12342.
   PubMed Web of Science ®Google Scholar
• Li, H., Liu, J., and Hunter, C.V., 2020. A meta-analysis of the factor structure of the Classroom Assessment Scoring System (CLASS). Journal of experimental education, 88 (2), 265–287. doi:10.1080/00220973.2018.1551184.
   Web of Science ®Google Scholar
• Malmberg, L.-E., et al., 2010. Observed classroom quality during teacher education and two years of professional practice. Journal of educational psychology, 102 (4), 916–932. doi:10.1037/a0020920.
   Web of Science ®Google Scholar
• Mantzicopoulos, P., et al., 2018. The stability of kindergarten teachers’ effectiveness: a generalizability study comparing the framework for teaching and the classroom assessment scoring system. Educational assessment, 23 (1), 24–46. doi:10.1080/10627197.2017.1408407.
   Web of Science ®Google Scholar
• Mashburn, A.J., et al., 2008. Measures of classroom quality in prekindergarten and children’s development of academic, language, and social skills. Child development, 79 (3), 732–749. doi:10.1111/j.1467-8624.2008.01154.x.
   PubMed Web of Science ®Google Scholar
• Mashburn, A.J., et al., 2014a. Improving the power of an experimental study of a social and emotional learning program: application of generalizability theory to the measurement of classroom-level outcomes. Prevention science, 15 (2), 146–155. doi:10.1007/s11121-012-0357-3.
   PubMed Web of Science ®Google Scholar
• Mashburn, A., et al., 2014b. The effect of observation length and presentation order on the reliability and validity of classroom observations. Educational and psychological measurement, 74 (3), 400–422. doi:10.1177/0013164413515882.
   Web of Science ®Google Scholar
• McCaffrey, D.F., et al., 2015. Uncovering multivariate structure in classroom observations in the presence of rater errors. Educational measurement: issues and practice, 34 (2), 34–46. doi:10.1111/emip.12061.
   Web of Science ®Google Scholar
• McHugh, M.L., 2012. Interrater reliability: the Kappa statistic. Biochem med (Zagreb), 22 (3), 276–282.
   PubMed Web of Science ®Google Scholar
• Merritt, E.G. et al., 2012. The contribution of emotional support to children’s social behaviors and self-regulatory skills in first grade. School psychology review, 41 (2), 141–159. doi:10.1080/02796015.2012.12087517.
   Web of Science ®Google Scholar
• Pianta, R.C., and Hamre, B.K., 2009. Conceptualization, measurement, and improvement of classroom processes: standardized observation can leverage capacity. Educational researcher, 38 (2), 109–119. doi:10.3102/0013189X09332374.
   Web of Science ®Google Scholar
• Pianta, R.C., Hamre, B.K., and Mintz, S.L., 2012. The CLASS-secondary manual. Charlottesville: University of Virginia.
   Google Scholar
• Pianta, R.C., La Paro, K.M., and Hamre, B.K., 2008. The classroom assessment scoring system: manual, Pre-K. Baltimore, MD: Paul H. Brookes.
   Google Scholar
• Ponitz, C., et al., 2009. Early adjustment, gender differences, and classroom organizational climate in first grade. Elementary school journal, 110 (2), 142–162. doi:10.1086/605470.
   Web of Science ®Google Scholar
• Sandilos, L.E., and DiPerna, J.C., 2014. Measuring quality in kindergarten classrooms: structural analysis of the Classroom Assessment Scoring System (CLASS K–3). Early education and development, 25 (6), 894–914. doi:10.1080/10409289.2014.883588.
   Web of Science ®Google Scholar
• Stuck, A., Kammermeyer, G., and Roux, S., 2016. The Reliability and structure of the Classroom Assessment Scoring System in German preschools. European early childhood education research journal, 24 (6), 873–894. doi:10.1080/1350293X.2016.1239324.
   Web of Science ®Google Scholar
• Styck, K.M., et al., 2021. Examining rater effects on the Classroom Assessment Scoring System. Child development, 92 (3), 976–993. doi:10.1111/cdev.13460.
   PubMed Web of Science ®Google Scholar
• von Suchodoletz, A., et al., 2014. A Typical morning in preschool: observations of teacher–child interactions in German preschools. Early childhood research quarterly, 29 (4), 509–519. doi:10.1016/j.ecresq.2014.05.010.
   Web of Science ®Google Scholar
• Yates, G.C.R., and Yates, S.M., 1990. Teacher effectiveness research: towards describing user-friendly classroom instruction. Educational psychology, 10 (3), 225–238.
   Google Scholar