References
- Austin, G., & Duerr, M. (2005). Guidebook for the California Healthy Kids Survey. Part III. School climate survey for teachers and other staff, 2005-2006 edition. WestEd. http://www.wested.org/pub/docs/chks_surveys_summary.html
- Bagozzi, R. P. (1978). The construct validity of the affective, behavioral, and cognitive components of attitude by analysis of covariance structures. Multivariate Behavioral Research, 13(1), 9–31. https://doi.org/10.1207/s15327906mbr1301_2
- Bauer, D. J., Howard, A. L., Baldasaro, R. E., Curran, P. J., Hussong, A. M., & Chassin, L. (2013). A trifactor model for integrating ratings across multiple informants. Psychological Methods, 18(4), 475–493. https://doi.org/10.1037/a0032475
- Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness-of-fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588
- Berkowitz, R., Moore, H., Astor, R. A., & Benbenishty, R. (2017). A research synthesis of the associations between socioeconomic background, inequality, school climate, and academic achievement. Review of Educational Research, 87(2), 425–469. https://doi.org/10.3102/0034654316669821
- Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & W. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions and new directions (pp. 349–381). Jossey-Bass.
- Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
- Carretero-Dios, H., Eid, M., & Ruch, W. (2011). Analyzing multitrait-multimethod data with multilevel confirmatory factor analysis: An application to the validation of the State-Trait Cheerfulness Inventory. Journal of Research in Personality, 45(2), 153–164. https://doi.org/10.1016/j.jrp.2010.12.007
- Cohen, J., McCabe, L., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. The Teachers College Record, 111, 180–213. https://eric.ed.gov/?id=EJ826002
- Cornell, D., Huang, F., Konold, T., Shukla, K., Malone, M., Datta, P., Jia, Y., Stohlman, S., Burnette, A., & Meyer, J. P. (2016). Development of a standard model for school climate and safety assessment: Final report. Curry School of Education, University of Virginia.
- Dary, T., & Pickeral, T. (ed). (2013). School climate: Practices for implementation and sustainability. A school climate practice brief, number 1. National School Climate Center.
- De Haan, A., Prinzie, P., Sentse, M., & Jongerling, J. (2018). Latent difference score modeling: A flexible approach for studying informant discrepancies. Psychological Assessment, 30(3), 358–369. https://doi.org/http://dx.doi.10.1037/pas0000480
- Dedrick, R. F., & Greenbaum, P. E. (2011). Multilevel confirmatory factor analysis of a scale measuring interagency collaboration of children’s mental health agencies. Journal of Emotional and Behavioral Disorders, 19(1), 27–40. https://doi.org/10.1177/1063426610365879
- Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16(1), 149–167. https://doi.org/10.1016/j.leaqua.2004.09.009
- Eid, M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika, 65(2), 241–261. https://doi.org/10.1007/BF02294377
- Eid, M., Lischetzke, T., Nussbeck, F. W., & Trierweiler, L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple indicator CT-C(M-1) model. Psychological Methods, 8(1), 38–60. https://doi.org/10.1037/1082-989X.8.1.38
- Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2008). Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13(3), 230–253. https://doi.org/10.1037/a0013219
- Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 6(1), 56–83. https://doi.org/10.1080/10705519909540119
- Flake, J. K., & Petway, K. T. (2019). Methodologies for investigating and interpreting student-teacher rating incongruence in noncognitive assessment. Educational Measurement: Issues and Practice, 38(1), 63–77. https://doi.org/10.1111/emip.12201
- Garson, G. D. (2013). Factor analysis. Statistical Associates Publishing.
- Gase, L. N., Gomez, L. M., Kuo, T., Glenn, B. A., Inkelas, M., & Ponce, N. A. (2017). Relationships among student, staff, and administrative measures of school climate and student health and academic outcomes. Journal of School Health, 87(5), 319–328. https://doi.org/10.1111/josh.12501
- Geiser, C., Eid, M., & Nussbeck, F. W. (2008). On the meaning of the latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods, 13(1), 49–57. https://doi.org/10.1037/1082-989X.13.1.49
- Gomez, R., Vance, A., & Stavropoulos, V. (2018). Correlated trait-correlated method minus one analysis of the convergent and discriminant validity of the Conner’s 3 short forms. Assessment, 40(1), 194–205. https://doi.org/10.1177/1073191118803714
- Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
- Huang, F., Cornell, D., Konold, T. R., Meyer, P., Lacey, A., Nekvasil, E., Heilbrun, A., & Shukla, K. (2015). Multilevel factor structure and concurrent validity of the teacher version of the Authoritative School Climate Survey. Journal of School Health, 85(12), 843–851. https://doi.org/10.1111/josh.12340
- Juvonen, J., Nishina, A., & Graham, S. (2000). Peer harassment, psychological adjustment, and school functioning in early adolescence. Journal of Educational Psychology, 92(2), 349–359. https://doi.org/10.1037/0022-0663.92.2.349
- Kenny, D. A. (1979). Correlation and causation. Wiley.
- Kenny, D. A., & Kashy, D. A. (1992). Analysis of multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112(1), 165–172. https://doi.org/10.1037/0033-2909.112.1.165
- Kim, E. S., Dedrick, R. F., Cao, C., & Ferron, J. M. (2016). Multilevel factor analysis: Reporting guidelines and a review of reporting practices. Multivariate Behavioral Research, 51(6), 881–898. https://doi.org/10.1080/00273171.2016.1228042
- Koch, T., Schultze, M., Burrus, J., Roberts, R. D., & Eid, M. (2015). A multilevel CFA-MTMM models for nested structurally different methods. Journal of Educational and Behavioral Statistics, 40(5), 477–510. https://doi.org/10.3102/1076998615606109
- Konold, T. R. (2018). A multilevel MTMM approach to estimating the influences of contextual factors on trait and informant-based method effects in assessments of school climate. Journal of Psychoeducational Assessment, 36(5), 464–476. https://doi.org/10.1177/0734282916683286
- Konold, T. R., & Cornell, D. (2015a). Measurement and structural relations of an authoritative school climate model: A multi-level latent variable investigation. Journal of School Psychology, 53(6), 447–461. https://doi.org/http:/dx.doi.10.1016/j.jsp.2015.09.001
- Konold, T. R., & Cornell, D. (2015b). Multilevel multitrait-multimethod model of structurally different and interchangeable raters of school climate. Psychological Assessment, 27(3), 1097–1109. https://doi.org/http://dx.doi.10.1037/pas0000098
- Konold, T. R., & Shukla, K. (2017). Estimating school climate traits across multiple informants: An illustration of a multitrait–multimethod validation through latent variable modeling. Educational Assessment, 22(1), 54–69. https://doi.org/10.1080/10627197.2016.1271705
- Kozlowski, S. W., & Klein, K. J. (2000). A multilevel approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 3–90). Jossey-Bass.
- Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7(2), 228–244. https://doi.org/10.1037/1082-989X.7.2.228
- Liard, R. D., & De Los Reyes, A. (2013). Testing informant discrepancies as predictors of adolescent psychopathology: Why difference scores cannot tell you what you want to know and how polynomial regression may. Journal of Abnormal Child Psychology, 41(1), 1–14. https://doi.org/10.1007/s10802-012-9659-y
- Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002). To parcel or not to parcel: Exploring the question, weighting the merits. Structural Equation Modeling, 9(2), 151–173. https://doi.org/10.1207/S15328007SEM0902_1
- Loukas, A. (2007). What is school climate? Leadership Compass, 5(1), 1–3. https://www.naesp.org/sites/default/files/resources/2/Leadership_Compass/2007/LC2007v5n1a4.pdf
- Low, J. A., Keith, T. Z., & Jensen, M. (2015). What predicts method effects in child behavior ratings? Journal of Psychoeducational Assessment, 33(2), 177–187. https://doi.org/10.1177/0734282914544922
- Ludtke, O., Marsh, H., Robitzsch, A., & Trautwein, U. (2011). A 2 × 2 taxonomy of multilevel latent contextual models: Accuracy-bias trade-offs in full and partial error-correction models. Psychological Methods, 16(4), 444–467. https://doi.org/10.1037/a0024376
- Luo, Z., Breslau, J., Gardiner, J. C., Chen, Q., & Breslau, N. (2014). Assessing interchangeability at cluster levels with multiple-informant data. Statistics in Medicine, 33(3), 361–375. https://doi.org/10.1002/sim.5948
- Marsh, H. W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 12(4), 335–361. https://doi.org/10.1177/014662168901300402
- Marsh, H. W., & Grayson, D. (1995). Latent variable models of multitrait-multimethod matrices. In R. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 177–198). Sage.
- Marsh, H. W., Ludtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Koller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47(2), 106–124. https://doi.org/10.1080/00461520.2012.670488
- Muthen, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28(4), 338–354. https://doi.org/10.1111/j.1745-3984.1991.tb00363.x
- Nussbeck, F. W., Eid, M., Geiser, C., Courvoisier, D. S., & Lischetzke, T. (2009). A CTC(M-1) model for different types of raters. Methodology, 5(3), 88–98. https://doi.org/10.1027/1614-2241.5.3.88
- Olweus, D. (2007). The Olweus Bullying Questionnaire. Hazelden.
- Park, N., & Peterson, C. (2006). Character strengths and happiness among young children: Content analysis of parental descriptions. Journal of Happiness Studies, 7(3), 323–341. https://doi.org/10.1007/s10902-005-3648-6
- Ramsey, C. M., Spira, A. P., Parisi, J. M., & Rebok, G. W. (2016). School climate: Perceptual differences between students, parents, and school staff. School Effectiveness and School Improvement, 27(4), 629–641. https://doi.org/10.1080/09243453.2016.1199436
- Reise, S. P., Ventura, J., Nuechterlein, K. H., & Kim, K. H. (2005). An illustration of multilevel factor analysis. Journal of Personality Assessment, 84(2), 126–136. https://doi.org/10.1207/s15327752jpa8402_02
- Ryu, E. (2014). Model fit evaluation in multilevel structural equation models. Frontiers in Psychology, 5(1), 1–9. https://doi.org/10.3389/fpsyg.2014.00081
- Schmitt, N. (1978). Path analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 2(2), 157–173. https://doi.org/10.1177/014662167800200201
- Stapleton, L. M., Yang, J. S., & Hancock, G. R. (2016). Construct meaning in multilevel settings. Journal of Educational and Behavioral Statistics, 41(5), 481–520. https://doi.org/10.3102/1076998616646200
- Sterba, S. K., & Rights, J. D. (2017). Effects of parceling on model selection: Parcel-allocation variability in model ranking. Psychological Methods, 22(1), 47–68. https://doi.org/10.1037/met0000067
- Thornberry, T. P., Lizotte, A. J., Krohn, M. D., Farnworth, M., & Jang, S. J. (1991). Testing interactional theory: An examination of reciprocal causal relationships among family, school, and delinquency. Journal of Criminal Law & Criminology, 82(1), 3–35. https://doi.org/10.2307/1143788
- Wang, M. T., & Degol, J. L. (2015). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315–352. https://doi.org/10.1007/s10648-015-9319-1
- Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9(1), 1–26. https://doi.org/10.1177/014662168500900101