References
- Abe, Y., & Gee, K. A. (2014). Sensitivity analyses for clustered data: An illustration from a large-scale clustered randomized controlled trial in education. Evaluation and Program Planning, 47, 26–34. https://doi.org/https://doi.org/10.1016/j.evalprogplan.2014.07.001
- Al Otaiba, S., Connor, C. M., Folsom, J. S., Greulich, L., Meadows, J., & Li, Z. (2011). Assessment data-informed guidance to individualize kindergarten reading Instruction: Findings from a cluster-randomized control field trial. The Elementary School Journal, 111(4), 535–560. https://doi.org/https://doi.org/10.1086/659031
- Ames, A. J. (2013). Accuracy and precision of an effect size and its variance from a multilevel model for cluster randomized trials: A simulation study. Multivariate Behavioral Research, 48(4), 592–618. https://doi.org/https://doi.org/10.1080/00273171.2013.802978
- Apthorp, H., Randel, B., Cherasaro, T., Clark, T., McKeown, M., & Beck, I. (2012). Effects of a supplemental vocabulary program on word knowledge and passage comprehension. Journal of Research on Educational Effectiveness, 5(2), 160–188. https://doi.org/https://doi.org/10.1080/19345747.2012.660240
- Asparouhov, T., & Muthén, B. (2006, August). Multilevel modeling of complex survey data [Paper presentation]. Proceedings of the Joint Statistical Meeting in Seattle, 2718–2726.
- Asparouhov, T. (2005). Sampling weights in latent variable modeling. Structural Equation Modeling: A Multidisciplinary Journal, 12(3), 411–434. https://doi.org/https://doi.org/10.1207/s15328007sem1203_4
- Asparouhov, T., & Muthén, B. (2005). Multivariate statistical modeling with survey data. Proceedings of the Federal Committee on Statistical Methodology 2005 Research Conference, 1–30.
- Bell, B. A., Morgan, G. B., Kromrey, J. D., & Ferron, J. M. (2010, July-August). The impact of small cluster size on multilevel models: A Monte Carlo examination of two-level models with binary and continuous predictors [Paper presentation]. Paper Session Presented at the Meeting of the Joint Statistical Meetings, Vancouver, Canada.
- Beretvas, S. N. (2011). Cross-classified and multiple-membership models. In J. J. Hox & J. K. Roberts (Eds.), Handbook of advanced multilevel analysis (pp. 313–334). Routledge.
- Campbell, M. K., Mollison, J., Steen, N., Grimshaw, J. M., & Eccles, M. (2000). Analysis of cluster randomized trials in primary care: A practical approach. Family Practice, 17(2), 192–196. https://doi.org/https://doi.org/10.1093/fampra/17.2.192
- Chen, Q., Hughes, J. N., Liew, J., & Kwok, O. (2010). Joint contributions of peer acceptance and peer academic reputation to achievement in academically at-risk children: Mediating processes. Journal of Applied Developmental Psychology, 31(6), 287–448. https://doi.org/https://doi.org/10.1016/j.appdev.2010.09.001
- Chen, Q., Kwok, O., Luo, W., & Willson, V. L. (2010). The impact of ignoring a level of nesting structure in multilevel growth mixture models: A Monte Carlo study. Structural Equation Modeling: A Multidisciplinary Journal, 17(4), 570–589. https://doi.org/https://doi.org/10.1080/10705511.2010.510046
- Chung, H., & Beretvas, S. N. (2012). The impact of ignoring multiple membership data structures in multilevel models. The British Journal of Mathematical and Statistical Psychology, 65(2), 185–200. https://doi.org/https://doi.org/10.1111/j.2044-8317.2011.02023.x
- Clarke, P., & Wheaton, B. (2007). Addressing data sparseness in contextual population research: Using cluster analysis to create synthetic neighborhoods. Sociological Methods & Research, 35(3), 311–351. https://doi.org/https://doi.org/10.1177/0049124106292362
- Dedrick, R. F., Ferron, J. M., Hess, M. R., Hogarty, K. Y., Kromrey, J. D., Lang, T. R., Niles, J. D., & Lee, R. S. (2009). Multilevel modeling: A review of methodological issues and applications. Review of Educational Research, 79(1), 69–102. https://doi.org/https://doi.org/10.3102/0034654308325581
- Diperna, J. C., Lei, P., Bellinger, J., & Cheng, W. (2015). Efficacy of the Social Skills Improvement System Classwide Intervention Program (SSIS-CIP) primary version. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, 30(1), 123–141. https://doi.org/https://doi.org/10.1037/spq0000079
- Donner, A., & Klar, N. (2004). Pitfalls and controversies in cluster randomization trials. American Journal of Public Health, 94(3), 416–422. https://doi.org/https://doi.org/10.2105/AJPH.94.3.416
- Edwards, S. J. L., Braunholtz, D. A., Lilford, R. J., & Stevens, A. J. (1999). Ethical issues in the design and conduct of cluster randomised controlled trials. BMJ (Clinical Research ed.), 318(7195), 1407–1409. https://doi.org/https://doi.org/10.1136/bmj.318.7195.1407
- Glaman, R., & Chen, Q. (2018). Measurement invariance of a classroom engagement measure among academically at-risk students. Frontiers in Psychology, 8(2345), 2345–2349. https://doi.org/https://doi.org/10.3389/fpsyg.2017.02345
- Graves, S. L., & Frohwerk, A. (2009). Multilevel modeling and school psychology: A review and practical example. School Psychology Quarterly, 24(2), 84–94. https://doi.org/https://doi.org/10.1037/a0016160
- Hegedus, S. J., Dalton, S., & Tapper, J. R. (2015). The impact of technology-enhanced curriculum on learning advanced algebra in US high school classrooms. Educational Technology Research and Development, 63(2), 203–228. https://doi.org/https://doi.org/10.1007/s11423-015-9371-z
- Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2(3), 172–177. https://doi.org/https://doi.org/10.1111/j.1750-8606.2008.00061.x
- Hoogland, J. J., & Boomsma, A. (1998). Robustness studies in covariance structure modeling. Sociological Methods & Research, 26(3), 329–367. https://doi.org/https://doi.org/10.1177/0049124198026003003
- Hox, J. J., & Stoel, R. D. (2005). Multilevel and SEM approaches to growth curve modeling. In B. S. Everitt & D. C. Howell (Series Eds.), Encyclopedia of statistics in behavioral science (Vol. 3, pp. 1296–1305). John Wiley & Sons.
- Hox, J. J., Moerbeek, M., & van de Schoot, R. (2017). Multilevel analysis: Techniques and applications. (3rd ed.). Routledge.
- Hughes, J. N., Kwok, O., & Im, M. (2013). Effect of retention in first grade on parents’ educational expectations and children’s academic outcomes. American Educational Research Journal, 50(6), 1336–1359. https://doi.org/https://doi.org/10.3102/0002831213490784
- Jo, B., Asparouhov, T., Muthén, B. O., Ialongo, N. S., & Brown, C. H. (2008). Cluster randomized trials with treatment noncompliance. Psychological Methods, 13(1), 1–18. https://doi.org/https://doi.org/10.1037/1082-989X.13.1.1
- Kautz, T., Schochet, P. Z., Tilley, C. (2017). Comparing impact findings from design-based and model-based methods: An empirical investigation (NCEE 2017-4026). The National Center for Education Evaluation and Regional Assistance.
- Kiernan, K., Tao, J., & Gibbs, P. (2012, April). Tips and strategies for mixed modeling with SAS/STAT procedures [Paper presentation]. Paper Session Presented at the Meeting of the SAS Global Forum, Orlando, Florida.
- Kim, J. S., Olson, C. B., Scarcella, R., Kramer, J., Pearson, M., van Dyk, D., Collins, P., & Land, R. E. (2011). A randomized experiment of a cognitive strategies approach to text-based analytical writing for mainstreamed Latino English language learners in grades 6 to 12. Journal of Research on Educational Effectiveness, 4(3), 231–463. https://doi.org/https://doi.org/10.1080/19345747.2010.523513
- Lai, M. H. C., & Kwok, O. (2015). Examining the rule of thumb not using multilevel modeling: The “design effect smaller than two” rule. The Journal of Experimental Education, 83(3), 423–438. https://doi.org/https://doi.org/10.1080/00220973.2014.907229
- Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1(3), 86–92. https://doi.org/https://doi.org/10.1027/1614-1881.1.3.86
- McDonald, L., Moberg, D. P., Brown, R., Rodriguez-Espiricueta, I., Flores, N. I., Burke, M. P., & Coover, G. (2006). After-school multifamily groups: A randomized controlled trial involving low-income, urban, Latino children. Children & Schools, 28(1), 25–34. https://doi.org/https://doi.org/10.1093/cs/28.1.25
- Moerbeek, M. (2004). The consequence of ignoring a level of nesting in multilevel analysis. Multivariate Behavioral Research, 39(1), 129–149. https://doi.org/https://doi.org/10.1207/s15327906mbr3901_5
- Moineddin, R., Matheson, F. I., & Glazier, R. H. (2007). A simulation study of sample size for multilevel logistic regression models. BMC Medical Research Methodology, 7(34), 10–34. https://doi.org/https://doi.org/10.1186/1471-2288-7-34
- Muthén, B. (2004). Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. In D. Kaplan (Ed.), The SAGE handbook of quantitative methodology for the social sciences (pp. 345–368). Sage.
- Muthén, B. O., & Satorra, A. (1995). Complex sample data in structural equation modeling. Sociological Methodology, 25, 267–316. https://doi.org/https://doi.org/10.2307/271070
- Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (7th ed.). Muthén & Muthén.
- Pornprasertmanit, S., Lee, J., & Preacher, K. J. (2014). Ignoring clustering in confirmatory factor analysis: Some consequences for model fit and standardized parameter estimates. Multivariate Behavioral Research, 49(6), 518–543. https://doi.org/https://doi.org/10.1080/00273171.2014.933762
- Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Sage.
- Raudenbush, S. W., & Liu, X. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5(2), 199–213. https://doi.org/https://doi.org/10.1037/1100:82989X.5.2.199
- Raudenbush, S. W., & Xiao-Feng, L. (2001). Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychological Methods, 6(4), 387–401. https://doi.org/https://doi.org/10.1037//1082-989X.6.4.387
- Russell, M., O'Dwyer, L. M., & Miranda, H. (2009). Diagnosing students' misconceptions in algebra: Results from an experimental pilot study. Behavior Research Methods, 41(2), 414–424. https://doi.org/https://doi.org/10.3758/BRM.41.2.414
- Sarama, J., Clements, D. H., Wolfe, C. B., & Spitler, M. E. (2012). Longitudinal evaluation of a scale-up model for teaching mathematics with trajectories and technologies. Journal of Research on Educational Effectiveness, 5(2), 105–135. https://doi.org/https://doi.org/10.1080/19345747.2011.627980
- SAS Institute Inc. (2011). SAS/STAT 9.3 user’s guide. SAS Institute, Inc.
- Savage, R., Abrami, P. C., Piquette, N., Wood, E., Deleveaux, G., Sanghera-Sidhu, S., & Burgos, G. (2013). A (pan-Canadian) cluster randomized control effectiveness trial of the ABRACADABRA web-based literacy program. Journal of Educational Psychology, 105(2), 310–328. https://doi.org/https://doi.org/10.1037/a0031025
- Sim, J., & Dawson, A. (2012). Informed consent and cluster-randomized trials. American Journal of Public Health, 102(3), 480–485. https://doi.org/https://doi.org/10.2105/AJPH.2011.300389
- Spilt, J. L., Hughes, J. N., Wu, J., & Kwok, O. (2012). Dynamics of teacher-student relationships: Stability and change across elementary school and the influence on children's academic success. Child Development, 83(4), 1180–1195. https://doi.org/https://doi.org/10.1111/j.1467-8624.2012.01761.x
- Spybrook, J., Kelcey, B., & Dong, N. (2016). Power for detecting treatment by moderator effects in two-and three-level cluster randomized trials. Journal of Educational and Behavioral Statistics, 41(6), 605–627. https://doi.org/https://doi.org/10.3102/1076998616655442
- Van den Noortgate, W., Opdenakker, M., & Onghena, P. (2005). The effects of ignoring a level in multilevel analysis. School Effectiveness and School Improvement, 16(3), 281–303. https://doi.org/https://doi.org/10.1080/09243450500114850
- Wampold, B. E., & Serlin, R. C. (2000). The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychological Methods, 5(4), 425–433.
- Wu, J., & Kwok, O. (2012). Using SEM to analyze complex survey data: A comparison between design-based single-level and model-based multilevel approaches. Structural Equation Modeling, 19(1), 16–35. https://doi.org/https://doi.org/10.1080/10705511.2012.634703