Intention-to-treat analysis in partially nested randomized controlled trials with real-world complexity

References

• Angrist, J. D., G. W. Imbens, and D. B. Rubin. 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association 91 (434): 444–455. doi: 10.1080/01621459.1996.10476902
   Web of Science ®Google Scholar
• Baldwin, S. A., D. J. Bauer, E. Stice, and P. S. Rohde. 2011. “Evaluating Models for Partially Clustered Designs.” Psychological Methods 16 (2): 149–165. doi: 10.1037/a0023464
   PubMed Web of Science ®Google Scholar
• Bates, D., M. Maechler, B. Bolker, and S. Walker. 2014. “_lme4: Linear Mixed-effects Models Using Eigen and S4_.” R package version 1.1-7. http://CRAN.R-project.org/package=lme4.
   Google Scholar
• Bauer, D. J., S. K. Sterba, and D. D. Hallfors. 2008. “Evaluating Group-based Interventions When Control Participants Are Ungrouped.” Multivariate Behavioral Research 43 (2): 210–236. doi: 10.1080/00273170802034810
   PubMed Web of Science ®Google Scholar
• Biesta, G. 2007. “Why ‘What Works’ Won’t Work: Evidence-based Practice and the Democratic Deficit in Educational Research.” Educational Theory 57 (1): 1–22. doi: 10.1111/j.1741-5446.2006.00241.x
   Google Scholar
• Bloom, H. S., L. Richburg-Hayes, and A. R. Black. 2007. “Using Covariates to Improve Precision for Studies That Randomize Schools to Evaluate Educational Interventions.” Educational Evaluation and Policy Analysis 29 (1): 30–59. doi: 10.3102/0162373707299550
   Web of Science ®Google Scholar
• Borman, G. D. 2002. “Experiments for Educational Evaluation and Improvement.” Peabody Journal of Education 77 (4): 7–27. doi: 10.1207/S15327930PJE7704_2
   Google Scholar
• Borman, G. D., J. Benson, and L. T. Overman. 2005. “Families, Schools, and Summer Learning.” The Elementary School Journal 106 (2): 131–150. doi: 10.1086/499195
   Web of Science ®Google Scholar
• Borman, G. D., M. E. Goetz, and N. M. Dowling. 2009. “Halting the Summer Achievement Slide: A Randomized Field Trial of the KindergARTen Summer Camp.” Journal of Education for Students Placed at Risk 14 (2): 133–147. doi: 10.1080/10824660802427652
   Google Scholar
• Chaplin, D., and J. Capizzano. 2006. Impacts of a Summer Learning Program: A Random Assignment Study of Building Education Leaders for Life (BELL). Washington, DC: The Urban Institute.
   Google Scholar
• Coalition for Evidence-based Policy. 2003. Identifying and Implementing Educational Practices Supported by Rigorous Evidence: A User Friendly Guide. Washington, DC: U.S. Department of Education.
   Google Scholar
• Cooper, H., B. Nye, K. Charlton, J. Lindsay, and S. Greathouse. 1996. “The Effects of Summer Vacation on Achievement Test Scores: A Narrative and Meta-analytic Review.” Review of Educational Research 66 (3): 227–268. doi: 10.3102/00346543066003227
   Web of Science ®Google Scholar
• Cramér, H. 1946. Mathematical Methods of Statistics. Princeton, NJ: Princeton University Press.
   Google Scholar
• Goldstein, H. 2011. Multilevel Statistical Models. 4th ed. Chichester: Wiley.
   Google Scholar
• Hernández, A. V., E. W. Steyerberg, and J. D. F. Habbema. 2004. “Covariate Adjustment in Randomized Controlled Trials with Dichotomous Outcomes Increases Statistical Power and Reduces Sample Size Requirements.” Journal of Clinical Epidemiology 57 (5): 454–460. doi: 10.1016/j.jclinepi.2003.09.014
   PubMed Web of Science ®Google Scholar
• Huber, P. J. 1967. “The Behavior of Maximum Likelihood Estimates under Nonstandard Conditions.” Proceedings of the Fifth Berkeley Symposium on mathematical statistics and probability, 221–223. Berkeley, CA: University of California Press, Vol. 1.
   Google Scholar
• Imbens, G. W. 2011. Experimental Design for Unit and Cluster Randomized Trials. Working Paper, Harvard University.
   Google Scholar
• Imbens, G. W., and J. Angrist. 1994. “Identification and Estimation of Local Average Treatment Effects.” Econometrica 62: 467–476. doi: 10.2307/2951620
   Web of Science ®Google Scholar
• Jo, B. 2002. “Model Misspecification Sensitivity Analysis in Estimating Causal Effects of Interventions with Non-compliance.” Statistics in Medicine 21 (21): 3161–3181. doi: 10.1002/sim.1267
   PubMed Web of Science ®Google Scholar
• Jo, B., T. Asparouhov, and B. O. Muthén. 2008. “Intention-to-treat Analysis in Cluster Randomized Trials with Noncompliance.” Statistics in Medicine 27 (27): 5565–5577. doi: 10.1002/sim.3370
   PubMed Web of Science ®Google Scholar
• Jo, B., T. Asparouhov, B. O. Muthén, N. S. Ialongo, and C. H. Brown. 2008. “Cluster Randomized Trials with Treatment Noncompliance.” Psychological Methods 13 (1): 1–18. doi: 10.1037/1082-989X.13.1.1
   PubMed Web of Science ®Google Scholar
• Kirschner, F., F. Paas, P. A. Kirschner, and J. Janssen. 2011. “Differential Effects of Problem-Solving Demands on Individual and Collaborative Learning Outcomes.” Learning and Instruction 21 (4): 587–599. doi: 10.1016/j.learninstruc.2011.01.001
   Web of Science ®Google Scholar
• Kreft, I. 1996. “Are Multilevel Techniques Necessary? An Overview, Including Simulation Studies.” Unpublished manuscript, California State University, Los Angeles.
   Google Scholar
• Leckie, G., R. French, C. Charlton, and W. Browne. 2014. “Modeling Heterogeneous Variance–Covariance Components in Two-level Models.” Journal of Educational and Behavioral Statistics 39 (5): 307–332. doi: 10.3102/1076998614546494
   Web of Science ®Google Scholar
• Lee, K. J., and S. G. Thompson. 2005. “Clustering by Health Professional in Individually Randomised Trials.” BMJ: British Medical Journal 330 (7483): 142–144. doi: 10.1136/bmj.330.7483.142
   Web of Science ®Google Scholar
• Lockwood, J. R., H. Doran, and D. F. McCaffrey. 2003. “Using R for Estimating Longitudinal Student Achievement Models.” R News 3 (3): 17–23.
   Google Scholar
• Lohr, S., P. Z. Schochet, and E. Sanders. 2014. Partially Nested Randomized Controlled Trials in Education Research: A Guide to Design and Analysis. NCER 2014-2000. Washington, DC: National Center for Education Research.
   Google Scholar
• McCombs, J. S., J. F. Pane, C. H. Augustine, H. L. Schwartz, P. Martorell, and L. Zakaras. 2014. Ready for Fall? Near-Term Effects of Voluntary Summer Learning Programs on Low-Income Students’ Learning Opportunities and Outcomes. Santa Monica, CA: Rand Corporation.
   Google Scholar
• Mosteller, F., and R. F. Boruch, eds. 2002. Evidence Matters: Randomized Trials in Education Research. Washington, DC: Brookings Institution Press.
   Google Scholar
• Pinheiro, J. C., and D. M. Bates. 2000. Mixed-Effects Models in S and S-PLUS. Statistics and Computing. Berlin: Springer-Verlag.
   Google Scholar
• Pinheiro, J., D. Bates, S. DebRoy, and D. Sarkar. 2014. R Core Team. (2014). nlme: Linear and Nonlinear Mixed Effects Models. R package version 3.1–117. http://cran.r-project.org/web/packages/nlme/index.html.
   Google Scholar
• Price, M., and P. L. Anderson. 2011. “The Impact of Cognitive Behavioral Therapy on Post Event Processing among Those with Social Anxiety Disorder.” Behaviour Research and Therapy 49 (2): 132–137. doi: 10.1016/j.brat.2010.11.006
   PubMed Web of Science ®Google Scholar
• R Development Core Team. 2008. R: A Language and Environment for Statistical Computing. Retrieved from Vienna, Austria. http://www.R-project.org
   Google Scholar
• Raudenbush, S. W., and A. S. Bryk. 2002. Hierarchical Linear Models: Applications and Data Analysis Methods. Vol. 1. Thousand Oaks, CA: Sage.
   Google Scholar
• Roberts, C., and S. A. Roberts. 2005. “Design and Analysis of Clinical Trials with Clustering Effects Due to Treatment.” Clinical Trials 2 (2): 152–162. doi: 10.1191/1740774505cn076oa
   PubMed Web of Science ®Google Scholar
• Sanders, E. A. 2011. “Multilevel Analysis Methods for Partially Nested Cluster Randomized Trials.” Unpublished doctoral dissertation.
   Google Scholar
• Slavin, R. E. 2002. “Evidence-Based Education Policies: Transforming Educational Practice and Research.” Educational Researcher 31 (7): 15–21. doi: 10.3102/0013189X031007015
   Google Scholar
• Shadish, W. R., T. D. Cook, and D. Campbell 2002. Experimen- tal and Quasi-experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin.
   Google Scholar
• Slavin, R. E. 2008. “Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations.” Educational Researcher 37 (1): 5–14. doi: 10.3102/0013189X08314117
   Web of Science ®Google Scholar
• Snijders, T., and R. Bosker. 2012. Multilevel Analysis: An Introduction to Basic and Multilevel Analysis. 2nd ed. London: Sage.
   Google Scholar
• Sterba, S. K., K. J. Preacher, R. Forehand, E. J. Hardcastle, D. A. Cole, and B. E. Compas. 2014. “Structural Equation Modeling Approaches for Analyzing Partially Nested Data.” Multivariate Behavioral Research 49 (2): 93–118. doi: 10.1080/00273171.2014.882253
   PubMed Web of Science ®Google Scholar
• Tessler, J. M. 2014. “Three-level Models for Partially Nested Data Structures.” Unpublished doctoral dissertation.
   Google Scholar
• Towne, L., and R. J. Shavelson, eds. 2002. Scientific Research in Education. Washington, DC: National Academies Press.
   Google Scholar
• Vadasy, P. F., and E. A. Sanders. 2008. “Benefits of Repeated Reading Intervention for Low-Achieving Fourth-and Fifth-grade Students.” Remedial and Special Education 29: 235–249.
   Web of Science ®Google Scholar
• Weiss, M. J., J. R. Lockwood, and D. F. McCaffrey. 2014. “Estimating the Standard Error of the Impact Estimator in Individually Randomized Trials with Clustering.” MDRC Working Papers on Research Methodology. MDRC.
   Google Scholar
• What Works Clearinghouse. 2014. Procedures and Standards Handbook (Version 3.0). Washington, DC: Institute of Education Sciences.
   Google Scholar
• White, H. 1980. “A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity.” Econometrica 48: 817–830. doi: 10.2307/1912934
   Web of Science ®Google Scholar