Statistical power in partially nested designs probing multilevel mediation

References

• Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families.
   Google Scholar
• Aguinis, H., Edwards, J. R., & Bradley, K. J. (2017). Improving our understanding of moderation and mediation in strategic management research. Organizational Research Methods, 20(4), 665–685.
   Web of Science ®Google Scholar
• Apsche, J. A., Bass, C. K., & Backlund, B. (2012). Mediation analysis of Mode Deactivation Therapy, (MDT). The Behavior Analyst Today, 13(2), 2–10.
   Google Scholar
• Baldwin, S. A., Murray, D. M., Shadish, W. R., Pals, S. L., Holland, J. M., Abramowitz, J. S., … Watson, J. (2011). Intraclass correlation associated with therapists: Estimates and applications in planning psychotherapy research. Cognitive Behaviour Therapy, 40(1), 15–33.
   PubMedGoogle Scholar
• Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008). Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research, 43(2), 210–236.
   PubMed Web of Science ®Google Scholar
• Beasley, T. M. (2014). Tests of mediation: Paradoxical decline in statistical power as a function of mediator collinearity. The Journal of Experimental Education, 82(3), 283–306.
   PubMed Web of Science ®Google Scholar
• Burke, J. D., & Loeber, R. (2015). The effectiveness of the stop now and Plan (SNAP) Program for boys at risk for violence and delinquency. Prevention Science, 16(2), 242–253.
   PubMed Web of Science ®Google Scholar
• Burke, J. D., & Loeber, R. (2016). Mechanisms of behavioral and affective treatment outcomes in a cognitive behavioral intervention for boys. Journal of Abnormal Child Psychology, 44(1), 179–189.
   PubMed Web of Science ®Google Scholar
• Candlish, J., Teare, M. D., Cohen, J., & Bywater, T. (2019). Statistical design and analysis in trials of proportionate interventions: A systematic review. Trials, 20(1), 151.
   PubMedGoogle Scholar
• Christensen, K. S., Haugen, W., Sirpal, M. K., & Haavet, O. R. (2015). Diagnosis of depressed young people—criterion validity of WHO-5 and HSCL-6 in Denmark and Norway. Family Practice, 32(3), 359–363. doi:10.1093/fampra/cmv011
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Cox, K., & Kelcey, B. (2019). Optimal sample allocation in group-randomized mediation studies with a group-level mediator. The Journal of Experimental Education, 87(4), 616–640.
   Web of Science ®Google Scholar
• David, O. A., David, D., & Dobrean, A. (2014). Efficacy of the rational positive parenting program for child externalizing behavior: Can an emotion-regulation enhanced cognitive-behavioral parent program be more effective than a standard one? Journal of Evidence-Based Psychotherapies, 14(2), 159.
   Web of Science ®Google Scholar
• Derella, O. J., Johnston, O. G., Loeber, R., & Burke, J. D. (2019). CBT-enhanced emotion regulation as a mechanism of improvement for childhood irritability. Journal of Clinical Child & Adolescent Psychology, 48(Suppl. 1), S146–S154.
   PubMedGoogle Scholar
• Dong, N., Reinke, W. M., Herman, K. C., Bradshaw, C. P., & Murray, D. W. (2016). Meaningful effect sizes, intraclass correlations, and proportions of variance explained by covariates for planning two-and three-level cluster randomized trials of social and behavioral outcomes. Evaluation Review, 40(4), 334–377.
   PubMed Web of Science ®Google Scholar
• Dunsmore, J. C., Booker, J. A., & Ollendick, T. H. (2013). Parental emotion coaching and child emotion regulation as protective factors for children with oppositional defiant disorder. Social Development, 22(3), 444–466.
   Web of Science ®Google Scholar
• Eden, D. (2017). Field experiments in organizations. Annual Review of Organizational Psychology and Organizational Behavior, 4, 91–122.
   Google Scholar
• Eden, D., Stone-Romero, E. F., & Rothstein, H. R. (2015). Synthesizing results of multiple randomized experiments to establish causality in mediation testing. Human Resource Management Review, 25(4), 342–351.
   Web of Science ®Google Scholar
• Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12(2), 121–138.
   PubMed Web of Science ®Google Scholar
• Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18(3), 233–239.
   PubMed Web of Science ®Google Scholar
• Gelfand, L. A., Mensinger, J. L., & Tenhave, T. (2009). Mediation analysis: A retrospective snapshot of practice and more recent directions. The Journal of General Psychology, 136(2), 153–178.
   PubMed Web of Science ®Google Scholar
• Gottfredson, D. C., Cook, T. D., Gardner, F. E., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16(7), 893–926.
   PubMed Web of Science ®Google Scholar
• Hayes, A. F., & Scharkow, M. (2013). The relative trustworthiness of inferential tests of the indirect effect in statistical mediation analysis: Does method really matter? Psychological Science, 24(10), 1918–1927.
   PubMed Web of Science ®Google Scholar
• Hinshaw, S. P. (2007). Moderators and mediators of treatment outcome for youth with ADHD: Understanding for whom and how interventions work. Journal of Pediatric Psychology, 32(6), 664–675.
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2006). Arbitrary metrics: Implications for identifying evidence-based treatments. American Psychologist, 61(1), 42–49.
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1–27.
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2010). Problem-solving skills training and parent management training for opposition a defiant disorder and conduct disorder. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 211–226). New York: The Guilford Press.
   Google Scholar
• Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44(8), 1116–1129.
   PubMed Web of Science ®Google Scholar
• Kelcey, B., Dong, N., Spybrook, J., & Cox, K. (2017). Statistical power for causally-defined indirect effects in group-randomized trials with individual-level mediators. Journal of Educational and Behavioral Statistics, 42(5), 499–530.
   Web of Science ®Google Scholar
• Kelcey, B., Dong, N., Spybrook, J., & Shen, Z. (2017). Experimental power for indirect effects in group-randomized studies with group-level mediators. Multivariate Behavioral Research, 52(6), 699–719.
   PubMed Web of Science ®Google Scholar
• Kelcey, B., Hill, H., & Chin, M. (2019). Teacher mathematical knowledge, instructional quality, and student outcomes: A multilevel mediation analysis. School Effectiveness & School Improvement, 30(4), 398–431.
   Web of Science ®Google Scholar
• Kelcey, B., & Phelps, G. (2013a). Considerations for designing group randomized trials of professional development with teacher knowledge outcomes. Educational Evaluation and Policy Analysis, 35(3), 370–390.
   Web of Science ®Google Scholar
• Kelcey, B., & Phelps, G. (2013b). Strategies for improving power in school-randomized studies of professional development. Evaluation Review, 37(6), 520–554.
   PubMed Web of Science ®Google Scholar
• Kelcey, B., & Shen, Z. (2016). Multilevel design of school effectiveness studies in sub-Saharan Africa. School Effectiveness and School Improvement, 27(4), 492–510.
   Web of Science ®Google Scholar
• Kelcey, B., Spybrook, J., & Dong, N. (2019). Sample size planning in cluster-randomized studies of multilevel mediation. Prevention Science, 20, 407–418.
   PubMed Web of Science ®Google Scholar
• Kisbu-Sakarya, Y., MacKinnon, D. P., & Miočević, M. (2014). The distribution of the product explains normal theory mediation confidence interval estimation. Multivariate Behavioral Research, 49(3), 261–268.
   PubMed Web of Science ®Google Scholar
• Lachowicz, M. J., Sterba, S. K., & Preacher, K. J. (2015). Investigating multilevel mediation with fully or partially nested data. Group Processes & Intergroup Relations, 18(3), 274–289.
   Web of Science ®Google Scholar
• Lindsey, M., Brandt, N., Becker, K., Lee, B., Barth, R., Daleiden, E., & Chorpita, B. (2014). Identifying the common elements of treatment engagement interventions in children’s mental health services. Clinical Child and Family Psychology Review, 17(3), 283–298.
   PubMed Web of Science ®Google Scholar
• Liu, J. C., Chang, L. Y., Wu, S. Y., & Tsai, P. S. (2015). Resilience mediates the relationship between depression and psychological health status in patients with heart failure: A cross-sectional study. International Journal of Nursing Studies, 52(12), 1846–1853. doi:10.1016/j.ijnurstu.2015.07.005
   PubMed Web of Science ®Google Scholar
• Lochman, J. E., Evans, S. C., Burke, J. D., Roberts, M. C., Fite, P. J., Reed, G. M., … Elena Garralda, M. (2015). An empirically based alternative to DSM-5’s disruptive mood dysregulation disorder for ICD-11. World Psychiatry, 14(1), 30–33.
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104.
   PubMed Web of Science ®Google Scholar
• Moss, B., Kelcey, B., & Showers, N. (2014). Classrooms as moderators of development education effectiveness and student achievement. Community College Review, 42, 201–220.
   Google Scholar
• Nohe, C., Michaelis, B., Menges, J. I., Zhang, Z., & Sonntag, K. (2013). Charisma and organizational change: A multilevel study of perceived charisma, commitment to change, and team performance. The Leadership Quarterly, 24(2), 378–389.
   Web of Science ®Google Scholar
• Phelps, G., Kelcey, B., Liu, S., & Jones, N. (2016). Informing estimates of program effects for studies of mathematics professional development using teacher content knowledge outcomes. Evaluation Review, 40, 383–409.
   Web of Science ®Google Scholar
• Pituch, K. A., & Stapleton, L. M. (2012). Distinguishing between cross- and cluster-level mediation processes in the cluster randomized trial. Sociological Methods & Research, 41, 630–670.
   Web of Science ®Google Scholar
• Preacher, K. J., & Selig, J. P. (2012). Advantages of Monte Carlo confidence intervals for indirect effects. Communication Methods and Measures, 6(2), 77–98.
   Google Scholar
• Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2(2), 173.
   Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (Vol. 1). New York: Sage.
   Google Scholar
• Raudenbush, S. W., Martinez, A., & Spybrook, J. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29, 5–29.
   Web of Science ®Google Scholar
• Roberts, C., & Roberts, S. (2005). Design and analysis of clinical trials with clustering effects due to treatment. Clinical Trials, 2(2), 152–162.
   PubMed Web of Science ®Google Scholar
• Scott, K. (2018). Identifying the mechanisms of change and in-session therapist fidelity in measurement based care for depression (Unpublished Doctoral Dissetation). Retrieved from http://hdl.handle.net/2022/22500
   Google Scholar
• Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22(1), 49–59.
   PubMed Web of Science ®Google Scholar
• Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13, 290–312.
   Google Scholar
• Spybrook, J., Kelcey, B., & Dong, N. (2016). Power analyses for detecting treatment by moderator effects in cluster randomized trials. Journal of Educational and Behavioral Statistics, 41, 605–627.
   Web of Science ®Google Scholar
• Sterba, S. K. (2017). Partially nested designs in psychotherapy trials: A review of modeling developments. Psychotherapy Research, 27(4), 425–436.
   PubMed Web of Science ®Google Scholar
• Suldo, S. M., Parker, J. S., Shaunessy-Dedrick, E., & O’Brennan, L. M. (2019). Mental health interventions. In Jennifer A. Fredricks, Amy L. Reschly, & Sandra L. Christenson (Eds.), Handbook of student engagement interventions (pp. 199–215). San Diego: Academic Press.
   Google Scholar
• VanderWeele, T. J. (2010). Direct and indirect effects for neighborhood-based clustered and longitudinal data. Sociological Methods & Research, 38, 515–544.
   PubMed Web of Science ®Google Scholar
• Windgassen, S., Goldsmith, K., Moss-Morris, R., & Chalder, T. (2016). Establishing how psychological therapies work: The importance of mediation analysis.
   Google Scholar