Individual Participant Data Meta-Analysis Including Moderators: Empirical Validation

References

• Aydin, O., & Yassikaya, M. Y. (2022). Validity and reliability analysis of the plotdigitizer software program for data extraction from single-case graphs. Perspectives on Behavior Science, 45(1), 239–257. https://doi.org/10.1007/s40614-021-00284-0
   PubMed Web of Science ®Google Scholar
• Baek, E. K., & Ferron, J. M. (2013). Multilevel models for multiple-baseline data: Modeling across-participant variation in autocorrelation and residual variance. Behavior Research Methods, 45(1), 65–74. https://doi.org/10.3758/s13428-012-0231-z
   PubMed Web of Science ®Google Scholar
• Beretvas, S. N., & Chung, H. (2008). A review of meta-analyses of single-subject experimental designs: Methodological issues and practice. Evidence-Based Communication Assessment and Intervention, 2(3), 129–141. https://doi.org/10.1080/17489530802446302
   Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. John Wiley & Sons.
   Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2010). A basic introduction to fixed‐effect and random‐effects models for meta‐analysis. Research Synthesis Methods, 1(2), 97–111. https://doi.org/10.1002/jrsm.12
   PubMed Web of Science ®Google Scholar
• Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single case research. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis (pp. 197–198) Lawrence Erlbaum.
   Google Scholar
• Card, N. A. (2016). Applied meta-analysis for social science research .
   Google Scholar
• Cohen J. (1969). Statistical Power Analysis for the Behavioral Sciences. Academic Press, New York, 101–105.
   Google Scholar
• Coleman (2006). A simulation study of the piecewise hierarchical model approach to meta-analysis of single -subject data. ProQuest Dissertations Publishing.
   Google Scholar
• Cooper, H. (2017). Research synthesis and meta-analysis: A step-by-step approach. SAGE Publications, Inc. https://doi.org/10.4135/9781071878644
   Google Scholar
• Cooper, H., & Patall, E. A. (2009). The relative benefits of meta-analysis conducted with individual participant data versus aggregated data. Psychological Methods, 14(2), 165–176. https://doi.org/10.1037/a0015565
   PubMed Web of Science ®Google Scholar
• Declercq, L., Jamshidi, L., Fernández-Castilla, B., Beretvas, S., Moeyaert, M., Ferron, J., & Van den Noortgate, W. (2019). Analysis of single-case experimental count data using the linear mixed effects model: A simulation study. Behavior Research Methods, 51(6), 2477–2497. https://doi.org/10.3758/s13428-018-1091-y
   PubMed Web of Science ®Google Scholar
• Declercq, L., Jamshidi, L., Fernández-Castilla, B., Moeyaert, M., Beretvas, S., Ferron, J., & Van den Noortgate, W. (2022). Multilevel meta-analysis of individual participant data of single-case experimental designs: One-stage versus two-stage methods. Multivariate Behavioral Research, 57(2–3), 298–317. https://doi.org/10.1080/00273171.2020.1822148
   PubMed Web of Science ®Google Scholar
• Drevon, D., Fursa, S. R., & Malcolm, A. L. (2017). Intercoder reliability and validity of WebPlotDigitizer in extracting graphed data. Behavior Modification, 41(2), 323–339. https://doi.org/10.1177/0145445516673998
   PubMed Web of Science ®Google Scholar
• Farmer, J. L., Owens, C. M., Ferron, J. M., & Allsopp, D. H. (2010). A methodological review of single-case meta-analyses [Paper presentation]. American Educational Research Association.
   Google Scholar
• Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3–8. https://doi.org/10.3102/0013189X005010003
   Google Scholar
• Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Academic Press.
   Google Scholar
• Jamshidi, L., Declercq, L., Fernández-Castilla, B., Ferron, J., Moeyaert, M., Beretvas, S. N., & Van den Noortgate, W. (2021). Bias adjustment in multilevel meta-analysis of standardized single-case experimental data. The Journal of Experimental Education, 89(2), 344–361. https://doi.org/10.1080/00220973.2019.1658568
   Web of Science ®Google Scholar
• Jamshidi, L., Heyvaert, M., Declercq, L., Fernández-Castilla, B., Ferron, J. M., Moeyaert, M., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2022). A systematic review of single-case experimental design meta-analyses: Characteristics of study designs, data and analyses. Evidence-Based Communication Assessment and Intervention, 1–25. https://doi.org/10.1080/17489539.2022.2089334
   Google Scholar
• Joo, S. H., Ferron, J. M., Moeyaert, M., Beretvas, S. N., & Van den Noortgate, W. (2019). Approaches for specifying the level-1 error structure when synthesizing single-case data. The Journal of Experimental Education, 87(1), 55–74. https://doi.org/10.1080/00220973.2017.1409181
   Web of Science ®Google Scholar
• Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. SAGE Publications, Inc.
   Google Scholar
• Maggin, D. M., O'Keeffe, B. V., & Johnson, A. H. (2011). A quantitative synthesis of methodology in the meta-analysis of single-subject research for students with disabilities: 1985–2009. Exceptionality, 19(2), 109–135. https://doi.org/10.1080/09362835.2011.565725
   Web of Science ®Google Scholar
• Moeyaert, M. (2019). Quantitative synthesis of research evidence: Multilevel meta-analysis. Behavioral Disorders, 44(4), 241–256. https://doi.org/10.1177/0198742918806926
   Web of Science ®Google Scholar
• Moeyaert, M., & Fingerhut, J. (2022). Quantitative synthesis of personalized trials studies: Meta-analysis of aggregated data versus individual patient data. Harvard Data Science Review, (Special Issue 3). https://doi.org/10.1162/99608f92.3574f1dc
   PubMedGoogle Scholar
• Moeyaert, M., Maggin, D., & Verkuilen, J. (2016). Reliability, validity, and usability of data extraction programs for single-case research designs. Behavior Modification, 40(6), 874–900. https://doi.org/10.1177/0145445516645763
   PubMed Web of Science ®Google Scholar
• Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S., & Van den Noortgate, W. (2014). Three- level analysis of single-case experimental data: Empirical validation. The Journal of Experimental Education, 82(1), 1–21. https://doi.org/10.1080/00220973.2012.745470
   Web of Science ®Google Scholar
• Moeyaert, M., Ugille, M., Ferron, J., Beretvas, S., & Van den Noortgate, W. (2013). The three-level synthesis of standardized single-subject experimental data: A Monte Carlo simulation study. Multivariate Behavioral Research, 48(5), 719–748. https://doi.org/10.1080/00273171.2013.816621
   PubMed Web of Science ®Google Scholar
• Moeyaert, M., Ugille, M., Ferron, J. M., Beretvas, S. N., & Van den Noortgate, W. (2014). The influence of the design matrix on treatment effect estimates in the quantitative analyses of single-subject experimental design research. Behavior Modification, 38(5), 665–704. https://doi.org/10.1177/0145445514535243
   PubMed Web of Science ®Google Scholar
• Moeyaert, M., Yang, P., & Xu, X. (2022). The power to explain variability in intervention effectiveness in single-case research using hierarchical linear modeling. Perspectives on Behavior Science, 45(1), 13–35. https://doi.org/10.1007/s40614-021-00304-z
   PubMed Web of Science ®Google Scholar
• Moeyaert, M., Yang, P., Xu, X., & Kim, E. (2021). Characteristics of moderators in meta-analyses of single-case experimental design studies. Behavior Modification, 014544552110021. https://doi.org/10.1177/01454455211002111
   Google Scholar
• Parker, R. I., Vannest, K. J., & Davis, J. L. (2011). Effect size in single-case research: A review of nine nonoverlap techniques. Behavior Modification, 35(4), 303–322. https://doi.org/10.1177/0145445511399147
   PubMed Web of Science ®Google Scholar
• SAS Institute Inc (2013). SAS/ACCESS® 9.4 Interface to ADABAS: Reference. SAS Institute Inc.
   Google Scholar
• Schlosser, R. W., Lee, D. L., & Wendt, O. (2008). Application of the percentage of non-overlapping data (PND) in systematic reviews and meta-analyses: A systematic review of reporting characteristics. Evidence-Based Communication Assessment and Intervention, 2(3), 163–187. https://doi.org/10.1080/17489530802505412
   Google Scholar
• Shadish, W. R., & Sullivan, K. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43(4), 971–980. https://doi.org/10.3758/s13428-011-0111-y
   PubMed Web of Science ®Google Scholar
• Shadish, W. R., Rindskopf, D. M., Hedges, L. V., & Sullivan, K. J. (2013). Bayesian estimates of autocorrelations in single-case designs. Behavior Research Methods, 45(3), 813–821. https://doi.org/10.3758/s13428-012-0282-1
   PubMed Web of Science ®Google Scholar
• Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A., & Song, F. (2000). Methods for meta-analysis in medical research. John Wiley.
   Google Scholar
• Valentine, J. C., Tanner‐Smith, E. E., Pustejovsky, J. E., & Lau, T. S. (2016). Between-case standardized mean difference effect sizes for single-case designs: A primer and tutorial using the scdhlm web application. Campbell Systematic Reviews, 12(1), 1–31. https://doi.org/10.4073/cmdp.2016.1
   Google Scholar
• Ugille, M., Moeyaert, M., Beretvas, S. N., Ferron, J., & Van den Noortgate, W. (2012). Multilevel meta-analysis of single-subject experimental designs: A simulation study. Behavior Research Methods, 44(4), 1244–1254. https://doi.org/10.3758/s13428-012-0213-1
   PubMed Web of Science ®Google Scholar
• Ugille, M., Moeyaert, M., Beretvas, S., Ferron, J., & Van Den Noortgate, W. (2014). Bias corrections for standardized effect size estimates used with single-subject experimental designs. The Journal of Experimental Education, 82(3), 358–374. https://doi.org/10.1080/00220973.2013.813366
   Web of Science ®Google Scholar
• Van den Noortgate, W., & Onghena, P. (2003a). Combining single-case experimental studies using hierarchical linear models. School Psychology Quarterly, 18(3), 325–346. https://doi.org/10.1521/scpq.18.3.325.22577
   Web of Science ®Google Scholar
• Van Den Noortgate, W., & Onghena, P. (2003b). Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments, & Computers : a Journal of the Psychonomic Society, Inc, 35(1), 1–10. https://doi.org/10.3758/BF03195492
   PubMedGoogle Scholar
• Van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence-Based Communication Assessment and Intervention, 2(3), 142–151. https://doi.org/10.1080/17489530802505362
   Google Scholar
• What Works Clearinghouse. (2022). What works clearinghouse standards handbook (Version 5.0). U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee/wwc/handbooks
   Google Scholar