Bayesian Analysis for Multiple-baseline Studies Where the Variance Differs across Cases in OpenBUGS

References

• Gast DL, Ledford JR. Single case research methodology: applications in special education and behavioral sciences. In: Gast DL, Ledford JR, editors. Research approaches in applied settings. New York (NY): Routledge. 2018. p.1–26
   Google Scholar
• Kazdin AE. Single-case research designs: methods for clinical and applied settings. 2nd ed. New York, NY: Oxford University Press; 2011.
   Google Scholar
• Kennedy CH. Single-case designs for educational research. Boston (MA): Allyn & Bacon; 2005.
   Google Scholar
• Horner RH, Odom SL. Constructing single case research designs: logic and options. In: Kratochwill TR, Levin JR, editors. Single-case intervention research: methodological and statistical advances. Washington (DC): American Psychological Association. 2014. p.27–51
   Google Scholar
• Kratochwill TR, Hitchcock J, Horner RH, Levin JR, Odom SL, Rindskopf DM, Shadish WR (2010). Single-case designs technical documentation. What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
   Google Scholar
• Shadish WR, Sullivan KJ. Characteristics of single-case designs used to assess intervention effects in 2008. Behav Res Methods. 2011;43(4):971–80. doi:10.3758/s13428-011-0111-y.
   PubMed Web of Science ®Google Scholar
• Barlow DH, Nock MK, Hersen M. Single case experimental designs: strategies for studying behavior change. 3rd ed. Boston (MA): Pearson; 2009.
   Google Scholar
• Beretvas SN, Chung H. A review of meta-analyses of single-subject experimental designs: methodological issues and practice. Evid Based Commun Assess Interv. 2008;2(3):129–41. doi:10.1080/17489530802446302.
   Google Scholar
• Shadish WR. Analysis and meta-analysis of single case designs: an introduction. J Sch Psychol. 2014;52(2):109–22. doi:10.1016/j.jsp.2013.11.009.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Rindskopf DM. Methods for evidence-based practice: quantitative synthesis of single subject designs. New Dir Eval. 2007;113(113):95–109. doi:10.1002/ev.217.
   Google Scholar
• Smith JD. Single-case experimental designs: a systematic review of published research and current standards. Psychol Methods. 2012;17(4):510–50. doi:10.1037/a0029312.
   PubMed Web of Science ®Google Scholar
• Morgan DL, Morgan RK. Single-participant research design: bringing science to managed care. Am Psychol. 2001;56(2):119–27. doi:10.1037/0003-066X.56.2.119.
   PubMed Web of Science ®Google Scholar
• Lane JD, Gast DL. Visual analysis in single case experimental design studies: brief review and guidelines. Neuropsychol Rehabil. 2014;24(3–4):445–63. doi:10.1080/09602011.2013.815636.
   PubMed Web of Science ®Google Scholar
• Baek E, Moeyaert M, Petit-Bois M, Beretvas SN, Van den Noortgate W, Ferron JM. The use of multilevel analysis for integrating single-case experimental design results within a study and across studies. Neuropsychol Rehabil. 2014;24(3–4):590–606. doi:10.1080/09602011.2013.835740.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Kyse EN, Rindskopf D. Analyzing data from single-case designs using multilevel models: new applications and some agenda items for future research. Psychol Methods. 2013;18(3):385–405. doi:10.1037/a0032964.
   PubMed Web of Science ®Google Scholar
• Van den Noortgate W, Onghena P. Combining single-case experimental data using hierarchical linear models. Sch Psychol Q. 2003a;18(3):325–46. doi:10.1521/scpq.18.3.325.22577.
   Web of Science ®Google Scholar
• Van den Noortgate W, Onghena P. Hierarchical linear models for the quantitative integration of effects sizes in single-case research. Behav Res Methods Instrum Comput. 2003b;35(1):1–10. doi:10.3758/BF03195492.
   PubMedGoogle Scholar
• Bronsnan J, Moeyaert M, Bewsome KB, Healy O, Heyvaert M, Onghena P, Van den Noortgate W. Multilevel analysis of multiple-baseline data evaluating precision teaching as an intervention of improving fluency in foundational reading skills for at risk readers. Exceptionality. 2018;26:137-161.
   Web of Science ®Google Scholar
• Gage NA, Lewis TJ, Stichter JP. Functional behavioral assessment-based interventions for students with or at risk for emotional and/or behavioral disorders in school: a hierarchical linear modeling meta-analysis. Behav Disord. 2012;37(2):55–77. doi:10.1177/019874291203700201.
   Web of Science ®Google Scholar
• Saddler B, Asaro-Saddler K, Moeyaert M, Ellis-Robison T. Effects of a summarizing strategy on written summaries of children with emotional and behavioral disorders. Remedial Spec Educ. 2017;38(2):87–97. doi:10.1177/0741932516669051.
   Web of Science ®Google Scholar
• Maggin D, O’Keeffe B, Johnson A. A quantitative synthesis of methodology in the meta-analysis of single-subject research for students with disabilities: 1985-2009. Exceptionality. 2011;19(2):109–35. doi:10.1080/09362835.2011.565725.
   Web of Science ®Google Scholar
• Goldstein H. Multilevel statistical models. 2nd ed. New York, NY: Wiley; 1995.
   Google Scholar
• Moerbeek M, van Breukelen GJP, Berger MPF. Design issues for experiments in multilevel populations. J Edu Behav Stat. 2000;25:271–84.
   Web of Science ®Google Scholar
• Raudenbush SW, Bryk AS. Hierarchical linear models: applications and data analysis methods. Thousand Oaks (CA): Sage; 2002.
   Google Scholar
• Wampold BE, Serlin RC. The consequence of ignoring a nested factor on measures of effect size in analysis of variance. Psychol Methods. 2000;5(4):425–33. doi:10.1037/1082-989X.5.4.425.
   PubMed Web of Science ®Google Scholar
• Baek E, Ferron JM. Multilevel models for multiple-baseline data: modeling across participant variation in autocorrelation and residual variance. Behav Res Method. 2013;45(1):65–74. doi:10.3758/s13428-012-0231-z.
   PubMed Web of Science ®Google Scholar
• Declercq L, Jamshidi L, Fernandez-Castilla B, Beretvas SN, Moeyaert M, Ferron JM, Van den Noortgate W. Analysis of single-case experimental count data using the linear mixed effects model: a simulation study. Behav Res Methods. 2018;51(6):2477–97. doi:10.3758/s13428-018-1091-y.
   Web of Science ®Google Scholar
• Joo S-H, Ferron JM. Application of the within- and between-series estimators to non-normal multiple-baseline data: maximum likelihood and Bayesian approaches. Multivariate Behav Res. 2019;54(5):666–89. doi:10.1080/00273171.2018.1564877.
   PubMed Web of Science ®Google Scholar
• Petit-Bois M, Baek E, Van den Noortgate W, Beretvas SN, Ferron JM. The consequences of modeling autocorrelation when synthesizing single-case studies using a three level model. Behav Res Method. 2016;48(2):803–12. doi:10.3758/s13428-015-0612-1.
   PubMed Web of Science ®Google Scholar
• Ferron JM, Bell BA, Hess MR, Rendina-Gobioff G, Hibbard ST. Making treatment effect inferences from multiple-baseline data: the utility of multilevel modeling approaches. Behav Res Methods. 2009;41(2):372–84. doi:10.3758/BRM.41.2.372.
   PubMed Web of Science ®Google Scholar
• Owens CM, Ferron JM. Synthesizing single-case studies: a Monte Carlo examination of a three-level meta-analytic model. Behav Res Methods. 2012;44(3):795–805. doi:10.3758/s13428-011-0180-y.
   PubMed Web of Science ®Google Scholar
• Ugille M, Moeyaert M, Beretvas T, Ferron J, Van den Noortgate W. Multilevel meta-analysis of single-subject experimental designs: a simulation study. Behav Res Methods. 2012;44(4):1244–54. doi:10.3758/s13428-012-0213-1.
   PubMed Web of Science ®Google Scholar
• Huitema BE, McKean JW. Design specification issues in time-series intervention models. Educ Psychol Meas. 2000;60(1):38–58. doi:10.1177/00131640021970358.
   Web of Science ®Google Scholar
• Goldstein H, Healy M, Rasbash J. Multilevel time series models with applications to repeated measures data. Stat Med. 1994;13(16):1643–55. doi:10.1002/sim.4780131605.
   PubMed Web of Science ®Google Scholar
• Heitjan DF, Sharma D. Modeling repeated-series longitudinal data. Stat Med. 1997;16(4):347–55. doi:10.1002/(SICI)1097-0258(19970228)16:4<347::AID-SIM423>3.0.CO;2-W.
   PubMed Web of Science ®Google Scholar
• Jennrich RI, Schluchter MD. Unbalanced repeated-measures models with structured covariance matrices. Biometrics. 1986;42(4):805–20. doi:10.2307/2530695.
   PubMed Web of Science ®Google Scholar
• Ware JH. Linear models for the analysis of longitudinal studies. Am Stat. 1985;39:95–101.
   Web of Science ®Google Scholar
• Yang M, Goldstein H. Multilevel models for longitudinal data. In: Engel U, Reinecke J, editors. Analysis of change: advanced techniques in panel data analysis. New York, NY: Walter de Gruyter; 1996. p. 191–220.
   Google Scholar
• Ferron JM, Dailey R, Yi Q. Effects of misspecifying the first level error structure in two-level models of change. Multivariate Behav Res. 2002;37(3):379–403. doi:10.1207/S15327906MBR3703_4.
   PubMed Web of Science ®Google Scholar
• Kwok O, West SG, Green SB. The impact of misspecifying the within-subject covariance structure in multiwave longitudinal multilevel models: a Monte Carlo study. Multivariate Behav Res. 2007;42(3):557–92. doi:10.1080/00273170701540537.
   Web of Science ®Google Scholar
• Heyvaert M, Saenen L, Maes B, Onghena P. Systematic review of restraint interventions for challenging behaviour among persons with intellectual disabilities: focus on effectiveness in single-case experiments. J Appl Res Intellect Disabil. 2014;27(6):493–510. doi:10.1111/jar.12094.
   PubMed Web of Science ®Google Scholar
• Vanderkerken L, Heyvaert M, Maes B, Onghena P. Psychosocial interventions for reducing vocal challenging behavior in persons with autistic disorder: a multilevel meta-analysis of single-case experiments. Res Dev Disabil. 2013;34(12):4515–33. doi:10.1016/j.ridd.2013.09.030.
   PubMed Web of Science ®Google Scholar
• Ferron JM, Farmer JL, Owens CM. Estimating individual treatment effects from multiple-baseline data: a Monte Carlo study of multilevel modeling approaches. Behav Res Methods. 2010;42(4):930–43. doi:10.3758/BRM.42.4.930.
   PubMed Web of Science ®Google Scholar
• Baek E, Ferron JM. Modeling heterogeneity of the level-1 Error covariance matrix in multilevel models for single-case data using Bayesian estimation. Methodology. 2020;16(2):166–85. doi:10.5964/meth.2817.
   Web of Science ®Google Scholar
• Baek E, Petit-Bois M, Van den Noortgate W, Beretvas T, Ferron J. Using visual analysis to evaluate and refine multilevel models of single-case studies. J Spec Edu. 2016;50(1):18–26. doi:10.1177/0022466914565367.
   Web of Science ®Google Scholar
• Kenward MG, Roger JH. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics. 1997;53(3):983–97. doi:10.2307/2533558.
   PubMed Web of Science ®Google Scholar
• Kenward MG, Roger JH. An improved approximation to the precision of fixed effects from restricted maximum likelihood. Comput Stat Data Anal. 2009;53(7):2583–95. doi:10.1016/j.csda.2008.12.013.
   Web of Science ®Google Scholar
• Moeyaert M, Ugille M, Ferron J, Beretvas SN, Van den Noortgate W. The three-level synthesis of standardized single-subject experimental data: a Monte Carlo simulation study. Multivariate Behav Res. 2013;48(5):719–48. doi:10.1080/00273171.2013.816621.
   PubMed Web of Science ®Google Scholar
• Chen MH, Shao QM. Monte Carlo estimation of Bayesian credible and HPD Intervals. J Comput Graph Stat. 1999;8:69–92.
   Web of Science ®Google Scholar
• Cowles MK, Carlin BP. Markov chain Monte Carlo convergence diagnostics: a comparative review. J Am Stat Assoc. 1996;91(434):883–904. doi:10.1080/01621459.1996.10476956.
   Web of Science ®Google Scholar
• Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian data analysis. 2nd ed. Boca Raton (FL): Chapman and Hall/CRC; 2004.
   Google Scholar
• Gilks WR, Richardson S, Spiegelhalter DJ. Markov chain Monte Carlo in practice. In: Gilks WR, Richardson S, Spiegelhalter DJ, editors. Introducing Markov Chain Monte Carlo. Boca Raton (FL): Chapman and Hall/CRC. 1996. p.1–20
   Google Scholar
• Tierney L. Markov chains for exploring posterior distributions. Ann Stat. 1994;22(4):1701–62. doi:10.1214/aos/1176325750.
   Web of Science ®Google Scholar
• Gelman A. Prior distribution. Encyclopedia of Environ. 2002;3:1634–37.
   Google Scholar
• de Vries RM, Morey RD. Bayesian hypothesis testing for single-subject designs. Psychol Methods. 2013;18(2):165–85. doi:10.1037/a0031037.
   PubMed Web of Science ®Google Scholar
• Rindskopf D. Nonlinear Bayesian analysis for single case designs. J Sch Psychol. 2014;52(2):179–89. doi:10.1016/j.jsp.2013.12.003.
   PubMed Web of Science ®Google Scholar
• Baldwin SA, Fellingham GW. Bayesian methods for the analysis of small sample multilevel data with a complex variance structure. Psychol Methods. 2013;18(2):151–64. doi:10.1037/a0030642.
   PubMed Web of Science ®Google Scholar
• Browne W. MCMC estimation in MLwinN. Bristol (England): Centre for Multilevel Modeling; 2008.
   Google Scholar
• Shadish WR, Rindskopf D, Hedges L, Sullivan K. Bayesian estimates of autocorrelations in single-case designs. Behav Res Methods. 2013;45(3):813–21. doi:10.3758/s13428-012-0282-1.
   PubMed Web of Science ®Google Scholar
• Baek E, Beretvas SN, Van den Noortgate W, Ferron JM. Brief research report: Bayesian versus REML estimations with noninformative priors in multilevel single-case data. J Exp Edu. 2020;88(4):698–710. doi:10.1080/00220973.2018.1527280.
   Web of Science ®Google Scholar
• Moeyaert M, Rindskopf D, Onghena P, Van den Noortgate W. Multilevel modeling of single-case data: a comparison of Maximum likelihood and Bayesian estimation. Psychol Methods. 2017;22(4):760–78. doi:10.1037/met0000136.
   PubMed Web of Science ®Google Scholar
• Swaminathan H, Rogers H, Horner R. An effect size measure and Bayesian analysis of single-case designs. J Sch Psychol. 2014;52(2):213–30. doi:10.1016/j.jsp.2013.12.002.
   PubMed Web of Science ®Google Scholar
• Lunn D, Spiegelhalter D, Thomas A, Best N (2009). OpenBUGS [Computer software]. http://www.openbugs.net/w/FrontPage.
   Google Scholar
• Harris KR, Friedlander BD, Saddler B, Frizzelle R, Graham S. Self-monitoring of attention versus self-monitoring of academic performance: effects among students with ADHD in the general education classroom. J Spec Educ. 2005;39(3):145–56. doi:10.1177/00224669050390030201.
   Web of Science ®Google Scholar
• Tummers B (2006). DataThief III (version 1.6) [software]. http://datathief.org/.
   Google Scholar
• Gelman A. Prior distributions for variance parameters in hierarchical models. Bayesian Anal. 2006;1(3):515–33. doi:10.1214/06-BA117A.
   Web of Science ®Google Scholar
• Goldstein M. Subjective Bayesian analysis: principles and practice. Bayesian Anal. 2006;3(3):403–20. doi:10.1214/06-BA116.
   Google Scholar
• Spiegelhalter DJ, Abrams KR, Myles JP. Bayesian approaches to clinical trials and health-care evaluation, section 5.7.3. Chichester, England: Wiley; 2004.
   Google Scholar
• Berger JO, Strawderman WE. Choice of hierarchical priors: admissibility in estimation of normal means. Ann Stat. 1996;24(3):931–51. doi:10.1214/aos/1032526950.
   Web of Science ®Google Scholar
• Daniels MJ, Kass RE. Nonconjugate Bayesian estimation of covariance matrices and its use in hierarchical models. J Am Stat Assoc. 1999;94(448):1254–63. doi:10.1080/01621459.1999.10473878.
   Web of Science ®Google Scholar
• Gelman A, Hill LS. Data analysis using regression and multilevel/hierarchical models. New York (NY): Cambridge University Press; 2007.
   Google Scholar
• Brooks SP, Gelman A. General methods for monitoring convergence of iterative simulations. J Comput Graph Stat. 1998;7:434–55.
   Web of Science ®Google Scholar
• Spiegelhalter D, Thomas A, Best N, Lunn D (2014). OpenBUGS user manual. http://www.openbugs.net/Manuals/Manual.html.
   Google Scholar
• Brooks SP, Roberts GO. Assessing convergence of Markov chain Monte Carlo algorithms. Stat Comput. 1998;8(4):319–35. doi:10.1023/A:1008820505350.
   Web of Science ®Google Scholar
• Gelman A, Rubin DB. Inference from iterative simulation using multiple sequences. Stat Sci. 1992;7(4):457–72. doi:10.1214/ss/1177011136.
   Google Scholar