The Three-Level Synthesis of Standardized Single-Subject Experimental Data: A Monte Carlo Simulation Study

REFERENCES

• Alen , E. , Grietens , H. and Van den Noortgate , W. 2009 . Meta-analysis of single-case studies: An illustration for the treatment of anxiety disorders. Unpublished manuscript
   Google Scholar
• Allison , D. B. and Gorman , B. S. 1993 . Calculating effect sizes for meta-analysis: The case of the single case. . Behavior Research Therapy , 31 : 621 – 631 .
   PubMed Web of Science ®Google Scholar
• Barlow , D. H. and Hersen , M. 1984 . Single-case experimental designs: Strategies for studying behavior change () , 2nd ed. , New York , NY : Pergamon Press .
   Google Scholar
• Beretvas , S. N. and Chung , H. 2008 . A review of single-subject experimental design meta-analyses: Methodological issues and practice. . Evidence-Based Communication and Assessment and Intervention , 2 : 129 – 141 .
   Google Scholar
• Busk , P. L. and Serlin , R. C. 1992 . “ Meta-analysis for single-case research. ” . In Single-case research design and analysis: New directions for psychology and education , Edited by: Kratochwill , T. R. and Levin , J. R. 187 – 212 . Mahwah , NJ : Erlbaum .
   Google Scholar
• Cohen , J. 1988 . Statistical power analysis for the behavioral sciences , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Cools , W. , Van den Noortgate , W. and Onghena , P. 2008 . ML-DEs: A program for designing efficient multilevel studies. . Behavior Research Methods , 40 : 236 – 249 .
   PubMed Web of Science ®Google Scholar
• Denis , J. , Van den Noortgate , W. and Maes , B. 2011 . Self-injurious behavior in people with profound intellectual disabilities: A meta-analysis of single-case studies. . Research in Developmental Disabilities , 32 : 911 – 923 .
   PubMed Web of Science ®Google Scholar
• Edgington , E. S. and Onghena , P. 2007 . Randomization tests () , 4th ed. , London , , UK : Chapman & Hall .
   Google Scholar
• Farmer , J. , Owens , C. M. , Ferron , J. M. and Allsopp , D. 2010 . A review of social science single-case meta-analyses. Manuscript in preparation
   Google Scholar
• Ferron , J. M. , Bell , B. A. , Hess , M. F. , Rendina-Gobioff , G. and Hibbard , S. T. 2009 . Making treatment effect inferences from multiple-baseline data: The utility of multilevel modeling approaches. . Behavior Research Methods , 41 : 372 – 384 .
   PubMed Web of Science ®Google Scholar
• Ferron , J. M. , Farmer , J. L. and Owens , C. M. 2010 . Estimating individual treatment effects from multiple-baseline data: A Monte Carlo study of multilevel-modeling approaches. . Behavior Research Methods , 42 : 930 – 943 .
   PubMed Web of Science ®Google Scholar
• Fisch , G. S. 2001 . Evaluating data from behavioral analysis: Visual inspection or statistical models? . Behavioural Processes , 54 : 137 – 154 .
   PubMed Web of Science ®Google Scholar
• Hanley , G. P. , Iwata , B. A. , Thompson , R. H. and Lindberg , J. S. 2000 . A component analysis of “stereotypy as reinforcement” for alternative behavior. . Journal of Applied Behavior Analysis , 33 : 285 – 297 .
   PubMed Web of Science ®Google Scholar
• Hersen , M. and Barlow , D. H. 1976 . Single-case experimental designs: Strategies for studying behavior. , New York , NY : Pergamon Press .
   Google Scholar
• Heyvaert , M. , Saenen , L. , Maes , B. and Onghena , P. 2012 . Systematic review of restraint interventions for challenging behaviour among persons with intellectual disabilities: Experiences and effectiveness. Manuscript submitted for publication
   Google Scholar
• Hoogland , J. J. and Boomsma , A. 1998 . Robustness studies in covariance structure modeling. An overview and a meta-analysis. . Sociological Methods & Research , 26 : 329 – 367 .
   Web of Science ®Google Scholar
• Jones , R. J. , Weinrott , M. R. and Vaught , R. S. 1978 . Effects of serial dependency on the agreement between visual and statistical inference. . Journal of Applied Behavior Analysis , 11 : 277 – 283 .
   PubMed Web of Science ®Google Scholar
• Kazdin , A. E. 1982 . Single case research designs: Methods for clinical and applied settings. , Oxford , , UK : Oxford University Press .
   Google Scholar
• Kazdin , A. E. and Kopel , S. A. 1975 . On resolving ambiguities of the multiple-baseline design: Problems and recommendations. . Behavior Therapy , 6 : 601 – 608 .
   Web of Science ®Google Scholar
• Kennedy , C. H. 2005 . Single-case designs for educational research. , New York , NY : Allyn & Bacon .
   Google Scholar
• Kokina , A. and Kern , L. 2010 . Social story interventions for students with autism spectrum disorders: A meta-analysis. . Journal of Autism and Developmental Disorders , 40 : 812 – 826 .
   PubMed Web of Science ®Google Scholar
• Kratochwill , T. R. , ed. 1978 . Single subject research: Strategies for evaluating change. , New York , NY : Academic Press .
   Google Scholar
• Kratochwill , T. R. and Levin , J. R. , eds. 1992 . Single-case research design and analysis: New directions for psychology and education. , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Kreft , I. and de Leeuw , J. 1998 . Introducing multilevel modeling , London , , UK : Sage .
   Google Scholar
• Lindberg , J. S. , Iwata , B. A. and Kahng , S. W. 1999 . On the relation between object manipulation and stereotypic self-injurious behavior. . Journal of Applied Behavior Analysis , 32 : 51 – 62 .
   PubMed Web of Science ®Google Scholar
• Littell , R. C. , Milliken , G. A. , Stroup , W. W. , Wolfinger , R. D. and Schabenberger , O. 2006 . SAS© system for mixed models () , 2nd ed. , Cary , NC : SAS Institute Inc .
   Google Scholar
• Maggin , D. M. , Swaminathan , H. , Rogers , H. J. , O'Keeffe , B. V. , Sugai , G. and Horner , R. H. 2011 . A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. . Journal of School Psychology , 49 : 301 – 321 .
   PubMed Web of Science ®Google Scholar
• McCord , B. E. , Grosser , J. W. , Iwata , B. A. and Powers , L. A. 2005 . An analysis of response-blocking parameters in the prevention of pica. . Journal of Applied Behavior Analysis , 38 : 391 – 394 . doi: 10.1901/jaba.2005.92-04
   PubMed Web of Science ®Google Scholar
• McReynolds , L. and Kearns , K. 1983 . Single-subject experimental designs in communicative disorders. , Baltimore , MD : University Park Press .
   Google Scholar
• Moeyaert , M. , Ugille , M. , Ferron , J. , Beretvas , N. and Van den Noortgate , W. 2013a . Three-level analysis of single-case experimental data: Empirical validation. . Journal of Experimental Education , Advance online publication, doi: 10.1080/00220973.2012.745470
   Web of Science ®Google Scholar
• Moeyaert , M. , Ugille , M. , Ferron , J. , Beretvas , N. and Van den Noortgate , W. 2013b . The misspecification of the covariance structures in multilevel models for single-case data: A Monte Carlo simulation study. Manuscript submitted for publication
   Google Scholar
• Moeyaert , M. , Ugille , M. , Ferron , J. , Beretvas , N. and Van den Noortgate , W. 2013c . Modeling external events in the three-level analysis of multiple-baseline across participants designs: A simulation study. . Behavior Research Methods , 45 : 547 – 559 .
   PubMed Web of Science ®Google Scholar
• Normand , M. P. and Bailey , J. S. 2006 . The effects of celeration lines on visual data analysis. . Behavior Modification , 30 : 295 – 314 .
   PubMed Web of Science ®Google Scholar
• Ottenbacher , K. J. 1993 . Interrater agreement of visual analysis in single-subject decisions: Quantitative review and analysis. . American Journal of Mental Retardation , 98 : 135 – 142 .
   PubMedGoogle Scholar
• Owens , C. M. and Ferron , J. M. 2012 . Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model. . Behavior Research Methods , 44 : 795 – 805 .
   PubMed Web of Science ®Google Scholar
• Richards , S. B. , Taylor , R. , Ramasamy , R. and Richards , R. Y. 1999 . Single subject research: Applications in educational and clinical settings. , Belmont , CA : Wadsworth .
   Google Scholar
• Roane , H. S. , Piazza , C. C. , Sgro , G. M. , Volkert , V. M. and Anderson , C. M. 2001 . Analysis of aberrant behaviour associated with Rett syndrome. . Disability and Rehabilitation , 23 ( 3–4 ) : 139 – 148 .
   PubMed Web of Science ®Google Scholar
• Rolider , A. , Williams , L. , Cummings , A. and Van Houten , R. 1991 . The use of a brief movement restriction procedure to eliminate severe inappropriate behavior. . Journal of Behavior Therapy and Experimental Psychiatry , 22 ( 1 ) : 23 – 30 . doi: 10.1016/0005-7916(91)90029-5
   PubMed Web of Science ®Google Scholar
• Roscoe , E. M. , Iwata , B. A. and Goh , H.-L. 1998 . A comparison of noncontingent reinforcement and sensory extinction as treatments for self-injurious behavior. . Journal of Applied Behavior Analysis , 31 : 635 – 646 .
   PubMed Web of Science ®Google Scholar
• Salzberg , C. L. , Strain , P. S. and Baer , D. M. 1987 . Meta-analysis for single subject research: When does it clarify, when does it obscure. . Remedial and Special Education , 8 : 140 – 146 .
   Web of Science ®Google Scholar
• Shadish , W. R. and Rindskopf , D. M. 2007 . “ Methods for evidence-based practice: Quantitative synthesis of single-subject designs. ” . In Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation , Edited by: Julnes , G. and Rog , D. J. 95 – 109 . San Francisco , CA : Jossey-Bass .
   Google Scholar
• Shadish , W. R. and Sullivan , K. J. 2011 . Characteristics of single-case designs used to assess intervention effects in 2008. . Behavior Research Methods , 43 : 971 – 980 . doi: 10.3758/s13428-011-0111-y
   PubMed Web of Science ®Google Scholar
• Shogren , K. A. , Faggella-Luby , M. N. , Bae , S. J. and Wehmeyer , M. L. 2004 . The effect of choice-making as an intervention for problem behavior: A meta-analysis. . Journal of Positive Behavior Interventions , 4 : 228 – 237 .
   Web of Science ®Google Scholar
• Swanson , H. L. and Sachse-Lee , C. 2000 . A meta-analysis of single-subject-design intervention research for students with LD. . Journal of Learning Disabilities , 33 : 114 – 136 .
   PubMed Web of Science ®Google Scholar
• Tawney , J. W. and Gast , D. L. 1984 . Single subject research in special education. , Columbus , OH : Merrill .
   Google Scholar
• Thompson , R. H. , Iwata , B. A. , Conners , J. and Roscoe , E. M. 1999 . Effects of reinforcement for alternative behavior during punishment of self-injury. . Journal of Applied Behavior Analysis , 32 : 317 – 328 .
   PubMed Web of Science ®Google Scholar
• Tobler , W. R. 1970 . A computer movie simulating urban growth in the Detroit region. . Economic Geography , 46 : 234 – 240 .
   Web of Science ®Google Scholar
• Van den Noortgate , W. and Onghena , P. 2003 . Combining single-case experimental data using hierarchical linear models. . School Psychology Quarterly , 18 : 325 – 346 .
   Web of Science ®Google Scholar
• Van den Noortgate , W. and Onghena , P. 2008 . A multilevel meta-analysis of single-subject experimental design studies. . Evidence Based Communication Assessment and Intervention , 2 : 142 – 151 .
   Google Scholar
• Van den Noortgate , W. , Opdenakker , M. and Onghena , P. 2005 . The effects of ignoring a level in multilevel analysis. . School of Effectiveness and School Improvement , 16 : 281 – 303 .
   Web of Science ®Google Scholar
• Wang , S. , Cui , Y. and Parrila , R. 2011 . Examining the effectiveness of peer-mediated and video-modeling social skills interventions for children with autism spectrum disorders: A meta-analysis in single-case research using HLM. . Research in Autism Spectrum Disorder , 5 : 562 – 569 .
   Web of Science ®Google Scholar
• White , O. R. 1987 . The quantitative synthesis of single-subject research: Methodology and validation. Comment. . Remedial and Special Education , 8 : 34 – 39 .
   Web of Science ®Google Scholar
• White , O. R. and Haring , N. G. 1980 . Exceptional teaching () , 2nd ed. , Columbus , OH : Charles E. Merrill .
   Google Scholar
• Wolery , M. , Busick , M. , Reichow , B. and Barton , E. E. 2010 . Comparison of overlap methods for quantitatively synthesizing single subject data. . Journal of Special Education , 44 : 18 – 28 .
   Web of Science ®Google Scholar
• Zhou , L. M. , Goff , G. A. and Iwata , B. A. 2000 . Effects of increased response effort on self-injury and object manipulation as competing responses. . Journal of Applied Behavior Analysis , 33 ( 1 ) : 29 – 40 .
   PubMed Web of Science ®Google Scholar