A demonstration of how to do a meta-analysis that combines single-case designs with between-groups experiments: The effects of choice making on challenging behaviors performed by people with disabilities

References

• *References marked with an asterisk indicate studies included in the meta-analysis.
   Google Scholar
• Shogren KA, Faggella-Luby M, Bae SJ, Wehmeyer ML. The effect of choice-making as an intervention for problem behavior: A meta-analysis. Journal of Positive Behavior Interventions 2004;6:228–237.
   Web of Science ®Google Scholar
• Murphy G. Challenging behavior: A barrier to inclusion? Journal of Policy and Practice in Intellectual Disabilities 2009;6:89–90.
   Web of Science ®Google Scholar
• Benson BA, Brooks WT. Aggressive challenging behaviour and intellectual disability. Current Opinion in Psychiatry 2008;21:454–458.
   PubMed Web of Science ®Google Scholar
• Cooper SA, Smiley E, Allan LM, Jackson A, Finlayson J, Mantry D, Morrison J. Adults with intellectual disabilities: Prevalence, incidence and remission of self-injurious behaviour, and related factors. Journal of Intellectual Disability Research 2009;53:200–216.
   PubMed Web of Science ®Google Scholar
• Poon KK. Challenging behaviors among children with autism spectrum disorders and multiple disabilities attending special schools in Singapore. Research in Developmental Disabilities 2012;33:578–582.
   PubMed Web of Science ®Google Scholar
• Goh AE, Bambara LM. Individualized positive behavior support in school settings: A meta-analysis. Remedial and Special Education 2012;33:271–286.
   Web of Science ®Google Scholar
• Harvey ST, Boer D, Meyer LH, Evans IM. Updating a meta-analysis of intervention research with challenging behaviour: Treatment validity and standards of practice. Journal of Intellectual and Developmental Disability 2009;34:67–80.
   PubMed Web of Science ®Google Scholar
• Heyvaert M, Maes B, Van dN, Kuppens S, Onghena P. A multilevel meta-analysis of single-case and small-n research on interventions for reducing challenging behavior in persons with intellectual disabilities. Research in Developmental Disabilities 2012;33:766–780.
   Google Scholar
• Freeman R. Positive behavior support strategies: Transition plans for a brighter future [PowerPoint slides]. 2005. Retrieved May 31, 2015 from: www.kipbs.org/new_kipbs/basicinfo/files/kanstrans2005handouts.pdf
   Google Scholar
• Allison DB, Gorman BS. Make things as simple as possible, but no simpler: A rejoinder to scruggs and mastropieri. Behav Res Ther 1994;32:885–890.
   Web of Science ®Google Scholar
• Shadish WR, Hedges LV, Pustejovsky JE. Analysis and meta-analysis of single-case designs with a standardized mean difference statistic: A primer and applications. Journal of School Psychology 2014;52:123–147.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Hedges LV, Pustejovsky JE, Boyajian JG, Sullivan KJ, Andrade A, Barrientos JL. A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic. Neuropsychological Rehabilitation 2014;24:528–53.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Sullivan KJ. Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods 2011;43:971–980.
   PubMed Web of Science ®Google Scholar
• Hedges LV, Pustejovsky JE, Shadish WR. A standardized mean difference effect size for single case designs. Research Synthesis Methods 2012;3:224–239.
   PubMed Web of Science ®Google Scholar
• Hedges LV, Pustejovsky JE, Shadish WR. A standardized mean difference effect size for multiple baseline designs across individuals. Research Synthesis Methods 2013;4:324–341.
   PubMed Web of Science ®Google Scholar
• Marso D. Shadish WR. User Guide for DHPS, D_Power, and GPHDPwr SPSS Macros Version 1.0.Manual 2014. Retrieved May 31, 2015 from: http://faculty.ucmerced.edu/wshadish/software/software-meta-analysis-single-case-design
   Google Scholar
• Tanner‐Smith EE, Tipton E. Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS. Research Synthesis Methods 2014;5:13–30.
   PubMed Web of Science ®Google Scholar
• Tipton E. Small sample adjustments for robust variance estimation with meta-regression. Psychol Methods 2015;20:375–393.
   PubMed Web of Science ®Google Scholar
• Fisher Z. Tipton E. robumeta: Robust variance meta-regression. [R package] version 1.1. 2014. Retrieved May 31, 2015 from: http://CRAN.R-project.org/package=robumeta
   Google Scholar
• Bambara LM, Koger F, Katzer T, Davenport TA. Embedding choice in the context of daily routines: An experimental case study. Journal of the Association for Persons with Severe Handicaps 1995;20:185–195.
   Google Scholar
• Cole CL, Levinson TR. Effects of within-activity choices on the challenging behavior of children with severe developmental disabilities. Journal of Positive Behavior Interventions 2002;4:29–37.
   Web of Science ®Google Scholar
• Dibley S, Lim L. Providing choice making opportunities within and between daily school routines. Journal of Behavioral Education 1999;9(2):117–132.
   Google Scholar
• Frea WD, Arnold CL, Vittimberga GL. A demonstration of the effects of augmentative communication on the extreme aggressive behavior of a child with autism within an integrated preschool setting. Journal of Positive Behavior Interventions 2001;3:194–198.
   Google Scholar
• Kern L, Mantegna ME, Vorndran CM, Bailin D, Hilt A. Choice of task sequence to reduce problem behaviors. Journal of Positive Behavior Interventions 2001;3:3–10.
   Google Scholar
• Peterson SMP, Caniglia C, Royster AJ. Application of choice-making intervention for a student with multiply maintained problem behavior. Focus on Autism and Other Developmental Disabilities 2001;16:240–246.
   Google Scholar
• Powell S, Nelson B. Effects of choosing academic assignments on a student with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis 1997;30:181–183.
   PubMed Web of Science ®Google Scholar
• *Bennett DE, Zentall SS, French BF, Giorgetti-Borucki K. The effects of computer-administered choice on students with and without characteristics of attention-Deficit/Hyperactivity disorder. Behavioral Disorders 2006;31:189–203.
   Web of Science ®Google Scholar
• *Bleck AA. Examining the impact of student choice of writing topic on writing production and accuracy [dissertation]. Lincoln (NE): The University of Nebraska – Lincoln; 2013. Retrieved May 31, 2015 from: ProQuest Dissertations and Theses http://search.proquest.com/docview/1416418759?accountid=14515, Order No. 3566304.
   Google Scholar
• *Cale SI, Carr EG, Blakeley-Smith A, Owen-DeSchryver J. Context-based assessment and intervention for problem behavior in children with autism spectrum disorder. Behavior Modification;2009 33:707–742.
   PubMed Web of Science ®Google Scholar
• *Carter CM. Using choice with game play to increase language skills and interactive behaviors in children with autism. Journal of Positive Behavior Interventions 2001;3:131–151.
   Google Scholar
• *Ramsey ML, Jolivette K, Patterson DP, Kennedy C. Using choice to increase time on-task, task-completion, and accuracy for students with emotional/behavior disorders in a residential facility. Education and Treatment of Children 2010:1–21.
   Google Scholar
• *Ramsey ML. Using function-based choice-making interventions to increase task completion and accuracy and to reduce problem behaviors for students with E/BD [dissertation]. Atlanta (GA): Georgia State University; 2010. Retrieved May 31, 2015 from: ProQuest Dissertations and Theses, (Order No. 3447909) http://search.proquest.com/docview/859014538?accountid=14515.
   Google Scholar
• *Tasky KK, Rudrud EH, Schulze KA, Rapp JT. Using choice to increase on-task behavior in individuals with traumatic brain injury. Journal of Applied Behavior Analysis 2008;41:261–265.
   PubMed Web of Science ®Google Scholar
• *Ulke-Kurkcuoglu B, Kircaali-Iftar G. A comparison of the effects of providing activity and material choice to children with autism spectrum disorders. Journal of Applied Behavior Analysis 2010;43:717–721.
   PubMed Web of Science ®Google Scholar
• *Watanabe M, Sturmey P. The effect of choice-making opportunities during activity schedules on task engagement of adults with autism. J Autism Dev Disord 2003;33:535–538.
   PubMed Web of Science ®Google Scholar
• BioSoft. Ungraph for Windows [computer program]. Version 5.0. Cambridge, UK: Author; 2004.
   Google Scholar
• Shadish WR, Brasil ICC, Illingworth DA, White KD, Galindo R, Nagler ED, Rindskopf DM. Using UnGraph to extract data from image files: Verification of reliability and validity. Behavior Research Methods 2009;41:177–183.
   PubMed Web of Science ®Google Scholar
• Shadish WR, Robinson L, Lu C. ES: A computer program and manual for effect size calculation [computer program]. St. Paul (MN): Assessment Systems Corporation; 1999.
   Google Scholar
• Hedges LV. Distribution theory for glass’s estimator of effect size and related estimators. Journal of Educational Statistics 1981;6:107–128.
   Google Scholar
• Komsta L. outliers: Tests for outliers [R package]. Version 0.14. 2011. Retrieved May 31, 2015 from: http://CRAN.R-project.org/package=outliers
   Google Scholar
• Gamer M, Lemon J, Fellows I, Singh P. irr: Various coefficients of interrater reliability and agreement. [R package] Version 0.84. 2012. Retrieved May 31, 2015 from: http://CRAN.R-project.org/package=irr
   Google Scholar
• Fisher Z, Tipton E robumeta: An R-package for robust variance estimation in meta-analysis. Working paper. 2014; Retrieved May 31, 2015 from: http://blogs.cuit.columbia.edu/let2119/files/2013/03/Fisher-and-Tipton-.pdf
   Google Scholar
• Viechtbauer W. Conducting meta-analyses in R with the metafor package.Journal of Statistical Software 2010;36(3):1–48. Retrieved May 31, 2015 from: http://www.jstatsoft.org/v36/i03/.
   Web of Science ®Google Scholar
• R Core Team. R: A language and environment for statistical computing [computer program]. R foundation for statistical computing, Vienna, Austria; 2012. Retrieved May 31, 2015 from: http://www.R-project.org/.
   Google Scholar
• Viechtbauer W, Cheung MW. Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods 2010;1:112–25.
   PubMed Web of Science ®Google Scholar
• *Romaniuk C, Miltenberger R, Conyers C, Jenner N, Jurgens M, Ringenberg C. The influence of activity choice on problem behaviors maintained by escape versus attention. Journal of Applied Behavior Analysis 2002;35:349–362.
   PubMed Web of Science ®Google Scholar
• *Dyer K, Dunlap G, Winterling V. Effects of choice making on the serious problem behaviors of students with severe handicaps. Journal of Applied Behavior Analysis 1990;23:515–524.
   PubMed Web of Science ®Google Scholar
• Rothstein H, Sutton AJ, Borenstein M, editors. Publication bias in meta-analysis: Prevention, assessment and adjustments. New York, NY: Wiley; 2005. p 356.
   Google Scholar
• Mahoney MJ. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research 1977;1(2):161–175.
   Google Scholar
• Sham E, Smith T. Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis. Journal of Applied Behavior Analysis 2014;47:663–678.
   PubMed Web of Science ®Google Scholar
• *Dunlap G, de Perczel M, Clarke S, Wilson D, Wright S, White R, Gomez A. Choice making to promote adaptive behavior for students with emotional and behavioral challenges. Journal of Applied Behavior Analysis 1994;27:505–518.
   PubMed Web of Science ®Google Scholar
• *Jolivette K, Wehby JH, Canale J, Massey NG. Effect of choice-making opportunities on the behavior of students with emotional and behavioral disorders. Behavioral Disorders 2001;26:131–145.
   Web of Science ®Google Scholar
• *Moes DR. Integrating choice-making opportunities within teacher-assigned academic tasks to facilitate the performance of children with autism. Journal of the Association for Persons with Severe Handicaps 1998;23:319–328.
   Google Scholar
• *Seybert S, Dunlap G, Ferro J. The effects of choice-making on the problem behaviors of high school students with intellectual disabilities. Journal of Behavioral Education 1996;6:49–65.
   Google Scholar
• Ghosh D, Vogt A. Outliers: An Evaluation of Methodologies. Joint Statistical Meetings. 2012:3455–3460.
   Google Scholar