A review of meta-analyses of single-subject experimental designs: Methodological issues and practice

References

• References used in the narrative literature review are marked with an asterisk
   Google Scholar
• *Algozzine , B , Browder , D and Karvonen , M . 2001 . Effects of interventions to promote self-determination for individuals with disabilities . Review of Educational Research , 71 : 219 – 277 .
   Google Scholar
• *Allison , DB , Faith , MS and Franklin , RD . 1995 . Antecedent exercise in the treatment of disruptive behavior: A meta-analytic review . Clinical Psychology: Science and Practice , 2 : 279 – 304 .
   Google Scholar
• Becker , BJ . 1992 . Using results from replicated studies to estimate linear models . Journal of Educational Statistics , 17 : 341 – 362 .
   Google Scholar
• Beretvas , SN and Chung , H . May 2007 . “ R-squared change effect size estimates for single-subject meta-analyses ” . In Paper presented at the 7th Annual International Campbell Collaboration Colloquium in London May , England
   Google Scholar
• Beretvas , SN , Chung , H , Machalicek , WA and Riviello , C . May 2008 . “ Computation of regression-based effect size measures ” . In Paper presented at the 8th Annual International Campbell Collaboration Colloquium in Vancouver May , Canada
   Google Scholar
• Blumberg , CJ . 1984 . Comments on “A simplified time-series analysis for evaluating treatment interventions” . Journal of Applied Behavior Analysis , 17 : 539 – 542 .
   PubMed Web of Science ®Google Scholar
• *Bonner , M and Barnett , DW . 2004 . Intervention-based school psychology services: Training for child-level accountability; preparing for program-level accountability . Journal of School Psychology , 42 : 23 – 43 .
   Google Scholar
• Box , GEP and Jenkins , JM . 1976 . Time series analysis: Forecasting and control , 2nd , San Francisco, CA : Holden–Day .
   Google Scholar
• Busk , PL and Marascuilo , LA . 1988 . Autocorrelation in single-subject research: A counterargument to the myth of no autocorrelation . Behavioral Assessment , 10 : 229 – 242 .
   Google Scholar
• Busk , PL and Marascuilo , LA . 1992 . “ Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors ” . In Single-case research design and analysis: New directions for psychology and education , Edited by: Kratochwill , TR and Levin , JR . 159 – 185 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Campbell , JM . 2003 . Efficacy of behavioral interventions for reducing problem behavior in persons with autism: A quantitative synthesis of single-subject research . Research in Developmental Disabilities , 24 : 120 – 138 .
   PubMed Web of Science ®Google Scholar
• *Carey , LM and Matyas , TA . 2005 . Training of somatosensory discrimination after stroke: Facilitation of stimulus generalization . American Journal of Physical and Medical Rehabilitation , 84 : 428 – 42 .
   PubMedGoogle Scholar
• Center , BA , Skiba , RJ and Casey , A . 1985–1986 . A methodology for the quantitative synthesis of intra-subject design research . Journal of Special Education , 19 : 387 – 400 .
   Web of Science ®Google Scholar
• Cohen , J . 1977 . Statistical power analysis for the behavioral sciences (rev ed.) , Hillsdale, NJ : Erblaum .
   Google Scholar
• Cooper , H and Hedges , LV . 1994 . The handbook of research synthesis , New York, NY : Russell Sage Foundation .
   Google Scholar
• Crosbie , J . 1993 . Interrupted time-series analysis with single-subject data . Journal of Consulting and Clinical Psychology , 61 : 966 – 974 .
   PubMed Web of Science ®Google Scholar
• Crosbie , J . 1995 . “ Interrupted time-series analysis with short series: Why it is problematic; how it can be improved ” . In The analysis of change , Edited by: Gottman , JM . 361 – 395 . Mahwah, NJ : Erlbaum .
   Google Scholar
• *Didden , R , Duker , PC and Korzilius , H . 1997 . Meta-analytic study on treatment effectiveness for problem behaviors with individuals who have mental retardation . American Journal on Mental Retardation , 101 : 387 – 399 .
   PubMedGoogle Scholar
• *DuPaul , GJ and Eckert , TL . 1997 . The effects of school-based interventions for attention deficit hyperactivity disorder: A meta-analysis . School Psychology Review , 26 : 5 – 27 .
   Google Scholar
• Faith , MS , Allison , DB and Gorman , BS . 1996 . “ Meta-analysis of single-case research ” . In Design and analysis of single-case research , Edited by: Franklin , DR , Allison , DB and Gorman , BS . 245 – 277 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Galassi , JP and Gersh , TL . 1993 . Myths, misconceptions and missed opportunity: Single-case designs and counseling psychology . Journal of Counseling Psychology , 40 : 525 – 531 .
   Web of Science ®Google Scholar
• Glass , GV . 1976 . Primary, secondary, and meta-analysis of research . Educational Researcher , 5 : 3 – 8 .
   Google Scholar
• Glass , GV , Willson , VW and Gottman , JM . 1975 . Design and analysis of time-series experiments , Boulder : Colorado Associated University Press .
   Google Scholar
• Gorman , BS and Allison , DB . 1996 . “ Statistical alternatives for single-case designs ” . In Design and analysis of single-case research , Edited by: Franklin , DR , Allison , DB and Gorman , BS . 159 – 214 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Gorsuch , RL . 1983 . Three methods for analyzing limited time-series (N of 1) data . Behavioral Assessment , 5 : 141 – 154 .
   Google Scholar
• Hedges , LV and Olkin , I . 1985 . Statistical methods for meta-analysis , New York : Academic Press .
   Google Scholar
• Hershberger , SL , Wallace , DD , Green , SG and Marquis , JG . 1999 . “ Meta-analysis of single-case designs ” . In Statistical strategies for small sample research , Edited by: Hoyle , RH . 107 – 132 . Thousand Oaks, CA : Sage .
   Google Scholar
• Huitema , BE . 1985 . Autocorrelation in applied behavior analysis: A myth . Behavioral Analysis , 7 : 107 – 110 .
   Google Scholar
• Huitema , BE . 2004 . Analysis of interrupted time-series experiments using ITSE: A critique. Understanding statistics , 3 : 27 – 46 .
   Google Scholar
• Huitema , BE and McKean , JW . 1998 . Irrelevant autocorrelation in least-squares intervention models . Psychological Methods , 3 : 104 – 116 .
   Web of Science ®Google Scholar
• Huitema , BE and McKean , JW . 2000 . Design specification issues in time-series intervention models . Educational and Psychological Measurement , 60 : 38 – 58 .
   Web of Science ®Google Scholar
• Hunter , JE and Schmidt , FL . 1990 . Methods of meta-analysis: Correcting error and bias in research findings , Newbury Park, CA : Sage Publications .
   Google Scholar
• Jones , RR , Weinrott , M and Vaught , RS . 1978 . Effects of serial dependency on the agreement between visual and statistical inference . Journal of Applied Behavior Analysis , 11 : 277 – 283 .
   PubMed Web of Science ®Google Scholar
• *Kahng , S , Iwata , BA and Lewin , AB . 2002 . Behavioral treatment of self-injury, 1964 to 2000 . American Journal on Mental Retardation , 107 : 212 – 221 .
   PubMedGoogle Scholar
• Kavale , KA , Mathur , SR , Forness , SR , Quinn , MM and Rutherford , RB . 2000 . Right reason in the integration of group and single-subject research in behavioral disorders . Behavioral Disorders , 25 : 142 – 157 .
   Web of Science ®Google Scholar
• Kazdin , AE . 1982 . Single-case research designs: Methods for clinical and applied settings , New York, NY : Oxford University Press .
   Google Scholar
• Lundervold , D and Bourland , G . 1988 . Quantitative analysis of treatment of aggression, self-injury, and property destruction . Behavior Modification , 12 : 590 – 617 .
   PubMed Web of Science ®Google Scholar
• Ma , H . 2006 . An alternative method for quantifying synthesis of single-subject research: Percent of data points exceeding the median . Behavior Modification , 30 : 598 – 617 .
   PubMed Web of Science ®Google Scholar
• *Marquis , JG , Horner , RH , Carr , EG , Turnbull , AP , Thompson , M Behrens , GA . 2000 . “ A meta-analysis of positive behavior support ” . In Contemporary special education research: Syntheses of the knowledge base on critical instructional issues , Edited by: Gersten , RM , Schiller , EP and Vaughn , S . 137 – 178 . Mahway, NJ : Erlbaum .
   Google Scholar
• *Mastropieri , MA and Scruggs , TE . 1985–86 . Early intervention for socially withdrawn children . Journal of Special Education , 19 : 429 – 441 .
   Google Scholar
• *Mathur , SR , Kavale , KA , Quinn , MM , Forness , SR and Rutherford , RB . 1998 . Social skills interventions with students with emotional and behavioral problems: A quantitative synthesis of single-subject research . Behavioral Disorders , 23 : 193 – 201 .
   Google Scholar
• *Maughan , DR , Christiansen , E and Jenson , WR . 2005 . Behavioral parent training as a treatment for externalizing behaviors and disruptive behavior disorders: A meta-analysis . School Psychology Review , 34 : 267 – 286 .
   Google Scholar
• Morris , SB and DeShon , RP . 2002 . Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs . Psychological Methods , 7 : 105 – 125 .
   PubMed Web of Science ®Google Scholar
• Nourbakhsh , MR and Ottenbacher , KJ . 1994 . The statistical analysis of single-subject data: A comparative examination . Physical Therapy , 74 : 768 – 776 .
   PubMed Web of Science ®Google Scholar
• Pankratz , A . 1983 . Forecasting with univariate Box–Jenkins models: Concepts and cases , New York : Wiley .
   Google Scholar
• Parker , RI and Hagan-Burke , S . 2007 . Single-case research results as clinical outcomes . Journal of School Psychology , 45 : 637 – 653 .
   Web of Science ®Google Scholar
• Parker , RI , Hagan-Burke , S and Vannest , K . 2007 . Percentage of all non-overlapping data (PAND): An alternative to PND . Journal of Special Education , 40 : 194 – 204 .
   Web of Science ®Google Scholar
• Parsonson , BS and Baer , DM . 1992 . “ The visual analysis of data, and current research into the stimuli controlling it ” . In Single-case research design and analysis: new directions for psychology and education , Edited by: Kratochwill , TR and Levin , JR . 15 – 40 . Hillsdale, NJ : Erlbaum .
   Google Scholar
• Riviello , C and Beretvas , SN . 2008 . “ Detecting lag-one autocorrelation in interrupted time series designs with small sample sizes ” . In Manuscript submitted for publication
   Google Scholar
• *Schlosser , RW and Lee , DL . 2000 . Promoting generalization and maintenance in augmentative and alternative communication: A meta-analysis of 20 years of effectiveness research . Augmentative and Alternative Communication , 16 : 208 – 226 .
   Google Scholar
• Schlosser , RW , Lee , D and Wendt , O . in press . “ The percentage of non-overlapping data (PND): A systematic review of reporting characteristics in systematic reviews and meta-analyses ” . In Evidence-Based Communication Assessment and Intervention
   Google Scholar
• *Scholz , OB and Ott , R . 2000 . Effect and course of tape-based hypnotherapy in subjects suffering from insomnia . Australian Journal of Clinical Hypnotherapy and Hypnosis , 21 : 96 – 114 .
   Google Scholar
• *Scotti , JR , Evans , IM , Meyer , LH and Walker , P . 1991 . A meta-analysis of intervention research with problem behavior: Treatment validity and standards of practice . American Journal on Mental Retardation , 96 : 233 – 256 .
   PubMedGoogle Scholar
• Scruggs , TE , Mastropieri , MA and Casto , G . 1987 . The quantitative synthesis of single-subject research: Methodology and validation . Remedial and Special Education , 8 : 24 – 33 .
   Web of Science ®Google Scholar
• *Scruggs , TE , Mastropieri , MA , Cook , SB and Escobar , C . 1986 . Early intervention for children with conduct disorders: A quantitative synthesis of single-subject research . Behavioral Disorders , 11 : 260 – 71 .
   Google Scholar
• *Scruggs , TE , Mastropieri , MA , Forness , SR and Kavale , KA . 1988 . Early language intervention: A quantitative synthesis of single-subject research . Journal of Special Education , 22 : 259 – 83 .
   Google Scholar
• *Scruggs , TE , Mastropieri , MA and McEwen , I . 1988 . Early intervention for developmental functioning: A quantitative synthesis of single-subject research . Journal of the Division for Early Childhood , 12 : 359 – 67 .
   Google Scholar
• Shadish , WR and Rindskopf , DM . 2007 . “ Methods for evidence-based practice: Quantitative synthesis of single-subject designs ” . In Informing federal policies on evaluation method: Building the evidence base for method choice in government sponsored evaluation , Edited by: Julnes , G and Rog , DJ . 95 – 109 . San Francisco : Jossey–Bass .
   Google Scholar
• *Shogren , KA , Faggella-Luby , MN , Bae , SJ and Wehmeyer , ML . 2004 . The effect of choice-making as an intervention for problem behavior: A meta-analysis . Journal of Positive Behavior Interventions , 6 : 228 – 237 .
   Google Scholar
• *Skiba , RJ , Casey , A and Center , BA . 1985–86 . Nonaversive procedures in the treatment of classroom behavior problems . Journal of Special Education , 19 : 459 – 481 .
   Google Scholar
• *Swanson , HL and Sachse-Lee , C . 2000 . A meta-analysis of single-subject-design intervention research for students with LD . Journal of Learning Disabilities , 33 : 114 – 136 .
   PubMedGoogle Scholar
• *Swanson , HL , O'Shaughnessy , TE and McMahon , CM . 1998 . A selective synthesis of single subject design intervention research on students with learning disabilities . Advances in Learning and Behavioral Disabilities , 12 : 79 – 126 .
   Google Scholar
• Tryon , WW . 1982 . A simplified time-series analysis for evaluating treatment interventions . Journal of Applied Behavior Analysis , 15 : 423 – 429 .
   PubMed Web of Science ®Google Scholar
• van den Noortgate , W and Onghena , P . 2003 . Hierarchical linear models for the quantitative integration of effect sizes in single-case research . Behavior Research Methods, Instruments & Computers , 35 : 1 – 10 .
   PubMedGoogle Scholar
• van den Noortgate , W and & Onghena , P . in press . A multi-level analysis of single-subject studies . Evidence-Based Communication Assessment and Intervention ,
   Google Scholar
• Wendt , O . May 2008 . “ Computation of non-regression-based effect size metrics ” . In Paper presented at the 8th Annual International Campbell Collaboration Colloquium in Vancouver May , Canada
   Google Scholar
• White , OR , Rusch , FR , Kazdin , AE and Hartmann , DP . 1989 . Applications of meta-analysis in individual subject research . Behavioral Assessment , 11 : 281 – 296 .
   Google Scholar
• Wurthmann , C , Klieser , E , Lehmann , E and Krauth , J . 1996 . Single-subject experiments to determine individually differential effects of anxiolytics in generalized anxiety disorder . Neuropsychobiology , 33 : 196 – 201 .
   PubMedGoogle Scholar
• Xin , YP , Grasso , E , Dipipi-Hoy , CM and Jitendra , A . 2005 . The effects of purchasing skill instruction for individuals with developmental disabilities: A meta-analysis . Exceptional Children , 71 : 379 – 400 .
   Web of Science ®Google Scholar