Using linear mixed effects models: A single-case experimental design meta-analysis of functional communication training

References

• Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Second International Symposium on Information Theory (pp. 267–281). Budapest: Akademiai Kiado.
   Google Scholar
• Arizona Software. (2008). GraphClick (Version 3.0) [Computer software]. Neuchatel: Author. Retrieved from http://www.arizona-software.ch
   Google Scholar
• Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59, 390–412. doi:10.1016/j.jml.2007.12.005
   Web of Science ®Google Scholar
• Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1–48. doi:10.18637/jss.v067.i01
   Web of Science ®Google Scholar
• *Bloom, S., Lambert, J., Dayton, E., & Samaha, A. (2013). Teacher-conducted trial-based functional analyses as the basis for intervention. Journal of Applied Behavior Analysis, 46, 208–218. doi:10.1002/jaba.21
   PubMed Web of Science ®Google Scholar
• Boyle, M. A., Samaha, A. L., Rodewald, A. M., & Hoffmann, A. N. (2013). Evaluation of the reliability and validity of GraphClick as a data extraction program. Computers in Human Behavior, 29, 1023–1027. doi:10.1016/j.chb.2012.07.031
   Web of Science ®Google Scholar
• Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531–563. doi:10.1177/0145445503261167
   PubMed Web of Science ®Google Scholar
• *Byiers, B. J., Dimian, A., & Symons, F. J. (2014). Functional communication training in rett syndrome: A preliminary study. American Journal on Intellectual and Developmental Disabilities, 119, 340–350. doi:10.1352/1944-7558-119.4.340
   PubMedGoogle Scholar
• Carr, E. G., & Durand, V. (1985). Reducing behavior problems through functional communication training. Journal of Applied Behavior Analysis, 18, 111–126.10.1901/jaba.1985.18-111
   PubMed Web of Science ®Google Scholar
• Chezan, L. C., Wolfe, K., & Drasgow, E. (2017). A meta-analysis of functional communication training on problem behavior and alternative communicative responses. Focus on Autism and Other Developmental Disabilities. doi:10.1177/1088357617741294
   Google Scholar
• Chiu, M. M., & Roberts, C. A. (2016). Improved analyses of single cases: Dynamic multilevel analysis. Developmental Neurorehabilitation, 332, 1–13. doi:10.3109/17518423.2015.1119904
   Google Scholar
• Cox, D. R., & Hinkley, D. V. (1974). Theoretical statistics. London: Chapman & Hall.10.1007/978-1-4899-2887-0
   Google Scholar
• Denis, J., Van den Noortgate, W., & Maes, B. (2011). Self-injurious behavior in people with profound intellectual disabilities: A meta-analysis of single-case studies. Research in Developmental Disabilities, 32, 911–923. doi:10.1016/j.ridd.2011.01.014
   PubMed Web of Science ®Google Scholar
• Dunst, C. J., & Hamby, D. W. (2012). Guide for calculating and interpreting effect sizes and confidence intervals in intellectual and developmental disability research studies. Journal of Intellectual and Developmental Disability, 37, 89–99. doi:10.3109/13668250.2012.673575
   PubMed Web of Science ®Google Scholar
• Eager, C., & Roy, J. (2017). Mixed effects models are sometimes terrible. arXiv:1701.04858 [stat]. arXiv: 1701.04858.
   Google Scholar
• *Falcomata, T. S., Wacker, D. P., Ringdahl, J. E., Vinquist, K., & Dutt, A. (2013). An evaluation of generalization of mands during functional communication training. Journal of Applied Behavior Analysis, 46, 444–454. doi:10.1002/jaba.37
   PubMed Web of Science ®Google Scholar
• Faraway, J. J. (2006). Extending linear models with R. Boca Raton, FL: Chapman & Hall.
   Google Scholar
• *Fisher, W. W., & Thompson, R. H. (2000). Facilitating tolerance of delayed reinforcement during functional communication training. Behavior Modification, 24, 3–29. doi:10.1177/0145445500241001
   PubMed Web of Science ®Google Scholar
• Gage, N. A., & Lewis, T. J. (2014). Hierarchical linear modeling meta-analysis of single-subject design research. The Journal of Special Education, 48, 3–16. doi:10.1177/0022466912443894
   Web of Science ®Google Scholar
• Gast, D. L. (Ed.). (2010). Single-subject research methodology in behavioral sciences. New York, NY: Routledge.
   Google Scholar
• *Hammond, J. L., & Hall, S. S. (2011). Functional analysis and treatment of aggressive behavior following resection of a craniopharyngioma. Developmental Medicine & Child Neurology, 53, 369–374. doi:10.1111/j.1469-8749.2010.03887.x
   PubMed Web of Science ®Google Scholar
• Heath, A. K., Ganz, J. B., Parker, R., Burke, M., & Ninci, J. (2015). A meta-analytic review of functional communication training across mode of communication, age, and disability. Review Journal of Autism and Developmental Disorders, 2, 155–166. doi:10.1007/s40489-014-0044-3
   Web of Science ®Google Scholar
• Hedges, L. V. (2008). What are effect sizes and why do we need them? Child Development Perspectives, 2, 167–171. doi:10.1111/j.1750-8606.2008.00060.x
   Web of Science ®Google Scholar
• Heyvaert, M., Saenen, L., Maes, B., & Onghena, P. (2015). Comparing the percentage of non-overlapping data approach and the hierarchical linear modeling approach for synthesizing single-case studies in autism research. Research in Autism Spectrum Disorders, 11, 112–125. doi:10.1016/j.rasd.2014.12.002
   Web of Science ®Google Scholar
• Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71, 165–179. doi:10.1177/001440290507100203
   Web of Science ®Google Scholar
• *Kahng, S. W., Iwata, B. A., DeLeon, I. G., & Worsdell, A. S. (1997). Evaluation of the ‘control over reinforcement’ component in functional communication training. Journal of Applied Behavior Analysis, 30, 267–277. doi:10.1901/jaba.1997.30-267
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.) New York, NY: Oxford University Press.
   Google Scholar
• *Kelley, M. E., Lerman, D. C., & Van Camp, C. M. (2002). The effects of competing reinforcement schedules on the acquisition of functional communication. Journal of Applied Behavior Analysis, 35, 59–63. doi:10.1901/jaba.2002.35-59
   PubMed Web of Science ®Google Scholar
• Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). Single-case technical documentation. Retrieved from https://ies.ed.gov/ncee/wwc/Docs/ReferenceResources/wwc_scd.pdf
   Google Scholar
• *Kuhn, D. E., Chirighin, A. E., & Zelenka, K. (2010). Discriminated functional communication: A procedural extension of functional communication training. Journal of Applied Behavior Analysis, 43, 249–264. doi:10.1901/jaba.2010.43-249
   PubMed Web of Science ®Google Scholar
• *Lambert, J. M., Bloom, S. E., & Irvin, J. (2012). Trial-based functional analysis and functional communication training in an early childhood setting. Journal of Applied Behavior Analysis, 45, 579–584. doi:10.1901/jaba.2012.45-579
   PubMed Web of Science ®Google Scholar
• *Lehardy, R. K., Lerman, D. C., Evans, L. M., O’Connor, A., & LeSage, D. L. (2013). A simplified methodology for identifying the function of elopement. Journal of Applied Behavior Analysis, 46, 256–270. doi:10.1002/jaba.22
   PubMed Web of Science ®Google Scholar
• Lobo, M. A., Moeyaert, M., Baraldi Cunha, A., & Babik, I. (2017). Single-case design, analysis, and quality assessment for intervention research. Journal of Neurologic Physical Therapy, 41, 187–197. doi:10.1097/NPT.0000000000000187
   PubMed Web of Science ®Google Scholar
• Maggin, D. M., & Chafouleas, S. M. (2013). Introduction to the special series. Remedial and Special Education, 34, 3–8. doi:10.1177/0741932512466269
   Web of Science ®Google Scholar
• Maggin, D. M., Swaminathan, H., Rogers, H. J., O'Keeffe, B. V., Sugai, G., & Horner, R. H. (2011). A generalized least squares regression approach for computing effect sizes in single-case research: Application examples. Journal of School Psychology, 49, 301–321. doi:10.1016/j.jsp.2011.03.004
   PubMed Web of Science ®Google Scholar
• Mastropieri, M. A., & Scruggs, T. E. (1985). Early intervention for socially withdrawn children. The Journal of Special Education, 19, 429–441. doi:10.1177/002246698501900407
   Web of Science ®Google Scholar
• McNeish, D. M., & Stapleton, L. M. (2014). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28, 295–314. doi: 10.1007/s10648-014-9287-x
   Web of Science ®Google Scholar
• *Mildon, R. L., Moore, D. W., & Dixon, R. S. (2004). Combining noncontingent escape and functional communication training as a treatment for negatively-reinforced disruptive behavior. Journal of Positive Behavior Interventions, 6, 92–102. doi:10.1177/10983007040060020401
   Web of Science ®Google Scholar
• Moeyaert, M., Ugille, M., Ferron, J. M., Beretvas, S. N., & Van den Noortgate, W. (2013). Three-level analysis of single-case experimental data: Empirical validation. The Journal of Experimental Education, 82, 1–21. doi:10.1080/00220973.2012.745470
   Web of Science ®Google Scholar
• Moeyaert, M., Ugille, M., Ferron, J. M., Onghena, P., Heyvaert, M., & Beretvas, S. N. (2015). Estimating intervention effects across different types of single-subject experimental designs: Empirical illustration. School Psychology Quarterly, 30, 50–63. doi:10.1037/spq0000068
   PubMed Web of Science ®Google Scholar
• Parker, R. I., & Brossart, D. F. (2003). Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189–211. doi:10.1016/S0005-7894(03)80013-8
   Web of Science ®Google Scholar
• Parker, R. I., Hagan-Burke, S., & Vannest, K. (2007). Percentage of all non-overlapping data (PAND). The Journal of Special Education, 40, 194–204. doi:10.1177/00224669070400040101
   Web of Science ®Google Scholar
• Parker, R. I., & Vannest, K. J. (2012). Bottom-up analysis of single-case research designs. Journal of Behavioral Education, 21, 254–265. doi:10.1007/s10864-012-9153-1
   Google Scholar
• Parker, R. I., Vannest, K., & Brown, K. J. (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40, 357–367. doi:10.1016/j.beth.2008.10.006
   PubMed Web of Science ®Google Scholar
• Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284–299. doi: 10.1016/j.beth.2010.08.00610.1016/j.beth.2010.08.006
   PubMed Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
   Google Scholar
• R.Core Team (2017). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. https://www.R-project.org/
   Google Scholar
• Richman, D. M., Barnard-Brak, L., Grubb, L., Bosch, A., & Abby, L. (2015). Meta-analysis of noncontingent reinforcement effects on problem behavior. Journal of Applied Behavior Analysis, 48, 131–152. doi:10.1002/jaba.189
   PubMed Web of Science ®Google Scholar
• Rindskopf, D. (2014). Bayesian analysis of data from single case designs. Neuropsychological Rehabilitation, 24, 572–589. doi:10.1080/09602011.2013.866903
   PubMed Web of Science ®Google Scholar
• Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. doi:10.1214/aos/1176344136
   Web of Science ®Google Scholar
• Shadish, W. R., Hedges, L. V., Horner, R. H., & Odom, S. L. (2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research (NCER 2015-002). Washington, DC: National Center for Education Research, Institute of Education Sciences, U. S. Department of Education. Retrieved from http://ies.ed.gov/
   Google Scholar
• Slavin, R. E. (1986). Best-evidence synthesis: An alternative to meta-analytic and traditional reviews. Educational Researcher, 15, 5–11. doi:10.3102/0013189X015009005
   Google Scholar
• Swaminathan, H., Rogers, H. J., & Horner, R. H. (2014). An effect size measure and Bayesian analysis of single-case designs. Journal of School Psychology, 52, 105–122. doi:10.1016/j.jsp.2013.12.002
   Web of Science ®Google Scholar
• Van den Noortgate, W., & Onghena, P. (2003). Combining single-case experimental data using hierarchical linear models. School Psychology Quarterly, 18, 325–346. doi:10.1521/scpq.18.3.325.22577
   Web of Science ®Google Scholar
• Van den Noortgate, W., & Onghena, P. (2008). A multilevel meta-analysis of single-subject experimental design studies. Evidence Based Communication Assessment and Intervention, 2, 142–151.10.1080/17489530802505362
   Google Scholar
• *Volkert, V. M., Lerman, D. C., Call, N. A., & Trosclair-Lasserre, N. (2009). An evaluation of resurgence during treatment with functional communication training. Journal of Applied Behavior Analysis, 42, 145–160. doi:10.1901/jaba.2009.42-145
   PubMed Web of Science ®Google Scholar