Selecting the proper Tau-U measure for single-case experimental designs: Development and application of a decision flowchart

References

• Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy, 31(6), 621–631. https://doi.org/10.1016/0005-7967(93)90115-B
   PubMed Web of Science ®Google Scholar
• Brossart, D. F., Laird, V. C., & Armstrong, T. W. (2018). Interpreting Kendall’s Tau and Tau for single-case experimental designs. Cogent Psychology, 5, 1–26. https://doi.org/10.1080/23311908.2018.1518687
   Web of Science ®Google Scholar
• Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30(5), 531–563. https://doi.org/10.1177/0145445503261167
   PubMed Web of Science ®Google Scholar
• Brossart, D. F., Vannest, K. J., Davis, J. L., & Patience, M. A. (2014). Incorporating nonoverlap indices with visual analysis for quantifying intervention effectiveness in single-case experimental designs. Neurological Rehabilitation, 24(3–4), 464–491. https://doi.org/10.1080/09602011.2013.868361org/10.1080/09602011.2013.868361
   PubMed Web of Science ®Google Scholar
• Cakiroglu, O. (2012). Single subject research: Applications to special education. British Journal of Special Education, 39(1), 21–29. https://doi.org/10.1111/j.1467-8578.2012.00530.x
   Google Scholar
• Declercq, L., Jamshidi, L., Fernández-Castilla, B., Beretvas, S., Moeyaert, M., Ferron, J., & Van Den Noortgate, W. (2019). Analysis of single-case experimental count data using the linear mixed effects model: A simulation study. Behavior Research Methods, 51(6), 2477–2497. https://doi.org/10.3758/s13428-018-1091-y
   PubMed Web of Science ®Google Scholar
• Every Student Succeeds Act. (2015), Pub. L. No.114-95, §4014, 129 Stat. 1802
   Google Scholar
• Ferron, J., Goldstein, H., Olszewski, A., & Rohrer, L. (2020). Indexing effects in single-case experimental designs by estimating the percent of goal obtained. Evidence-Based Communication Assessment and Intervention, 14(1), 6–27. https://doi.org/10.1080/17489539.2020.1732024
   Google Scholar
• Fingerhut, J., Marbou, K., & Moeyaert, M. (2020). Single-Case Quantification Technique Ranking Tool (Version 1.2) [Microsoft Excel® tool]. doi:
   Google Scholar
• Fingerhut, J., Moeyaert, M., & Manolov, R. (2020). Literature review of single-case quantitative analysis techniques. https://doi.org/10.31234/osf.io/7yt4g
   Google Scholar
• Fingerhut, J., Xu, X., & Moeyaert, M. (2021). Impact of within-case variability on Tau-U and regression-based effect size measures for single-case experimental data. Evidence-Based Communication and Intervention.
   Google Scholar
• Gage, N. A., Grasley-Boy, N. M., & MacSuga-Gage, A. S. (2018). Professional development to increase teacher behavior-specific praise: A single-case design replication. Psychology in the Schools, 55(3), 264–277. https://doi.org/10.1002/pits.22106
   Web of Science ®Google Scholar
• Ganz, J., & Ayres, K. (2018). Methodological standards in single-case experimental design: Raising the bar. Research in Developmental Disabilities, 79, 3–9. https://doi.org/10.1016/j.ridd.2018.03.003
   PubMed Web of Science ®Google Scholar
• Giannakakos, A. R., & Lanovaz, M. J. (2019). Using AB designs with nonoverlap effect size measures to support clinical decision-making: A Monte Carlo validation. Behavior Modification. Advance online publication. 1–16. https://doi.org/10.1177/0145445519860219
   Google Scholar
• Horner, R. H., Swaminathan, H., Sugai, G., & Smolkowski, K. (2012). Considerations for the systematic analysis and use of single case research. Education and Treatment of Children, 35(2), 269–290. https://doi.org/10.1353/etc.2012.0011
   Web of Science ®Google Scholar
• Jaksic, H., Vause, T., Frijters, J. C., & Feldman, M. (2018). A comparison of a novel application of hierarchical linear modeling and nonparametric analysis for single-subject designs. Behavior Analysis: Research and Practice, 18(2), 203–218. https://doi.org/10.1037/bar0000091
   Google Scholar
• Lane, J. D., & Gast, D. L. (2014). Visual analysis in single case experimental design studies: Brief review and guidelines. Neuropsychological Rehabilitation, 24(3–4), 445–463. https://doi.org/10.1080/09602011.2013.815636
   PubMed Web of Science ®Google Scholar
• Lenz, A. (2013). Calculating effect size in single-case research: A comparison of nonoverlap methods. Measurement and Evaluation in Counseling and Development, 46(1), 64–73. https://doi.org/10.1177/0748175612456401
   Web of Science ®Google Scholar
• Ma, H. (2006). An alternative method for quantitative synthesis of single-subject research: Percentage of data points exceeding the median. Behavior Modification, 30(5), 598–617. https://doi.org/10.1177/0145445504272974
   PubMed Web of Science ®Google Scholar
• Manolov, R. (2014). SD_band.R [R Syntax] https://dl.dropboxusercontent.com/s/elhy454ldf8pij6/SD_band.R
   Google Scholar
• Manolov, R., & Moeyaert, M. (2017). Recommendations for choosing single-case data analytical techniques. Behavior Therapy, 48(1), 97–114. https://doi.org/10.1016/j.beth.2016.04.008
   PubMed Web of Science ®Google Scholar
• Manolov, R., Moeyaert, M., & Fingerhut, J. (2021). A priori metric justification in single-case experimental designs research. Perspectives on Behavior Science. https://doi.org/10.1007/s40614-021-00282-2
   Google Scholar
• Manolov, R., & Solanas, A. (2013). A comparison of mean phase difference and generalized least squares for analyzing single-case data. Journal of School Psychology, 51(2), 201–215. https://doi.org/10.1016/j.jsp.2012.12.005
   PubMed Web of Science ®Google Scholar
• McClain, M. B., Otero, T. L., Haut, J., & Schatz, R. B. (2014). Single subject design in educational research: The use of effect size measures in analysis and interpretation. In SAGE Research Methods Cases. SAGE Publishing. https://doi.org/10.4135/978144627305014534173
   Google Scholar
• McKinney, T., & Vasquez, E., III. (2014). There’s a bug in your ear!: Using technology to increase the accuracy of DTT implementation. Education and Training in Autism and Developmental Disabilities, 49(4), 594–601. https://www.jstor.org/stable/24582354
   Web of Science ®Google Scholar
• Moeyaert, M., Ferron, J. M., Beretvas, S. N., & Van Den Noortgate, W. (2014). From a single-level analysis to a multilevel analysis of single-case experimental designs. Journal of School Psychology, 52(2), 191–211. https://doi.org/10.1016/j.jsp.2013.11.003
   PubMed Web of Science ®Google Scholar
• Ninci, J., Vannest, K. J., Wilson, V., & Zhang, N. (2015). Interrater agreement between visual analysis of single-case data: A meta-analysis. Behavior Modification, 39(4), 510–541. https://doi.org/10.1177/0145445515581327
   PubMed Web of Science ®Google Scholar
• Parker, R., Hagan-Burke, S., & Vannest, K. (2007). Percentage of All Non-Overlapping Data (PAND): An alternative to PND. Journal of Special Education, 40(4), 194–204. https://doi.org/10.1177/00224669070400040101
   Web of Science ®Google Scholar
• Parker, R., & Vannest, K. J. (2009). An improved effect size for single case research: Nonoverlap of all pairs (NAP). Behavior Therapy, 40(4), 357–367. https://doi.org/10.1016/j.beth.2008.10.006
   PubMed Web of Science ®Google Scholar
• Parker, R., Vannest, K. J., & Brown, L. (2009). The improvement rate difference for single-case research. Exceptional Children, 75(2), 135–150. https://doi.org/10.1177/001440290907500201
   Web of Science ®Google Scholar
• Parker, R., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau. Behavior Therapy, 42(2), 284–299. https://doi.org/10.1016/j.beth.2010.08.006
   PubMed Web of Science ®Google Scholar
• Pustejovsky, J. E. (2019). Procedural sensitivities of effect sizes for single-case designs with directly observed behavioral outcome measures. Psychological Methods, 24(2), 217–235. https://doi.org/10.1037/met0000179
   PubMed Web of Science ®Google Scholar
• Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014). Design-comparable effect sizes in multiple-baseline designs: A general modeling framework. Journal of Educational and Behavioral Statistics, 39(5), 368–393. https://doi.org/10.3102/1076998614547577
   Web of Science ®Google Scholar
• Rakap, S. (2015). Effect sizes as result interpretation aids in single-subject experimental research: Description and application of four nonoverlap methods. British Journal of Special Education, 42(1), 11–33. https://doi.org/10.1111/1467-8578.12091
   Web of Science ®Google Scholar
• Rohatgi, A. (2016). Webplotdigitizer ver.3.10. http://arohatgi.info/WebPlotDigitizer
   Google Scholar
• Schlosser, R. W. (2009). The role of single-subject experimental designs in EBP times. Focus: Technical Brief, 22, 1–8. https://ktdrr.org/ktlibrary/articles_pubs/ncddrwork/focus/focus22/
   Google Scholar
• Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single subject research: Methodology and validation. Remedial and Special Education, 8(2), 24–33. https://doi.org/10.1177/074193258700800206
   Web of Science ®Google Scholar
• Shadish, W. R. (2014). Statistical analyses of single-case designs: The shape of things to come. Current Directions in Psychological Science, 23(2), 139–146. https://doi.org/10.1177/0963721414524773
   Web of Science ®Google Scholar
• Shadish, W. R., Hedges, L. V., Pustejovsky, J. E., Rindskopf, D. M., Boyajian, J. G., & Sullivan, K. J. (2014). Analyzing single-case designs: D, G, hierarchical models, Bayesian estimators, generalized additive models, and the hopes and fears of researchers about analyses. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 247–281). American Psychological Association.
   Google Scholar
• Solomon, B. G., Howard, T. K., & Stein, B. L. (2015). Critical assumptions and distribution features pertaining to contemporary single-case effect sizes. Journal of Behavioral Education, 24(4), 438–458. https://doi.org/10.1007/s10864-015-9221-4
   Web of Science ®Google Scholar
• Swaminathan, H., Rogers, J. J., & Horner, R. H. (2014). An effect size measure and Bayesian analysis of single-case designs. Journal of School Psychology, 52(2), 213–230.
   PubMed Web of Science ®Google Scholar
• Tarlow, K. R. (2016). Baseline corrected Tau calculator. Retrieved June 16, 2021, from https://www.ktarlow.com/stats/tau
   Google Scholar
• Tarlow, K. R. (2017). An improved rank correlation effect size statistic for single-case designs: Baseline corrected Tau. Behavior Modification, 41(4), 427–467. https://doi.org/10.1177/0145445516676750
   PubMed Web of Science ®Google Scholar
• Van Den Noortgate, W., & Onghena, P. (2003a). Hierarchical linear models for the quantitative integration of effect sizes in single case research. Behavior Research Methods, Instruments & Computers, 35(1), 1–10. https://doi.org/10.3758/BF03195492
   PubMedGoogle Scholar
• Van Den Noortgate, W., & Onghena, P. (2003b). Multilevel meta-analysis: A comparison with traditional meta-analytical procedures. Educational and Psychological Measurement, 63(5), 765–790. https://doi.org/10.1177/0013164403251027
   Web of Science ®Google Scholar
• Vannest, K. J., & Ninci, J. (2015). Evaluating intervention effects in single-case research designs. Journal of Counseling and Development, 93(4), 403–411. https://doi.org/10.1002/jcad.12038
   Web of Science ®Google Scholar
• Vannest, K. J., Parker, R. I., Gonen, O., & Adiguzel, T. (2016). Single case research: Web based calculators for SCR analysis. (Version 2.0) [Web-based application]. Texas A&M University. http://www.singlecaseresearch.org
   Google Scholar
• Vannest, K. J., Peltier, C., & Haas, A. (2018). Results reporting in single case experiments and single case meta-analysis. Research in Developmental Disabilities, 79, 10–18. https://doi.org/10.1016/j.ridd.2018.04.029
   PubMed Web of Science ®Google Scholar
• Vannest, K. J., & Sallese, M. R. (2021). Benchmarking effect sizes in single-case experimental designs. Evidence-based Communication Assessment and Intervention.
   Google Scholar
• What Works Clearinghouse. (2020). What works clearinghouse standards handbook, version 4.1. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee/wwc/handbooks
   Google Scholar
• White, O. R., & Haring, N. G. (1980). Exceptional teaching: A multimedia training package. Merrill.
   Google Scholar
• Wolery, M., Busick, M., Reichow, B., & Barton, E. E. (2010). Comparison of overlap methods for quantitatively synthesizing single-subject data. Journal of Special Education, 44(1), 18–29. https://doi.org/10.1177/0022466908328009
   Web of Science ®Google Scholar
• Wolfe, K., Seaman, M. A., & Drasgow, E. (2016). Interrater agreement of the visual analysis of individual tiers and functional relations in multiple baseline designs. Behavior Modification, 40(6), 852–873. https://doi.org/10.1177/0145445516644699
   PubMed Web of Science ®Google Scholar