21,065
Views
83
CrossRef citations to date
0
Altmetric
Research Article

Interpreting Kendall’s Tau and Tau-U for single-case experimental designs

ORCID Icon, & | (Reviewing editor)
Article: 1518687 | Received 21 Aug 2017, Accepted 06 Aug 2018, Published online: 21 Oct 2018

References

  • Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behaviour Research and Therapy, 31, 621–631.
  • Atkins, D. C., Bedics, J. D., McGlinchey, J. B., & Beauchaine, T. P. (2005). Assessing clinical significance: Does it matter which method we use? Journal of Consulting and Clinical Psychology, 73, 982–989. doi:10.1037/0022-006X.73.5.982
  • Baer, D. M. (1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167–172.
  • Barlow, D. H., & Hersen, M. (Eds.). (1984). Single case experimental designs: Strategies for studying behavior change (2nd ed.). Oxford, England: Pergamon Press.
  • Barnett, S. D., Heinemann, A. W., Libin, A., Houts, A. C., Gassaway, J., Sen-Gupta, S., … Brossart, D. F. (2012). Small N designs for rehabilitation research. Journal of Rehabilitation Research & Development, 49, 175–186. doi:10.1682/JRRD.2010.12.0242
  • Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D., & O’Neil, P. (2008). Clinical practice as natural laboratory for psychotherapy research: A guide to case-based time-series analysis. American Psychologist, 63(2), 77–95. doi: 10.1901/jaba.1974.7-647
  • Brossart, D. F., Meythaler, J. M., Parker, R. I., McNamara, J., & Elliott, T. R. (2008). Advanced regression methods for single-case designs: Studying propranolol in the treatment for agitation associated with traumatic brain injury. Rehabilitation Psychology, 53, 357–369. doi: 10.1037/a0012973
  • Brossart, D. F., Parker, R. I., & Castillo, L. G. (2011). Robust regression for single-case data analysis: How can it help? Behavior Research Methods, 43, 710–719. doi: 10.3758/s13428-011-0079-7
  • Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531–563. doi: 10.1177/0145445503261167
  • Brossart, D. F., Vannest, K. J., Davis, J. L., & Patience, M. A. (2014). Incorporating nonoverlap indices with visual analysis for quantifying intervention effectiveness in single-case experimental designs. Neuropsychological Rehabilitation, 24, 464–491. doi: 10.1080/09602011.2013.868361
  • Byiers, B. J., Reichle, J., & Symons, F. J. (2012). Single-subject experimental design for evidence-based practice. American Journal of Speech-Language Pathology, 21, 397–414. doi:10.1044/1058-0360(2012/11-0036)
  • Campbell, J. M. (2004). Statistical comparison of four effect sizes for single-subject designs. Behavior Modification, 28, 234–246. doi:10.1177/0145445503259264
  • *Cole, K., & Vaughan, F. L. (2005). Brief cognitive behavioural therapy for depression associated with parkinson’s disease: A single case series. Behavioural and Cognitive Psychotherapy, 33, 89–102. doi:10.1017/S1352465804001791
  • *Cory, L., Dattilo, J., & Williams, R. (2006). Effects of a leisure education program on social knowledge and skills of youth with cognitive disabilities. Therapeutic Recreation Journal, 40(3), 144–164.
  • DeProspero, A., & Cohen, S. (1979). Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573–579.
  • Faith, M. S., Allison, D. B., & Gorman, B. S. (1996). Meta-analysis of single-case research. In R. D. Franklin, D. B. Allison, & B. S. Gorman (Eds.), Design and analysis of single-case research (pp. 245–277). Mahwah, NJ: Lawrence Erlbaum Associates.
  • Fisher, W. W., Kelley, M. E., & Lomas, J. E. (2003). Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs. Journal of Applied Behavior Analysis, 36, 406.
  • *Geremia, G. M. (1997). Cognitive therapy in the treatment of body dysmorphic disorder. (Unpublished Doctoral dissertation). Hofstra University, Hempstead, NY.
  • GetData Graph Digitizer. (2013). GetData graph digitizer (2.26). Retrieved from http://www.getdata-graph-digitizer.com.
  • Hagopian, L. P., Fisher, W. W., Thompson, R. H., & Owen-DeSchryver, J. (1997). Toward the development of structured criteria for interpretation of functional analysis data. Journal of Applied Behavior Analysis, 30, 313–326.
  • *Hamilton, R. A., Scott, D., & MacDougall, M. P. (2007). Assessing the effectiveness of self-talk interventions on endurance performance. Journal of Applied Sport Psychology, 19, 226–239. doi:10.1080/10413200701230613
  • Harbst, K. B., Ottenbacher, K. J., & Harris, S. R. (1991). Interrater reliability of therapists’ judgments of graphed data. Physical Therapy, 71, 107–115.
  • *Heard, K. (1997). A functional analysis of wandering behavior in geriatric patients with alzheimer’s disease. ( Unpublished Doctoral dissertation). Mississippi State University
  • *Hillis, A. E. (1998). Treatment of naming disorders: New issues regarding old therapies. Journal of the International Neuropsychological Society, 4, 648–660. doi:10.1017/S135561779846613X
  • *Hopper, T., & Holland, A. (1998). Situation-specific training for adults with aphasia: An example. Aphasiology, 12, 933–944. doi:10.1080/02687039808249461
  • Huitema, B. E. (1986). Autocorrelation in behavioral research: Wherefore art thou? In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances. New York: Plenum.
  • Huitema, B. E., & McKean, J. W. (2000). Design specification issues in time-series intervention models. Educational and Psychological Measurement, 60, 38–58. doi: 10.1177/00131640021970358
  • Huitema, B. E., McKean, J. W., & Laraway, S. (2007). Time-series intervention analysis using ITSACORR: Fatal flaws. Journal of Modern Applied Statistical Methods, 6, 367–379.
  • *Johnson, J. J., Hrycaiko, D. W., Johnson, G. V., & Halas, J. M. (2004). Self-talk and female youth soccer performance. Sport Psychologist, 18, 44–59.
  • *Jonsdottir, J., Cattaneo, D., Regola, A., Crippa, A., Recalcati, M., Rabuffetti, M., … Casiraghi, A. (2007). Concepts of motor learning applied to a rehabilitation protocol using biofeedback to improve gait in a chronic stroke patient: An A-B system study with multiple gait analyses. Neurorehabilitation and Neural Repair, 21, 190–194. doi:10.1177/1545968306290823
  • Kahng, S. W., Chung, K.-M., Gutshall, K., Pitts, S. C., Kao, J., & Girolami, K. (2010). Consistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 43, 35–45. doi:10.1901/jaba.2010.43-35
  • Kazdin, A. E. (1978). Methodological and interpretive problems of single-case experimental designs. Journal of Consulting & Clinical Psychology, 46(4), 629–642.
  • Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1/2), 81–93.
  • Kendall, M. G. (1976). Rank correlation methods (4th ed.). New York: NY: Hafner.
  • *Kevan, I. M., Gumley, A. I., & Coletta, V. (2007). Post-traumatic stress disorder in a person with a diagnosis of schizophrenia: Examining the efficacy of psychological intervention using single N methodology. Clinical Psychology & Psychotherapy, 14, 229–243. doi:10.1002/cpp.534
  • *Khawaja, N. G., & Oei, T. P. S. (1998). Catastrophic cognitions and the clinical outcome: Two case studies. Behavioural and Cognitive Psychotherapy, 26, 271–282. doi:10.1017/S1352465898000289
  • *Kinugasa, T., Cerin, E., & Hooper, S. (2004). Single-subject research designs and data analyses for assessing elite athletes’ conditioning. Sports Medicine, 34, 1035–1050. doi:10.2165/00007256-200434150-00003
  • *Koul, R., & Harding, R. (1998). Identification and production of graphic symbols by individuals with aphasia: Efficacy of a software application. Augmentative and Alternative Communication, 14, 11–24. doi:10.1080/07434619812331278166
  • Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2010). [10]. Single-case design technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdfwebsite
  • Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34, 26–38. doi:10.1177/0741932512452794
  • Krippendorff, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). Thousand Oaks, CA: Sage.
  • *Lerner, B. S., Ostrow, A. C., Yura, M. T., & Etzel, E. F. (1996). The effects of goal-setting and imagery training programs on the free-throw performance of female collegiate basketball players. Sport Psychologist, 10, 382–397.
  • *Lévesque, M., Savard, J., Simard, S., Gauthier, J. G., & Ivers, H. (2004). Efficacy of cognitive therapy for depression among women with metastatic cancer: A single-case experimental study. Journal of Behavior Therapy and Experimental Psychiatry, 35, 287–305. doi:10.1016/j.jbtep.2004.05.002
  • *Lewin, L. M., Cowan, M., Ganzini, L., Gonzales, L., & Rasmussen, J. (1997). Behavioral problem-solving, contracting, and feedback with nursing home residents. Journal of Clinical Geropsychology, 3, 245–255.
  • Ma, H. H. (2006). An alternative method for quantitative synthesis of single-subject research: Percentage of data points exceeding the median. Behavior Modification, 30, 598–617. doi: 10.1177/0145445504272974
  • Manolov, R., & Solanas, A. (2008). Comparing N=1 effect size indices in presence of autocorrelation. Behavior Modification, 32, 860–875. doi:10.1177/0145445508318866
  • *Matson, J. L., Sevin, J. A., Box, M. L., Francis, K. L., & Sevin, B. M. (1993). An evaluation of two methods for increasing self-initiated verbalizations in autistic children. Journal of Applied Behavior Analysis, 26, 389–398. doi:10.1901/jaba.1993.26-389
  • Matson, J. L., Turygin, N. C., Beighley, J., & Matson, M. L. (2012). Status of single-case research designs for evidence-based practice. Research in Autism Spectrum Disorders, 6, 931–938. doi:10.1016/j.rasd.2011.12.008
  • Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis of single-case time series: Effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341–351.
  • *McDonnell, A., Reeves, S., Johnson, A., & Lane, A. (1998). Managing challenging behaviour in an adult with learning disabilities: The use of low arousal approach. Behavioural and Cognitive Psychotherapy, 26, 163–171. doi:10.1017/S1352465898000174
  • *McKelvey, M. L., Dietz, A. R., Hux, K., Weissling, K., & Beukelman, D. R. (2007). Performance of a person with chronic aphasia using personal and contextual pictures in a visual scene display prototype. Journal of Medical Speech-Language Pathology, 15, 305–317.
  • *Nott, M. T., Chapparo, C., & Heard, R. (2008). Effective occupational therapy intervention with adults demonstrating agitation during post-traumatic amnesia. Brain Injury, 22, 669–683. doi:10.1080/02699050802227170
  • *Palmisano, B., & Arco, L. (2007). Changes in functional behaviour of adults with brain injury and spouse-caregiver burden with in-home neurobehavioural intervention. Behaviour Change, 24, 36–49. doi:10.1375/bech.24.1.36
  • Park, H., Marascuilo, L., & Gaylord-Ross, R. (1990). Visual inspection and statistical analysis of single-case designs. Journal of Experimental Education, 58, 311–320.
  • Parker, R. I., & Brossart, D. F. (2003). Evaluating single-case research data: A comparison of seven statistical methods. Behavior Therapy, 34, 189–211. doi:10.1016/S0005-7894(03)80013-8
  • Parker, R. I., & Brossart, D. F. (2006). Phase contrasts for mulitphase single case intervention designs. School Psychology Quarterly, 21, 46–61.
  • Parker, R. I., & Hagan-Burke, S. (2007a). Median-based overlap analysis for single case data: A second study. Behavior Modification, 31, 919–936.
  • Parker, R. I., & Hagan-Burke, S. (2007b). Useful effect size interpretations for single case research. Behavior Therapy, 38, 95–105. doi:10.1016/j.beth.2006.05.002
  • Parker, R. I., Hagan-Burke, S., & Vannest, K. (2007). Percentage of all non-overlapping data (PAND): An alternative to PND. The Journal of Special Education, 40, 194–204.
  • Parker, R. I., & Vannest, K. (2009). An improved effect size for single case research: Non-Overlap of All Pairs (NAP). Behavior Therapy, 40, 367. doi:10.1016/j.beth.2008.10.006
  • Parker, R. I, Vannest, K. J, & Davis, J. L. (2011a). Effect size in single-case research: a review of nine nonoverlap techniques. Behavior Modification, 35, 303–322. doi: 10.1177/0145445511399147
  • Parker, R. I, Vannest, K. J, Davis, J. L, & Sauber, S. B. (2011b). Combining nonoverlap and trend for single-case research: tau-u. Behavior Therapy, 42, 284–299. doi: 10.1177/0145445511399147
  • Parsonson, B. S., & Baer, D. M. (1986). The graphic analysis of data. In A. Poling & R. W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 157–186). New York: Plenum.
  • *Peach, R., & Wong, P. (2004). Integrating the message level into treatment for agrammatism using story retelling. Aphasiology, 18, 429–441. doi:10.1080/02687030444000147
  • R Core Team (2013). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
  • *Rasing, E. J. (1993). Effects of a multifaceted training procedure on the social behaviors of hearing-impaired children with severe language disabilities: A replication. Journal of Applied Behavior Analysis, 26, 405–406. doi:10.1901/jaba.1993.26-405
  • *Raymer, A. M., Ciampitti, M., Holliway, B., Singletary, F., Blonder, L. X., Ketterson, T., … Gonzalez Rothi, L. J. (2007). Semantic-phonologic treatment for noun and verb retrieval impairments in aphasia. Neuropsychological Rehabilitation, 17, 244–270. doi:10.1080/09602010600814661
  • *Reid, D. H., Parsons, M. B., Phillips, J. F., & Green, C. W. (1993). Reduction of self-injurious hand mouthing using response blocking. Journal of Applied Behavior Analysis, 26, 139–140. doi:10.1901/jaba.1993.26-139
  • *Renvall, K., Laine, M., & Martin, N. (2007). Treatment of anomia with contextual priming: Exploration of a modified procedure with additional semantic and phonological tasks. Aphasiology, 21, 499–527. doi:10.1080/02687030701254248
  • *Rizvi, S. L., & Nock, M. K. (2008). Single-case experimental designs for the evaluation of treatments for self-injurious and suicidal behaviors. Suicide and Life-Threatening Behavior, 38, 498–510. doi:10.1521/suli.2008.38.5.498
  • *Rose, M., & Douglas, J. (2006). A comparison of verbal and gesture treatments for a word production deficit resulting from acquired apraxia of speech. Aphasiology, 20, 1186–1209. doi:10.1080/02687030600757325
  • Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8, 24–33.
  • Sen, P. K. (1968). Estimates of the regression coefficient based on Kendall’s Tau. American Statistical Association Journal, 63, 1379–1389.
  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin Company.
  • Shadish, W. R., Hedges, L. V., Horner, R. H., & Odom, S. L. (2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research. Retrieved from http://ies.ed.gov/
  • Shadish, W. R., Rindskopf, D. M., & Hedges, L. V. (2008). The state of the science in the meta-analysis of single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 2, 188–196.
  • Shadish, W. R., Zuur, A. F., & Sullivan, K. J. (2014). Using generalized additive (mixed) models to analyze single case designs. Journal of School Psychology, 52, 149–178. doi: 10.1016/j.jsp.2013.11.004
  • *Singh, N. N., Singh, S. D., Sabaawi, M., Myers, R. E., & Wahler, R. G. (2006). Enhancing treatment team process through mindfulness-based mentoring in an inpatient psychiatric hospital. Behavior Modification, 30, 423–441. doi:10.1177/0145445504272971
  • Smith, J. D. (2012). Single-case experimental designs: A systematic review of published research and current standards. Psychological Methods, 17, 510–550. doi: 10.1037/a0029312
  • Solomon, B. G. (2014). Violations of assumptions in school-based single-case data: Implications for the selection and interpretation of effect sizes. Behavior Modification, 38, 477–496.
  • *Stapleton, S., Adams, M., & Atterton, L. (2007). A mobile phone as a memory aid for individuals with traumatic brain injury: A preliminary investigation. Brain Injury, 21, 401–411. doi:10.1080/02699050701252030
  • Stewart, K. K., Carr, J. E., Brandt, C. W., & McHenry, M. M. (2007). An evaluation of the conservative dual-criterion method for teaching university students to visually inspect AB-design graphs. Journal of Applied Behavior Analysis, 40, 713–718. doi: 10.1901/jaba.2007.713–718
  • *Suzman, K. B., Morris, R. D., Morris, M. K., & Milan, M. A. (1997). Cognitive-behavioral remediation of problem solving deficits in children with acquired brain injury. Journal of Behavior Therapy and Experimental Psychiatry, 28, 203–212. doi:10.1016/S0005-7916(97)00023-2
  • Tarlow, K. R. (2014). Kendall’s Tau and Tau-U for single-case research (R script version July 2014). Retrieved from http://www.ktarlow.com/stats.
  • Tarlow, K. R. (2016a). An improved rank correlation effect size statistic for single-case designs: Baseline corrected Tau. Behavior Modification. Advance online publication. doi: 10.1177/0145445516676750
  • Tarlow, K. R. (2016b). Baseline corrected Tau calculator. Retrieved from http://www.ktarlow.com/stats/tau
  • Tate, R. L., McDonald, S., Perdices, M., Togher, L., & Savage, S. (2008). Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the single-case experimental design (SCED) scale. Neuropsychological Rehabilitation, 18, 385–401.
  • Theil, H. (1950). A rank-invariant method of linear and polynomial regression analysis, III. Proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen A, 53, 1397–1412.
  • *Thompson, C. D., & Born, D. G. (1999). Increasing correct participation in an exercise class for adult day care clients. Behavioral Interventions, 14, 171–186. doi:10.1002/(SICI)1099-078X(199907/09)14:3<171::AID-BIN33>3.0.CO;2-B
  • *Thompson, C. K., Kearns, K. P., & Edmonds, L. A. (2006). An experimental analysis of acquisition, generalisation, and maintenance of naming behaviour in a patient with anomia. Aphasiology, 20, 1226–1244. doi:10.1080/02687030600875655
  • *Tloczynski, J., Malinowski, A., & Lamorte, R. (1997). Rediscovering and reapplying contingent informal meditation. Psychologia, 40, 14–21.
  • Vannest, K. J., Parker, R. I., & Gonen, O. (2011). Single case research: Web based calculators for SCR analysis (Version 1.0) (Web based application). College Station, TX: Texas A&M University. Retrieved from http://www.singlecaseresearch.org/calculators/tau-u
  • *Wanlin, C. M., Hrycaiko, D. W., Martin, G. L., & Mahon, M. (1997). The effects of a goal-setting package on the performance of speed skaters. Journal of Applied Sport Psychology, 9, 212–228. doi:10.1080/10413209708406483
  • *Warren, J. O. (1998). The effect on unipolar depression of a behavioral intervention targeting eating behavior ( Doctoral dissertation). Available from UMI Dissertations Publishing. (9835314).
  • *Weems, C. F. (1998). The evaluation of heart rate biofeedback using a multi-element design. Journal of Behavior Therapy and Experimental Psychiatry, 29, 157–162. doi:10.1016/S0005-7916(98)00005-6
  • *Werle, M. A., Murphy, T. B., & Budd, K. S. (1993). Treating chronic food refusal in young children: Home-based parent training. Journal of Applied Behavior Analysis, 26, 421–433. doi:10.1901/jaba.1993.26-421
  • White, O. R., & Haring, N. G. (1980). Exceptional teaching (2nd ed.). Columbus, OH: Merrill.
  • *Whitfield, G. W. (1999). Validating school social work: An evaluation of a cognitive-behavioral approach to reduce school violence. Research on Social Work Practice, 9, 399–426. doi:10.1177/104973159900900402
  • *Wilkinson, L. A. (2005). Supporting the inclusion of a student with asperger syndrome: A case study using conjoint behavioural consultation and self‐management. Educational Psychology in Practice, 21, 307–326. doi:10.1080/02667360500344914
  • Wolery, M., Busick, M., Reichow, B., & Barton, E. E. (2010). Comparison of overlap methods for quantitatively synthesizing single-subject data. The Journal of Special Education, 44, 18–28. doi: 10.1177/0022466908328009
  • Wolfe, K., & Slocum, T. A. (2015). A comparison of two approaches to training visual analysis of AB graphs. Journal of Applied Behavior Analysis, 48, 472–477. doi:10.1002/jaba.212
  • Ximenes, V. M., Manolov, R., Solanas, A., & Quera, V. (2009). Factors affecting visual inference in single-case designs. The Spanish Journal of Psychology, 12, 823–832.