Measuring reliable change in traumatic brain injury (TBI): The pitfalls of using readily available formulae

References

• Access Economics. (2009). The economic cost of spinal cord injury and traumatic brain injury in Australia. Report by Access Economics for the Victorian Neurotrauma Initiative. Canberra: Access Economics, 31.
   Google Scholar
• Barr, W. B. (2002). Neuropsychological testing for assessment of treatment effects: Methodologic issues. CNS Spectrums, 7, 300–306. doi:10.1017/S1092852900017715
   PubMedGoogle Scholar
• Basso, M. R., Carona, F. D., Lowery, N., & Axelrod, B. N. (2002). Practice effects on the WAIS-III across 3- and 6-month intervals. The Clinical Neuropsychologist, 16(1), 57–63. doi:10.1076/clin.16.1.57.8329
   PubMed Web of Science ®Google Scholar
• Bird, C. M., Papadopoulou, K., Ricciardelli, P., Rossor, M. N., & Cipolotti, L. (2004). Monitoring cognitive changes: Psychometric properties of six cognitive tests. British Journal of Clinical Psychology, 43, 197–210. doi:10.1348/014466504323088051
   PubMed Web of Science ®Google Scholar
• Charter, R. A. (1996). Revisiting the standard errors of measurement, estimate, and prediction and their application to test scores. Perceptual and Motor Skills, 82(3_suppl), 1139–1144. doi:10.2466/pms.1996.82.3c.1139
   Web of Science ®Google Scholar
• Chelune, G. J., Naugle, R. I., Lüders, H., Sedlak, J., & Awad, I. A. (1993). Individual change after epilepsy surgery: Practice effects and base-rate information. Neuropsychology, 7, 41. doi:10.1037/0894-4105.7.1.41
   Google Scholar
• Christensen, B. K., Colella, B., Inness, E., Hebert, D., Monette, G., Bayley, M., & Green, R. E. (2008a). Recovery of cognitive function after traumatic brain injury: A multilevel modeling analysis of canadian outcomes. Archives of Physical Medicine and Rehabilitation, 89, (12 Suppl), S3--15. doi:10.1016/j.apmr.2008.10.002
   Google Scholar
• Christensen, B. K., Colella, B., Inness, E., Hebert, D., Monette, G., Bayley, M., & Green, R. E. (2008b). Recovery of cognitive function after traumatic brain injury: A multilevel modeling analysis of canadian outcomes. Archives of Physical Medicine and Rehabilitation, 89(12), S3–S15. doi:10.1016/j.apmr.2008.10.002
   Web of Science ®Google Scholar
• Crawford, J. R., & Garthwaite, P. H. (2006). Comparing patients’ predicted test scores from a regression equation with their obtained scores: A significance test and point estimate of abnormality with accompanying confidence limits. Neuropsychology, 20, 259. doi:10.1037/0894-4105.20.3.259
   PubMed Web of Science ®Google Scholar
• Crawford, J. R., & Howell, D. C. (1998). Regression equations in clinical neuropsychology: An evaluation of statistical methods for comparing predicted and obtained scores. Journal of Clinical and Experimental Neuropsychology, 20, 755–762. doi:10.1076/jcen.20.5.755.1132
   PubMed Web of Science ®Google Scholar
• De Monte, E. V., Geffen, M. G., & Kwapil, K. (2005). Test-retest reliability and practice effects of a rapid screen of mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 27, 624–632. doi:10.1080/13803390490918589
   PubMed Web of Science ®Google Scholar
• Dikmen, S., Heaton, R. K., Grant, I., & Temkin, N. R. (1999). Test-retest relaibility and practice effects of expanded halstead-reitan neuropsychological test battery. Journal of the International Neuropsychological Society, 6, 346–356. doi:10.1017/S1355617799544056
   Google Scholar
• Dikmen, S. S., Machamer, J., Temkin, N. R., & McLean, A. (1990). Neuropsychological recovery in patients with moderate to severe head injury: 2 year follow-up. Journal of Clinical and Experimental Neuropsychology, 12, 507–519. doi:10.1080/01688639008400997
   PubMed Web of Science ®Google Scholar
• Fox, D. D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. The Clinical Neuropsychologist, 25, 488–495. doi:10.1080/13854046.2011.554443
   PubMed Web of Science ®Google Scholar
• Gavett, B. E., Ashendorf, L., & Gurnani, A. S. (2015). Reliable change on neuropsychological tests in the uniform data set. Journal of the International Neuropsychological Society, 21, 558–567. doi:10.1017/S1355617715000582
   PubMed Web of Science ®Google Scholar
• Greve, K. W., Love, J. M., Sherwin, E., Mathias, C. W., Houston, R., & Brennan, A. (2002). Temporal stability of the Wisconsin Card Sorting Test in a chronic traumatic brain injury sample. Assessment, 9, 271–277.
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., Temkin, N., Dikmen, S., Avitable, N., Taylor, M. J., Marcotte, T. D., & Grant, I. (2001). Detecting change: A comparison of three neuropsychological methods, using normal and clinical samples. Archives of Clinical Neuropsychology, 16, 75–91. doi:10.1093/arclin/16.1.75
   PubMed Web of Science ®Google Scholar
• Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. R., Henry, G. K., & Hart, R. P. (2010). Official position of the American Academy of clinical neuropsychology on serial neuropsychological assessments: the utility and challenges of repeat test administrations in clinical and forensic contexts. The Clinical Neuropsychologist, 24, 1267–1278. doi:10.1080/13854046.2010.526785
   PubMed Web of Science ®Google Scholar
• Hinton-Bayre, A. D. (2010a). Calculating the test-retest reliability co-efficient from normative retest data for determineing reliable change. Archives of Clinical Neuropsychology, 26, 76–77. doi:10.1177/1073191102009003006
   PubMed Web of Science ®Google Scholar
• Hinton-Bayre, A. D. (2010b). Deriving Reliable Change Statistics from Test-Retest Normative Data: Comparison of Models and Mathematical Expressions. Archives of Clinical Neuropsychology, 25, 244–256. doi:10.1093/arclin/acq008
   PubMed Web of Science ®Google Scholar
• Hinton-Bayre, A. D. (2016). Clarifying discrepancies in responsiveness between reliable change indices. Archives of Clinical Neuropsychology, 31, 754–768. doi:10.1093/arclin/acw064
   PubMed Web of Science ®Google Scholar
• Holdnack, J., & Drozdick, L. (2009). Advanced clinical solutions for WAIS-IV and WMS-IV: Clinical and interpretive manual. Texas: Pearson.
   Google Scholar
• Hyder, A. A., Wunderlich, C. A., Puvanachandra, P., Gururaj, G., & Kobusingye, O. C. (2007). The impact of traumatic brain injuries: A global perspective. NeuroRehabilitation-an Interdisciplinary Journal, 22, 341–354.
   PubMed Web of Science ®Google Scholar
• Iverson, G. L. (1999). Interpreting change on the WAIS-III/WMS-III following traumatic brain injury. Journal of Cognitive Rehabilitation, 17, 16–21.
   Google Scholar
• Iverson, G. L. (2001). Interpreting change on the WAIS-III/WMS-III in clinical samples. Archives of Clinical Neuropsychology, 16, 183–191. doi:10.1093/arclin/16.2.183
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467. doi:10.1076/clin.17.4.460.27934
   PubMed Web of Science ®Google Scholar
• Ivnik, R. J., Smith, G. E., Lucas, J., Petersen, R. C., Boeve, B. F., Kokmen, E., & Tangalos, E. G. (1999). Testing normal older people three or four times at 1- to 2-year intervals: Defining normal variance. Neuropsychology, 13, 121. doi:10.1037/0894-4105.13.1.121
   PubMed Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12. doi:10.1037//0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Jennett, B., Snoek, J., Bond, M. R., & Brooks, N. (1981). Disability after severe head injury: observations on the use of the Glasgow Outcome Scale. Journal of Neurology, Neurosurgery & Psychiatry, 44, 285–293. doi:10.1136/jnnp.44.4.285
   PubMed Web of Science ®Google Scholar
• Jennett, B., & Teasdale, G. (1981). Management of head injuries. Philadelphia: F.A. Davis.
   Google Scholar
• MAA (2013). Neuropsychological assessment of children and adults with traumatic brain injury: Guidelines for the NSW compulsory third party scheme and lifetime care and support scheme. Sydney: MAA.
   Google Scholar
• Management of Concussion/mTBI Working Group. (2009). VA/DoD clinical practice guideline for management of concussion/mild traumatic brain injury. Journal of Rehabilitation Research and Development, 46, CP1.
   PubMedGoogle Scholar
• Maassen, G. H., Bossema, E. R., & Brand, N. (2006). Reliable change assessment with practice effects in sport concussion research: A comment on Hinton-Bayre. British journal of sports medicine, 40(10), 829–833. doi:10.1136/bjsm.2005.023713
   PubMed Web of Science ®Google Scholar
• McCaffrey, R. J., Duff, K., & Westervelt, H. J. (2000). Practitioner’s guide to evaluating change with neuropsychological assessment instruments: New York: Springer Science & Business Media.
   Google Scholar
• McSweeny, A. J., Naugle, R. I., Chelune, G. J., & Luders, H. (1993). “TScores for Change”: An illustration of a regression approach to depicting change in clinical neuropsychology. Clinical Neuropsychologist, 7, 300–312. doi:10.1080/13854049308401901
   Google Scholar
• Miller, J. B., Axelrod, B. N., Rapport, L. J., Hanks, R. A., Bashem, J. R., & Schutte, C. (2012). Substitution of California verbal learning test, for verbal paired associates on the Wechsler Memory Scale. The Clinical Neuropsychologist, 26, 599–608. doi:10.1080/13854046.2012.677478
   PubMed Web of Science ®Google Scholar
• Millis, S. R., Rosenthal, M., Novack, T. A., Sherer, M., Nick, T. G., Kreutzer, J. S., … Ricker, J. H. (2001). Long-term neuropsychological outcome after traumatic brain injury. Journal of Head Trauma Rehabilitation, 16, 343–355. doi:10.1097/00001199-200108000-00005
   PubMed Web of Science ®Google Scholar
• Ponsford, J., Sloan, S., & Snow, P. (2012). Traumatic brain injury: Rehabilitation for everyday adaptive living. East Sussex: Psychology Press.
   Google Scholar
• Ruff, R. M., Iverson, G. L., Barth, J. T., Bush, S. S., Broshek, D. K., Policy, t. N., & Planning Committee. (2009). Recommendations for diagnosing a mild traumatic brain injury: A national academy of neuropsychology education paper. Archives of Clinical Neuropsychology, 24(1), 3–10. doi:10.1093/arclin/acp006
   PubMed Web of Science ®Google Scholar
• Sawrie, S. M., Chelune, G. J., Naugle, R. I., & Lüders, H. O. (1996). Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery. Journal of the International Neuropsychological Society, 2, 556–564. doi:10.1017/S1355617700001739
   PubMedGoogle Scholar
• Schultz, R., & Tate, R. L. (2013). Methodological issues in longitudinal research on cognitive recovery after traumatic brain injury: evidence from a systematic review. Brain Impairment, 14(3), 450–474. doi:10.1017/BrImp.2013.24
   Web of Science ®Google Scholar
• Tate, R., McDonald, S., & Lulham, J. (1998). Incidence of hospital‐treated traumatic brain injury in an Australian community. Australian and New Zealand Journal of Public Health, 22, 419–423. doi:10.1111/j.1467-842X.1998.tb01406.x
   PubMed Web of Science ®Google Scholar
• Temkin, N. R., Heaton, R. K., Grant, I., & Dikmen, S. S. (1999). Detecting significant change in neuropsychological test performance: A comparison of four models. Journal of the International Neuropsychological Society, 5, 357–369. doi:10.1017/S1355617799544068
   PubMed Web of Science ®Google Scholar
• Thiruselvam, I., Vogt, E. M., & Hoelzle, J. B. (2015). The interchangeability of CVLT-II and WMS-IV verbal paired associates scores: A slightly different story. Archives of Clinical Neuropsychology, 30, 248–255. doi:10.1093/arclin/acv010
   PubMed Web of Science ®Google Scholar
• Till, C., Colella, B., Verwegen, J., & Green, R. E. (2008). Postrecovery cognitive decline in adults with traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 89, S25–S34. doi:10.1016/j.apmr.2008.07.004
   PubMed Web of Science ®Google Scholar
• Turner, T. H., Renfroe, J. B., Elm, J., Duppstadt-Delambo, A., & Hinson, V. K. (2016). Robustness of reliable change indices to variability in Parkinson’s disease with mild cognitive impairment. Applied Neuropsychology: Adult, 23, 399–402. doi:10.1080/23279095.2016.1160907
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (1997a). Wechsler memory scale (WMS-III). San Antonio, TX: Psychological corporation.
   Google Scholar
• Wechsler, D. (1997b). Wechsler adult intelligence scale (WAIS-III). San Antonio, TX: Psychological corporation.
   Google Scholar
• Wechsler, D. (2009). Wechsler memory scale-(WMS-IV). New York: The Psychological Corporation.
   Google Scholar
• Wechsler, D., Coalson, D. L., & Raiford, S. E. (2008). WAIS-IV: Wechsler adult intelligence scale. San Antonio, TX: Pearson.
   Google Scholar
• Wong, P. P., Monette, G., & Weiner, N. I. (2001). Mathematical models of cognitive recovery. Brain Injury, 15, 519–530. doi:10.1080/02699050116774
   PubMed Web of Science ®Google Scholar
• Zegers, F. E., & Hafkenscheid, A. (1994). The ultimate reliable change index: An alternative to the Hageman & Arrinell approach: Groningen: Psychologische Instituten RU Groningen.
   Google Scholar