Methodological considerations of assessing meaningful/reliable change in computerized neurocognitive testing following sport-related concussion

References

• Abeare, C. A., Messa, I., Zuccato, B. G., Merker, B., & Erdodi, L. (2018). Prevalence of invalid performance on baseline testing for sport-related concussion by age and validity indicator. JAMA Neurology, 75(6), 697–703. https://doi.org/10.1001/jamaneurol.2018.0031
   PubMed Web of Science ®Google Scholar
• Alsalaheen, B., Stockdale, K., Pechumer, D., & Broglio, S. P. (2016). Measurement Error in the Immediate Postconcussion Assessment and Cognitive Testing (ImPACT): Systematic review. Journal of Head Trauma Rehabilitation, 31(4), 242–251. https://doi.org/10.1097/HTR.0000000000000175
   PubMed Web of Science ®Google Scholar
• Barnett, A. G., Van Der Pols, J. C., & Dobson, A. J. (2005). Regression to the mean: What it is and how to deal with it. International Journal of Epidemiology, 34(1), 215–220. https://doi.org/10.1093/ije/dyh299
   PubMed Web of Science ®Google Scholar
• Barr, W. B. (2002). Neuropsychological testing for assessment of treatment effects: Methodologic issues. CNS Spectrums, 7(4), 300–306. https://doi.org/10.1017/s1092852900017715
   PubMedGoogle Scholar
• Brett, B. L., Smyk, N., Solomon, G., Baughman, B. C., & Schatz, P. (2016). Long-term stability and reliability of baseline cognitive assessments in high school athletes using ImPACT at 1-, 2-, and 3-year Test-Retest Intervals. Archives of Clinical Neuropsychology, 31(8), 904–914. https://doi.org/10.1093/arclin/acw055
   PubMed Web of Science ®Google Scholar
• Broshek, D. K., De Marco, A. P., & Freeman, J. R. (2015). A review of post-concussion syndrome and psychological factors associated with concussion. Brain Injury, 29(2), 228–237. https://doi.org/10.3109/02699052.2014.974674
   PubMed Web of Science ®Google Scholar
• Covassin, T., Elbin, R. J., III, Stiller-Ostrowski, J. L., & Kontos, A. P. (2009). Immediate post-concussion assessment and cognitive testing (ImPACT) practices of sports medicine professionals. Journal of Athletic Training, 44(6), 639–644. https://doi.org/10.4085/1062-6050-44.6.639
   PubMed Web of Science ®Google Scholar
• Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. https://doi.org/10.1093/arclin/acr120
   PubMed Web of Science ®Google Scholar
• Echemendia, R. J., Iverson, G. L., McCrea, M., Broshek, D. K., Gioia, G. A., Sautter, S. W., Macciocchi, S. N., & Barr, W. B. (2011). Role of neuropsychologists in the evaluation and management of sport-related concussion: An inter-organization position statement. The Clinical Neuropsychologist, 25(8), 1289–1294. https://doi.org/10.1080/13854046.2011.618466
   PubMed Web of Science ®Google Scholar
• Echemendia, R. J., Iverson, G. L., McCrea, M., Macciocchi, S. N., Gioia, G. A., Putukian, M., & Comper, P. (2013). Advances in neuropsychological assessment of sport-related concussion. British Journal of Sports Medicine, 47(5), 294–298. https://doi.org/10.1136/bjsports-2013-092186
   PubMed Web of Science ®Google Scholar
• Elbin, R. J., Fazio-Sumrok, V., Anderson, M. N., D’Amico, N. R., Said, A., Grossel, A., Schatz, P., Lipinski, D., & Womble, M. (2019). Evaluating the suitability of the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) computerized neurocognitive battery for short-term, serial assessment of neurocognitive functioning. Journal of Clinical Neuroscience, 62, 138–141. https://doi.org/10.1016/j.jocn.2018.11.041
   PubMed Web of Science ®Google Scholar
• Elbin, R. J., Schatz, P., & Covassin, T. (2011). One-year test-retest reliability of the online version of ImPACT in high school athletes. The American Journal of Sports Medicine, 39(11), 2319–2324. https://doi.org/10.1177/0363546511417173
   PubMed Web of Science ®Google Scholar
• Erdal, K. (2012). Neuropsychological testing for sports-related concussion: How athletes can sandbag their baseline testing without detection. Archives of Clinical Neuropsychology, 27(5), 473–479. https://doi.org/10.1093/arclin/acs050
   PubMed Web of Science ®Google Scholar
• Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. K., Henry, G. K., & Hart, R. P. (2010). Official position of the American Academy of Clinical Neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administration in clinical and forensic settings. The Clinical Neuropsychologist, 24(8), 1267–1278. https://doi.org/10.1080/13854046.2010.526785
   PubMed Web of Science ®Google Scholar
• Henry, L. C., Elbin, R. J., Collins, M. W., Marchetti, G., & Kontos, A. P. (2016). Examining recovery trajectories after sport-related concussion with a multimodal clinical assessment approach. Neurosurgery, 78(2), 232–241. https://doi.org/10.1227/NEU.0000000000001041
   PubMed Web of Science ®Google Scholar
• Henry, L. C., & Sandel, N. (2015). Adolescent subtest norms for the ImPACT neurocognitive battery. Applied Neuropsychology. Child, 4(4), 266–276. https://doi.org/10.1080/21622965.2014.911094
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467. https://doi.org/10.1076/clin.17.4.460.27934
   PubMed Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Kinnaman, K. A., Mannix, R. C. D., Comstock, R., & Meehan, III, W. P. (2013). Management strategies and medication use for treating paediatric patients with concussions. Acta Paediatrica, 102(9), e424–e428. https://doi.org/10.1111/apa.12315
   Web of Science ®Google Scholar
• Lichtenstein, J. D., Linnea, K. S., & Maerlender, A. C. (2018). Patterns of referral in high school concussion management programs: A pilot study of consultants from different disciplines. Applied Neuropsychology: Child, 7(4), 334–341. https://doi.org/10.1080/21622965.2017.1340158
   PubMed Web of Science ®Google Scholar
• Lichtenstein, J. D., & Merz, Z. C. (2019). Post-exertion neuropsychological testing in the management of sport-related concussion. Psychological Injury and Law, 12(2), 146–154. https://doi.org/10.1007/s12207-019-09350-0
   Web of Science ®Google Scholar
• Lovell, M. R. (2011). ImPACT technical manual: Online ImPACT 2007–2012 (Vol. 2013). ImPACT Applications.
   Google Scholar
• Lovell, M. R. (2016). ImPACT Administration and Interpretation Manual. ImPACT Applications.
   Google Scholar
• Lovell, M. R., Iverson, G. L., Collins, M. W., Podell, K., Johnston, K. M., Pardini, D., Pardini, J., Norwig, J., & Maroon, J. C. (2006). Measurement of symptoms following sports-related concussion: Reliability and normative data for the post-concussion scale. Applied Neuropsychology, 13(3), 166–174. https://doi.org/10.1207/s15324826an1303_4
   PubMed Web of Science ®Google Scholar
• Maerlender, A. C., Masterson, C. J., James, T. D., Beckwith, J., Brolinson, P. G., Crisco, J., Duma, S., Flashman, L. A., Greenwald, R., Rowson, S., Wilcox, B., & McAllister, T. W. (2016). Test-retest, retest, and retest: Growth curve models of repeat testing with Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT). Journal of Clinical and Experimental Neuropsychology, 38(8), 869–874. https://doi.org/10.1080/13803395.2016.1168781
   PubMed Web of Science ®Google Scholar
• Maerlender, A., & Molfese, D. L. (2015). Repeat baseline assessment in college-age athletes. Developmental Neuropsychology, 40(2), 69–73. https://doi.org/10.1080/87565641.2015.1014089
   PubMed Web of Science ®Google Scholar
• McCrea, M., Barr, W. B., Guskiewicz, K., Randolph, C., Marshall, S. W., Cantu, R., Onate, J. A., & Kelly, J. P. (2005). Standard regression-based methods for measuring recovery after sport-related concussion. Journal of the International Neuropsychological Society, 11(1), 58–69. https://doi.org/10.1017/S1355617705050083
   PubMed Web of Science ®Google Scholar
• McCrea, M., Randolph, C., & Kelly, J. P. (2000). The Standardized Assessment of Concussion (SAC): Manual for Administration. Scoring and Interpretation (2nd ed.). CNS Inc.
   Google Scholar
• McCrory, P., Meeuwisse, W., Dvořák, J., Aubry, M., Bailes, J., Broglio, S., Cantu, R. C., Cassidy, D., Echemendia, R. J., Castellani, R. J., Davis, G. A., Ellenbogen, R., Emery, C., Engebretsen, L., Feddermann-Demont, N., Giza, C. C., Guskiewicz, K. M., Herring, S., Iverson, G. L., … Vos, P. E. (2017). Consensus statement on concussion in sport-the 5th international conference on concussion in sport held in Berlin, October 2016. British Journal of Sports Medicine, 51(11), 838–847. https://doi.org/10.1136/bjsports-2017-097699
   PubMed Web of Science ®Google Scholar
• McGrath, N., Dinn, W. M., Collins, M. W., Lovell, M. R., Elbin, R. J., & Kontos, A. P. (2013). Post-exertion neurocognitive test failure among student-athletes following concussion. Brain Injury, 27(1), 103–113. https://doi.org/10.3109/02699052.2012.729282
   PubMed Web of Science ®Google Scholar
• McSweeny, J. A., Naugle, R. I., Chelune, G. J., & Luders, H. (1993). T scores for change”: An illustration of a regression approach to depicting change in clinical neuropsychology. Clinical Neuropsychologist, 7(3), 300–312. https://doi.org/10.1080/13854049308401901
   Google Scholar
• Messa, I., Korcsog, K., & Abeare, C. (2020). An updated review of the prevalence of invalid performance on the Immediate Post-Concussion and Cognitive Testing (ImPACT). The Clinical Neuropsychologist, 2020, 1–24. https://doi.org/10.1080/13854046.2020.1866676
   Google Scholar
• O’Brien, A. M., Casey, J. E., & Salmon, R. M. (2018). Short-term test-retest reliability of the ImPACT in healthy young athletes. Applied Neuropsychology. Child, 7(3), 208–216. https://doi.org/10.1080/21622965.2017.1290529
   PubMed Web of Science ®Google Scholar
• Resch, J. E., Schneider, M. W., & Munro Cullum, C. (2018). The test-retest reliability of three computerized neurocognitive tests used in the assessment of sport concussion. International Journal of Psychophysiology, 132, 31–38. https://doi.org/10.1016/j.ijpsycho.2017.09.011
   PubMed Web of Science ®Google Scholar
• Schatz, P. (2010). Long-term test-retest reliability of baseline cognitive assessments using ImPACT. The American Journal of Sports Medicine, 38(1), 47–53. https://doi.org/10.1177/0363546509343805
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Browndyke, J. (2002). Applications of computer-based neuropsychological assessment. The Journal of Head Trauma Rehabilitation, 17(5), 395–410. https://doi.org/10.1097/00001199-200210000-00003
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Ferris, C. S. (2013). One-month test-retest reliability of the ImPACT test battery. Archives of Clinical Neuropsychology, 28(5), 499–504. https://doi.org/10.1093/arclin/act034
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Maerlender, A. (2013). A two-factor theory for concussion assessment using ImPACT: Memory and speed. Archives of Clinical Neuropsychology, 28(8), 791–797. https://doi.org/10.1093/arclin/act077
   PubMed Web of Science ®Google Scholar
• Schatz, P., Pardini, J. E., Lovell, M. R., Collins, M. W., & Podell, K. (2006). Sensitivity and specificity of the ImPACT Test Battery for concussion in athletes. Archives of Clinical Neuropsychology, 21(1), 91–99. https://doi.org/10.1016/j.acn.2005.08.001
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Robertshaw, S. (2014). Comparing post-concussive neurocognitive test data to normative data presents risks for under-classifying “above average” athletes. Archives of Clinical Neuropsychology, 29(7), 625–632. https://doi.org/10.1093/arclin/acu041
   PubMed Web of Science ®Google Scholar
• Silverberg, N. D., & Iverson, G. L. (2011). Etiology of the post-concussion syndrome: Physiogenesis and psychogenesis revisited. NeuroRehabilitation, 29(4), 317–329. https://doi.org/10.3233/NRE-2011-0708
   PubMed Web of Science ®Google Scholar
• Silverberg, N. D., & Iverson, G. L. (2013). Is rest after concussion “the best medicine?”: Recommendations for activity resumption following concussion in athletes, civilians, and military service members. The Journal of Head Trauma Rehabilitation, 28(4), 250–259. https://doi.org/10.1097/HTR.0b013e31825ad658
   PubMed Web of Science ®Google Scholar
• Tsushima, W. T., Siu, A. M., Pearce, A. M., Zhang, G., & Oshiro, R. S. (2016). Two-year test-retest reliability of ImPACT in High School Athletes. Archives of Clinical Neuropsychology, 31(1), 105–111. https://doi.org/10.1093/arclin/acv066
   PubMed Web of Science ®Google Scholar