Invalid Baseline Testing with ImPACT: Does Sandbagging Occur with High School Athletes?

References

• Abeare, C., Messa, I., Zuccato, B. G., Merker, B., & Erdodi, L. (2018). Prevalence of invalid performance on baseline testing for sport-related concussion by age and validity indicator. JAMA Neurology, 75(6), 697–703. doi:10.1001/jamaneurol.2018.0031
   PubMed Web of Science ®Google Scholar
• Alsalaheen, B., Stockdale, K., Pechumer, D., & Broglio, S. P. (2016). Validity of the Immediate Post Concussion Assessment and Cognitive Testing (ImPACT). Sports Medicine, 46(10), 1487–1501. doi:10.1007/s40279-016-0532-y
   PubMed Web of Science ®Google Scholar
• Bailey, C. M., Echemendia, R. J., & Arnett, P. A. (2006). The impact of motivation on neuropsychological performance in sports-related mild traumatic brain injury. Journal of the International Neuropsychological Society, 12(04), 475–484. doi:10.1017/S1355617706060619
   PubMed Web of Science ®Google Scholar
• Barth, J. T., Alves, W. M., Ryan, T. V., Macciocchi, S. N., Rimel, R. W., Jane, J. A., & Nelson, W. E. (1989). Mild head injury in sports: Neuropsychological sequelae and recovery of function. In H. S. Levin, H. M. Eisenberg, & A. L. Benton (Eds.), Mild head injury. New York, NY: Oxford University Press, pp. 257–275.
   Google Scholar
• Bleiberg, J., Kane, R. L., Reeves, D. L., Garmoe, R. S., & Halpern, E. (2000). Factor analysis of computerized and traditional tests used in mild brain injury research. The Clinical Neuropsychologist, 14(3), 287–294. doi:10.1076/1385-4046(200008)14:3;1-P;FT287
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (2007). A reconsideration of the Slick et al. (1999) criteria for malingered neuriocognitive dysfunction. In K. D. Boone (Ed.), Assessment of feigned cognitive impairment (pp. 29–49). New York, NY: The Guilford Press.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Collie, A., Darby, D., & Maruff, P. (2001). Computerised cognitive assessment of athletes with sports related head injury. British Journal of Sports Medicine, 35(5), 297–302. doi:10.1136/bjsm.35.5.297
   PubMed Web of Science ®Google Scholar
• Collins, M. W., Iverson, G. I., Lovell, M. R., McKeag, D. B., Norwig, J., & Maroon, J. (2003). On-field predictors of neuropsychological and symptom deficit following sports-related concussion. Clinical Journal Sport Medicine, 13(4), 222–229. doi:10.1097/00042752-200307000-00005
   PubMed Web of Science ®Google Scholar
• Covassin, T., Elbin, R. J., III, Stiller-Ostrowski, J. L., & Kontos, A. P. (2009). Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) practices of sports medicine professionals. Journal of Athletic Training, 44(6), 639–644. doi:10.4085/1062-6050-44.6.639
   PubMed Web of Science ®Google Scholar
• Echemendia, R. J., Bruce, J. M., Bailey, C. M., Sanders, J. F., Arnett, P., & Vargas, G. (2012). The utility of post-concussion neuropsychological data in identifying cognitive change following sports-related MTBI in the absence of baseline data. The Clinical Neuropsychologist, 26(7), 1077–1091. doi:10.1080/13854046.2012.721006
   PubMed Web of Science ®Google Scholar
• Echemendia, R. J., & Julian, L. J. (2001). Mild traumatic brain injury in sports: Neuropsychology’s contribution to a developing field. Neuropsychology Review, 11(2), 69–88.
   PubMed Web of Science ®Google Scholar
• Elbin, R. J., Kontos, A. P., Kegel, N., Johnson, E., Burkhart, S., & Schatz, P. (2013). Individual and combined effects of LD and ADHD on computerized neurocognitive concussion test performance: Evidence for separate norms. Archives of Clinical Neuropsychology, 28(5), 476–484. doi:10.1093/arclin/act024
   PubMed Web of Science ®Google Scholar
• Elbin, R. J., Schatz, P., & Covassin, T. (2011). One-year test-retest reliability of the online version of ImPACT in high school athletes. The American Journal of Sports Medicine, 19(11), 2319–2324. doi:10.1177/0363546511417173
   Google Scholar
• Erdal, K. (2012). Neuropsychological testing for sports-related concussion: How athletes can sandbag their baseline testing without detection. Archives of Clinical Neuropsychology, 27(5), 473–479. doi:10.1093/arclin/acs050
   PubMed Web of Science ®Google Scholar
• Gaudet, C. E., & Weyandt, L. L. (2017). Immediate Post-Concussion and Cognitive Testing (ImPACT): A systematic review of the prevalence and assessment of invalid performance. The Clinical Neuropsychologist, 31(1), 43–58. doi:10.1080/13854046.2016.1220622
   PubMed Web of Science ®Google Scholar
• Green, P., & Flaro, L. (2003). Word memory test performance in children. Child Neuropsychology, 9(3), 189–207. doi:10.1076/chin.9.3.189.16460
   PubMed Web of Science ®Google Scholar
• Gualtieri, C. T., & Johnson, L. G. (2006). Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21(7), 623–643. doi:10.1016/j.acn.2006.05.007
   PubMed Web of Science ®Google Scholar
• Higgins, K. L., Caze, T., & Maerlender, A. (2018). Validity and reliability of baseline testing in a standardized environment. Archives of Clinical Neuropsychology, 33(4), 437–443. doi:10.1093/arclin/acx071
   PubMed Web of Science ®Google Scholar
• Higgins, K. L., Denney, R. L., & Maerlender, A., (2017). Sandbagging on the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) in a high school athlete population. Archives of Clinical Neuropsychology, 32(3), 259–266.
   PubMed Web of Science ®Google Scholar
• Hunt, T. N., Ferrara, M. S., Miller, L. S., & Macciocchi, S. (2007). The effect of effort on baseline neuropsychological test scores in high school football athletes. Archives of Clinical Neuropsychology, 22(5), 615–622. doi:10.1016/j.acn.2007.04.005
   PubMed Web of Science ®Google Scholar
• ImPACT Applications, Inc. (2016). Administration and interpretation manual. Retrieved from www.impacttest.com.
   Google Scholar
• Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467. doi:10.1076/clin.17.4.460.27934
   PubMed Web of Science ®Google Scholar
• Kontos, A. P., Sufrinko, A., Womble, M., & Kegel, N. (2016). Neuropsychological assessment following concussion: An evidence-based review of the role of neuropsychological assessment pre- and post-concussion. Current Pain and Headache Reports, 20(6), 38. doi:10.1007/s11916-016-0571-y
   PubMed Web of Science ®Google Scholar
• Kuhn, A. W., & Solomon, G. S. (2014). Supervision and computerized neurocognitive baseline test performance in high school athletes: An initial investigation. Journal of Athletic Training, 49(6), 800–805. doi:10.4085/1062-6050-49.3.66
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2005). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology (2nd ed., pp. 116–159). New York, NY: Oxford University Press.
   Google Scholar
• Lau, B. C., Collins, M. W., & Lovell, M. R. (2011). Sensitivity and specificity of subacute computerized neurocognitive testing and symptom evaluation in predicting outcomes after sports-related concussion. The American Journal of Sports Medicine, 39(6), 1209–1216. doi:10.1177/0363546510392016
   PubMed Web of Science ®Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). New York: Oxford University Press.
   Google Scholar
• Lichtenstein, J. D., Moser, R. S., & Schatz, P. (2013). Age and test setting affect the prevalence of invalid baseline scores on neurocognitive tests. The American Journal of Sports Medicine, 42(2), 479–484. doi:10.1177/0363546513509225
   PubMed Web of Science ®Google Scholar
• Lovell, M. (2007). ImPACT 2007 (6.0) clinical interpretation manual. Pittsburgh, PA: ImPACT Applications, Inc.
   Google Scholar
• Manderino, L. M., & Gunstad, J. (2017). Performance of the Immediate Post-Concussion Assessment and Cogniive Testing protocol validity indices. Archives of Clinical Neuropsychology, 33(5), 596–605. doi:10.1093/arclin/acx102
   Web of Science ®Google Scholar
• Mayers, L. B., & Redick, T. S. (2012). Clinical utility of ImPACT assessment for postconcussion return-to-play counseling: Psychometric issues. Journal of Clinical and Experimental Neuropsychology, 34(3), 235–242. doi:10.1080/13803395.2011.630655
   PubMed Web of Science ®Google Scholar
• McCrory, P., Meeuwisse, W., Dvorak, J., Aubry, M., Bailes, J., Broglio, S & Vos, P. (2017). Consensus statement on concussion in sport – The 5th International Conference on Concussion in Sport held in Berlin, October 2016. British Journal of Sports Medicine 51, 851-858. doi:10.1136/bjsports-2017-097699
   Google Scholar
• Moser, R. S., Schatz, P., Neidzwski, K., & Ott, S. D. (2011). Group versus individual administration affects baseline neurocognitive test performance. The American Journal of Sports Medicine, 39(11), 2325–2330. doi:10.1177/0363546511417114
   PubMed Web of Science ®Google Scholar
• Ott, S. D., Bailey, C. M., & Broshek, D. K. (2018). An interdisciplinary approach to sports concussion evaluation and management: The role of a neuropsychologist. Archives of Clinical Neuropsychology, 33(3), 319–329. doi:10.1093/arclin/acx132
   PubMed Web of Science ®Google Scholar
• R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0. Retrieved from http://www.R-project.org/
   Google Scholar
• Rabinowitz, A. R., Merritt, V. C., & Arnett, P. A. (2015). The return-to-play incentive and the effect of motivation on neuropsychological test-performance: Implications for baseline testing. Developmental Neuropsychology, 40(1), 29–33. doi:10.1080/87565641.2014.1001066
   PubMed Web of Science ®Google Scholar
• Randolph, C., McCrea, M., & Barr, W. B. (2005). Is neuropsychological testing useful in the management of sport-related concussion? Journal of Athletic Training, 40(3), 139–154. doi:10.4085/1062-6050-51.4.04
   PubMed Web of Science ®Google Scholar
• Register-Mihalik, J. K., Kontos, D. L., Guskiewicz, K. M., Mihalik, J. P., Conder, R., & Shields, E. W. (2012). Age-related differences and reliability on computerized and paper-and-pencil neurocognitive assessment batteries. Journal of Athletic Training, 47(3), 297–305. doi:10.4085/1062-6050-47.3.13
   PubMed Web of Science ®Google Scholar
• Schatz, P., Elbin, R. J., Anderson, M. N., Savage, J., & Covassin, T. (2017). Exploring sandbagging behaviors, effort, and perceived utility of the ImPACT baseline assessment in college athletes. Sport, Exercise, and Performance Psychology, 6(3), 243–251. doi:10.1037/spy0000100
   Web of Science ®Google Scholar
• Schatz, P., & Glatts, C. (2013). “Sandbagging” baseline test performance on ImPACT, without detection, is more difficult than it appears. Archives of Clinical Neuropsychology, 28(3), 236–244. doi:10.1093/arclin/act009
   PubMed Web of Science ®Google Scholar
• Schatz, P., Kelley, T., Ott, S. D., Solomon, G. S., Elbin, R. J., Higgins, K., … Moser, R. S. (2014). Utility of repeated assessment after invalid baseline neurocognitive test performance. Journal of Athletic Training, 49(5), 659–664. doi:10.4085/1062-6050-49.3.37
   PubMed Web of Science ®Google Scholar
• Schatz, P., Moser, R. S., Solomon, G. S., Ott, S. D., & Karpf, R. (2012). Prevalence of invalid computerized baseline neurocognitive test results in high school and collegiate athletes. Journal of Athletic Training, 47(3), 289–296. doi:10.4085/1062-6050-47.3.14
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Robertshaw, S. (2014). Comparing post-concussive neurocognitive test data to normative data presents risks for under-classifying “above average” athletes. Archives of Clinical Neuropsychology, 29(7), 625. doi:10.1093/arclin/acu041
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Sandel, N. (2013). Sensitivity and specificity of the online version of ImPACT in high school and collegiate athletes. The American Journal of Sports Medicine, 41(2), 321–326. doi:10.1177/0363546512466038
   PubMed Web of Science ®Google Scholar
• Siedlik, J. A., Siscos, S., Evans, K., Rolf, A., Gallagher, P., Seeley, J., & Vardiman, J. (2015). Computerized neurocognitive assessments and detection of the malingering athlete. Journal of Sports Medicine and Physical Fitness, 56(9), 1086–1091.
   PubMed Web of Science ®Google Scholar
• Szabo, A. J., Alosco, M. L., Fedor, A., & Gunstad, J. (2013). Invalid performance and the ImPACT in National Collegiate Athletic Association Division I football players. Journal of Athletic Training, 48(6), 851–855. doi:10.4085/1062-6050-48.6.20
   PubMed Web of Science ®Google Scholar
• Tsushima, W. T., Siu, A. M., Pearce, A. N., Zhang, G., & Oshiro, R. S. (2015). Two-year test-retest reliability of ImPACT in high school athletes. Archives of Clinical Neuropsychology, 31(1), 105–111. doi:10.1093/arclin/acv066
   PubMed Web of Science ®Google Scholar
• Visser, S. H., Danielson, M. L., Bitsko, R. H., Holbrook, J. R., Kogan, M. D., Ghandour, R. M., … Blumberg, S. J. (2014). Trends in the parent-report of health care provider-diagnosed and medicated attention-deficit/hyperactivity disorder: United States, 2003-2011. Journal of the American Academy of Child and Adolescent Psychiatry, 53(1), 34–46. doi:10.1016/j.jaac.2013.09.001
   PubMed Web of Science ®Google Scholar