Evaluating the test–retest reliability of symptom indices associated with the ImPACT post-concussion symptom scale (PCSS)

References

• Alla, S., Sullivan, J. S., Hale, L., & McCrory, P. (2009). Self-report scales/checklists for the measurement of concussion symptoms: A systematic review. British Journal of Sports Medicine, 43(Suppl 1), i3–i12. doi:10.1136/bjsm.2009.058339
   PubMed Web of Science ®Google Scholar
• Alla, S., Sullivan, S. J., & McCrory, P. (2012). Defining asymptomatic status following sports concussion: Fact or fallacy? British Journal of Sports Medicine, 46(8), 562–569. doi:10.1136/bjsm.2010.081299
   PubMed Web of Science ®Google Scholar
• Anastasi, A. (1998). Psychological testing (6th ed.). New York, NY: MacMillan.
   Google Scholar
• Brett, B. L., & Solomon, G. S. (2016). The influence of validity criteria on Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) test-retest reliability among high school athletes. Journal of Clinical and Experimental Neuropsychology, 39(3), 286–295. doi:10.1080/13803395.2016.1224322
   PubMed Web of Science ®Google Scholar
• Broshek, D. K., Kaushik, T., Freeman, J. R., Erlanger, D., Webbe, F., & Barth, J. T. (2005). Sex differences in outcome following sports-related concussion. Journal of Neurosurgery, 102(5), 856–863. doi:10.3171/jns.2005.102.5.0856
   PubMed Web of Science ®Google Scholar
• Brown, N. J., Mannix, R. C., O’Brien, M. J., Gostine, D., Collins, M. W., & Meehan, W. P., III. (2014). Effect of cognitive activity level on duration of post-concussion symptoms. Pediatrics, 133(2), 1–6. doi:10.1542/peds.2013-2125
   PubMed Web of Science ®Google Scholar
• Bruce, J., Echemendia, R., Meeuwisse, W., Comper, P., & Sisco, A. (2013). 1 year test-retest reliability of ImPACT in professional ice hockey players. The Clinical Neuropsychologist, 28(1), 14–25. doi:10.1080/13854046.2013.866272
   PubMed Web of Science ®Google Scholar
• Chan, R. C. K. (2001). Base rate of post-concussion symptoms among normal people and its neuropsychological correlates. Clinical Rehabilitation, 15, 266–273. doi:10.1191/026921501675253420
   PubMed Web of Science ®Google Scholar
• Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284
   Google Scholar
• Cole, W. R., Arrieux, J. P., Schwab, K., Ivins, B. J., Qashu, F. M., & Lewis, S. C. (2013). Test-retest reliability of four computerized neurocognitive assessment tools in an active duty military population. Archives of Clinical Neuropsychology, 28(7), 732–742. doi:10.1093/arclin/act040
   PubMed Web of Science ®Google Scholar
• Collins, M. W., Lovell, M. R., Iverson, G. L., Cantu, R. C., Maroon, J. C., & Field, M. (2002). Cumulative effects of concussion in high school athletes. Neurosurgery, 51(5), 1175–1181. doi:10.1097/00006123-200211000-00011
   PubMed Web of Science ®Google Scholar
• Covassin, T., Elbin, R. J., Harris, W., Parker, T., & Kontos, A. P. (2012). The role of age and sex in symptoms, neurocognitive performance, and postural stability in athletes after concussion. The American Journal of Sports Medicine, 40(6), 1303–1312. doi:10.1177/0363546512444554
   PubMed Web of Science ®Google Scholar
• Covassin, T., Schatz, P., & Swanik, C. B. (2007). Sex differences in neuropsychological function and post-concussion symptoms of concussed collegiate athletes. Neurosurgery, 61(2), 345–351. doi:10.1227/01.NEU.0000279972.95060.CB
   PubMed Web of Science ®Google Scholar
• Covassin, T., Stearne, D., & Elbin, R. (2008). Concussion history and postconcussion neurocognitive performance and symptoms in collegiate athletes. Journal of Athletic Training, 43(2), 119–124. doi:10.4085/1062-6050-43.2.119
   PubMed Web of Science ®Google Scholar
• Doolan, A. W., Day, D. D., Maerlender, A. C., Goforth, M., & Brolinson, P. G. (2012). A review of return to play issues and sports-related concussion. Annals of Biomedical Engineering, 40(1), 106–113. doi:10.1007/s10439-011-0413-3
   PubMed Web of Science ®Google Scholar
• Echemendia, R. J., Iverson, G. L., McCrea, M., Macciocchi, S. N., Gioia, G. A., Putukian, M., & Comper, P. (2013). Advances in neuropsychological assessment of sport-related concussion. British Journal of Sports Medicine, 47(5), 294–298. doi:10.1136/bjsports-2013-092186
   PubMed Web of Science ®Google Scholar
• Elbin, R. J., Schatz, P., & Covassin, T. (2011). One-year test-retest reliability of the online version of ImPACT in high school athletes. The American Journal of Sports Medicine, 39(11), 2319–2324. doi:10.1177/0363546511417173
   PubMed Web of Science ®Google Scholar
• Frommer, L. J., Gurka, K. K., Cross, K. M., Ingersoll, C. D., Comstock, R. D., & Saliba, S. A. (2011). Sex differences in concussion symptoms of high school athletes. Journal of Athletic Training, 46(1), 76–84. doi:10.4085/1062-6050-46.1.76
   PubMed Web of Science ®Google Scholar
• Garden, N., & Sullivan, K. (2010). An examination of the base rates of post-concussion symptoms: The influence of demographics and depression. Applied Neuropsychology, 17, 1–7. doi:10.1080/09084280903297495
   PubMed Web of Science ®Google Scholar
• Giza, C. C., & Hovda, D. A. (2001). The neurometabolic cascade of concussion. Journal of Athletic Training, 36(3), 228–235.
   PubMed Web of Science ®Google Scholar
• Giza, C. C., & Hovda, D. A. (2014). The new neurometabolic cascade of concussion. Neurosurgery, 75(4), S24–S33. doi:10.1227/NEU.0000000000000505
   PubMedGoogle Scholar
• Giza, C. C., Kutcher, J. S., Ashwal, S., Barth, J., Getchius, T. S. D., Gioia, G. A., … Zafonte, R. (2013). Summary of evidence-based guideline update: Evaluation and management of concussion in sports: Report of the Guideline Development Subcommittee of the American Academy of Neurology. Neurology, 80(24), 2250–2257. doi:10.1212/WNL.0b013e31828d57dd
   PubMed Web of Science ®Google Scholar
• Gouvier, W. D., Uddo-Crane, M., & Brown, L. M. (1988). Base rates of post-concussional symptoms. Archives of Clinical Neuropsychology, 3, 273–278. doi:10.1093/arclin/3.3.273
   PubMedGoogle Scholar
• Grindel, S. H., Lovell, M. R., & Collins, M. W. (2001). The assessment of sport-related concussion: The evidence behind neuropsychological testing and management. Clinical Journal of Sport Medicine, 11(3), 134–143. doi:10.1097/00042752-200107000-00003
   PubMed Web of Science ®Google Scholar
• Guskiewicz, K. M., Bruce, S. L., Cantu, R. C., Ferrara, M. S., Kelly, J. P., McCrea, M., … McLeod, T. C. V. (2004). Recommendations on management of sport-related concussion: Summary of the National Athletic Trainers’ Association position statement. Neurosurgery, 55(4), 891–896. doi:10.1227/01.NEU.0000143800.49798.19
   PubMed Web of Science ®Google Scholar
• Guskiewicz, K. M., McCrea, M., Marshall, S. W., Cantu, R. C., Randolph, C., Barr, W., … Kelly, J. P. (2003). Cumulative effects associated with recurrent concussion in collegiate football players. JAMA: the Journal of the Maerican Medical Association, 290(19), 2549–2555. doi:10.1001/jama.290.19.2549
   PubMed Web of Science ®Google Scholar
• Guskiewicz, K. M., Weaver, N. L., Padua, D. A., & Garrett, W. E. (2000). Epidemiology of concussion in collegiate and high school football players. The American Journal of Sports Medicine, 28(5), 643–650. doi:10.1177/03635465000280050401
   PubMed Web of Science ®Google Scholar
• Harmon, K. G., Drezner, J. A., Gammons, M., Guskiewicz, K. M., Halstead, M., Herring, S. A., … Roberts, W. O. (2013). American Medical Society for Sports Medicine position statement: Concussion in sport. British Journal of Sports Medicine, 47, 15–26. doi:10.1136/bjsports-2012-091941
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Brooks, B., Lovell, M., & Collins, M. (2006). No cumulative effects for one or two previous concussions. British Journal of Sports Medicine, 40(1), 72–75. doi:10.1136/bjsm.2005.020651
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., & Lange, R. T. (2003). Examination of “postconcussion-like” symptoms in a healthy sample. Journal of Applied Neuropsychology, 10(3), 137–144. doi:10.1207/S15324826AN1003_02
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Lovell, M. R., & Collins, M. W. (2003). Interpreting change on ImPACT following sport concussion. The Clinical Neuropsychologist, 17(4), 460–467. doi:10.1076/clin.17.4.460.27934
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., & Schatz, P. (2015). Advanced topics in neuropsychological assessment following sport-related concussion. Journal of Brain Injury, 29(2), 263–275. doi:10.3109/02699052.2014.965214
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Silverberg, N. D., Mannix, R., Maxwell, B. A., Atkins, J. E., Zafonte, R., & Berkner, P. D. (2015). Factors associated with concussion-like symptom reporting in high school athletes. JAMA Pediatrics, 169(12), 1132–1140. doi:10.1001/jamapediatrics.2015.2374
   PubMed Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. doi:10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Kaut, K. P., DePompei, R., Kerr, J., & Congeni, J. (2003). Reports of head injury and symptom knowledge among college athletes: Implications for assessment and educational intervention. Clinical Journal of Sport Medicine, 13(4), 213–221. doi:10.1097/00042752-200307000-00004
   PubMed Web of Science ®Google Scholar
• Kerr, Z. Y., Register-Mihalik, J. K., Marshall, S. W., Evenson, K. R., Mihalik, J. P., & Guskiewicz, K. M. (2014). Disclosure and non-disclosure of concussion and concussion symptoms in athletes: Review and application of the socio-ecological framework. Brain Injury, 28(8), 1009–1021. doi:10.3109/02699052.2014.904049
   PubMed Web of Science ®Google Scholar
• Kontos, A. P., Elbin, R. J., Schatz, P., Covassin, T., Henry, L., Pardini, J., & Collins, M. W. (2012). A revised factor structure for the post-concussion symptom scale baseline and postconcussion factors. The American Journal Of Sports Medicine, 40, 2375–2384.
   PubMed Web of Science ®Google Scholar
• Lau, B. C., Collins, M. W., & Lovell, M. R. (2011). Sensitivity and specificity of subacute computerized neurocognitive testing and symptom evaluation in predicting outcomes after sports-related concussion. The American Journal of Sports Medicine, 39(6), 1209–1216.
   Google Scholar
• Lovell, M. R. (2016). Administration and interpretation manual. San Diego, CA: ImPACT Applications, Inc.
   Google Scholar
• Lovell, M. R., Collins, M. W., Podell, K., Powell, J., & Maroon, J. (2000). ImPACT: Immediate post-concussion assessment and cognitive testing. Pittsburgh, PA: NeuroHealth Systems, LLC.
   Google Scholar
• Lovell, M. R., Iverson, G. L., Collins, M. W., Podell, K., Johnston, K. M., Pardini, D., … Maroon, J. C. (2006). Measurement of symptoms following sports-related concussion: Reliability and normative data for the post-concussion scale. Applied Neuropsychology, 13(3), 166–174. doi:10.1207/s15324826an1303_4
   PubMed Web of Science ®Google Scholar
• MacFarlane, M. P., & Glenn, T. C. (2015). Neurochemical cascade of concussion. Journal of Brain Injury, 29(2), 139–153. doi:10.3109/02699052.2014.965208
   PubMed Web of Science ®Google Scholar
• McClincy, M. P., Lovell, M. R., Pardini, J., Collins, M. W., & Spore, M. K. (2006). Recovery from sports concussion in high school and collegiate athletes. Brain Injury, 20(1), 33–39. doi:10.1080/02699050500309817
   PubMed Web of Science ®Google Scholar
• McCrea, M., Hammeke, T., Olsen, G., Leo, P., & Guskiewicz, K. (2004). Unreported concussion in high school football players: Implications for prevention. Clinical Journal of Sport Medicine, 14(1), 13–17. doi:10.1097/00042752-200401000-00003
   PubMed Web of Science ®Google Scholar
• McCrory, P., Meeuwisse, W. H., Dvorak, J., Aubry, M., Bailes, J., Broglio, S., … Vos, P. E. (2017). Consensus statement on concussion in sport—The 5th international conference on concussion in sport held in Berlin, October 2016. British Journal of Sports Medicine, published online first. doi:10.1136/brsports-2017-098699
   Web of Science ®Google Scholar
• McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. doi:10.1037/1082-989X.1.1.30
   Web of Science ®Google Scholar
• Meier, T. B., Brummel, B. J., Singh, R., Nerio, C. J., Polanski, D. W., & Bellgowan, P. S. F. (2014). The underreporting of self-reported symptoms following sports-related concussion. Journal of Science and Medicine in Sport, 18(5), 507–511. doi:10.1016/j.jsams.2014.07.008
   PubMed Web of Science ®Google Scholar
• Merritt, V. C., & Arnett, P. A. (2014). Premorbid predictors of postconcussion symptoms in collegiate athletes. Journal of Clinical and Experimental Neuropsychology, 36(10), 1098–1111. doi:10.1080/13803395.2014.983463
   PubMed Web of Science ®Google Scholar
• Merritt, V. C., Meyer, J. E., & Arnett, P. A. (2015). A novel approach to classifying postconcussion symptoms: The application of a new framework to the Post-Concussion Symptom Scale. Journal of Clinical and Experimental Neuropsychology, 37(7), 764–775. doi:10.1080/13803395.2015.1060950
   PubMed Web of Science ®Google Scholar
• Merritt, V. C., Rabinowitz, A. R., & Arnett, P. A. (2015). Injury-related predictors of symptom severity following sports-related concussion. Journal of Clinical & Experimental Neuropsychology, 37(3), 265–275. doi:10.1080/13803395.2015.1004303
   PubMed Web of Science ®Google Scholar
• Morgan, C. D., Zuckerman, S. L., Lee, Y. M., King, L., Beaird, S., Sills, A. K., & Solomon, G. S. (2015). Predictors of postconcussion syndrome after sports-related concussion in young athletes: A matched case-control study. Journal of Neurosurgery: Pediatrics, 15(6), 589–598.
   PubMed Web of Science ®Google Scholar
• Moser, R. S., Iverson, G. L., Echemendia, R. J., Lovell, M. R., Schatz, P., Webbe, F. M., … Silver, C. H. (2007). Neuropsychological evaluation in the diagnosis and management of sports-related concussion. Archives of Clinical Neuropsychology, 22(8), 909–916. doi:10.1016/j.acn.2007.09.004
   PubMed Web of Science ®Google Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
   Google Scholar
• Pardini, D., Stump, J., Lovell, M., Collins, M., Moritz, K., & Fu, F. (2004). The Post Concussion Symptom Scale (PCSS): A factor analysis. British Journal of sports medicine, 38(5), 661–662.
   Google Scholar
• Portney, L. G., & Watkins, M. P. (1993). Foundations of clinical research: Applications to practice. Norwalk, CT: Appleton & Lange.
   Google Scholar
• Schatz, P. (2010). Long-term test-retest reliability of baseline cognitive assessments using ImPACT. The American Journal of Sports Medicine, 38(1), 47–53. doi:10.1177/0363546509343805
   PubMed Web of Science ®Google Scholar
• Schatz, P., & Ferris, C. S. (2013). One-month test-retest reliability of the ImPACT test battery. Archives of Clinical Neuropsychology, 28(5), 499–504. doi:10.1093/arclin/act034
   PubMed Web of Science ®Google Scholar
• Shoukri, M. M., Asyali, M. H., & Donner, A. (2004). Sample size requirements for the design of reliability study: Review and new results. Statistical Methods in Medical Research, 13, 251–271.
   Web of Science ®Google Scholar
• Slick, D. (2006). Psychometrics in neuropsychological assessment. In E. Strauss, E. Sherman, & O. Spreen (Eds.), A compendium of neuropsychological tests. New York, NY: Oxford University Press.
   Google Scholar
• Smith-Seemiller, L., Fow, N. R., Kant, R., & Franzen, M. D. (2003). Presence of post-concussion syndrome symptoms in patients with chronic pain vs mild traumatic brain injury. Brain Injury, 17(3), 199–206. doi:10.1080/0269905021000030823
   PubMed Web of Science ®Google Scholar
• Topolovec-Vranic, J., Zhang, S., Wong, H., Lam, E., Jing, R., Russell, K., … Weng, X.; Candadian Brain Injury and Violence Research Team. (2015). Recognizing the symptoms of mental illness following concussions in the sports community: A need for improvement. PLoS One, 10(11), e0141699. doi:10.1371/journal.pone.0141699
   PubMed Web of Science ®Google Scholar
• Trahan, D. E., Ross, C. E., & Trahan, S. L. (2001). Relationships among postconcussional-type symptoms, depression, and anxiety in neurologically normal young adults and victims of mild brain injury. Archives of Clinical Neuropsychology, 16(5), 435–445. doi:10.1093/arclin/16.5.435
   PubMed Web of Science ®Google Scholar
• Tsushima, W. T., Siu, A. M., Pearce, A. M., Zhang, G., & Oshiro, R. S. (2016). Two-year test-retest reliability of ImPACT in high school athletes. Archives of Clinical Neuropsychology, 31(1), 105–111. doi:10.1093/arclin/acv066
   PubMed Web of Science ®Google Scholar
• Wang, Y., Chan, R. C. K., & Deng, Y. (2006). Examination of postconcussion-like symptoms in healthy university students: Relationships to subjective and objective neuropsychological function performance. Archives of Clinical Neuropsychology, 21(4), 339–347. doi:10.1016/j.acn.2006.03.006
   PubMed Web of Science ®Google Scholar
• Weir, J. P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Condition Research, 19(1), 231–240.
   PubMed Web of Science ®Google Scholar
• Ziegler, M., Ehrlenspiel, F., & Brand, R. (2009). Latent state-trait theory: An application in sport psychology. Psychology of Sport and Exercise, 10, 344–349. doi:10.1016/j.psychsport.2008.12.004
   Web of Science ®Google Scholar