The impact of administration order in studies of computerized neurocognitive assessment tools (NCATs)

References

• Ackerman, P. L., & Kanfer, R. (2009). Test length and cognitive fatigue: An empirical examination of effects on performance and test-taker reactions. Journal of Experimental Psychology: Applied, 15(2), 163–181. doi:10.1037/a0015719
   PubMed Web of Science ®Google Scholar
• Baird, B. J., Tombaugh, T. N., & Francis, M. (2007). The effects of practice on speed of information processing using the adjusting-paced serial addition test (Adjusting-PSAT) and the computerized tests of information processing (CTIP). Applied Neuropsychology, 14(2), 88–100. doi:10.1080/09084280701319912
   PubMed Web of Science ®Google Scholar
• Basso, M. R., Bornstein, R. A., & Lang, J. M. (1999). Practice effects on commonly used measures of executive function across twelve months. The Clinical Neuropsychologist, 13(3), 283–292. doi:10.1076/clin.13.3.283.1743
   PubMed Web of Science ®Google Scholar
• Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J. … Siemers, E. R. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. doi:10.1016/j.acn.2004.12.003
   PubMed Web of Science ®Google Scholar
• Benedict, R. H., & Zgaljardic, D. J. (1998). Practice effects during repeated administrations of memory tests with and without alternate forms. Journal of Clinical and Experimental Neuropsychology, 20(3), 339–352. doi:10.1076/jcen.20.3.339.822
   PubMed Web of Science ®Google Scholar
• Broglio, S. P., Ferrara, M. S., Macciocchi, S. N., Baumgartner, T. A., & Elliott, R. (2007). Test- retest reliability of computerized concussion assessment programs. Journal of Athletic Training, 42(4), 509–514.
   PubMed Web of Science ®Google Scholar
• Brophy, L. M., Jackson, M., & Crowe, S. F. (2009). Interference effects on commonly used memory tasks. Archives of Clinical Neuropsychology, 24(1), 105–112. doi:10.1093/arclin/acp013
   PubMed Web of Science ®Google Scholar
• Campbell, D., & Stanley, J. (1963). Experimental and quasi-experimental designs for research. Chicago, IL: Rand-McNally.
   Google Scholar
• Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology,22, S39–S48. doi:10.1016/j.acn.2006.10.004
   PubMed Web of Science ®Google Scholar
• Elias, M. F., Robbins, M. A., & Elias, P. K. (1996). A 15-year longitudinal study of Halstead-Reitan neuropsychological test performance. Journal of Gerontology: Psychological Sciences, 51B(6), P331–P334. doi:10.1093/geronb/51B.6.P331
   Google Scholar
• Eonta, S. E., Carr, W., McArdle, J. J., Kain, J. M., Tate, C., Wesensten, N. J., … Kamimori, G. H. (2011). Automated neuropsychological assessment metrics: Repeated assessment with two military samples. Aviation, Space, and Environmental Medicine, 82(1), 34–39. doi:10.3357/ASEM.2799.2011
   PubMedGoogle Scholar
• Ferguson, C. J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40(5), 532–538. doi:10.1037/a0015808
   Web of Science ®Google Scholar
• Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. R., Henry, G. K., & Hart, R. P. (2010). Official position of the American academy of clinical neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administrations in clinical and forensic contexts. The Clinical Neuropsychologist, 24(8), 1267–1278. doi:10.1080/13854046.2010.526785
   PubMed Web of Science ®Google Scholar
• Jensen, J. L., Berry, D. A., & Kummer, T. A. (2013). Investigating the effects of exam length on performance and cognitive fatigue. PloS ONE, 8(8), 1–9. doi:10.1371/journal.pone.0070270
   Web of Science ®Google Scholar
• Kay, G., & Kane, R. L. (1991). Repeated measures in neuropsychology: Use of serial testing to measure changes in cognitive functioning. Journal of Clinical and Experimental Neuropsychology, 13, 49–50.
   Web of Science ®Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). New York, NY: Oxford University Press.
   Google Scholar
• Llorente, A. M., Sines, M. C., Rozelle, J. C., Turcich, M. R., & Casatta, A. (2000). Effects of test administration order on children’s neuropsychological performance: Emerging one-word expressive and receptive language skills. The Clinical Neuropsychologist, 14(2), 162–172.
   PubMed Web of Science ®Google Scholar
• Lloyd, K. P., Higginson, C. I., Lating, J. M., & Coiro, M. J. (2012). Test-order effects: A measure of verbal memory influences performance on a measure of verbal fluency. Applied Neuropsychology: Adult, 19(4), 299–304. doi:10.1080/09084282.2012.670153
   PubMed Web of Science ®Google Scholar
• Lowe, C., & Rabbitt, P. (1998). Test/re-test reliability of the CANTAB and ISPOCD neuropsychological batteries: Theoretical and practical issues. Neuropsychologia, 36(9), 915–923.
   PubMed Web of Science ®Google Scholar
• McCaffrey, R. J., Ortega, A., Orsillo, S. M., Nelles, W. B., & Haase, R. F. (1992). Practice effects in repeated neuropsychological assessments. The Clinical Neuropsychologist, 6, 32–42.
   Google Scholar
• McCaffrey, R. J., Westervelt, H. J., & Haase, R. F. (2001). Serial neuropsychological assessment with the National Institute of Mental Health (NIMH) AIDS abbreviated neuropsychological battery. Archives of Clinical Neuropsychology, 16(1), 9–18.
   PubMed Web of Science ®Google Scholar
• Nelson, L. D., Pfaller, A. Y., Rein, L. E., & McCrea, M. A. (2015). Rates and predictors of invalid baseline test performance in high school and collegiate athletes for 3 computerized neurocognitive tests; ANAM, axon sports, and ImPACT. The American Journal of Sports Medicine, 1–9. doi:10.1177/0363546515587714
   Web of Science ®Google Scholar
• Nelson, L. D., LaRoche, A. A., Pfaller, A. Y., Lerne, B. E., Hammeke, T. A., Randolph, C., … McCrea, M. A. (2016). Prospective, head-to-head study of three computerized neurocognitive assessment tools (CNTs): Reliability and validity for the assessment of sport- related concussion. Journal of the International Neuropsychological Society, 22, 24–37. doi:10.1017/S1355617715001101
   PubMed Web of Science ®Google Scholar
• Neuger, G. J., O’Leary, D. S., Fishburne, F. J., Barth, J. T., Berent, S., Groidani, B., & Boll, T. J. (1981). Order effects on the Halstead-Reitan neuropsychological battery and allied procedures. Journal of Consulting and Clinical Psychology, 49(5), 722–730.
   PubMed Web of Science ®Google Scholar
• Rogers, J. J., & Fox, A. M. (2012). Event-related potential practice effects on the paced auditory serial addition test (PASAT). Advances in Cognitive Psychology, 8(4), 281–291. doi:10.2478/v10053-008-0123-z
   PubMed Web of Science ®Google Scholar
• Ryan, J. J., Glass, L. A., Hinds, R. M., & Brown, C. N. (2010). Administration order effects on the test of memory malingering. Applied Neuropsychology, 17(4), 246–250. doi:10.1080/09084282.2010.499802
   PubMed Web of Science ®Google Scholar
• Schacter, D. L., & Buckner, R. L. (1998). Priming and the Brain. Neuron, 20, 185–195.
   PubMed Web of Science ®Google Scholar
• Schatz, P. (2010). Long-term test-retest reliability of baseline cognitive assessments using ImPACT. The American Journal of Sports Medicine, 38(1), 47–53. doi:10.1177/0363546509343805
   PubMed Web of Science ®Google Scholar
• Segalowitz, S., Mahaney, P., Santesso, D., Macgregor, L., Dywan, J., & Willer, B. (2007). Retest reliability in adolescents of a computerized neuropsychological battery used to assess recovery from concussion. NeuroRehabilitation, 22(3), 243–251.
   PubMed Web of Science ®Google Scholar
• Tulsky, D. S., & Zhu, J. (2000). Could test length or order affect scores on letter number sequencing of the WAIS-III and WMS-III? Ruling out effects of fatigue. The Clinical Neuropsychologist, 14(4), 474–478.
   PubMed Web of Science ®Google Scholar
• Wilson, B. A., Watson, P. C., Baddeley, A. D., Emslie, H., & Evans, J. J. (2000). Improvement or simply practice? The effects of twenty repeated assessments on people with and without brain injury. Journal of the International Neuropsychological Society, 6, 469–479.
   PubMed Web of Science ®Google Scholar
• Zhu, J., & Tulsky, D. S. (2000). Co-norming of the WAIS-III and WMS-III: Is there a test-order effect on IQ and memory scores? The Clinical Neuropsychologist, 14(4), 461–467.
   PubMed Web of Science ®Google Scholar