Digital neuropsychological assessment: Feasibility and applicability in patients with acquired brain injury

References

• American Psychological Association. (Ed.). (1986). Guidelines for computer-based tests and interpretations.
   Google Scholar
• Baker, E., Letz, R. E., Fidler, A. T., Shalat, S., Plantamura, D., & Lyndon, M. (1985). A computer-based neurobehavioral evaluation system for occupational and environmental epidemiology: Methodology and validation studies. Neurobehavioral Toxicology and Teratology, 7(4), 369–377.
   PubMedGoogle Scholar
• Bauer, R. M., Iverson, G. L., Cernich, A. N., Binder, L. M., Ruff, R. M., & Naugle, R. I. (2012). Computerized neuropsychological assessment devices: joint position paper of the american academy of clinical neuropsychology and the national academy of neuropsychology. Archives of Clinical Neuropsychology, 27(3), 362–373. https://doi.org/10.1093/arclin/acs027
   PubMed Web of Science ®Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate - a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B (Methological), 57(1), 289–300. https://www.jstor.org/stable/2346101
   Google Scholar
• Bilder, R. M., & Reise, S. P. (2019). Neuropsychological tests of the future: How do we get there from here? The Clinical Neuropsychologist, 33(2), 220–245. https://doi.org/10.1080/13854046.2018.1521993
   PubMed Web of Science ®Google Scholar
• Calamia, M., Markon, K., & Tranel, D. (2012). Scoring higher the second time around: Meta-analyses of practice effects in neuropsychological assessment. The Clinical Neuropsychologist, 26(4), 543–570. https://doi.org/10.1080/13854046.2012.680913
   PubMed Web of Science ®Google Scholar
• Canini, M., Battista, P., Della Rosa, P. A., Catricalà, E., Salvatore, C., Gilardi, M. C., & Castiglioni, I. (2014). Computerized neuropsychological assessment in aging: Testing efficacy and clinical ecology of different interfaces. Computational and Mathematical Methods in Medicine, 2014, 804723. https://doi.org/10.1155/2014/804723
   PubMed Web of Science ®Google Scholar
• Carr, A. C., Woods, R. T., & Moore, B. J. (1986). Automated cognitive assessment of elderly patients: A comparison of two types of response device. British Journal of Clinical Psychology, 25(4), 305–306. https://doi.org/10.1111/j.2044-8260.1986.tb00711.x
   PubMed Web of Science ®Google Scholar
• Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22(SUPPL. 1), 39–48. https://doi.org/10.1016/j.acn.2006.10.004
   PubMed Web of Science ®Google Scholar
• Commission, I. T. (2001). International guidelines for test use. International Journal of Testing, 1(2), 93–114. https://doi.org/10.1207/S15327574IJT0102
   Google Scholar
• Davis, R., Libon, D. J., Au, R., Pitman, D., & Penney, D. L. (2015). THink: Inferring cognitive status from subtle behaviors. AI Magazine, 36(3), 49–60. https://doi.org/10.1609/aimag.v36i3.2602
   Web of Science ®Google Scholar
• Diaz-Orueta, U., Blanco-Campal, A., Lamar, M., Libon, D. J., & Burke, T. (2020). Marrying past and present neuropsychology: is the future of the process-based approach technology-based? Frontiers in Psychology, 11(March), 1–15. https://doi.org/10.3389/fpsyg.2020.00361
   PubMed Web of Science ®Google Scholar
• Dickinson, M. D., & Hiscock, M. (2011). The Flynn effect in neuropsychological assessment. Applied Neuropsychology, 18(2), 136–142. https://doi.org/10.1080/09084282.2010.547785
   PubMed Web of Science ®Google Scholar
• Elwood, R. W. (2001). MicroCog: Assessment of cognitive functioning. Neuropsychology Review, 11(2), 89–100. https://doi.org/10.1023/A:1016671201211
   PubMed Web of Science ®Google Scholar
• Findlater, L., Froehlich, J. E., Fattal, K., Wobbrock, J. O., & Dastyar, T. (2013). Age-related differences in performance with touchscreens compared to traditional mouse input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13) (pp. 343–346). Association for Computing Machinery. https://doi.org/10.1145/2470654.2470703
   Google Scholar
• Folstein, M. F., Folstein, S. E., White, T., & Messer, M. A. (2010). MMSE-2: Mini-mental state examination (2nd ed.). Psychological Assessment Resources, Inc.
   Google Scholar
• Germine, L., Reinecke, K., & Chaytor, N. S. (2019). Digital neuropsychology: Challenges and opportunities at the intersection of science and software. Clinical Neuropsychologist, 33(2), 271–286. https://doi.org/10.1080/13854046.2018.1535662
   PubMed Web of Science ®Google Scholar
• Gershon, R. C., Cella, D., Fox, N. A., Havlik, R. J., Hendrie, H. C., & Wagster, M. V. (2010). Assessment of neurological and behavioural function: The NIH Toolbox. The Lancet Neurology, 9(2), 138–139. https://doi.org/10.1016/S1474-4422(09)70335-7
   PubMed Web of Science ®Google Scholar
• Gerth, S., Dolk, T., Klassert, A., Fliesser, M., Fischer, M. H., Nottbusch, G., & Festman, J. (2016). Adapting to the surface: A comparison of handwriting measures when writing on a tablet computer and on paper. Human Movement Science, 48, 62–73. https://doi.org/10.1016/j.humov.2016.04.006
   PubMed Web of Science ®Google Scholar
• Gualtieri, C. T., & Johnson, L. G. (2006). Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21(7), 623–643. https://doi.org/10.1016/j.acn.2006.05.007
   PubMed Web of Science ®Google Scholar
• Guilbert, J., Alamargot, D., & Morin, M. F. (2019). Handwriting on a tablet screen: Role of visual and proprioceptive feedback in the control of movement by children and adults. Human Movement Science, 65(September), 30–41. https://doi.org/10.1016/j.humov.2018.09.001
   Web of Science ®Google Scholar
• Hammes, J. (1973). De Stroop Kleur-Woord Test: Handleiding [The Stroop Color-Word Test: Manual]. Swets & Zeitlinger.
   Google Scholar
• Harvey, P. D. (2012). Clinical applications of neuropsychological assessment. Dialogues in Clinical Neuroscience, 14(1), 91–99.
   PubMedGoogle Scholar
• Hazan, E., Frankenburg, F., Brenkel, M., & Shulman, K. (2017). The test of time: A history of clock drawing. International Journal of Geriatric Psychiatry, 33(1), e22–e30. https://doi.org/10.1002/gps.4731
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., & Matthews, C. G. (1986). Differences in neuropsychological test performance associated with age, education, and sex. In I. Grant & K. M. Adams (Eds.), Neuropsychological assessment in neuropsychiatric disorders: Clinical methods and empirical findings (pp. 100–120). Oxford University Press.
   Google Scholar
• Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin card sorting test manual revised and expanded (2nd ed.). Psychological Assessment Resources, Inc.
   Google Scholar
• Holzinger, A. (2010). Finger instead of mouse: touch screens as a means of enhancing universal access. IIn N. Carbonell, & C. Stephanidis (Eds.), Universal access : Theoretical perspectives, practice, and experience (Vol. 2615, pp. 387–397). (Lecture notes in computer sciences). Springer. https://doi.org/10.1007/3-540-36572-9_30
   Google Scholar
• Iverson, G. L., Brooks, B. L., Ashton, V. L., Johnson, L. G., & Gualtieri, C. T. (2009). Does familiarity with computers affect computerized neuropsychological test performance? Journal of Clinical and Experimental Neuropsychology, 31(5), 594–604. https://doi.org/10.1080/13803390802372125
   PubMed Web of Science ®Google Scholar
• Jenkins, A., Lindsay, S., Eslambolchilar, P., Thornton, I. M., & Tales, A. (2016). Administering cognitive tests through touch screen tablet devices: Potential issues. Journal of Alzheimer’s Disease, 54(3), 1169–1182. https://doi.org/10.3233/JAD-160545
   PubMed Web of Science ®Google Scholar
• Joddrell, P., & Astell, A. J. (2016). Studies involving people with dementia and touchscreen technology: A literature review. JMIR Rehabilitation and Assistive Technologies, 3(2), e10. https://doi.org/10.2196/rehab.5788
   PubMedGoogle Scholar
• Kabat, M. H., Kane, R. L., Jefferson, A. L., & DiPino, R. K. (2001). Construct validity of selected automated neuropsychological assessment metrics (ANAM) battery measures. Clinical Neuropsychologist, 15(4), 498–507. https://doi.org/10.1076/clin.15.4.498.1882
   PubMed Web of Science ®Google Scholar
• Kane, R. L., & Kay, G. G. (1992). Computerized assessment in neuropsychology: A review of tests and test batteries. Neuropsychology Review, 3(1), 1–117. https://doi.org/10.1007/BF01108787
   PubMed Web of Science ®Google Scholar
• Kane, R. L., & Reeves, D. L. (1997). The neuropsychology handbook: Automated neuropsychological assessment metrics (ANAM). Springer.
   Google Scholar
• Kaplan, E. (1988). The process approach to neuropsychological assessment. Aphasiology, 2(3–4), 309–311. https://doi.org/10.1080/02687038808248930
   Web of Science ®Google Scholar
• Kim, H., Cho, Y. S., & Do, E. Y. L. (2011). Computational clock drawing analysis for cognitive impairment screening. Proceedings of the 5th International Conference on Tangible Embedded and Embodied Interaction, TEI’11(May 2014), 297–300. https://doi.org/10.1145/1935701.1935768
   Google Scholar
• Knudsen, A. K., Hotopf, M., Skogen, J. C., Øverland, S., & Mykletun, A. (2010). The health status of nonparticipants in a population-based health study. American Journal of Epidemiology, 172(11), 1306–1314. https://doi.org/10.1093/aje/kwq257
   PubMed Web of Science ®Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). Oxford University Press.
   Google Scholar
• Lezak, M. D., Howieson, D. B., Loring, D. W., Hannay, H. J., & Fischer, J. S. (2004). Neuropsychological assessment (4th ed.). Oxford University Press.
   Google Scholar
• Maroon, J. C., Lovell, M. R., Norwig, J., Podell, K., Powell, J. W., & Hartl, R. (2000). Cerebral concussion in athletes: Evaluation and neuropsychological testing. Neurosurgery, 47(3), 659–672. https://doi.org/10.1227/00006123-200009000-00027
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., & Meyers, K. R. (1995). Rey complex figure test and recognition trial. Psychological Assessment Resources.
   Google Scholar
• Muñiz, J., & Bartram, D. (2007). Improving international tests and testing. European Psychologist, 12(3), 206–219. https://doi.org/10.1027/1016-9040.12.3.206
   Web of Science ®Google Scholar
• Murata, A., & Iwase, M. (2005). Usability of touch-panel interfaces for older adults. Human Factors, 47(4), 767–776. https://doi.org/10.1518/001872005775570952
   PubMed Web of Science ®Google Scholar
• Nasreddine, Z. S., Philips, N. A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., … Chertkow, H. (2005). The montreal cognitive assessment, MoCA : A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. https://doi.org/10.1111/j.1532-5415.2005.53221.x
   PubMed Web of Science ®Google Scholar
• Nyhus, E., & Barceló, F. (2009). The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions : A critical update. Brain and Cognition, 71(3), 437–451. https://doi.org/10.1016/j.bandc.2009.03.005
   PubMed Web of Science ®Google Scholar
• Olson, R., Parkinson, M., & McKenzie, M. (2010). Selection bias introduced by neuropsychological assessments. Canadian Journal of Neurological Sciences, 37(2), 264–268. https://doi.org/10.1017/S0317167100010039
   PubMed Web of Science ®Google Scholar
• Parsey, C. M., & Schmitter-Edgecombe, M. (2013). Applications of technology in neuropsychological assessment. Clinical Neuropsychologist, 27(8), 1328–1361. https://doi.org/10.1080/13854046.2013.834971
   PubMed Web of Science ®Google Scholar
• Paul, R. H., Lawrence, J., Williams, L. M., Richard, C. C., Cooper, N., & Gordon, E. (2005). Preliminary validity of “integneuroTM”: A new computerized battery of neurocognitive tests. International Journal of Neuroscience, 115(11), 1549–1567. https://doi.org/10.1080/00207450590957890
   PubMed Web of Science ®Google Scholar
• Powell, D. H., Kaplan, E. F., Whitla, D., Catlin, R., & Funkenstein, H. H. (1993). Microcog: Assessment of cognitive functioning version 2.1. The Psychological Corporation.
   Google Scholar
• Rabin, L. A., Spadaccini, A. T., Brodale, D. L., Grant, K. S., Elbulok-Charcape, M. M., & Barr, W. B. (2014). Utilization rates of computerized tests and test batteries among clinical neuropsychologists in the United States and Canada. Professional Psychology, Research and Practice, 45(5), 368–377. https://doi.org/10.1037/a0037987
   Web of Science ®Google Scholar
• Rasquin, S., Ooms, N., van de Sande, P., Beers, K., & Schmand, B. (2009). Validity and data of reference of a visual-spatial search task: O-search-task [in Dutch]. Tijdschrift Voor Neuropsychologie, 3, 44–54.
   Google Scholar
• Reitan, R. M. (1955). The relation of the trail making test to organic brain damage. Journal of Consulting Psychology, 19(5), 393–394. https://doi.org/10.1037/h0044509
   PubMedGoogle Scholar
• Robbins, T. W., James, M., Owen, A. M., Sahakian, B. J., Lawrence, A. D., Mcinnes, L., & Rabbitt, P. M. A. (1998). A study of performance on tests from the CANTAB battery sensitive to frontal lobe dysfunction in a large sample of normal volunteers: Implications for theories of executive functioning and cognitive aging. Journal of the International Neuropsychological Society, 4(5), 474–490. https://doi.org/10.1017/S1355617798455073
   PubMed Web of Science ®Google Scholar
• Robbins, T. W., James, M., Owen, A. M., Sahakian, B. J., McInnes, L., & Rabbitt, P. (1994). Cambridge neuropsychological test automated battery (CANTAB): A factor analytic study of a large sample of normal elderly volunteers. Dementia, 5(5), 266–281. https://doi.org/10.1159/000106735
   PubMedGoogle Scholar
• Saan, R. J., & Deelman, B. G. (1986). De 15-Woordentest A en B. (Een voorlopige handleiding). Afdeling Neuropsychologie, AZG (interne publicatie).
   Google Scholar
• Scheydt, S., Müller Staub, M., Frauenfelder, F., Nielsen, G. H., Behrens, J., & Needham, I. (2017). Sensory overload: A concept analysis. International Journal of Mental Health Nursing, 26(2), 110–120. https://doi.org/10.1111/inm.12303
   PubMed Web of Science ®Google Scholar
• Schlegel, R. E., & Gilliland, K. (2007). Development and quality assurance of computer-based assessment batteries. Archives of Clinical Neuropsychology, 22(SUPPL. 1), 49–61. https://doi.org/10.1016/j.acn.2006.10.005
   Web of Science ®Google Scholar
• Schmand, B., Groenink, S. C., & Van Den Dungen, M. (2008). Letterfluency: Psychometrische eigenschappen en Nederlandse normen (Letter fluency: Psychometric properties and Dutch normative data; Article in Dutch). Tijdschrift Voor Gerontologie En Geriatrie, 39(2), 64–76. https://doi.org/10.1007/bf03078128
   PubMedGoogle Scholar
• Schmand, B., Houxen, P., de Koning, I., Gerritsen, M., Hoogman, M., Muslimovic, D., … van Tricht, M. Normen neuropsychologische tests 2012 [Dutch Normative Data Neuropsychological Tests 2012]., Pub. L. No. 2012, Nederlands Instituut van Psychologen (2012).
   Google Scholar
• Schwarz, N. (2007). Retrospective and concurrent self-reports: The rationale for real-time data capture. In The science of real-time data capture: Self-reports in health research (pp. 11–26). Oxford University Press.
   Google Scholar
• Shah, S. G. S., & Robinson, I. (2007). Benefits of and barriers to involving users in medical device technology development and evaluation. International Journal of Technology Assessment in Health Care, 23(1), 131–137. https://doi.org/10.1017/S0266462307051677
   PubMed Web of Science ®Google Scholar
• Shuhfried, G. (2013). Vienna test system: Psychological assessment. Shuhfried.
   Google Scholar
• Shulman, K. I. (2000). Clock-drawing: Is it the ideal cognitive screening test? International Journal of Geriatric Psychiatry, 15(6), 548–561. https://doi.org/10.1002/1099-1166(200006)15:6<548::AID-GPS242>3.0.CO;2-U
   PubMed Web of Science ®Google Scholar
• Silverstein, S. M., Berten, S., Olson, P., Paul, R., Williams, L. M., Cooper, N., & Gordon, E. (2007). Development and validation of a World-Wide-Web-based neurocognitive assessment battery: WebNeuro. Behavior Research Methods, 39(4), 940–949. https://doi.org/10.3758/BF03192989
   PubMed Web of Science ®Google Scholar
• Spreij, L. A., Gosselt, I. K., Visser-Meily, J. M. A., Hoogerbrugge, A., Kootstra, T., & Nijboer, T. C. W. (n.d.). The journey is just as important as the destination - digital neuropsychological assessment provides performance stability measures.
   Google Scholar
• Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd.). Oxford University Press.
   Google Scholar
• Tun, P. A., & Lachman, M. E. (2010). The association between computer use and cognition across adulthood: Use it so you won’t lose it? Psychological Aging, 25(3), 560–568. https://doi.org/10.1037/a0019543
   PubMed Web of Science ®Google Scholar
• UNESCO Institute for Statistics. (2012). International standard classification of education: ISCED 2011.
   Google Scholar
• Van der Stoep, N., Visser-Meily, J. M. A., Kappelle, L. J., de Kort, P. L. M., Huisman, K. D., Eijsackers, A. L. H., … Nijboer, T. C. W. (2013). Exploring near and far regions of space: Distance-specific visuospatial neglect after stroke. Journal of Clinical and Experimental Neuropsychology, 35(8), 799–811. https://doi.org/10.1080/13803395.2013.824555
   PubMed Web of Science ®Google Scholar
• Verhage, F. (1965). Intelligence and age in a dutch sample. Human Development, 8(4), 238–245. https://doi.org/10.1159/000270308
   Web of Science ®Google Scholar
• Vermeent, S., Dotsch, R., Schmand, B., Klaming, L., Miller, J. B., & van Elswijk, G. (2020). Evidence of validity for a newly developed digital cognitive test battery. Frontiers in Psychology, 11(April), 1–11. https://doi.org/10.3389/fpsyg.2020.00770
   PubMed Web of Science ®Google Scholar
• Wallace, S. E., Donoso Brown, E. V., Schreiber, J. B., Diehl, S., Kinney, J., & Zangara, L. (2019). Touchscreen tablet-based cognitive assessment versus paper-based assessments for traumatic brain injury. NeuroRehabilitation, 45(1), 25–36. https://doi.org/10.3233/NRE-192725
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (2004). WAIS-III Nederlandse bewerking – Derde editie. Afname en scoringshandleiding. Harcourt Test Publishers.
   Google Scholar
• Wilson, B., Cockburn, J., & Halligan, P. W. (1987). Development of a behavioral test of visuospatial neglect. Archives of Physical Medicine and Rehabilitation, 68(2), 98–102.
   PubMed Web of Science ®Google Scholar
• Witt, J. A., Alpherts, W., & Helmstaedter, C. (2013). Computerized neuropsychological testing in epilepsy: Overview of available tools. Seizure, 22(6), 416–423. https://doi.org/10.1016/j.seizure.2013.04.004
   PubMed Web of Science ®Google Scholar
• Wood, E., Willoughby, T., Rushing, A., Bechtel, L., & Gilbert, J. (2005). Use of computer input devices by older adults. Journal of Applied Gerontology, 24(5), 419–438. https://doi.org/10.1177/0733464805278378
   Web of Science ®Google Scholar