Computerized Neuropsychological Assessment Devices: Joint Position Paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology

References

• American Academy of Clinical Neuropsychology . 2007 . American Academy of Clinical Neuropsychology (AACN) practice guidelines for neuropsychological assessment and consultation . The Clinical Neuropsychologist , 21 ( 2 ) : 209 – 231 .
   PubMed Web of Science ®Google Scholar
• American Psychological Association . 2007 . Record keeping guidelines . American Psychologist , 62 : 993 – 1004 .
   PubMed Web of Science ®Google Scholar
• American Psychological Association . 1999 . Standards for educational and psychological testing , Washington , DC : American Psychological Association .
   Google Scholar
• American Psychological Association . 1986 . Guidelines for computer-based tests and interpretations , Washington , DC : American Psychological Association .
   Google Scholar
• Anger , WK , Storzbach , D , Binder , LM , Campbell , KA , Rohlman , DS McCauley , L . 1999 . Neurobehavioral deficits in Persian Gulf veterans: evidence from a population-based study. Portland Environmental Hazards Research Center . Journal of the International Neuropsychological Society , 5 ( 3 ) : 203 – 212 .
   PubMed Web of Science ®Google Scholar
• APA (2010). Ethical Principles of Psychologists and Code of Conduct (2010 Amendments), from http://www.apa.org/ethics/code/index.aspx
   Google Scholar
• Berger , SG , Chibnall , JT and Gfeller , JD . 1997 . Construct validity of the computerized version of the Category Test . Journal of Clinical Psychology , 53 ( 7 ) : 723 – 726 .
   PubMed Web of Science ®Google Scholar
• Bleiberg , J , Cernich , AN , Cameron , K , Sun , W , Peck , K Ecklund , PJ . 2004 . Duration of cognitive impairment after sports concussion . Neurosurgery , 54 ( 5 ) : 1073 – 1078 . , discussion 1078–1080
   PubMed Web of Science ®Google Scholar
• Bleiberg , J , Garmoe , WS , Halpern , EL , Reeves , DL and Nadler , JD . 1997 . Consistency of within-day and across-day performance after mild brain injury . Neuropsychiatry, Neuropsychology, and Behavioral Neurology , 10 ( 4 ) : 247 – 253 .
   PubMedGoogle Scholar
• Bolfer , C , Casella , EB , Baldo , MV , Mota , AM , Tsunemi , MH Pacheco , SP . 2010 . Reaction time assessment in children with ADHD . Arquivos de Neuro-Psiquiatria , 68 ( 2 ) : 282 – 286 .
   PubMed Web of Science ®Google Scholar
• Boone , KB . 2009 . The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations . The Clinical Neuropsychologist , 23 : 729 – 741 .
   PubMed Web of Science ®Google Scholar
• Boone , KB . (Ed.) (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. New York: Guilford Press
   Google Scholar
• Broglio , SP , Ferrara , MS , Macciocchi , SN , Baumbartner , TA and Elliott , R . 2007 . Test-retest reliability of computerized concussion assessment programs . Journal of Athletic Training , 42 : 509 – 514 .
   PubMed Web of Science ®Google Scholar
• Brooks , BL , Iverson , GL , Sherman , EM and Roberge , MC . 2010 . Identifying cognitive problems in children and adolescents with depression using computerized neuropsychological testing . Applied Neuropsychology , 17 ( 1 ) : 37 – 43 .
   PubMed Web of Science ®Google Scholar
• Bush , SS , Ruff , RM , Troster , AI , Barth , JT , Koffler , SP Pliskin , NH . 2005 . Symptom validity assessment: practice issues and medical necessity NAN policy & planning committee . Archives of Clinical Neuropsychology , 20 ( 4 ) : 419 – 426 .
   PubMed Web of Science ®Google Scholar
• Campbell , KA , Rohlman , DS , Storzbach , D , Binder , LM , Anger , WK Kovera , CA . 1999 . Test-retest reliability of psychological and neurobehavioral tests self-administered by computer . Assessment , 6 ( 1 ) : 21 – 32 .
   PubMed Web of Science ®Google Scholar
• Cernich , A , Reeves , D , Sun , W and Bleiberg , J . 2007 . Automated Neuropsychological Assessment Metrics sports medicine battery . Archives of Clinical Neuropsychology , 22 ( Suppl 1 ) : S101 – 114 .
   PubMed Web of Science ®Google Scholar
• Cernich , AN , Brennana , DM , Barker , LM and Bleiberg , J . 2007 . Sources of error in computerized neuropsychological assessment . Archives of Clinical Neuropsychology , 22S : S39 – S48 .
   Google Scholar
• Chamberlain , SR , Robbins , TW , Winder-Rhodes , S , Muller , U , Sahakian , BJ Blackwell , AD . 2011 . Translational approaches to frontostriatal dysfunction in attention-deficit/hyperactivity disorder using a computerized neuropsychological battery . Biological Psychiatry , 69 ( 12 ) : 1192 – 1203 .
   PubMed Web of Science ®Google Scholar
• Choca , J and Morris , J . 1992 . Administering the Category Test by computer: Equivalence of results . The Clinical Neuropsychologist , 6 ( 1 ) : 9 – 15 .
   Google Scholar
• Collie , A , Makdissi , M , Maruff , P , Bennell , K and McCrory , P . 2006 . Cognition in the days following concussion: comparison of symptomatic versus asymptomatic athletes . Journal of Neurology, Neurosurgery, and Psychiatry , 77 ( 2 ) : 241 – 245 .
   PubMed Web of Science ®Google Scholar
• Collins , MW , Lovell , MR , Iverson , GL , Ide , T and Maroon , J . 2006 . Examining concussion rates and return to play in high school football players wearing newer helmet technology: a three year prospective cohort study . Neurosurgery , 58 ( 2 ) : 275 – 286 .
   PubMed Web of Science ®Google Scholar
• Constantinou , M , Bauer , L , Ashendorf , L , Fisher , JM and McCaffrey , RJ . 2005 . Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tasks? . Archives of Clinical Neuropsychology , 20 : 191 – 198 .
   PubMed Web of Science ®Google Scholar
• Creeger , CP , Miller , KF and Paredes , DR . 1990 . Micromanaging time: Measuring and controlling timing errors in computer-controlled experiments . Behavior Research Methods, Instruments, and Computers , 22 : 34 – 79 .
   Google Scholar
• Cronbach , LJ . 1971 . “ Test validation ” . In Educational measurement, , 2nd , Edited by: Thorndike , RL . 443 – 507 . Washington , DC : American Council on Education .
   Google Scholar
• Crook , TH , Kay , GG and Larrabee , GJ . 2009 . “ Computer-based cognitive testing ” . In Neuropsychological Asessment of Neuropsychiatric and Neuromedical Disorders, , 3rd , Edited by: Grant , I and Adams , KM . 84 – 100 . New York : Oxford University Press .
   Google Scholar
• Doniger , GM , Dwolatzky , T , Zucker , DM , Chertkow , H , Crystal , H Schweiger , A . 2006 . Computerized cognitive testing battery identifies mild cognitive impairment and mild dementia even in the presence of depressive symptoms . American Journal of Alzheimer's Disease and Other Dementias , 21 ( 1 ) : 28 – 36 .
   PubMedGoogle Scholar
• Doniger , GM , Zucker , DM , Schweiger , A , Dwolatzky , T , Chertkow , H Crystal , H . 2005 . Towards practical cognitive assessment for detection of early dementia: a 30-minute computerized battery discriminates as well as longer testing . Current Alzheimer Research , 2 ( 2 ) : 117 – 124 .
   PubMedGoogle Scholar
• Dorion , AA , Sarazin , M , Hasboun , D , Hahn-Barma , V , Dubois , B Zouaoui , A . 2002 . Relationship between attentional performance and corpus callosum morphometry in patients with Alzheimer's disease . Neuropsychologia , 40 ( 7 ) : 946 – 956 .
   PubMed Web of Science ®Google Scholar
• Downing , SM . & Haladyna, T. M. (Eds.) (2006). Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates Publishers
   Google Scholar
• Dwolatzky , T , Whitehead , V , Doniger , GM , Simon , ES , Schweiger , A Jaffe , D . 2004 . Validity of the Mindstreams computerized cognitive battery for mild cognitive impairment . Journal of Molecular Neuroscience , 24 ( 1 ) : 33 – 44 .
   PubMed Web of Science ®Google Scholar
• Feldstein , SN , Keller , FR , Protman , RE , Durham , RL , Klebe , KJ and Davis , HP . 1999 . A comparison of computerized and standard version of the Wisconsin Card Sorting Test . The Clinical Neuropsychologist , 13 : 303 – 313 .
   PubMed Web of Science ®Google Scholar
• Forster , KI and Forster , JC . 2003 . DMDX: A Windows display proram with millisecond accuracy . Behavior Research Methods, Instruments, and Computers , 35 : 116 – 124 .
   PubMedGoogle Scholar
• Franzen , MD . 1989 . Reliability and validity in neuropsychological assessment , New York , NY : Plenum Press .
   Google Scholar
• Franzen , MD . 2000 . Reliability and validity in neurological assessment, , 2nd , New York , NY : Kluwer Academic/Plenum Press .
   Google Scholar
• Gaver , WW . 1991 . “ Technology affordances ” . In In CHI 1991 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Reaching through Technology , New York : Association for Computing Machinery .
   Google Scholar
• Gofen , A and Mackeben , M . 1997 . An introduction to accurate display timing for PC's under “Windows” . Spatial Vision , 10 ( 4 ) : 361 – 368 .
   PubMedGoogle Scholar
• Green , P , Rohling , ML , Lees-Haley , PR and Allen , LM . 2001 . Effort has a greater effect on test scores than severe brain injury in compensation claimants . Brain Injury , 15 : 1045 – 1060 .
   PubMed Web of Science ®Google Scholar
• Green , P , Rohling , ML , Lees-Haley , PR and Allen , LM 3rd . 2001 . Effort has a greater effect on test scores than severe brain injury in compensation claimants . Brain Injury , 15 ( 12 ) : 1045 – 1060 .
   PubMed Web of Science ®Google Scholar
• Gualtieri , CT and Johnson , LG . 2005 . Neurocognitive testing supports a broader concept of mild cognitive impairment . American Journal of Alzheimer's Disease and Other Dementias , 20 ( 6 ) : 359 – 366 .
   PubMedGoogle Scholar
• Gualtieri , CT and Johnson , LG . 2006 . Efficient allocation of attentional resources in patients with ADHD: maturational changes from age 10 to 29 . Journal of Attentional Disorders , 9 ( 3 ) : 534 – 542 .
   PubMedGoogle Scholar
• Gualtieri , CT and Johnson , LG . 2008 . A computerized test battery sensitive to mild and severe brain injury . Medscape Journal of Medicine , 10 ( 4 ) : 90
   PubMedGoogle Scholar
• Heilbronner , RL , Sweet , JJ , Morgan , JE , Larrabee , GJ and Millis , SR . 2009 . American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering . The Clinical Neuropsychologist , 23 ( 7 ) : 1093 – 1129 .
   PubMed Web of Science ®Google Scholar
• Heilbronner , RL , Sweet , JJ , Morgan , JE , Larrabee , GJ , Millis , SR and Participants , C . 2009 . American Academy of Clinical Neuropsychology Consensus Conference statement on the neuropsychological assessment of effort, response bias, and malingering . The Clinical Neuropsychologist , 23 ( 7 ) : 1093 – 1129 .
   PubMed Web of Science ®Google Scholar
• Hitchcock , E . 2006 . Computer access for people after stroke . Topics in Stroke Rehabilitation , 13 : 22 – 30 .
   PubMed Web of Science ®Google Scholar
• Iverson , GL , Brooks , BL , Ashton , VL , Johnson , LG and Gualtieri , CT . 2009 . Does familiarity with computers affect computerized neuropsychological test performance? . Journal of Clinical and Experimental Neuropsychology , 31 : 594 – 604 .
   PubMed Web of Science ®Google Scholar
• Iverson , GL , Brooks , BL , Collins , MW and Lovell , MR . 2006 . Tracking neuropsychological recovery following concussion in sport . Brain Injury , 20 ( 3 ) : 245 – 252 .
   PubMed Web of Science ®Google Scholar
• Iverson , GL , Brooks , BL , Langenecker , SA and Young , AH . 2011 . Identifying a cognitive impairment subgroup in adults with mood disorders . Journal of Affective Disorders , 132 : 360 – 367 .
   PubMed Web of Science ®Google Scholar
• Iverson , GL , Brooks , BL , Lovell , MR and Collins , MW . 2006 . No cumulative effects for one or two previous concussions . British Journal of Sports Medicine , 40 ( 1 ) : 72 – 75 .
   PubMed Web of Science ®Google Scholar
• Kramer , JJ . 1987 . On the question of professional standards for computer-based test interpretation . American Psychologist , 42 : 889 – 890 .
   Web of Science ®Google Scholar
• Larrabee , GJ . 2007 . Assessment of malingered neuropsychological deficits , New York : Oxford University Press .
   Google Scholar
• Marx , BP , Brailey , K , Proctor , SP , MacDonald , HZ , Graefe , AC Amoroso , P . 2009 . Association of Time Since Deployment, Combat Intensity, and Posttraumatic Stress Symptoms With Neuropsychological Outcomes Following Iraq War Deployment . Archives of General Psychiatry , 66 ( 9 ) : 996 – 1004 .
   PubMed Web of Science ®Google Scholar
• Matarazzo , JD . 1985 . Clinical psychological tst interpretations by computer: Hardware outpaces software . Computers in Human Behavior , 1 : 235 – 253 .
   Google Scholar
• Matarazzo , JD . 1986 . Computerized clinical psychological test interpretations: Unvalidated plue all mean and no sigma . American Psychologist , 41 : 96
   PubMed Web of Science ®Google Scholar
• Matarazzo , JD . 1990 . Psychological assessment versus psychological testing: Validation from Binet to the school, clinic, and courtroom . American Psychologist , 45 : 999 – 1017 .
   PubMed Web of Science ®Google Scholar
• McInnes , WJ and Taylor , TL . 2001 . Millisecond timing on PC's and Macs . Behavior Research Methods Instruments and Computers , 31 ( 1 ) : 129 – 136 .
   Google Scholar
• McLay , R , Spira , J and Reeves , D . 2010 . Use of computerized neuropsychological testing to help determine fitness to return to combat operations when taking medication that can influence cognitive function . Military Medicine , 175 ( 12 ) : 945 – 946 .
   PubMed Web of Science ®Google Scholar
• Messick , S . 1989 . “ Validity ” . In Educational measurement, , 3rd , Edited by: Linn , RL . 13 – 103 . New York : American Council on Education and Macmillan .
   Google Scholar
• Mitrushina , M , Boone , KB , Razani , J and D'Elia , LF . 2005 . Handbook of normative data for neuropsychological assessment, , 2nd , New York : Oxford University Press .
   Google Scholar
• Moore , JL , McAuley , JW , Long , L and Bornstein , R . 2002 . An Evaluation of the Effects of Methylphenidate on Outcomes in Adult Epilepsy Patients . Epilepsy & Behavior , 3 ( 1 ) : 92 – 95 .
   PubMed Web of Science ®Google Scholar
• Myors , B . 1999 . Timing accuracy of PC programs running under DOS and Windows . Behavior Research Methods, Instruments, & Computers , 31 : 322 – 328 .
   PubMedGoogle Scholar
• Naglieri , JA , Drasgow , F , Schmit , M , Handler , L , Prifitera , A , Margolis , A and Velasquez , R . Psychological testing on the internet: New problems, old issues . American Psychologist , 59 ( 3 ) 150 – 162 . (date)
   PubMed Web of Science ®Google Scholar
• Newman , TB and Kohn , MR . 2009 . Evidence-based diagnosis , New York : Cambridge University Press .
   Google Scholar
• Nunnally , JC and Bernstein , IH . 1994 . Psychometric theory, , 3rd , New York : McGraw-Hill, Inc .
   Google Scholar
• Ozonoff , D . 1995 . Environmental medicine for all: getting there form here . Lancet , 346 ( 8979 ) : 860
   PubMed Web of Science ®Google Scholar
• Pedhazer , EJ and Pedhazer Schmelkin , L . 1991 . Measurement, design, and analysis: An integrated approach , Hillsdale , NJ : Lawrence Erlbaum Associates Publishers .
   Google Scholar
• Peterson , SE , Stull , MJ , Collins , MW and Wang , HE . 2009 . Neurocognitive function of emergency department patients with mild traumatic brain injury . Annals of Emergency Medicine , 53 ( 6 ) : 796 – 803 e791 .
   PubMed Web of Science ®Google Scholar
• Plant , RR and Turner , G . 2009 . Millisecond precision psychological research in a world of commodity computers: new hardware, new problems? . Behavior Research Methods , 41 ( 3 ) : 598 – 614 .
   PubMed Web of Science ®Google Scholar
• Plant , RR , Hammond , N and Turner , G . 2004 . Self-validating presentation and response timing in cognitive paradigms: how and why? . Behavioral Research Methods, Instrumentation, and Computers , 36 ( 2 ) : 291 – 303 .
   PubMedGoogle Scholar
• Polderman , TJ , van Dongen , J and Boomsma , DI . 2011 . The relation between ADHD symptoms and fine motor control: a genetic study . Child Neuropsychology , 17 ( 2 ) : 138 – 150 .
   PubMed Web of Science ®Google Scholar
• Raymond , PD , Hinton-Bayre , AD , Radel , M , Ray , MJ and Marsh , NA . 2006 . Assessment of statistical change criteria used to define significant change in neuropsychological test performance following cardiac surgery . European Journal of Cardiothoracic Surgery , 29 ( 1 ) : 82 – 88 .
   PubMed Web of Science ®Google Scholar
• Reise , SP and Waller , NG . 2009 . Item response theory and clinical measurement . Annual Review of Clinical Psychology , 5 : 27 – 48 .
   PubMed Web of Science ®Google Scholar
• Retzlaff , PD , Callister , JD and King , RE . 1999 . Clinical procedures for the neuropsychological evaluation of U.S. Air Force pilots . Military Medicine , 164 ( 7 ) : 514 – 519 .
   PubMed Web of Science ®Google Scholar
• Retzlaff , PD and Gibertini , M . 2000 . “ Neuropsychometric issues and problems ” . In Clinician's guide to neuropsychological assessment , Edited by: Vanderploeg , RD . 277 – 299 . Mahwah , NJ : Lawrence Erlbaum Associates, Publishers .
   Google Scholar
• Slick , DJ , Tan , JE , Strauss , E , Mateer , CA , Harnadek , M and Sherman , EM . 2003 . Victoria Symptom Validity Test scores of patients with profound memory impairment: nonlitigants case studies . The Clinical Neuropsychologist , 17 ( 3 ) : 390 – 394 .
   PubMed Web of Science ®Google Scholar
• Stevens , A , Friedel , E , Mehen , G and Merten , T . 2008 . Malingering and uncooperativeness in psychiatric and psychological assessment: prevalance and effects in a German sample of claimants . Psychiatric Research , 157 : 191 – 200 .
   PubMed Web of Science ®Google Scholar
• Sweeney , JA , Kmiec , JA and Kupfer , DJ . 2000 . Neuropsychologic impairments in bipolar and unipolar mood disorders on the CANTAB neurocognitive battery . Biological Psychiatry , 48 ( 7 ) : 674 – 684 .
   PubMed Web of Science ®Google Scholar
• Sweet , JJ , King , JH , Malina , AC , Bergman , MA and Simmons , A . 2002 . Documenting the presence of forensic neuropsychology at national meetings and in relevant professional journals from 1990 to 2000 . The Clinical Neuropsychologist , 16 : 481 – 494 .
   PubMed Web of Science ®Google Scholar
• Thomas , ML . (2010). The value of Item Response Theory in clinical assessment: A review. Assessment, 18(3), 291–307
   Google Scholar
• Tien , AY , Spevack , TV , Jones , DW , Pearlson , GD , Schlaepfer , TE and Strauss , ME . 1996 . Computerized Wisconsin Card Sorting Test: comparison with manual administration . The Kaohsiung Journal of Medical Sciences , 12 ( 8 ) : 479 – 485 .
   PubMedGoogle Scholar
• Tornatore , JB , Hill , E , Laboff , JA and McGann , ME . 2005 . Self-administered screening for mild cognitive impairment: initial validation of a computerized test battery . Journal of Neuropsychiatry and Clinical Neurosciences , 17 ( 1 ) : 98 – 105 .
   PubMed Web of Science ®Google Scholar
• Urbina , S . 2004 . Essentials of psychological testing , Hoboken , NJ : John Wiley & Sons .
   Google Scholar
• Van Kampen , DA , Lovell , MR , Pardini , JE , Collins , MW and Fu , FH . 2006 . The “value added” of neurocognitive testing after sports-related concussion . American Journal of Sports Medicine , 34 ( 10 ) : 1630 – 1635 .
   PubMed Web of Science ®Google Scholar
• Vasterling , JJ , Proctor , SP , Amoroso , P , Kane , R , Heeren , T and White , RF . 2006 . Neuropsychological outcomes of army personnel following deployment to the Iraq war . Journal of the American Medical Association , 296 ( 5 ) : 519 – 529 .
   PubMed Web of Science ®Google Scholar
• West , LK , Curtis , KL , Greve , KW and Bianchini , KJ . 2011 . Memory in traumatic brain injury: the effects of injury severity and effort on the Wechsler Memory Scale-III . Journal of Neuropsychology , 5 : 114 – 125 .
   PubMed Web of Science ®Google Scholar
• Wild , K , Howieson , D , Webbe , F , Seelye , A and Kaye , J . 2008 . Status of computerized cognitive testing in aging: a systematic review . Alzheimer's & Dementia , 4 ( 6 ) : 428 – 437 .
   PubMed Web of Science ®Google Scholar
• Wouters , H , de Koning , I , Zwinderman , AH , van Gool , WA , Schmand , B Buiter , M . 2009 . Adaptive cognitive testing in cerebrovascular disease and vascular dementia . Dementia and Geriatric Cognitive Disorders , 28 ( 5 ) : 486 – 492 .
   PubMed Web of Science ®Google Scholar
• Wouters , H , Zwinderman , AH , van Gool , WA , Schmand , B and Lindeboom , R . 2009 . Adaptive cognitive testing in dementia . International Journal of Methods in Psychiatric Research , 18 ( 2 ) : 118 – 127 .
   PubMed Web of Science ®Google Scholar