Demographic corrections appear to compromise classification accuracy for severely skewed cognitive tests

References

• Adams , R. L. , Boake , C. and Crain , C. 1982 . Bias in a neuropsychological test classification related to education, age, and ethnicity . Journal of Consulting and Clinical Psychology , 50 : 143 – 145 .
   PubMed Web of Science ®Google Scholar
• Ainslie , N. K. and Murden , R. A. 1993 . Effect of education on the clock-drawing dementia screen in non-demented elderly persons . Journal of the American Geriatric Society , 41 : 249 – 252 .
   PubMed Web of Science ®Google Scholar
• Bamber , D. 1975 . The area above the ordinal dominance graph and the area below the receiver operating characteristic graph . Journal of Mathematical Psychology , 12 : 387 – 415 .
   Web of Science ®Google Scholar
• Bank , A. L. , Yochim , B. P. , MacNeill , S. E. and Lichtenberg , P. A. 2000 . Expanded normative data for the Mattis Dementia Rating Scale for use with urban, elderly medical patients . The Clinical Neuropsychologist , 14 : 149 – 156 .
   PubMed Web of Science ®Google Scholar
• Begg , C. B. and Greenes , R. A. 1983 . Assessment of diagnostic tests when disease verification is subject to selection bias . Biometrics , 39 : 207 – 215 .
   PubMed Web of Science ®Google Scholar
• Belle , S. H. , Seaberg , E. C. , Ganguli , M. , Ratcliff , G. , DeKosky , S. and Kuller , L. H. 1996 . Effect of education and gender adjustment on the sensitivity and specificity of a cognitive screening battery for dementia: Results from the MoVIES project . Neuroepidemiology , 15 : 321 – 329 .
   PubMed Web of Science ®Google Scholar
• Berkman , L. F. 1986 . The association between educational attainment and mental status examinations: Of etiologic significance for senile dementia or not? . Journal of Chronic Disease , 39 : 171 – 174 .
   PubMedGoogle Scholar
• Bickel , P. J. and Doksum , K. A. 1977 . Mathematical statistics: Basic ideas and selected topics , Oakland, CA : Holden-Day .
   Google Scholar
• Bornstein , R. A. 1986 . Classification rates obtained with “standard” cut-off scores on selected neuropsychological measures . Journal of Clinical and Experimental Neuropsychology , 8 : 413 – 420 .
   PubMed Web of Science ®Google Scholar
• Bravo , G. and Hébert , R. 1997 . Age- and education-specific reference values for the Mini-Mental and Modified Mini-Mental State examinations derived from a non-demented elderly population . International Journal of Geriatrics Psychiatry , 12 : 1008 – 1018 .
   PubMed Web of Science ®Google Scholar
• Brown , L. M. , Shinka , J. A. , Mortimer , J. A. and Graves , A. B. 2003 . 3MS normative data for the African Americans . Journal of Clinical and Experimental Neuropsychology , 25 : 234 – 241 .
   PubMed Web of Science ®Google Scholar
• Buschke , H. 1984 . Cued recall in amnesia . Journal of Clinical Neuropsychology , 6 : 433 – 440 .
   PubMed Web of Science ®Google Scholar
• Canadian Study of Health and Aging Working Group . 1994 . Canadian Study of Health and Aging: Study methods and prevalence of dementia . Canadian Medical Association Journal , 6 : 433 – 440 .
   Google Scholar
• Cohen , J. 1988 . Statistical power analysis for the behavioral sciences , 2nd , Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Davies , A. D. M. 1968 . The influence of age on Trail Making Test performance . Journal of Clinical Psychology , 24 : 96 – 98 .
   PubMed Web of Science ®Google Scholar
• Enders , C. K. and Bandalos , D. L. 1999 . The effects of heterogeneous item distributions on reliability . Applied Measurement in Education , 12 : 133 – 150 .
   Web of Science ®Google Scholar
• Fastenau , P. S. 1998 . Validity of regression-based norms: An empirical test of the Comprehensive Norms with older adults . Journal of Clinical and Experimental Neuropsychology , 20 : 906 – 916 .
   PubMed Web of Science ®Google Scholar
• Fastenau , P. S. and Adams , K. M. 1996 . Book review: Heaton, Grant, and Matthews' Comprehensive Norms: An overzealous attempt . Journal of Clinical and Experimental Neuropsychology , 18 : 444 – 448 .
   Web of Science ®Google Scholar
• Folstein , M. F. , Folstein , S. E. and McHugh , P. R. 1975 . “Mini-Mental State”: A practical method for grading the cognitive state of patients for the clinician . Journal of Psychiatry Research , 12 : 189 – 198 .
   PubMed Web of Science ®Google Scholar
• Hanley , J. A. and McNeil , B. J. 1982 . The meaning and use of the area under a receiver operating characteristic (ROC) curve . Radiology , 143 : 29 – 36 .
   PubMed Web of Science ®Google Scholar
• Hanley , J. A. and McNeil , B. J. 1983 . A method of comparing the areas under receiver operating characteristic curves derived from the same cases . Radiology , 148 : 839 – 843 .
   PubMed Web of Science ®Google Scholar
• Heaton , R. K. , Grant , I. and Matthews , C. G. 1991 . Comprehensive norms for an expanded Halstead-Reitan battery: Demographic corrections, research findings, and clinical applications , Odessa, , FL : Psychological Assessment Resources .
   Google Scholar
• Heaton , R. K. , Matthews , C. G. , Grant , I. and Avitable , N. 1996 . Demographic corrections with comprehensive norms: An overzealous attempt or a good start? . Journal of Clinical and Experimental Neuropsychology , 18 : 449 – 458 .
   Web of Science ®Google Scholar
• Heaton , R. K. , Ryan , L. , Grant , I. and Matthews , C. G. 1996 . “ Demographic influences on neuropsychological test performance ” . In Neuropsychological assessment of neuropsychiatric disorders , 2nd , Edited by: Grant , I. and Adams , K. M. 141 – 163 . New York, NY : Oxford University Press .
   Google Scholar
• Ivnik , R. J. , Smith , G. E. , Lucas , J. A. , Tangalos , E. G. , Kokmen , E. and Peterson , R. C. 1997 . Free and cued selective reminding test: MOANS norms . Journal of Clinical and Experimental Neuropsychology , 19 : 676 – 691 .
   PubMed Web of Science ®Google Scholar
• Jagger , C. , Clarke , M. , Anderson , J. and Battcock , T. 1992 . Misclassification of dementia by the Mini-Mental State Examination: Are education and social class the only factors? . Age and Ageing , 21 : 404 – 411 .
   PubMed Web of Science ®Google Scholar
• Jones , R. N. and Gallo , J. J. 2002 . Education and sex differences in the Mini-Mental State Examination: Effects of differential item functioning . Journal of Gerontology , 57B : 548 – 558 .
   Google Scholar
• Kiernan , R. J. and Matthews , C. G. 1976 . Impairment index versus T-score averaging in neuropsychological assessment . Journal of Consulting and Clinical Psychology , 44 : 951 – 957 .
   PubMed Web of Science ®Google Scholar
• Kittner , S. J. , White , L. R. , Farmer , M. E. , Wolz , M. , Kaplan , E. , Moes , E. and al , et . 1986 . Methodological issues in screening for dementia: The problem of education adjustment . Journal of Chronic Disease , 39 : 163 – 170 .
   PubMedGoogle Scholar
• Kraemer , H. C. , Moritz , D. J. and Yesavage , J. 1998 . Adjusting Mini-Mental State Examination scores for age and education level to screen for dementia: Correcting bias or reducing validity . International Psychogeriatrics , 10 : 43 – 51 .
   PubMedGoogle Scholar
• Long , C. L. and Klein , K. 1990 . Decision strategies on neuropsychology: II. Determination of age effects on neuropsychological performance . Archives of Clinical Neuropsychology , 5 : 335 – 345 .
   PubMedGoogle Scholar
• Macht , M. L. and Buschke , H. 1983 . Age differences in cognitive effort in recall . Journal of Gerontology , 38 : 695 – 700 .
   PubMedGoogle Scholar
• Mangione , C. M. , Seddon , J. M. , Cook , E. F. , Krug , J. H. , Sahagian , C. R. Campion , E. W. 1993 . Correlates of cognitive function scores in elderly outpatients . Journal of the American Geriatrics Society , 41 : 491 – 497 .
   PubMed Web of Science ®Google Scholar
• Marcopulos , B. A. , Gripshover , D. L. , Broshek , D. K. , McLain , C. A. and Brashear , H. R. 1999 . Neuropsychological assessment of psychogeriatric patients with limited education . The Clinical Neuropsychologist , 13 : 147 – 156 .
   PubMed Web of Science ®Google Scholar
• Marcopulos , B. A. , McLain , C. A. and Guiliano , A. J. 1997 . Cognitive impairment or inadequate norms? A study of healthy, rural, older adults with limited education . The Clinical Neuropsychologist , 11 : 111 – 131 .
   Web of Science ®Google Scholar
• Morgan , M. E. and Caccappolo-van Vliet , E. 2001 . Advanced years and low education: The case against the comprehensive norms . Journal of Forensic Neuropsychology , 2 : 53 – 69 .
   Google Scholar
• Mungas , D. , Marshall , S. C. , Weldon , M. , Haan , M. and Reed , B. R. 1996 . Age and education correction of Mini-Mental State Examination for English- and Spanish-speaking elderly . Neurology , 46 : 700 – 706 .
   PubMed Web of Science ®Google Scholar
• Murden , R. A. , McRae , T. D. , Kaner , S. and Bucknam , M. E. 1991 . Mini-Mental State Exam scores vary with education in Blacks and Whites . Journal of the American Geriatrics Society , 39 : 149 – 155 .
   PubMed Web of Science ®Google Scholar
• Nabors , N. A. , Vangel , S. J. , Lichtenberg , P. A. and Walsh , P. 1997 . Normative and clinical utility of the Hooper Visual Organization Test with geriatric medical inpatients . Journal of Clinical Geropsychology , 3 : 191 – 198 .
   Google Scholar
• O'Connell , M. E. and Tuokko , H. 2002 . The 12-Item Buschke Memory Test: Appropriate for use across levels of impairment . Applied Neuropsychology , 9 : 226 – 233 .
   PubMedGoogle Scholar
• O'Connell , M. E. , & Tuokko , H. 2010 Age corrections and dementia classification accuracy . Archives of Clinical Neuropsychology 25, 126–138 doi:10.1093/arclin/acp111
   Google Scholar
• O'Connell , M. E. , Tuokko , H. , Graves , R. E. and Kadlec , H. 2004 . Correcting the 3MS for bias does not improve accuracy when screening for cognitive impairment or dementia . Journal of Clinical and Experimental Neuropsychology , 26 : 970 – 980 .
   PubMed Web of Science ®Google Scholar
• Reitan , R. M. and Wolfson , D. 1995 . Influence of age and education on neuropsychological test results . Clinical Neuropsychologist , 9 : 151 – 158 .
   Web of Science ®Google Scholar
• Reitan , R. M. and Wolfson , D. 1996 . Relationships of age and education to Wechsler Adult Intelligence Scale IQ values in brain-damaged and non-brain damaged groups . Clinical Neuropsychologist , 10 : 293 – 304 .
   Web of Science ®Google Scholar
• Reitan , R. M. and Wolfson , D. 1997 . The influences of age and education on neuropsychological performances of persons with mild head injuries . Applied Neuropsychology , 4 : 16 – 33 .
   PubMedGoogle Scholar
• Reitan , R. M. and Wolfson , D. 2004 . Clinical and forensic issues regarding age, education, and the validity of neuropsychological test results: A review and presentation of a new study . Journal of Forensic Neuropsychology , 4 : 1 – 32 .
   Google Scholar
• Reitan , R. M. and Wolfson , D. 2005 . The effect of age and education transformations on neuropsychological test scores of persons with diffuse or bilateral brain damage . Applied Neuropsychology , 12 : 181 – 189 .
   PubMed Web of Science ®Google Scholar
• Sliwinski , M. , Buschke , H. , Stewart , W. F. , Masur , D. and Lipton , R. D. 1997 . The effect of dementia risk factors on comparative and diagnostic selective reminding norms . Journal of the International Neuropsychological Society , 3 : 317 – 326 .
   PubMedGoogle Scholar
• Sliwinski , M. J. , Hofer , S. M. , Hall , C. , Buschke , H. and Lipton , R. B. 2003 . “ Optimizing cognitive test norms for detection ” . In Mild cognitive impairment , Edited by: Petersen , R. 89 – 104 . New York, NY : Oxford University Press .
   Google Scholar
• Teng , E. L. and Chui , H. C. 1987 . The Modified Mini-Mental State (3MS) examination . Journal of Clinical Psychiatry , 48 : 314 – 318 .
   PubMed Web of Science ®Google Scholar
• Tombaugh , T. N. , McDowell , I. , Kristjansson , B. and Hubley , A. M. 1996 . Mini-Mental State Examination (MMSE) and the Modified MMSE (3MS): A psychometric comparison and normative data . Psychological Assessment , 8 : 48 – 59 .
   Web of Science ®Google Scholar
• Tuokko , H. , Kristjansson , E. and Miller , J. 1995 . Neuropsychological detection of dementia: An overview of the neuropsychological component of the Canadian Study of Health and Aging . Journal of Clinical and Experimental Neuropsychology , 17 : 352 – 373 .
   PubMed Web of Science ®Google Scholar
• Ylikoski , R. , Erkinjuntti , T. , Sulkava , R. , Juva , K. , Tilvis , R. and Valvanne , J. 1992 . Correction for age, education and other demographic variables in the use of the Mini Mental State Examination in Finland . Acta Neurologica Scandinavica , 85 : 391 – 396 .
   PubMed Web of Science ®Google Scholar
• Youngjohn , J. R. , Larrabee , G. L. and Crook , T. H. 1993 . New adult age- and education-corrected norms for the Benton Visual Retention Test . The Clinical Neuropsychologist , 7 : 155 – 160 .
   PubMed Web of Science ®Google Scholar
• Zhou , X. and Higgs , R. E. 2000 . Assessing the relative accuracies of two screening tests in the presence of verification bias . Statistics in Medicine , 19 : 1697 – 1705 .
   PubMed Web of Science ®Google Scholar
• Zweig , M. H. and Campbell , G. 1993 . Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine . Clinical Chemistry , 39 : 561 – 577 .
   PubMed Web of Science ®Google Scholar