Establishing the reliability and validity of neuropsychological disorders with low base rates: Some recommended guidelines

References

• American Psychiatric Association . 1980 . Diagnostic and statistical manual of mental disorders , 3rd ed. , Washington, DC : APA .
   Google Scholar
• American Psychiatric Association . 1987 . Diagnostic and statistical manual of mental disorders , 3rd ed. , Washington, DC : APA .
   Google Scholar
• Anthony , J. C. , LeResche , L. , Niaz , U. , von Korff , M. B. and Folstein , M. F. 1982 . Limits of the ‐Mini‐Mental State' as a screening test for dementia and delirium among hospital patients . Psychological Medicine , 12 : 397 – 408 .
   PubMed Web of Science ®Google Scholar
• Baldessarini , R. J. , Finklestein , S. and Arana , G. W. 1983 . The predictive power of diagnostic tests and the effect of prevalence of illness . Archives of General Psychiatry , 40 : 569 – 573 .
   PubMed Web of Science ®Google Scholar
• Cicchetti , D. V. 1981 . Testing the normal approximation and minimal sample size requirements of weighted kappa when the number of categories is large . Applied Psychological Measurement , 5 : 101 – 104 .
   Web of Science ®Google Scholar
• Cicchetti , D. V. 1985 . A critique of Whitehurst's “Interrater agreement for journal manuscript reviews”: De Omnibus, Disputandum Est . American Psychologist , 40 : 563 – 568 .
   Web of Science ®Google Scholar
• Cicchetti , D. V. 1988 . When diagnostic agreement is high, but reliability is low: Some paradoxes occurring in independent neuropsychological assessments . Journal of Clinical and Experimental Neuropsychology , 10 : 605 – 622 .
   PubMed Web of Science ®Google Scholar
• Cicchetti , D. V. and Fleiss , J. L. 1977 . Comparison of the null distributions of weighted kappa and the C ordinal statistic . Applied Psychological Measurement , 1 : 195 – 201 .
   Google Scholar
• Cicchetti , D. V. and Sparrow , S. S. 1981 . Developing criteria for establishing the interrater reliability of specific items in a given inventory: Applications to assessment of adaptive behavior . American Journal of Mental Deficiency , 86 : 127 – 137 .
   PubMedGoogle Scholar
• Cicchetti , D. V. , Sparrow , S. S. and Rourke , B. P. “ Adaptive behavior profiles of psychologically disturbed and developmentally disabled persons ” . In Handbook of Mental Retardation , Edited by: Matson , J. L. and Mulich , J. New York : Pergamon . in press
   Google Scholar
• Cohen , J. 1960 . A coefficient of agreement for nominal scales . Educational and Psychological Measurement , 20 : 37 – 46 .
   Web of Science ®Google Scholar
• Fleiss , J. L. 1981 . Statistical methods for rates and proportions , 2nd ed. , New York : Wiley .
   Google Scholar
• Fleiss , J. L. , Cohen , J. and Everitt , B. S. 1969 . Large samples standard errors of kappa and weighted kappa . Psychological Bulletin , 72 : 323 – 327 .
   Web of Science ®Google Scholar
• Grove , W. M. , Andreason , N. C. , Mc Donald‐Scott , P. , Keller , M. B. and Shapiro , R. W. 1981 . Reliability studies of psychiatric diagnosis: Theory and practice . Archives of General Psychiatry , 38 : 408 – 413 .
   PubMed Web of Science ®Google Scholar
• Kraemer , H. C. 1979 . Ramifications of a population model for kappa as a coefficient of reliability . Psychometrika , 44 : 461 – 472 .
   Web of Science ®Google Scholar
• Kraemer , H. C. 1982 . Estimating false alarms and missed events from interobserver agreement: Comment on Kaye . Psychological Bulletin , 92 : 749 – 754 .
   Web of Science ®Google Scholar
• Kraemer , H. C. 1987 . Charlie Brown and statistics: An exchange . Archives of General Psychiatry , 44 : 192 – 193 .
   PubMed Web of Science ®Google Scholar
• Kraemer , H. C. 1988 . Assessment of 2 × 2 associations: Generalization of signal detection methodology . American Statistician , 42 : 37 – 49 .
   Web of Science ®Google Scholar
• McClure , M. and Willett , W. C. 1987 . Misinterpretation and misuse of the kappa statistic . American Journal of Epidemiology , 126 : 161 – 169 .
   PubMed Web of Science ®Google Scholar
• Rourke , B. P. 1987 . Syndrome of nonverbal learning disabilities: The final common pathway of white‐matter disease/dysfunction? . The Clinical Neuropsychologist , 1 : 209 – 234 .
   Google Scholar
• Rourke , B. P. 1990 . Nonverbal learning disabilities: The syndrome and the model , New York : Guilford Press .
   Google Scholar
• Shrout , P. E. , Spitzer , R. L. and Fleiss , J. L. 1987 . Quantification of agreement in psychiatric diagnosis revisited . Archives of General Psychiatry , 44 : 172 – 177 .
   PubMed Web of Science ®Google Scholar
• Spitzer , R. L. and Fleiss , J. L. 1974 . A re‐analysis of the reliability of psychiatric diagnosis . British Journal of Psychiatry , 125 : 341 – 347 .
   PubMed Web of Science ®Google Scholar
• Spitznagel , E. L. and Helzer , J. E. 1985 . A proposed solution to the base rate problem in the kappa statistic . Archives of General Psychiatry , 42 : 725 – 728 .
   PubMed Web of Science ®Google Scholar
• Swets , J. A. 1988 . Measuring the accuracy of diagnostic systems . Science , 240 : 1285 – 1293 .
   PubMed Web of Science ®Google Scholar
• Uebersax , J. S. 1987 . Letter to the editor . Archives of General Psychiatry , 44 : 193 – 194 .
   Google Scholar
• Volkmar , F. R. , Bregman , J. , Cohen , D. J. and Cicchetti , D. V. 1988 . Diagnosis of Autism: DSM‐III and DSM‐III‐R . American Journal of Psychiatry , 145 : 1404 – 1408 .
   PubMed Web of Science ®Google Scholar
• Youden , W. J. 1950 . Index for rating diagnostic tests . Cancer , 3 : 32 – 35 .
   PubMed Web of Science ®Google Scholar
• Yule , G. U. 1912 . On the methods of measuring the association between two attributes . Journal of the Royal Statistical Society , 75 : 579 – 642 .
   Google Scholar