Reaffirming normal: The high risk of pathologizing healthy adults when interpreting the MMPI-2-RF

References

• American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: American Psychiatric Association.
   Google Scholar
• American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Association.
   Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57, 289–300.
   Web of Science ®Google Scholar
• Ben-Porath, Y. (2012). Interpreting the MMPI-2-RF. Minneapolis, MN: University of Minnesota Press.
   Google Scholar
• Ben-Porath, Y., & Tellegen, A. (2008/2011). MMPI-2-RF (Minnesota Multiphasic Personality Inventory -2-Restructured Form) Manual for Administration, Scoring, and Interpretation. Minneapolis, MN: University of Minnesota Press.
   Google Scholar
• Berthelson, L., Mulchan, S. S., Odland, A. P., Miller, L. J., & Mittenberg, W. (2013). False positive diagnosis of malingering due to the use of multiple effort tests. Brain Injury, 27, 1–8.
   PubMed Web of Science ®Google Scholar
• Binder, L. M., Iverson, G. L., & Brooks, B. L. (2009). To err is human: ‘Abnormal’ neuropsychological scores and variability are common in healthy adults. Archives of Clinical Neuropsychology, 24, 31–46.
   PubMed Web of Science ®Google Scholar
• Bleyer, A., & Welch, H. G. (2012). Effect of three decades of screening mammography on breast-cancer incidence. The New England Journal of Medicine, 367, 1998–2005.
   PubMed Web of Science ®Google Scholar
• Bond, M., Pavey, T., Welch, K., Cooper, C., Garside, R., Dean, S., & Hyde, C. (2013). Systematic review of the psychological consequences of false positive screening mammograms. Health Technology Assessment, 17, 1–170.
   PubMed Web of Science ®Google Scholar
• Brewer, N. T., Salz, T., & Lillie, S. E. (2007). Systematic review: The long-term effects of false positive mammograms. Annals of Internal Medicine, 146, 502–510.
   PubMed Web of Science ®Google Scholar
• Brodersen, J., & Siersma, V. D. (2013). Long-term psychosocial consequences of false positive screening mammography. Annals of Family Medicine, 11, 106–115.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L. (2010). Seeing the forest through the trees: Prevalence of low scores on the Wechsler Intelligence Scale for Children, Fourth Edition (WISC-IV). Psychological Assessment, 22, 650–656.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L. (2011). A study of low scores in Canadian children and adolescents on the Wechsler Intelligence Scale for Children, Fourth Edition (WISC-IV). Child Neuropsychology, 17, 281–289.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Holdnack, J. A., & Iverson, G. L. (2011). Advanced clinical interpretation of the WAIS-IV and WMS-IV: Prevalence of low scores varies by level of intelligence and years of education. Assessment, 18, 156–167.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., & Iverson, G. L. (2010). Comparing actual to estimated base rates of ‘abnormal’ scores on neuropsychological test batteries: Implications for interpretation. Archives of Clinical Neuropsychology, 25, 14–21.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Iverson, G. L., Feldman, H. H., & Holdnack, J. A. (2009). Minimizing misdiagnosis: Psychometric criteria for possible or probably memory impairment. Dementia and Geriatric Cognitive Disorders, 27, 439–450.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Iverson, G. L., Holdnack, J. A., & Feldman, H. H. (2008). Potential for misclassification of mild cognitive impairment: A study of memory scores on the Wechsler Memory Scale-III in healthy older adults. Journal of the International Neuropsychological Society, 14, 463–478.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Iverson, G. L., Sherman, E. M. S., & Holdnack, J. A. (2009). Healthy children and adolescents obtain some low scores across a battery of memory tests. Journal of the International Neuropsychological Society, 15, 613–617.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Iverson, G. L., & White, T. (2009). Advanced interpretation of the Neuropsychological Assessment Battery with older adults: Base rate analyses, discrepancy scores, and interpreting change. Archives of Clinical Neuropsychology, 24, 647–657.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Sherman, E. M. S., & Iverson, G. L. (2009). Developments in neuropsychological assessment: Refining psychometric and clinical interpretive methods. Canadian Psychology, 50, 196–209.
   Web of Science ®Google Scholar
• Brooks, B. L., Sherman, E. M. S., & Iverson, G. L. (2010). Healthy children get low scores too: Prevalence of low scores on the NEPSY-II in preschoolers, children, and adolescents. Archives of Clinical Neuropsychology, 25, 182–190.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L., Strauss, E., Sherman, E. M. S., Iverson, G. L., & Slick, D. J. (2009). Developments in neuropsychological assessment: Refining psychometric and clinical interpretive methods. Canadian Psychology, 50, 196–209. doi:10.1037/a0016066
   Web of Science ®Google Scholar
• Carrasco, R. M., Grups, J., Evans, B., Simco, E., & Mittenberg, W. (2013). Apparently abnormal Wechsler Memory Scale index score patterns in the normal population. Applied Neuropsychology, 22(1), 1–6. doi:10.1080/23279095.2013.816702
   Web of Science ®Google Scholar
• Crawford, J. R., Garthwaite, P. H., & Gault, C. B. (2007). Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries: A generic method with applications. Neuropsychology, 21, 419–430.
   PubMed Web of Science ®Google Scholar
• Crawford, J. R., Garthwaite, P. H., Longman, R. S., & Batty, A. M. (2012). Some supplementary methods for the analysis of WAIS-IV Index scores in neuropsychological assessment. Journal of Neuropsychology, 6, 192–211.
   PubMed Web of Science ®Google Scholar
• Crawford, J. R., Garthwaite, P. H., Morrice, N., & Duff, K. (2012). Some supplementary methods for the analysis of the RBANS. Psychological Assessment, 24, 365–374.
   PubMed Web of Science ®Google Scholar
• Crawford, J. R., Garthwaite, P. H., Sutherland, D., & Borland, N. (2011). Some supplementary methods for the analysis of the Delis-Kaplan Executive Function System. Psychological Assessment, 23, 888–898.
   PubMed Web of Science ®Google Scholar
• Croswell, J. M., Kramer, B. S., Kreimer, A. R., Prorok, P. C., Xu, J., Baker, S. G., & Schoen, R. E. (2009). Cumulative incidence of false positive results in repeated multimodal cancer screening. Annals of Family Medicine, 7, 212–222.
   PubMed Web of Science ®Google Scholar
• Donders, J., Elzinga, B., Kuipers, D., Helder, E., & Crawford, J. R. (2013). Development of an eight subtest short-form of the WISC-IV and evaluation of its clinical utility in children with traumatic brain injury. Child Neuropsychology, 19, 662–670.
   PubMed Web of Science ®Google Scholar
• Decker, S. L., Schneider, W. J., & Hale, J. (2012). Estimating base rates of impairment in neuropsychological test batteries: A comparison of quantitative models. Archives of Clinical Neuropsychology, 27, 69–84.
   PubMed Web of Science ®Google Scholar
• Donnell, A. J., Belanger, H. G., & Vanderploeg, R. D. (2011). Implications of psychometric measurement for neuropsychological interpretation. The Clinical Neuropsychologist, 25, 1097–1118.
   PubMed Web of Science ®Google Scholar
• Graham, J. R. (2006). MMPI-2: Assessing personality and psychopathology (4th ed.). New York, NY: Oxford University Press.
   Google Scholar
• Greene, R. L. (2011). MMPI-2/MMPI-2-RF: An interpretive manual (3rd ed.). New York, NY: Allyn & Bacon.
   Google Scholar
• Haro, J. M., Arbabzadeh-Bouchez, S., Brugha, T. S., Girolamo, G., Guyer, M. E., Jin, R., … Kessler, R. C. (2006). Concordance of the composite international diagnostic interview version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health surveys. International Journal of Methods in Psychiatric Research, 15, 167–180. doi:10.1002/mpr.196
   PubMed Web of Science ®Google Scholar
• Hedden, S., Gfroerer, J., Barker, P., Smith, S., Pemberton, M. R., Saavedra, L. M., … Novak, S. P. (2012). Comparison of NSDUH mental health data and methods with other data sources. CBHSQ Data Review.
   Google Scholar
• Huba, G. J. (1985). How unusual is a profile of test scores? Journal of Psychoeducational Assessment, 4, 321–325.
   Google Scholar
• Hubbard, R. A., Kerlikowske, K., Flowers, C. I., Yankaskas, B. C., Zhu, W., & Miglioretti, D. L. (2011). Cumulative probability of false positive recall or biopsy recommendation after 10 years of screening mammography. Annals of Internal Medicine, 155, 481–492.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Berglund, P., Borges, G., Nock, M., & Wang, P. S. (2005). Trends in suicide ideation, plans, gestures, and attempts in the United States, 1990–1992 to 2001–2003. JAMA. Journal of the American Medical Association, 293, 2487–2495.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Berglund, P. A., Chiu, W. T., Demler, O., Heeringa, S., Hiripi, E., & Zheng, H. (2004). The US National Comorbidity Survey Replication (NCS-R): Design and field procedures. International Journal of Methods in Psychiatric Research, 13, 69–92.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Study Replication. Archives of General Psychiatry, 62, 617–627.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Demler, O., Frank, R. G., Olfson, M., Pincus, H. A., Walters, E. E., … Zaslavsky, A. M. (2005). Prevalence and treatment of mental disorders, 1990 to 2003. The New England Journal of Medicine, 352, 2515–2523.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., McGonagle, K. A., Zhao, S., Nelson, C. B., Hughes, M., Eshleman, S., & Kendler, K. S. (1994). Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States: Results from the National Comorbidity Survey. Archives of General Psychiatry, 51, 8–19.
   PubMed Web of Science ®Google Scholar
• Lafata, J. E., Simpkins, J., Lamerato, L., Poisson, L., Divine, G., & Johnson, C. C. (2004). The economic impact of false positive cancer screens. Cancer Epidemiology, Biomarkers & Prevention, 13, 2126–2132.
   PubMed Web of Science ®Google Scholar
• Lenzenweger, M. F., Lane, M. C., Loranger, A. W., & Kessler, R. C. (2007). DSM-IV personality disorders in the National Comorbidity Survey Replication. Biological Psychiatry, 62, 553–564.
   PubMed Web of Science ®Google Scholar
• Merkelbach, H., Jelicic, M., & Jonker, C. (2012). Planting a misdiagnosis of Alzheimer’s disease in a person’s mind. Acta Neuropsychiatrica, 24, 60–62.
   PubMed Web of Science ®Google Scholar
• Odland, A. P., Berthelson, L., Sharma, V., Martin, P., & Mittenberg, W. (2013, February). Rates of elevated scores on the MMPI-2-RF in the normal population. Poster session presented at the meeting of the International Neuropsychological Society, Waikoloa, Hawaii.
   Google Scholar
• Odland, A. P., Martin, P., Perle, J., Simco, E. R., & Mittenberg, W. (2011). Rates of apparently abnormal MMPI-2 profiles in the normal population. The Clinical Neuropsychologist, 25, 1134–1144.
   PubMed Web of Science ®Google Scholar
• Rosenhan, D. L. (1973). On being sane in insane places. Science, 179, 250–258.
   PubMed Web of Science ®Google Scholar
• Shear, M. K., Greeno, C., Kang, J., Ludewig, D., Frank, E., Swartz, H. A., & Hanekamp, M. (2000). Diagnosis of nonpsychotic patients in community clinics. The American Journal of Psychiatry, 157, 581–586.
   PubMed Web of Science ®Google Scholar
• Shretlen, D. J., Testa, S., Winicki, J. M., Pearlson, G. D., & Gordon, B. (2008). Frequency and bases of abnormal performance by healthy adults on neuropsychological testing. Journal of the International Neuropsychological Society, 14, 436–445.
   PubMed Web of Science ®Google Scholar
• SPSS Inc. [released] (2009). PASW Statistics for Windows, Version 18.0. Chicago, IL: SPSS Inc.
   Google Scholar
• Substance Abuse and Mental Health Services Administration. (2011). Results from the 2011 National Survey on Drug Use and Health: Summary of National Findings, NSDUH Series H-44, HHS Publication No. (SMA) 12-4713. Rockville, MD: Substance Abuse and Mental Health Services Administration, 2012.
   Google Scholar
• Swartz, M., Blazer, D., George, L., & Landerman, R. (1986). Somatization disorder in a community population. American Journal of Psychiatry, 143, 1403–1408.
   PubMed Web of Science ®Google Scholar
• Tarescavage, A. M., Marek, R. J., Finn, J. A., Hicks, A., Rapier, J. L., & Ben-Porath, Y. S. (2013). Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) normative elevation rates: Comparisons with epidemiological prevalence rates. The Clinical Neuropsychologist, 27, 1106–1120.
   PubMed Web of Science ®Google Scholar
• Tellegen, A., & Ben-Porath, Y. S. (2008/2011). MMPI-2-RF (Minnesota Multiphasic Personality Inventory -2-Restructured Form) Technical Manual. Minneapolis, MN: University of Minnesota Press.
   Google Scholar
• Welch, H. G., & Black, W. C. (2010). Overdiagnosis in cancer. Journal of the National Cancer Institute, 102, 605–613.
   PubMed Web of Science ®Google Scholar