Cognitive impairment does not cause invalid performance: analyzing performance patterns among cognitively unimpaired, impaired, and noncredible participants across six performance validity tests

References

• American Academy of Clinical Neuropsychology. (2007). American Academy of Clinical Neuropsychology (AACN) practice guidelines for neuropsychological assessment and consultation. The Clinical Neuropsychologist, 21(2), 209–231.
   PubMed Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders-fifth edition (DSM-5). Arlington, VA: American Psychiatric Publishing.
   Google Scholar
• Armistead-Jehle, P., Cole, W. R., & Stegman, R. L. (2018). Performance and symptom validity testing as a function of medical board evaluation in U.S. military service members with a history of mild traumatic brain injury. Archives of Clinical Neuropsychology, 33(1), 120–124.
   Google Scholar
• Bailey, K. C., Soble, J. R., & O’Rourke, J. J. F. (2017). Clinical utility of the Rey 15-item test, recognition trial, and error scores for detecting noncredible neuropsychological performance in a mixed clinical sample of veterans. The Clinical Neuropsychologist,32(1), 119–131. doi:10.1080/13854046.2017.1333151
   PubMed Web of Science ®Google Scholar
• Bain, K. M., & Soble, J. R. (2017). Validation of the Advanced Clinical Solutions Word Choice Test (WCT) in a mixed clinical sample: Establishing classification accuracy, sensitivity/specificity, and cutoff scores. Assessment, doi:1073191117725172
   PubMedGoogle Scholar
• Barhon, L. I., Batchelor, J., Meares, S., Chekaluk, E., & Shores, E. A. (2015). A comparison of the degree of effort involved in the TOMM and the ACS Word Choice Test using a dual-task paradigm. Applied Neuropsychology: Adult, 22, 114–123.
   PubMed Web of Science ®Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57, 289–300.
   Web of Science ®Google Scholar
• Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638.
   PubMed Web of Science ®Google Scholar
• Boone, K., Lu, P., & Herzberg, D. S. (2002). The dot counting test manual. Los Angeles, CA: Western Psychological Services.
   Google Scholar
• Boone, K. B., Lu, P., Back, C., King, C., Lee, A., Philpott, L… Warner-Chacon, K. (2002). Sensitivity and specificity of the Rey Dot Counting Test in patients with suspect effort and various clinical samples. Archives of Clinical Neuropsychology, 17, 625–642.
   PubMed Web of Science ®Google Scholar
• Boone, K. B., Salazar, X., Lu, P., Warner-Chacon, K., & Razani, J. (2002). The Rey 15-Item Recognition Trial: A technique to enhance sensitivity of the Rey 15-Item Memorization Test. Journal of Clinical and Experimental Neuropsychology, 24(5), 561–573.
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (Ed.). (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. New York, NY: Guilford Press.
   Google Scholar
• Bush, S. S., Ruff, R. M., Tröster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., … Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity: NAN Policy & Planning Committee. Archives of Clinical Neuropsychology, 20(4), 419–426.
   PubMed Web of Science ®Google Scholar
• Constantinou, M., Bauer, L., Ashendorf, L., Fisher, J. M., & McCaffrey, R. J. (2005). Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tests? Archives of Clinical Neuropsychology, 20(2), 191–198.
   PubMed Web of Science ®Google Scholar
• Davis, J. J., & Millis, S. R. (2014). Examination of performance validity test failure in relation to number of tests administered. The Clinical Neuropsychologist, 28(2), 199–214.
   PubMed Web of Science ®Google Scholar
• Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23, 133–152.
   PubMed Web of Science ®Google Scholar
• Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432.
   PubMed Web of Science ®Google Scholar
• Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046.
   PubMed Web of Science ®Google Scholar
• Glickman, M. E., Rao, S. R., & Schultz, M. R. (2014). False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies. Journal of Clinical Epidemiology, 67, 850–857.
   PubMed Web of Science ®Google Scholar
• Graver C. J. (2012). In response to: Are effort measures sensitive to cognitive impairment? Published in the December issue (Mil Med 2011; 176(12): 1426–31). Military Medicine 177, 7.
   Google Scholar
• Green, P. (2003). Green’s word memory test for Windows: User’s manual. Edmonton, Canada: Green’s Publishing.
   Google Scholar
• Green, P., Allen, L., & Astner, K. (1996). The word memory test: A user’s guide to the oral and computer-administered forms, US version 1.1. Durham, NC: Cognisyst.
   Google Scholar
• Green, P., Lees-Haley, P. R., & Allen III, L. M. (2003). The Word Memory Test and the validity of neuropsychological test scores. Journal of Forensic Neuropsychology, 2(3–4), 97–124.
   Google Scholar
• Green, P., Montijo, J., & Brockhaus, R. (2011). High specificity of the Word Memory Test and Medical Symptom Validity Test in groups with severe verbal memory impairment. Applied Neuropsychology, 18, 86–94.
   PubMed Web of Science ®Google Scholar
• Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen III, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain injury, 15(12), 1045–1060.
   PubMed Web of Science ®Google Scholar
• Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218.
   Google Scholar
• Greve, K. W., Bianchini, K. J., & Doane, B. M. (2006). Classification accuracy of the Test of Memory Malingering in traumatic brain injury: Results of a known-groups analysis. Journal of Clinical and Experimental Neuropsychology, 28, 1176–1190.
   PubMed Web of Science ®Google Scholar
• Greve, K. W., Ord, J., Curtis, K. L., Bianchini, K. J., & Brennan, A. (2008). Detecting malingering in traumatic brain injury and chronic pain: A comparison of three forced-choice symptom validity tests. The Clinical Neuropsychologist, 22(5), 896–918.
   PubMed Web of Science ®Google Scholar
• Hampson, N. E., Kemp, S., Coughlan, A. K., Moulin, C. J. A., & Bhakta, B. B. (2014). Effort test performance in clinical acute brain injury, community brain injury, and epilepsy populations. Applied Neuropsychology: Adult, 21, 183–194.
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.
   Google Scholar
• Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129.
   PubMed Web of Science ®Google Scholar
• Henry, M., Merten, T., Wolf, S. A., & Harth, S. (2010). Nonverbal Medical Symptom Validity Test pe formance of healthy adults and clinical neurology patients. Journal of Clinical and Experimental Neuropsychology, 32(1), 19–27.
   Google Scholar
• Hilsabeck, R. C., Gordon, S. N., Hietpas-Wilson, T., & Zartman, A. L. (2011). Use of Trial 1 of the Test of Memory Malingering (TOMM) as a screening measure of effort: Suggested discontinuation rules. The Clinical Neuropsychologist, 25(7), 1228–1238.
   PubMed Web of Science ®Google Scholar
• Howe, L., & Loring, D. (2009). Classification accuracy and predictive validity of the Medical Symptom Validity Test’s Dementia Profile and Genuine Memory Impairment Profile. The Clinical Neuropsychologist, 23, 329–342.
   PubMed Web of Science ®Google Scholar
• Kiewel, N. A., Wisdom, N. M., Bradshaw, M. R., Pastorek, N. J., & Strutt, A. M. (2012). A retrospective review of digit span-related effort indicators in probable Alzheimer’s disease patients. The Clinical Neuropsychologist, 26(6), 965–974.
   PubMed Web of Science ®Google Scholar
• Larrabee. G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373.
   PubMed Web of Science ®Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment. Oxford: Oxford University Press.
   Google Scholar
• Loring, D. W., Goldstein, F. C., Chen, C., Drane, D. L., Lah, J. J., Zhao, L., & Larrabee, G. J. (2016). False-positive error rates for Reliable Digit Span and Auditory Verbal Learning Test performance validity measures in amnestic mild cognitive impairment and early Alzheimer disease. Archives of Clinical Neuropsychology, 31(4), 313–331.
   PubMed Web of Science ®Google Scholar
• Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776.
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., & Volbrecht, M. (2003). A validation of multiple malingering detection methods in a large clinical sample. Archives of Clinical Neuropsychology, 18(3), 261–276.
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26(1), 8–15.
   PubMed Web of Science ®Google Scholar
• Miller, J. B., Millis, S. R., Rapport, L. J., Bashem, J. R., Hanks, R. A., & Axelrod, B. N. (2011). Detection of insufficient effort using the Advanced Clinical Solutions for the Wechsler Memory Scale, Fourth Edition. The Clinical Neuropsychologist, 25, 160–172.
   PubMed Web of Science ®Google Scholar
• Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102.
   PubMed Web of Science ®Google Scholar
• Nutter-Upham, K. E., Saykin, A. J., Rabin, L. A., Roth, R. M., Wishart, H. A., Pare, N., & Flashman, L. A. (2008). Verbal fluency performance in amnestic MCI and older adults with cognitive complaints. Archives of Clinical Neuropsychology, 23(3), 229–241.
   PubMed Web of Science ®Google Scholar
• O’Bryant, S. E., Engel, L. R., Kleiner, J. S., Vasterling, J. J., & Black, F. W. (2007). Test of memory malingering (TOMM) trial 1 as a screening measure for insufficient effort. The Clinical Neuropsychologist, 21(3), 511–521.
   PubMed Web of Science ®Google Scholar
• Pearson. (2009). Advanced clinical solutions for WAIS-IV and WMS-IV: Clinical and interpretive manual. San Antonio, TX: Author.
   Google Scholar
• Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. F. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology, 29(7), 614–624.
   PubMed Web of Science ®Google Scholar
• Reese, C. S., Suhr, J. A., & Riddle, T. L. (2012). Exploration of malingering indices in the Wechsler Adult Intelligence Scale-digit span subtest. Archives of Clinical Neuropsychology, 27(2), 176–181.
   PubMed Web of Science ®Google Scholar
• Reitan, R. M., & Wolfson, D. (1993). The Halstead-Reitan neuropsychological test battery: Theory and clinical interpretation (2nd ed.). Tucson, AZ: Neuropsychology Press.
   Google Scholar
• Rey, A. (1964) L’examen Clinique en psychologie. Paris: Presses Universitaires de France.
   Google Scholar
• Rohling, M., & Boone, K. (2007). Future directions in effort assessment. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective. (pp. 453–469). New York, NY: Guilford.
   Google Scholar
• Sawyer, R. J., II, Testa, S. M., & Dux, M. (2017). Embedded performance validity tests with the Hopkins Verbal Learning Test–Revised and the Brief Visuospatial Memory Test–Revised. The Clinical Neuropsychologist, 31, 207–218.
   PubMed Web of Science ®Google Scholar
• Schroeder, R. W., & Marshall, P. S. (2011). Evaluation of the appropriateness of multiple symptom validity indices in psychotic and non-psychotic psychiatric populations. The Clinical Neuropsychologist, 25, 437–453.
   PubMed Web of Science ®Google Scholar
• Schroeder, R. W., Twumasi-Ankrah, P., Baade, L. E., & Marshall, P. S. (2012). Reliable digit span: A systematic review and cross-validation study. Assessment, 19(1), 21–30.
   PubMed Web of Science ®Google Scholar
• Schutte, C., & Axelrod, B. N. (2013). Use of embedded cognitive symptom validity measures in mild traumatic brain injury cases. In D. A. Carone (Ed.), Mild traumatic brain injury: Symptom validity assessment and malingering (pp. 159–181). New York, NY: Springer.
   Google Scholar
• Sharland, M. J., & Gfeller, J. D. (2007). A survey of neuropsychologists’ beliefs and practices with respect to the assessment of effort. Archives of Clinical Neuropsychology, 22(2), 213–223.
   PubMed Web of Science ®Google Scholar
• Slick, D. J., Sherman, E. M., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13, 545–561.
   PubMed Web of Science ®Google Scholar
• Spencer, R. J., Axelrod, B. N., Drag, L. L., Waldron-Perrine, B., Pangilinan, P. H., & Bieliauskas, L. A. (2013). WAIS-IV reliable digit span is no more accurate than age corrected scaled score as an indicator of invalid performance in a veteran sample undergoing evaluation for mTBI. The Clinical Neuropsychologist, 27(8), 1362–1372.
   PubMed Web of Science ®Google Scholar
• Suhr, J. A., & Barrash, J. (2007). Performance on standard attention, memory, and psychomotor speed tasks as indicators of malingering. In G. Larabee (Ed.), Assessment of malingered neuropsychological deficits (pp. 131–170). New York, NY: Oxford University Press.
   Google Scholar
• Sweet, J. J. (1999). Malingering: Differential diagnosis. In J. J. Sweet (Ed.), Forensic neuropsychology: Fundamentals and practice (pp. 255–285). New York, NY: Psychology Press.
   Google Scholar
• Teichner, G., & Wagner, M. T. (2004). The Test of Memory Malingering (TOMM): Normative data from cognitively intact, cognitively impaired, and elderly patients with dementia. Archives of Clinical Neuropsychology, 19(3), 455–464.
   PubMed Web of Science ®Google Scholar
• Tombaugh, T. N. (1996). Test of memory malingering: TOMM. North Tonawanda, NY: Multi-Health Systems.
   Google Scholar
• Walter, J., Morris, J., Swier-Vosnos, A., & Pliskin, N. (2014). Effects of severity of dementia on a symptom validity measure. The Clinical Neuropsychologist, 28(7), 1197–1208.
   PubMed Web of Science ®Google Scholar
• Webber, T. A., & Soble, J. R. (2017). Utility of various WAIS-IV Digit Span indices for identifying noncredible performance validity among cognitively impaired and unimpaired examinees. The Clinical Neuropsychologist, 32(4), 1–14.
   Web of Science ®Google Scholar
• Wechsler, D. (2008). WAIS-IV: Administration and scoring manual. New York, NY: The Psychological Corporation.
   Google Scholar
• Wechsler, D. (2009). Wechsler Memory Scales – Fourth Edition (WMS-IV): Administration and scoring manual. San Antonio, TX: Pearson Clinical Assessment.
   Google Scholar
• Willis, P. F., Farrer, T. J., & Bigler, E. D. (2011). Are effort measures sensitive to cognitive impairment? Military medicine, 176(12),1426–1431.
   PubMed Web of Science ®Google Scholar
• Young, J. C., Sawyer, R. J., Roper, B. L., & Baughman, B. C. (2012). Expansion and re-examination of Digit Span effort indices on the WAIS-IV. The Clinical Neuropsychologist, 26(1), 147–159.
   PubMed Web of Science ®Google Scholar
• Young, J. C., Roper, B. L., & Arentsen, T. J. (2016). Validity testing and neuropsychological practice in the VA healthcare system: Results from recent practitioner survey. The Clinical Neuropsychologist, 30(4), 497–514.
   PubMed Web of Science ®Google Scholar