Rates of False-Positive Classification Resulting From the Analysis of Additional Embedded Performance Validity Measures

REFERENCES

• Allen, M. D., Bigler, E. D., Larsen, J., Goodrich-Hunsaker, N. J., & Hopkins, R. O. (2007). Functional neuroimaging evidence for high cognitive effort on the Word Memory Test in the absence of external incentives. Brain Injury, 21, 1425–1428.
   PubMed Web of Science ®Google Scholar
• Allen, L. M., & Green, P. (1999). Severe TBI sample performance on CARB and WMT. Unpublished manuscript.
   Google Scholar
• Arnett, P. A., Hammeke, T. A., & Schwartz, L. (1995). Quantitative and qualitative performance on Rey’s 15-Item Test in neurological patients and dissimulators. The Clinical Neuropsychologist, 9, 17–26.
   Web of Science ®Google Scholar
• Babcock, L., & Loewenstein, G. (1997). Explaining bargaining impasse: The role of self-serving biases. Journal of Economic Perspectives, 11, 109–126.
   Web of Science ®Google Scholar
• Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20, 145–159.
   PubMed Web of Science ®Google Scholar
• Batt, K., Shores, E. A., & Chekaluk, E. (2008). The effect of distraction on the Word Memory Test and Test of Memory Malingering performance in patients with a severe brain injury. Journal of the International Neuropsychological Society, 14, 1074–1080.
   PubMed Web of Science ®Google Scholar
• Berthelson, L., Mulchan, S. S., Odland, A. P., Miller, L. J., & Mittenberg, W. (2013). False positive diagnosis of malingering due to the use of multiple effort tests. Brain Injury, 27, 909–916.
   PubMed Web of Science ®Google Scholar
• Bolter, J. F., Picano, J. J., & Zych, K. (1985, October). Item error frequencies on the Halstead Category Test: An index of performance validity. Paper presented at the annual meeting of the National Academy of Neuropsychology, Philadelphia, PA.
   Google Scholar
• Boone, K. B., & Lu, P. H. (2003). Noncredible cognitive performance in the context of severe brain injury. The Clinical Neuropsychologist, 17, 244–254.
   PubMed Web of Science ®Google Scholar
• Boone, K. B., Salazar, X., Lu, P., Warner-Chacoon, K., & Razani, J. (2002). The Rey 15-Item recognition trial: A technique to enhance sensitivity of the Rey 15-Item Memorization Test. Journal of Clinical and Experimental Neuropsychology, 24, 561–573.
   PubMed Web of Science ®Google Scholar
• Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., … Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity. NAN Policy & Planning Committee. Archives of Clinical Neuropsychology, 20, 419–426.
   PubMed Web of Science ®Google Scholar
• Committee on Mild Traumatic Brain Injury, American Congress of Rehabilitation Medicine. (1993). Definition of mild traumatic brain injury. Journal of Head Trauma Rehabilitation, 8(3), 86–87.
   Google Scholar
• Constantinou, M., Bauer, L., Ashendorf, L., Fisher, J., & McCaffrey, R. J. (2005). Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tests? Archives of Clinical Neuropsychology, 20, 191–198.
   PubMed Web of Science ®Google Scholar
• Davidson, H., Suffield, B., Orenczuk, S., Nantau, K., & Mandel, A. (1991, February). Screening for malingering using the Memory for Fifteen Items Test (MFIT). Poster session presented at the International Neuropsychological Society 19th Annual Meeting, San Antonio, TX.
   Google Scholar
• Davis, J. J., McHugh, T. S., Axelrod, B. N., & Hanks, R. A. (2012). Performance validity and neuropsychological outcomes in litigants and disability claimants. The Clinical Neuropsychologist, 26, 850–865.
   PubMed Web of Science ®Google Scholar
• Davis, J. J., & Millis, S. R. (2014). Examination of performance validity test failure in relation to number of tests administered. The Clinical Neuropsychologist, 28, 199–214.
   PubMed Web of Science ®Google Scholar
• Dawson, E., Gilovich, T., & Regan, D. T. (2002). Motivated reasoning and performance on the Wason Selection Task. Personality and Social Psychology Bulletin, 28, 1379–1387.
   Web of Science ®Google Scholar
• Dicarlo, M. A., Gfeller, J. D., & Oliveri, M. V. (2000). Effects of coaching on detecting feigned cognitive impairment with the Category Test. Archives of Clinical Neuropsychology, 15, 399–413.
   PubMed Web of Science ®Google Scholar
• Forrest, T. J., Allen, D. N., & Goldstein, G. (2004). Malingering indexes for the Halstead Category Test. The Clinical Neuropsychologist, 18, 334–337.
   PubMed Web of Science ®Google Scholar
• Fox, D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. The Clinical Neuropsychologist, 25, 488–495.
   PubMed Web of Science ®Google Scholar
• Frederick, R., Sarfaty, S., Johnston, J. D., & Powel, J. (1994). Validation of a detector of response bias on a forced-choice test of nonverbal ability. Neuropsychology, 8, 118–125.
   Web of Science ®Google Scholar
• Gervais, R. O., Rohling, M. L., Green, O., & Ford, W. (2004). A comparison of WMT, CARB, and TOMM failure rates in non-head injury disability claimants. Archives of Clinical Neuropsychology, 19, 475–487.
   PubMed Web of Science ®Google Scholar
• Gfeller, J. D., & Cradock, M. M. (1998). Detecting feigned neuropsychological impairment with the Seashore Rhythm Test. Journal of Clinical Psychology, 54, 431–438.
   PubMed Web of Science ®Google Scholar
• Gilovich, T. (1983). Biased evaluation and persistence in gambling. Journal of Personality and Social Psychology, 44, 1110–1126.
   PubMed Web of Science ®Google Scholar
• Green, P. (2003). Green’s Word Memory Test for Microsoft Windows. Edmonton, Alberta, Canada: Green’s Publishing.
   Google Scholar
• Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15, 1045–1060.
   PubMed Web of Science ®Google Scholar
• Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6, 218–224.
   Google Scholar
• Greiffenstein, M. F., Greve, K. W., Bianchini, K. J., & Baker, W. J. (2008). Test of Memory Malingering and Word Memory Test: A new comparison of failure concordance rates. Archives of Clinical Neuropsychology, 23, 801–807.
   PubMed Web of Science ®Google Scholar
• Griffin, G. A. E., Glassmire, D. M., Henderson, E. A., & McCann, C. (1997). Rey II: Redesigning the Rey Screening Test of malingering. Journal of Clinical Psychology, 53, 757–766.
   PubMed Web of Science ®Google Scholar
• Griffin, G. A. E., Normington, J., & Glassmire, D. (1996). Qualitative dimensions in scoring the Rey Visual Memory Test of malingering. Psychological Assessment, 8, 383–387.
   Web of Science ®Google Scholar
• Grote, C. L., Kooker, E. K., Garron, D. C., Nyenhuis, D. L., Smith, C. L., & Mattingly, M. L. (2000). Performance of compensation seeking and non-compensation seeking samples on the Victoria Symptom Validity Test: Cross-validation and extension of a standardization study. Journal of Clinical and Experimental Neuropsychology, 22, 709–719.
   PubMed Web of Science ®Google Scholar
• Guilmette, T. J., Hart, K. J., Giuliano, A. J., & Leininger, B. E. (1994). Detecting simulated memory impairment: Comparison of the Rey Fifteen-Item Test and the Hiscock Forced-Choice Procedure. The Clinical Neuropsychologist, 8, 283–294.
   Web of Science ®Google Scholar
• Hastorf, A. H., & Cantril, H. (1954). They saw a game: A case study. Journal of Abnormal and Social Psychology, 49, 129–134.
   PubMed Web of Science ®Google Scholar
• Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. L., Millis, S. R. & Conference Participants. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias and malingering. The Clinical Neuropsychologist, 23, 1093–1129.
   PubMed Web of Science ®Google Scholar
• Heinly, M. T., Greve, K. W., Bianchini, K. J., Love, J. M., & Brennan, A. (2005). WAIS Digit Span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12, 429–444.
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., & Binder, L. M. (2000). Detecting exaggeration and malingering in neuropsychological assessment. Journal of Head Trauma Rehabilitation, 15, 829–858.
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., & Franzen, M. D. (1996). Using multiple objective memory procedures to detect simulated malingering. Journal of Clinical and Experimental Neuropsychology, 18, 38–51.
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., & Tulsky, D. S. (2003). Detecting malingering on the WAIS-III: Unusual Digit Span performance patterns in the normal population and in clinical groups. Archives of Clinical Neuropsychology, 18, 1–9.
   PubMed Web of Science ®Google Scholar
• Keary, T. A., Frazier, T. W., Belzile, C. J., Chapin, J. S., Naugle, R. I., Najm, I. M., & Busch, R. M. (2013). Working memory and intelligence are associated with Victoria Symptom Validity Test hard item performance in patients with intractable epilepsy. Journal of the International Neuropsychological Society, 19, 314–323.
   PubMed Web of Science ®Google Scholar
• Kelly, P. J., Baker, G. A., van den Broek, M. D., Jackson, H., & Humphries, G. (2005). The detection of malingering in memory performance: The sensitivity and specificity of four measures in a UK population. British Journal of Clinical Psychology, 44, 333–341.
   PubMed Web of Science ®Google Scholar
• Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480–498.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17, 410–425.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2005). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: A scientific approach (pp. 115–158). New York, NY: Oxford University Press.
   Google Scholar
• Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22, 666–679.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2009). Malingering scales for the Continuous Recognition Memory Test and Continuous Visual Memory Test. The Clinical Neuropsychologist, 23, 167–180.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29, 364–373.
   PubMed Web of Science ®Google Scholar
• Lee, D., Reynolds, C. R., & Wilson, V. L. (2003). Standardized test administration: Why bother? Journal of Forensic Neuropsychology, 3(3), 55–81.
   Google Scholar
• Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York, NY: Oxford University Press.
   Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). Oxford, UK: Oxford University Press.
   Google Scholar
• Long, J. S., & Freese, J. (2006). Regression models for categorical dependent variables using Stata. College Station, TX: Stata Press.
   Google Scholar
• Loring, D. W., Lee, G. P., & Meador, K. J. (2005). Victoria Symptom Validity Test performance in non-litigating epilepsy surgery candidates. Journal of Clinical and Experimental Neuropsychology, 27, 610–617.
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., & Volbrecht, M. (2003). Validation of memory error patterns on the Rey Complex Figure and Recognition Trial. Applied Neuropsychology, 5, 120–131.
   Web of Science ®Google Scholar
• Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26, 8–15.
   PubMed Web of Science ®Google Scholar
• Miele, A. S., Gunner, J. H., Lynch, J. K., & McCaffrey, R. M. (2012). Are embedded validity indices equivalent to free-standing symptom validity tests? Archives of Clinical Neuropsychology, 27, 10–22.
   PubMed Web of Science ®Google Scholar
• Millis, S. R., & Kler, S. (1995). Limitations of the Rey Fifteen-Item Test in the detection of malingering. The Clinical Neuropsychologist, 9, 241–244.
   Web of Science ®Google Scholar
• Mittenberg, W., Theroux, S., Aguila-Puentex, G., Bianchini, K., Greve, K., & Rayls, K. (2001). Identification of malingered head injury on the Wechsler Adult Intelligence Scale (3rd ed.). The Clinical Neuropsychologist, 15, 440–445.
   PubMed Web of Science ®Google Scholar
• Mittenberg, W., Theroux-Fichera, S., Zielinski, R. E., & Heilbronner, R. L. (1995). Identification of malingered head injury on the Wechsler Adult Intelligence Scale-Revised. Professional Psychology: Research and Practice, 26, 491–498.
   Web of Science ®Google Scholar
• Moss, A., Jones, C., Fokias, D., & Quinn, D. (2003). The mediating effects of effort upon the relationship between head injury severity and cognitive functioning. Brain Injury, 17, 377–387.
   PubMed Web of Science ®Google Scholar
• Reitan, R. M., & Wolfson, D. (1993). The Halstead-Reitan neuropsychological test battery. Theory and clinical interpretation (2nd ed.). Tucson, AZ: Neuropsychology Press.
   Google Scholar
• Rey, A. (1964). L’examen clique en psychologie [Clinical assessment in psychology]. Paris: Presses Universitaires de France.
   Google Scholar
• Reznek, L. (2005). The Rey-15 Item Memory Test for malingering: A meta-analysis. Brain Injury, 19, 539–543.
   PubMed Web of Science ®Google Scholar
• Rogers, R., Harrell, E. H., & Liff, C. D. (1993). Feigning neuropsychological impairment: A critical review of methodological and clinical considerations. Clinical Psychology Review, 13, 255–274.
   Web of Science ®Google Scholar
• Schretlen, D., Brandt, J., Krafft, L., & van Gorp, W. (1991). Some caveats in using the Rey 15-Item Memory Test to detect malingered amnesia. Psychological Assessment, 3, 667–672.
   Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.
   PubMed Web of Science ®Google Scholar
• Slick, D., Hopp, G., Strauss, E., & Thompson, G. B. (1997). Victoria Symptom Validity Test. Odessa, FL: Psychological Assessment Resources.
   Google Scholar
• Slick, D. J, Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. The Clinical Neuropsychologist, 13, 545–561.
   PubMed Web of Science ®Google Scholar
• Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms and commentary (3rd ed.). Oxford, UK: Oxford University Press.
   Google Scholar
• Tan, J. E., Slick, D. J., Strauss, E., & Hultsch, D. F. (2002). How’d they do it? Malingering strategies on symptom validity tests. The Clinical Neuropsychologist, 4, 495–505.
   Web of Science ®Google Scholar
• Tenhula, W. N., & Sweet, J. J. (1994a, February). Category test cut-off scores for identifying malingerers. Paper presented at the annual meeting of the International Neuropsychological Society, Cincinnati, OH.
   Google Scholar
• Tenhula, W. N., & Sweet, J. J. (1994b, November). Category test cut-off scores for identifying malingerers. Paper presented at the annual meeting of the National Academy of Neuropsychology, Orlando, FL.
   Google Scholar
• Tenhula, W. N., & Sweet, J. J. (1996). Double cross validation of the booklet category test in detecting malingered traumatic brain injury. The Clinical Neuropsychologist, 10, 104–116.
   Web of Science ®Google Scholar
• Tombaugh, T. N. (1996). The Test of Memory Malingering (TOMM). North Tonawanda, NY: Multi-Health Systems.
   Google Scholar
• Trueblood, W., & Schmidt, M. (1993). Malingering and other validity considerations in the neuropsychological evaluation of mild head injury. Journal of Clinical and Experimental Neuropsychology, 15, 578–590.
   PubMed Web of Science ®Google Scholar
• Vickery, C. D., Berry, D. T. R., Inman, T. H., Harris, M. J., & Orey, S. A. (2001). Detection of inadequate effort on neuropsychological testing: A meta-analytic review of selected procedures. Archives of Clinical Neuropsychology, 16, 45–73.
   PubMed Web of Science ®Google Scholar
• Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failure. Clinical Neuropsychology, 23, 297–313.
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale, Revised. New York: Psychological Corporation.
   Google Scholar
• Wechsler, D. (2009). Advanced clinical solutions for WAIS-IV and WMS-IV. San Antonio, TX: Pearson.
   Google Scholar
• Zuckerman, M. (1979). Attribution of success and failure revisited, or: The motivational bias is alive and well in attribution theory. Journal of Personality, 47, 245–287.
   Web of Science ®Google Scholar