225
Views
5
CrossRef citations to date
0
Altmetric
Research Articles

Failing Performance Validity Cutoffs on the Boston Naming Test (BNT) Is Specific, but Insensitive to Non-Credible Responding

, , , , &
Pages 17-31 | Received 03 Nov 2021, Accepted 31 Jan 2022, Published online: 14 Feb 2022

References

  • Abeare, C. A., An, K., Tyson, B., Holcomb, M., Cutler, L., May, N., & Erdodi, L. A. (2021). The emotion word fluency test as an embedded validity indicator, alone and in multivariate verbal fluency validity composite. Applied Neuropsychology. Child, 1–12. Advance online publication, doi:10.1080/21622965.2021.1939027
  • Abeare, K., Cutler, L., An, K. Y., Razvi, P., Holcomb, M., & Erdodi, L. A. (2021). BNT-15: Revised performance validity cutoffs and proposed clinical classification ranges. Cognitive and Behavioral Neurology. Advance online publication.
  • Abeare, C., Erdodi, L., Messa, I., Terry, D. P., Panenka, W. J., Iverson, G. L., & Silverberg, N. D. (2021). Development of embedded performance validity indicators in the NIH toolbox cognitive battery. Psychological Assessment, 33(1), 90–96. doi:10.1037/pas0000958
  • Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J., & Erdodi, L. (2019). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation, 34(4), 20–31. doi:10.1097/HTR.0000000000000451
  • Abeare, K., Romero, K., Cutler, L., Sirianni, C. D., & Erdodi, L. A. (2021). Flipping the script: Measuring both performance validity and cognitive ability with the Forced Choice Recognition trial of the RCFT. Perceptual and Motor Skills, 128(4) Advance online publication, 1373–1408. doi:10.1177/00315125211019704.
  • Abeare, C., Sabelli, A., Taylor, B., Holcomb, M., Dumitrescu, C., Kirsch, N., & Erdodi, L. (2019). The importance of demographically adjusted cutoffs: Age and education bias in raw score cutoffs within the trail making test. Psychological Injury and Law, 12(2), 170–182. doi:10.1007/s12207-019-09353
  • Abramson, D. A., Resch, Z. J., Ovsiew, G. P., White, D. J., Bernstein, M. T., Basurto, K. S., & Soble, J. R. (2020). Impaired or invalid? Limitations of assessing performance validity using the Boston Naming Test. Applied Neuropsychology. Adult, 1–6. Advance online publication, doi:10.1080/23279095.2020.1774378
  • Ali, S., Elliott, L., Biss, R., Abumeeiz, M., Brantuo, M., Kuzmenka, P., … Erdodi, L. (2020). The BNT-15 provides an accurate measure of English proficiency in cognitively intact bilinguals – A study in cross-cultural assessment. Applied Neuropsychology. Adult, 1–13. Advance online publication, doi:10.1080/23279095.2020.1760277
  • An, K. Y., Charles, J., Ali, S., Enache, A., Dhuga, J., & Erdodi, L. A. (2019). Re-examining performance validity cutoffs within the complex ideational material and the Boston Naming Test-short form using an experimental malingering paradigm. Journal or Clinical and Experimental Neuropsychology, 41(1), 15–25. doi:10.1080/13803395.2018.1483488
  • Armistead-Jehle, P., Ingram, P. B., & Morris, N. M. (2020). Personality assessment inventory cognitive bias scale: Validation in a military sample. Archives of Clinical Neuropsychology, 35(7), 1154–1161. doi:10.1093/arclin/acaa049
  • Arnold, G., Boone, K. B., Lu, P., Dean, A., Wen, J., Nitch, S., & McPhearson, S. (2005). Sensitivity and specificity of finger tapping test scores for the detection of suspect effort. The Clinical Neuropsychologist, 19(1), 105–120. doi:10.1080/13854040490888567
  • Ashendorf, L. (2019). Rey auditory verbal learning test and rey–osterrieth complex figure test performance validity indices in a VA polytrauma sample. The Clinical Neuropsychologist, 33(8), 1388–1402. doi:10.1080/13854046.2018.1543454
  • Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. doi:10.1080/13854046.2017.1285961
  • Attridge, J., Zimmerman, D., Rolin, S., & Davis, J. J. (2020). Comparing Boston Naming Test short forms in a rehabilitation sample. Applied Neuropsychology. Adult, 1–6. doi:10.1080/23279095.2020.1811984
  • Axelrod, B. N., Fichtenberg, N. L., Millis, S. R., & Wertheimer, J. C. (2006). Detecting incomplete effort with digit span from the Wechsler Adult Intelligence Scale – Third Edition. The Clinical Neuropsychologist, 20(3), 513–523. doi:10.1080/13854040590967117
  • Axelrod, B. N., Meyers, J. E., & Davis, J. J. (2014). Finger tapping test performance as a measure of performance validity. The Clinical Neuropsychologist, 28(5), 876–888. doi:10.1080/13854046.2014.907583
  • Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159. doi:10.1080/13854040590947362
  • Bauer, L., O’Bryant, S. E., Lynch, J. K., McCaffrey, R. J., & Fisher, J. M. (2007). Examining the Test of Memory Malingering Trial 1 and Word Memory Test Immediate Recognition as screening tools for insufficient effort. Assessment, 14(3), 215–222. doi:10.1177/1073191106297617
  • Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638. doi:10.3109/02699052.2014.947627
  • Bigler, E. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444. doi:10.1007/s11682-015-9409-1
  • Blaskewitz, N., Merten, T., & Brockhaus, R. (2009). Detection of suboptimal effort with the Rey Complex Figure Test and Recognition Trial. Applied Neuropsychology, 16(1), 54–61. doi:10.1080/09084280802644227
  • Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examination. The Clinical Neuropsychologist, 23(4), 729–741. doi:10.1080/13854040802427803
  • Boone, K. B. (2013). Clinical Practice of Forensic Neuropsychology. New York, NY: Guilford.
  • Bortnik, K. E., Boone, K. B., Marion, S. D., Amano, S., Ziegler, E., Victor, T. L., & Zeller, M. A. (2010). Examination of various WMS-III logical memory scores in the assessment of response bias. The Clinical Neuropsychologist, 24(2), 344–357. doi:10.1080/13854040903307268
  • Brockhaus, R., & Merten, T. (2004). Neuropsychologische Diagnostik suboptimalen Leistungsverhaltens mit dem Word Memory Test [Neuropsychological assessment of supotimal performance: The Word Memory Test]. Nervenarzt, 75(9), 882–887. doi:10.1007/s00115-003-1592-4
  • Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the association for scientific advancement in psychological injury and law. Psychological Injury and Law, 7(3), 197–205. doi:10.1007/s12207-014-9198-7
  • Carone, D. A. (2008). Children with moderate/severe brain damage/dysfunction outperform adults with mild-to-no brain damage on the Medical Symptom Validity Test. Brain Injury, 22(12), 960–971. doi:10.1080/02699050802491297
  • Carone, D. A., Green, P., & Drane, D. L. (2014). Word Memory Test profiles in two cases with surgical removal of the left anterior hippocampus and parahippocampal gyrus. Applied Neuropsychology. Adult, 21(2), 155–160. doi:10.1080/09084282.2012.755533
  • Carvalho, L., Reis, A., Colombarolli, M. S., Pasian, S. R., Miguel, F. K., Erdodi, L. A., … Giromini, L. (2021). Discriminating feigned from credible PTSD symptoms: A validation of a Brazilian version of the Inventory of Problems-29 (IOP-29). Psychological Injury and Law, 14, 58–70. doi:10.1007/s12207-021-09403-3
  • Chafetz, M. (2011). reducing the probability of false positives in malingering detection of social security disability claimants. The Clinical Neuropsychologist, 25(7), 1239–1252. doi:10.1080/13854046.2011.586785
  • Chafetz, M. D. (2020). Deception is different: Negative validity test findings do not provide “evidence” for “good effort”. The Clinical Neuropsychologist. Advance online publication.
  • Chafetz, M. D., Williams, M. A., Ben-Porath, Y. S., Bianchini, K. J., Boone, K. B., Kirkwood, M. W., … Ord, J. S. (2015). Official position of the American academy of clinical neuropsychology social security administration policy on validity testing: Guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740. doi:10.1080/13854046.2015.1099738
  • Dandachi-fitzgerald, B., Merckelbach, H., Boskovic, I., & Jelicic, M. (2020). Do you know people who feign? Proxy respondents about feigned symptoms. Psychological Injury and Law, 13(3), 225–234. doi:10.1007/s12207-020-09387-6
  • Dandachi-fitzgerald, B., Ponds, R. W. H. M., & Merten, T. (2013). Symptom validity and neuropsychological assessment: A survey of practices and beliefs on neuropsychologists in six European countries. Archives of Clinical Neuropsychology, 28(8), 771–873. doi:10.1093/arclin/act073
  • Davis, J. J., & Millis, S. R. (2014). Examination of performance validity test failure in relation to number of tests administered. The Clinical Neuropsychologist, 28(2), 199–214. doi:10.1080/13854046.2014.884633
  • Deloria, R., Kivisto, A. J., Swier-Vosnos, A., & Elwood, L. (2021). Optimal per test cut-off scores and combinations of failure on multiple embedded performance validity tests in detecting performance invalidity in a mixed clinical sample. Applied Neuropsychology. Adult, 1–11. Advance online publication, doi:10.1080/23279095.2021.1973005
  • Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432. doi:10.1093/arclin/acs044
  • Denning, J. H. (2014a). Combining the Test of Memory Malingering Trial 1 with behavioral responses improves the detection of effort test failure. Applied Neuropsychology. Adult, 21(4), 269–277. doi:10.1080/23279095.2013.811076
  • Denning, J. H. (2014b). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 29(7), 729–730.
  • Denning, J. H. (2021). The TOMM1 discrepancy index (TDI): A new performance validity test (PVT) that differentiates between invalid cognitive testing and those diagnosed with dementia. Applied Neuropsychology. Adult, 1–8. Advance online publication. doi:10.1080/23279095.2021.1910951
  • Domen, C. H., Greher, M. R., Hosokawa, P. W., Barnes, S. L., Hoyt, B. D., & Wodushek, T. R. (2020). Are established embedded performance validity test cut-offs generalizable to patients with multiple sclerosis? Archives of Clinical Neuropsychology, 35(5), 511–516. doi:10.1093/arclin/acaa016
  • Donders, J., & Hayden, A. (2020). Utility of the D–KEFS color word interference test as an embedded measure of performance validity after traumatic brain injury. The Clinical Neuropsychologist, 1–11. doi:10.1080/13854046.2020.1861659
  • Dunn, A., Pyne, S., Tyson, B., Roth, R., Shahein, A., & Erdodi, L. A. (2021). Critical item analysis enhances the classification of the logical memory recognition trial as a performance validity indicator. Developmental Neuropsychology, 46(5), 327–346. doi:10.1080/87565641.2021.1956499
  • Erdodi, L. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation, 49(2), 179–213. doi:10.3233/NRE-218020
  • Erdodi, L. A., & Abeare, C. A. (2020). Stronger together: The wechsler adult intelligence scale – fourth edition as a multivariate performance validity test in patients with traumatic brain injury. Archives of Clinical Neuropsychology, 35(2), 188–204. doi:10.1093/arclin/acz032/5613200
  • Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017). WAIS-IV processing speed scores as measures of non-credible responding – The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157. doi:10.1037/pas0000319
  • Erdodi, L. A., Abeare, C. A., Medoff, B., Seke, K. R., Sagar, S., & Kirsch, N. L. (2018). A single error is one too many: The forced choice recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology, 33(7), 845–860. doi:10.1093/arclin/acx110
  • Erdodi, L. A., Dunn, A. G., Seke, K. R., Charron, C., McDermott, A., Enache, A., … Hurtubise, J. (2018). The Boston Naming Test as a measure of performance validity. Psychological Injury and Law, 11(1), 1–8. doi:10.1007/s12207-017-9309-3
  • Erdodi, L. A., Hurtubise, J. H., Brantuo, M., Cutler, L., Kennedy, A., & Hirst, R. (2020). Old vs new: The classic and D-KEFS C as embedded performance validity indicators and measures of psychomotor speed/executive function. Archives of Assessment Psychology, 10(1), 45–69. doi:10.1037/pas0000561
  • Erdodi, L. A., Jongsma, K. A., & Issa, M. (2017). The 15-item version of the Boston Naming Test as an index of English proficiency. The Clinical Neuropsychologist, 31(1), 168–178. doi:10.1080/13854046.2016.1224392
  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. doi:10.1080/13854046.2017.1323119
  • Erdodi, L. A., & Lichtenstein, J. D. (2021). Information processing speed tests as PVTs. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective (pp. 218–247). New York, NY: Guilford.
  • Erdodi, L. A., Nussbaum, S., Sagar, S., Abeare, C. A., & Schwartz, E. S. (2017). Limited English proficiency increases failure rates on performance validity tests with high verbal mediation. Psychological Injury and Law, 10(1), 96–103. doi:10.1007/s12207-017-9282-x
  • Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology & Neuroscience, 10(3), 325–344. https://doi.org/10.1037/pne0000103
  • Erdodi, L. A., Taylor, B., Sabelli, A., Malleck, M., Kirsch, N. L., & Abeare, C. A. (2019). Demographically adjusted validity cutoffs in the Finger Tapping Test are superior to raw score cutoffs. Psychological Injury and Law, 12(2), 113–126. doi:10.1007/s12207-019-09352-y
  • Fazio, R. L., Denning, J. H., & Denney, R. L. (2017). TOMM Trial 1 as a performance validity indicator in a criminal forensic sample. The Clinical Neuropsychologist, 31(1), 251–267. doi:10.1080/13854046.2016.1213316
  • Gaasedelen, O. J., Whiteside, D. M., Altmaier, E., Welch, C., & Basso, M. R. (2019). The construction and the initial validation of the Cognitive Bias Scale for the Personality Assessment Inventory. The Clinical Neuropsychologist, 33(8), 1467–1484. doi:10.1080/13854046.2019.1612947
  • Gavett, B. E., O’Bryant, S. E., Fisher, J. M., & McCaffrey, R. J. (2005). Hit rates of adequate performance based on the Test of Memory Malingering (TOMM) Trial 1. Applied Neuropsychology, 12(1), 1–4. doi:10.1207/s15324826an1201_1
  • Gervais, R. O., Ben-Porath, W., & Green, P. (2007). Development and validation of a Response Bias Scale (RBS) for the MMPI-2. Assessment, 14(2), 196–208. doi:10.1177/1073191106295861
  • Giromini, L., Barbosa, F., Coga, G., Azeredo, A., Viglione, D. J., & Zennaro, A. (2020). Using the Inventory of Problems – 29 (IOP-29) with the Test of Memory Malingering (TOMM) in symptom validity assessment: A study with a Portuguese sample of experimental feigners. Applied Neuropsychology. Adult, 27(6), 504–516. doi:10.1080/23279095.2019.1570929
  • Giromini, L., Viglione, D. J., Zennaro, A., Maffei, A., & Erdodi, L. A. (2020). SVT meets PVT: Development and initial validation of the Inventory of Problems – Memory (IOP-M). Psychological Injury and Law, 13(3), 261–274. doi:10.1007/s12207-020-09385-8
  • Glassmire, D. M., Wood, M. E., Ta, M. T., Kinney, D. I., & Nitch, S. R. (2019). Examining false-positive rates of Wechsler Adult Intelligence Scale (WAIS-IV) processing speed based embedded validity indicators among individuals with schizophrenia spectrum disorders. Psychological Assessment, 31(1), 120–125. doi:10.1037/pas0000650
  • Goodglass, H., Kaplan, E., & Barresi, B. (2001). Boston Diagnostic Aphasia Examination (3rd ed.). Philadelphia, PA: Lippincott Williams & Wilkins.
  • Green, C. M., Kirk, J. W., Connery, A. K., Baker, D. A., & Kirkwood, M. W. (2014). The use of the Rey 15-Item Test and recognition trial to evaluate noncredible effort after pediatric mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 36(3), 261–267. doi:10.1080/13803395.2013.879096
  • Green, P., Montijo, J., & Brockhaus, R. (2011). High specificity of the Word Memory Test and Medical Symptom Validity Test in groups with severe verbal memory impairment. Applied Neuropsychology, 18(2), 86–94. doi:10.1080/09084282.2010.523389
  • Greiffenstein, M. F., Greve, K. W., Bianchini, K. J., & Baker, W. J. (2008). Test of Memory Malingering and Word Memory Test: A new comparison of failure concordance rates. Archives of Clinical Neuropsychology, 23(7–8), 801–807. doi:10.1016/j.acn.2008.07.005
  • Greve, K. W., & Bianchini, K. J. (2006). Should the Retention trial of the Test of Memory Malingering be optional? Archives of Clinical Neuropsychology, 21(1), 117–119. doi:10.1016/j.acn.2005.06.009
  • Greve, K. W., Bianchini, K. J., & Doane, B. M. (2006). Classification accuracy of the Test of Memory Malingering in traumatic brain injury: Results of a known-group analysis. Journal of Clinical and Experimental Neuropsychology, 28(7), 1176–1190. doi:10.1080/13803390500263550
  • Greve, K. W., Bianchini, K. J., & Roberson, T. (2007). The Booklet Category Test and malingering in traumatic brain injury: Classification accuracy in known groups. The Clinical Neuropsychologist, 21(2), 318–337. doi:10.1080/13854040500488552
  • Guilmette, T. J., Sweet, J. J., Hebben, N., Koltai, D., Mahone, E. M., Spiegler, B. J., … Westerveld, M.; Conference Participants. (2020). American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34(3), 437–453.
  • Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources.
  • Heaton, R. K., Smith, H. H., Lehman, R. A. W., & Vogt, A. T. (1978). Prospects for faking believable deficits on neuropsychological testing. Journal of Consulting and Clinical Psychology, 46(5), 892–900. doi:10.1037/0022-006X.46.5.892
  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R., & Conference Participants (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129. doi:10.1080/13854040903155063
  • Heinly, M. T., Greve, K. W., Bianchini, K., Love, J. M., & Brennan, A. (2005). WAIS Digit-Span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444. doi:10.1177/1073191105281099
  • Hilsabeck, R. C., Gordon, S. N., Hietpas-Wilson, T., & Zartman, A. L. (2011). Use of Trial 1 of the Test of Memory Malingering (TOMM) as a screening measure of effort: Suggested discontinuation rules. The Clinical Neuropsychologist, 25(7), 1228–1238. doi:10.1080/13854046.2011.589409
  • Hurtubise, J., Baher, T., Messa, I., Cutler, L., Shahein, A., Hastings, M., … Erdodi, L. (2020). Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI. Applied Neuropsychology. Child, 9(4), 337–354. doi:10.1080/21622965.2020.1719409
  • Iverson, G. L., Lange, R. T., Green, P., & Franzen, M. D. (2002). Detecting exaggeration and malingering with the Trail Making Test. The Clinical Neuropsychologist, 16(3), 398–406. doi:10.1076/clin.16.3.398.13861
  • Iverson, G. L., & Tulsky, D. S. (2003). Detecting malingering on the WAIS-III: Unusual digit span performance patterns in the normal population and clinical groups. Archives of Clinical Neuropsychology, 18(1), 1–9. doi:10.1016/S0887-6177(01)00176-7
  • Jones, A. (2013). Test of Memory Malingering: Cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059. doi:10.1080/13854046.2013.804949
  • Jurick, S. M., Crocker, L. D., Merritt, V. C., Hoffman, S. N., Keller, A. V., Eglit, G. M. L., … Jak, A. J. (2020). Psychological symptoms and rates of performance validity improve following trauma-focused treatment in veterans with PTSD and history of mild-to-moderate TBI. Journal of International Neuropsychological Society, 26(1), 108–118. doi:10.1017/S1355617719000997
  • Kim, N., Boone, K. B., Victor, T., Lu, P., Keatinge, C., & Mitchell, C. (2010). Sensitivity and specificity of a digit symbol recognition trial in the identification of response bias. Archives of Clinical Neuropsychology, 25(5), 420–428. doi:10.1903/arclin/acq040
  • Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental Test of Memory Malingering Scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244. doi:10.1007/s12207-014-9200-4
  • Lace, J. W., Grant, A. F., Kosky, K. M., Teague, C. L., Lowell, K. T., & Gfeller, J. D. (2020). Identifying novel embedded performance validity test formulas within the repeatable battery for the assessment of neuropsychological status: A simulation study. Psychological Injury and Law, 13(3), 303–315. doi:10.1007/s12207-020-09382-x
  • Lace, J. W., Merz, Z. C., & Galioto, R. (2021a). Nonmemory composite embedded performance validity formulas in patients with multiple sclerosis. Archives of Clinical Neuropsychology, Advance online publication doi:10.1093/arclin/acab066
  • Lange, R. T., Iverson, G. L., Brickell, T. A., Staver, T., Pancholi, S., Bhagwat, A., & French, L. M. (2013). Clinical utility of the Conners’ Continuous Performance Test-II to detect poor effort in U.S. military personnel following traumatic brain injury. Psychological Assessment, 25(2), 339–352. doi:10.1037/a0030915
  • Langeluddecke, P. M., & Lucas, S. K. (2003). Wechsler Adult Intelligence Scale-Third Edition findings in relation to severity of brain injury in litigants. The Clinical Neuropsychologist, 17(2), 273–284. doi:10.1076/clin.17.2.273.16499
  • Larochette, A. C., & Harrison, A. G. (2012). Word Memory Test performance in Canadian adolescents with learning disabilities: A preliminary study. Applied Neuropsychology. Child, 1(1), 38–47. doi:10.1080/21622965.2012.665777
  • Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22(4), 666–679. doi:10.1080/13854040701494987
  • Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373. doi:10.1093/arclin/acu019
  • Larrabee, G. J., Rohling, M. L., & Meyers, J. E. (2019). Use of multiple performance and symptom validity measures: Determining the optimal per test cutoff for determination of invalidity, analysis of skew, and inter-test correlations in valid and invalid performance groups. The Clinical Neuropsychologist, 33(8), 1354–1370. doi:10.1080/13854046.2019.1614227
  • Lau, L., Basso, M. R., Estevis, E., Miller, A., Whiteside, D. M., Combs, D., & Arentsen, T. J. (2017). Detecting coached neuropsychological dysfunction: A simulation experiment regarding mild traumatic brain injury. The Clinical Neuropsychologist, 31(8), 1412–1431. doi:10.1080/13854046.2017.1318954
  • Lichtenstein, J. D., Greenacre, M. K., Cutler, L., Abeare, K., Baker, S. D., Kent, K. J., … Erdodi, L. A. (2019). Geographic variation and instrumentation artifacts: In search of confounds in performance validity assessment in adults with mild TBI. Psychological Injury and Law, 12(2), 127–145. doi:10.1007/s12207-019-0935
  • Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421. doi:10.1080/13854046.2017.1406146
  • Loring, D. W., Strauss, E., Hermann, B. P., Barr, W. B., Perrine, K., Trenerry, M. R., … Bowden, S. C. (2008). Differential neuropsychological test sensitivity to left temporal lobe epilepsy. Journal of the International Neuropsychological Society, 14(3), 394–400. doi:10.1017/S1355617708080582
  • Lu, P. H., Boone, K. B., Cozolino, L., & Mitchell, C. (2003). Effectiveness of the Rey-Osterrieth Complex Figure Test and the Meyers and Meyers recognition trial in the detection of suspect effort. The Clinical Neuropsychologist, 17(3), 426–440. doi:10.1076/clin.17.3.426.18083
  • Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American Professionals. The Clinical Neuropsychologist, 29(6), 741–746. doi:10.1080/13854046.2015.1087597
  • Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. doi:10.1080/13854046.2019.1637027
  • McWhirter, L., Ritchie, C., Stone, J., & Carson, A. (2020). Functional cognitive disorders: A systematic review. The Lancet Psychiatry, 7(2), 191–207. doi:10.1016/S2215-0366(19)30405-5
  • Medici, R. (2013). The use of multiple performance validity tests. Journal of Forensic Psychology Practice, 13(1), 68–78. doi:10.1080/15228932.2013.746909
  • Menon, V., Shanmuganathan, B., Thamizh, J. S., Arun, A. B., Kuppili, P. P., & Sarkar, S. (2018). Personality traits such as neuroticism and disability predict psychological distress in medically unexplained symptoms: A three‐year experience from a single centre. Personality and Mental Health, 12(2), 145–154. doi:10.1002/pmh.1405
  • Merten, T., Dandachi-fitzgerald, B., Hall, V., Schmandd, B. A., Santamaríae, P., & González-Ordi, H. (2013). Symptom validity assessment in European countries: Development and state of the art. Clínica y Salud, 24(3), 129–138. doi:10.1016/S1130-5274(13)70014-8
  • Messa, I., Korcsog, K., & Abeare, C. (2020). An updated review of the prevalence of invalid performance on the Immediate Post-Concussion and Cognitive Testing (ImPACT). Advance online publication. The Clinical Neuropsychologist, 1–24. doi:10.1080/13854046.2020.1866676
  • Miele, A. S., Gunner, J. H., Lynch, J. K., & McCaffrey, R. J. (2012). Are embedded validity indices equivalent to free-standing symptom validity tests? Archives of Clinical Neuropsychology, 27(1), 10–22. doi:10.1093/arclin/acr084
  • Millis, S. R. (2009). What clinicians really need to know about symptom exaggeration, insufficient effort, and malingering: Statistical and measurement matters. In J. E. Morgan & J. J. Sweet (Eds.), Neuropsychology of malingering casebook (pp. 21–37). New York: Psychology Press.
  • Nitch, S., Boone, K. B., Wen, J., Arnold, G., & Alfano, K. (2006). The utility of the Rey Word Recognition Test in the detection of suspect effort. The Clinical Neuropsychologist, 20(4), 873–887. doi:10.1080/13854040590967603
  • O’Bryant, S. E., Engel, L. R., Kleiner, J. S., Vasterling, J. J., & Black, F. W. (2007). Test of memory malingering (TOMM) trial 1 as a screening measure for insufficient effort. The Clinical Neuropsychologist, 21(3), 511–521. doi:10.1080/13854040600611368
  • O’Bryant, S. E., Gavett, B. E., McCaffrey, R. J., O’Jile, J. R., Huerkamp, J. K., Smitherman, T. A., & Humpreys, J. D. (2008). Clinical utility of Trial 1 of the Test of Memory Malingering (TOMM). Applied Neuropsychology, 15(2), 113–116. doi:10.1080/09084280802083921
  • Olla, O., Rykulski, N., Hurtubise, J. L., Bartol, S., Foote, R., Cutler, L., … Erdodi, L. (2021). Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients. Applied Neuropsychology. Adult, 28(6), 647–657. doi:10.1080/23279095.2019.161.1681424
  • Ord, A. S., Shura, R. D., Sansone, A. R., Martindale, S. L., Taber, K. H., & Rowland, J. A. (2021). Performance validity and symptom validity tests: Are they measuring different constructs? Neuropsychology, 35(3), 241–251. doi:10.1037/neu0000722
  • Pearson. (2009). Advanced Clinical Solutions for the WAIS-IV and WMS-IV – Technical Manual. San Antonio, TX: Author.
  • Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-Year Period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. doi:10.1093/arclin/acw007
  • Rai, J. K., An, K. Y., Charles, J., Ali, S., & Erdodi, L. A. (2019). Introducing a forced choice recognition trial to the Rey Complex Figure Test. Psychology & Neuroscience, 12(4), 451–472. doi:10.1037/pne0000175
  • Rai, J., & Erdodi, L. (2021). The impact of criterion measures on the classification accuracy of TOMM-1. Applied Neuropsychology. Adult, 28(2), 185–196. doi:10.1080/23279095.2019.161.1613994
  • Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., … Wright, M. J. (2013). Cross validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28(1), 30–37. doi:10.1093/arclin/acs106
  • Sabelli, A. G., Messa, I., Giromini, L., Lichtenstein, J. D., May, N., & Erdodi, L. A. (2021). Symptom versus performance validity in patients with mild TBI: Independent sources of non-credible responding. Psychological Injury and Law, 14(1), 17–36. doi:10.1007/s12207-021-09400-6
  • Schroeder, R. W., Boone, K. B., & Larrabee, G. J. (2021). Design methods in neuropsychological performance validity, symptom validity, and malingering research. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective (pp. 11–34). New York, NY: Guilford.
  • Schroeder, R. W., Martin, P. K., Heindrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. doi:10.1080/13854046.2018.1484517
  • Schutte, C., Axelrod, B. N., & Montoya, E. (2015). Making sure neuropsychological data are meaningful: Use of performance validity testing in medicolegal and clinical contexts. Psychological Injury and Law, 8(2), 100–105. doi:10.1007/s12207-015-9225-3
  • Schwartz, E. S., Erdodi, L., Rodriguez, N., Jyotsna, J. G., Curtain, J. R., Flashman, L. A., & Roth, R. M. (2016). CVLT-II forced choice recognition trial as an embedded validity indicator: A systematic review of the evidence. Journal of the International Neuropsychological Society, 22(8), 851–858. doi:10.1017/S1355617716000746
  • Sharland, M. J., & Gfeller, J. D. (2007). A survey of neuropsychologists’ beliefs and practice with respect to the assessment of effort. Archives of Clinical Neuropsychology, 22(2), 213–223. doi:10.1016/j.acn.2006.12.004
  • Shura, R. D., Martindale, S. L., Taber, K. H., Higgins, A. M., & Rowland, J. A. (2020). Digit Span embedded validity indicators in neurologically-intact veterans. The Clinical Neuropsychologist, 34(5), 1025–1037. doi:10.1080/13854046.2019.1635209
  • Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gantz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology. Adult, 23(2), 94–104. doi:10.1080/23279095.2015.1014556
  • Silk-Eglit, G. M., Stenclik, J. H., Miele, A. S., Lynch, J. K., & McCaffrey, R. J. (2015). Rates of false-positive classification resulting from the analysis of additional embedded performance validity measures. Applied Neuropsychology. Adult, 22(5), 335–347. doi:10.1080/23279095.2014.938809
  • Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., & Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity test (PVT) research. Psychological Injury and Law, 13, 44–56. doi:10.1007/s12207-019-09370-w
  • Soble, J. R., Bain, K. M., Bailey, K. C., Kirton, J. W., Marceaux, J. C., Critchfield, E. A., O’Rourke, J. J. F. (2019). Evaluating the accuracy of the Wechsler Memory Scale-Fourth Edition (WMS-IV) Logical Memory embedded validity index for detecting invalid test performance. Applied Neuropsychology. Adult, 26(4), 311–318. doi:10.1080/23279095.2017.1418744
  • Stålhammar, J., Hellström, P., Eckerström, C., & Wallin, A. (2020) Neuropsychological test performance among native and non-native Swedes: Second language effects. Advance online publication. Archives of Clinical Neuropsychology. 10.1093/arclin/acaa043
  • Stålhammar, J., Hellström, P., Eckerström, C., & Wallin, A. (2020). Neuropsychological test performance among native and non-native Swedes: Second language effects. Archives of Clinical Neuropsychology. doi:10.1093/arclin/acaa043
  • Stenclik, J. H., Miele, A. S., Silk-Eglit, G., Lynch, J. K., & McCaffrey, R. J. (2013). Can the sensitivity and specificity of the TOMM be increased with different cut-off scores? Applied Neuropsychology. Adult, 20(4), 243–248. doi:10.1080/09084282.2012.704603
  • Stevens, A., Friedel, E., Mehren, G., & Merten, T. (2008). Malingering and uncooperativeness in psychiatric and psychological assessment: Prevalence and effects in a German sample of claimants. Psychiatry Research, 157(1–3), 191–200. doi:10.1016/j.psychres.2007.01.003
  • Sugarman, M. A., & Axelrod, B. N. (2015). Embedded measures of performance validity using verbal fluency tests in a clinical sample. Applied Neuropsychology. Adult, 22(2), 141–146. doi:10.1080/23279095.2013.873439
  • Sugarman, M. A., Holcomb, E. M., Axelrod, B. N., Meyers, J. E., & Liethen, P. C. (2016). Embedded measures of performance validity in the Rey Complex Figure Test in a clinical sample of veterans. Applied Neuropsychology. Adult, 23(2), 105–114. doi:10.1080/23279095.2015.1014557
  • Suhr, J., Hammers, D., Dobbins-Buckland, K., Zimak, E., & Hughes, C. (2008). The relationship of malingering test failure to self-reported symptoms and neuropsychological findings in adults referred for ADHD evaluation. Archives of Clinical Neuropsychology, 23(5), 521–530. doi:10.1016/j.acn.2008.05.003
  • Sussman, Z. W., Peterson, R. L., Connery, A., Baker, K., & A, D. (2019). Utility of matrix reasoning as an embedded performance validity indicator in pediatric mild traumatic brain injury. Applied Neuropsychology. Child, 8(1), 70–75. doi:10.1080/21622965.2017.1382359
  • Tarachow, S. (1947). The syndrome of inhibition. Psychiatric Quarterly, 21(2), 233–252. doi:10.1007/BF01641756
  • Tyson, B. T., Baker, S., Greenacre, M., Kent, K. J., Lichtenstein, J. D., Sabelli, A., & Erdodi, L. A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45. doi:10.1016/j.yebeh.2018.08.010
  • Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failure. The Clinical Neuropsychologist, 23(2), 297–313. doi:10.1080/13854040802232682
  • Webber, T., Bailey, K. C., Alverson, A., Critchfield, E., Bain, K., Messerly, J., Soble, J. (2018). Correction to: Further validation of the Test of Memory Malingering (TOMM) trial 1 Performance Validity Index: Examination of false positives and convergent validity. Psychological Injury and Law, 11(4), 325–335. doi:10.1007/s12207-018-9335-9
  • White, D. J., Korinek, D., Bernstein, M. T., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2020). Cross-validation of non-memory-based embedded performance validity tests for detecting invalid performance among patients with and without neurocognitive impairment. Journal of Clinical and Experimental Neuropsychology, 42(5), 459–472. doi:10.1080/13803395.2020.1758634
  • Whiteside, D. M., Caraher, K., Hahn-Ketter, A., Gaasedelen, O., & Basso, M. R. (2019). Classification accuracy of individual and combined executive functioning embedded performance validity measures in mild traumatic brain injury. Applied Neuropsychology. Adult, 26(5), 472–481. doi:10.1080/23279095.2018.1443935
  • Whiteside, D. M., Kogan, J., Wardin, L., Philips, D., Franzwa, M. G., Rice, L., … Roper, B. (2015). Language-based embedded performance validity measures in traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 37(2), 220–227. doi:10.1080/13803395.2014.1002758
  • Whiteside, D., Wald, D., & Busse, M. (2011). Classification accuracy of multiple visual spatial measures in the detection of suspect effort. The Clinical Neuropsychologist, 25(2), 287–301. doi:10.1080/13854046.2010.538436
  • Whitney, K. A., Davis, J. J., Shepard, P. H., Bertram, D. M., & Adams, K. M. (2009). Digit span age scaled score in middle-aged military veterans: Is it more closely associated with TOMM failure than reliable digit span? Archives of Clinical Neuropsychology, 24(3), 263–272. doi:10.1093/arclin/acp034
  • Whitney, K., Hook, J. N., Steiner, A. R., Shepard, P. H., & Callaway, S. (2008). Is the Rey 15-Item Memory Test II (Rey II) a valid symptom validity test? Comparison with the TOMM. Applied Neuropsychology, 15(4), 287–292. doi:10.1080/09084280802325215
  • Wisdom, N. M., Brown, W. L., Chen, D. K., & Collins, R. L. (2012). The use of all three Test of Memory Malingering trials in establishing the level of effort. Archives of Clinical Neuropsychology, 27(2), 208–212. doi:10.1093/arclin/acr107
  • Young, G. (2015). Malingering in forensic disability-related assessments: Prevalence 15±15%. Psychological Injury and Law, 8(3), 188–199. doi:10.1007/s12207-015-9232-4

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.