263
Views
0
CrossRef citations to date
0
Altmetric
Articles

Cross-Cultural Performance Validity Testing: Managing False Positives in Examinees with Limited English Proficiency

, ORCID Icon, & ORCID Icon
Pages 273-294 | Received 19 Mar 2022, Accepted 19 Jul 2022, Published online: 19 Aug 2022

References

  • Abeare, C. A., An, K., Tyson, B., Holcomb, M., Cutler, L., May, N., & Erdodi, L. A. (2021). The emotion word fluency test as an embedded performance validity indicator – Alone and in a multivariate validity composite. Applied Neuropsychology: Child, 1–12. Advance online publication, doi:10.1080/21622965.2021.1939027
  • Abeare, K., Cutler, L., An, K. Y., Razvi, P., Holcomb, M., & Erdodi, L. A. (2022). BNT-15: Revised performance validity cutoffs and proposed clinical classification ranges. Cognitive and Behavioral Neurology Advance online publication, Publish Ahead of Print. doi:10.1097/WNN.0000000000000304
  • Abeare, C., Erdodi, L., Messa, I., Terry, D. P., Panenka, W. J., Iverson, G. L., & Silverberg, N. D. (2021). Development of embedded performance validity indicators in the NIH toolbox cognitive battery. Psychological Assessment, 33(1), 90–96. doi:10.1037/pas0000958
  • Abeare, C. A., Freund, S., Kaploun, K., McAuley, T., & Dumitrescu, C. (2017). The Emotion Word Fluency Test (EWFT): Initial psychometric, validation, and physiological evidence in young adults. Journal of Clinical and Experimental Neuropsychology, 39(8), 738–752. doi:10.1080/13803395.2016.1259396
  • Abeare, C. A., Hurtubise, J., Cutler, L., Sirianni, C., Brantuo, M., Makhzoun, N., & Erdodi, L. (2020). Introducing a forced choice recognition trial to the Hopkins verbal learning test – revised. The Clinical Neuropsychologist. Advance online publication. doi: 10.1080/13854046.2020.1779348.
  • Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J., Erdodi, L., & Erdodi, L. (2019). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation, 34(4), 20–31. doi:10.1097/HTR.0000000000000451
  • Abeare, K., Romero, K., Cutler, L., Sirianni, C. D., & Erdodi, L. A. (2021). Flipping the script: Measuring both performance validity and cognitive ability with the forced choice recognition trial of the RCFT. Perceptual and Motor Skills, 128(4), 1373–1408. doi:10.1177/00315125211019704
  • Abeare, C., Sabelli, A., Taylor, B., Holcomb, M., Dumitrescu, C., Kirsch, N., & Erdodi, L. (2019). The importance of demographically adjusted cutoffs: Age and education bias in raw score cutoffs within the Trail Making Test. Psychological Injury and Law, 12(2), 170–182. doi:10.1007/s12207-019-09353
  • Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80(2), 207–245. doi:10.3102/0034654310368803
  • Ali, S., Brantuo, M., Cutler, L., Kennedy, A., & Erdodi, L. (2022a). Limited English proficiency inhibits auditory verbal learning in cognitively healthy young adults – Exploring culturally responsive diagnostic and educational safeguards. Applied Neuropsychology: Child, 1–7. Advance online publication. doi:10.1080/21622965.2022.2034628
  • Ali, S., Elliott, L., Biss, R., Abumeeiz, M., Brantuo, M., Kuzmenka, P., Erdodi, L. (2022b). The BNT-15 provides an accurate measure of English proficiency in cognitively intact bilinguals – A study in cross-cultural assessment. Applied Neuropsychology: Adult, 29(3), 351–363. doi:10.1080/23279095.2020.1760277
  • An, K. Y., Charles, J., Ali, S., Enache, A., Dhuga, J., & Erdodi, L. A. (2019). Re-examining performance validity cutoffs within the complex ideational material and the Boston naming test-short form using an experimental malingering paradigm. Journal of Clinical and Experimental Neuropsychology, 41(1), 15–25. doi:10.1080/13803395.2018.1483488
  • An, K. Y., Kaploun, K., Erdodi, L. A., & Abeare, C. A. (2017). Performance validity in undergraduate research participants: A comparison of failure rates across tests and cutoffs. The Clinical Neuropsychologist, 31(1), 193–206. doi:10.1080/13854046.2016.1217046
  • Ardila, A. (2020). A cross-linguistic comparison of category verbal fluency test (ANIMALS): A systematic review. Archives of Clinical Neuropsychology, 35(2), 213–225. doi:10.1093/arclin/acz060
  • Ashendorf, L., Clark, E. L., & Humphreys, C. T. (2021). The Rey 15-item memory test in US veterans. Journal of Clinical and Experimental Neuropsychology, 43(3), 324–331. doi:10.1080/13803395.2021.1932761
  • Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. doi:10.1080/13854046.2017.1285961
  • Axelrod, B. N., Fichtenberg, N. L., Millis, S. R., & Wertheimer, J. C. (2006). Detecting incomplete effort with digit span from the Wechsler adult intelligence scale – third edition. The Clinical Neuropsychologist, 20(3), 513–523. doi:10.1080/13854040590967117
  • Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159. doi:10.1080/13854040590947362
  • Bailey, K. C., Goatte, W., Ramos-Usuga, D., Rivera, D., & Arango-Lasprilla, J. C. (2021). Cross-validation of the utility of test of memory malingering (TOMM) cut-offs in a large Colombian sample. Psychological Injury and Law, 14(2), 114–126. doi:10.1007/s12207-021-09407-z
  • Bell-Sprinkel, T. L., Boone, K. B., Miora, D., Cottingham, M., Victor, T., Ziegler, E., Wright, M. (2013). Re-examination of the Rey word recognition test. The Clinical Neuropsychologist, 27(3), 516–527. doi:10.1080/13854046.2012.744853
  • Berthelson, L., Mulchan, S. S., Odland, A., Miller, P., J, L., & Mittenberg, W. (2013). False positive diagnosis of malingering due to the use of multiple effort tests. Brain Injury, 27(7–8), 909–916. doi:10.3109/02699052.2013.793400
  • Bialystok, E. (2011). Reshaping the mind: The benefits of bilingualism. Canadian Journal of Experimental Psychology, 65(4), 229–235. doi:10.1037/a0025406
  • Bialystok, E., Craik, F., & Luk, G. (2008). Cognitive control and lexical access in younger and older bilinguals. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(4), 859–873. doi:10.1037/0278-7393.34.4.859
  • Bodner, T., Merten, T., & Benke, T. (2019). Performance validity measures in clinical patients with aphasia. Journal of Clinical and Experimental Neuropsychology, 41(5), 476–483. doi:10.1080/13803395.2019.1579783
  • Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examination. The Clinical Neuropsychologist, 23(4), 729–741. doi:10.1080/13854040802427803
  • Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York, NY: Guilford.
  • Boone, K. B., Salazar, X., Lu, P., Warner-Chacon, K., & Razani, J. (2002). The Rey 15-item recognition trial: A technique to enhance sensitivity of the Rey 15-item memorization test. Journal of Clinical and Experimental Neuropsychology, 24(5), 561–573. doi:10.1076/jcen.24.5.561.1004
  • Boone, K. B., Victor, T. L., Wen, J., Razani, J., & Pontón, M. (2007). The association between neuropsychological scores and ethnicity, language, and acculturation variables in a large patient population. Archives of Clinical Neuropsychology, 22(3), 355–365. doi:10.1016/j.acn.2007.01.010
  • Boskovic, I., Hope, L., Ost, J., Orthey, R., & Merckelback, H. (2019). Detecting feigned high impact experiences: A symptom over-report questionnaire outperforms the emotional Stroop task. Journal of Behavior Therapy and Experimental Psychiatry, 65, 1–7. doi:10.1016/j.jbtep.2019.101483
  • Boskovic, I., van der Heide, D., Hope, L., Merckelback, H., & Jelicic, M. (2017). Plausibility judgments of atypical symptoms across cultures: An explorative study among Western and non-Western experts. Psychological Injury and Law, 10(3), 274–281. doi:10.1007/s12207-017-9294-6
  • Brandt, J., & Benedict, R. H. B. (2001). Hopkins verbal learning test – revised. Odessa, FL: Psychological Assessment Services.
  • Brantuo, M., An, K., Biss, R., Ali, S., & Erdodi, L. A. (2022). Neurocognitive profiles associated with limited English proficiency in cognitively intact adults. Archives of Clinical Neuropsychology, Advance online publication doi:10.1093/arclin/acac019
  • Burton, V., Vilar-Lopez, R., & Puente, A. E. (2012). Measuring effort in neuropsychological evaluations of forensic cases of Spanish speakers. Archives of Clinical Neuropsychology, 27(3), 262–267. doi:10.1093/arclin/acs026
  • Bush, S. S., Heilbronner, R. L., & Ruff, R. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the association for scientific advancement in psychological injury and law. Psychological Injury and Law, 7(3), 197–205. doi:10.1007/s12207-014-9198-7
  • Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity (NAN Policy and Planning Committees). Archives of Clinical Neuropsychology, 20(4), 419–426. doi:10.1016/j.acn.2005.02.002
  • Chafetz, M. D. (2020). Deception is different: Negative validity test findings do not provide “evidence” for “good effort. The Clinical Neuropsychologist, 1–21. Advance online publication. doi:10.1080/13854046.2020.1840633
  • Chafetz, M. D., Williams, M. A., Ben-Porath, Y. S., Bianchini, K. J., Boone, K. B., Kirkwood, M. W., Ord, J. S. (2015). Official position of the American Academy of clinical neuropsychology social security administration policy on validity testing: Guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740. doi:10.1080/13854046.2015.1099738
  • Chiu, V. W., & Lee, T. (2002). Detection of malingering behavior at different levels of task difficulty in Hong Kong Chinese. Rehabilitation Psychology, 47(2), 194. doi:10.1037/0090-5550.47.2.194
  • Coffey, D., Marmol, L., Schock, L., & Adams, W. (2005). The influence of acculturation on the Wisconsin card sorting test by Mexican Americans. Archives of Clinical Neuropsychology, 20(6), 795–803. doi:10.1016/j.acn.2005.04.009
  • Crişan, I., Sava, F. A., Maricuţoiu, L. P., Ciumăgeanu, M. D., Axinia, O., Gîrniceanu, L., & Ciotlăuş, L. (2021). Evaluation of various detection strategies in the assessment of noncredible memory performance: Results of two experimental studies. Assessment, 107319112110401. Advance online publication. 10731911211040105. doi:10.1177/10731911211040105
  • Cutler, L., Abeare, C., Messa, I., Holcomb, M., & Erdodi, L. A. (2021). This will only take a minute: Time cutoffs are superior to accuracy cutoffs on the forced choice recognition trial of the Hopkins verbal learning test – revised. Applied Neuropsychology: Adult, 1–15. Advance online publication, doi:10.1080/23279095.2021.1884555
  • Cutler, L., Greenacre, M., Abeare, C. A., Sirianni, C. D., Roth, R. M., & Erdodi, L. (2022). Multivariate models provide an effective psychometric solution to the variability in classification accuracy of D-KEFS Stroop performance validity cutoffs. The Clinical Neuropsychologist. Advance online publication.
  • Dandachi-FitzGerald, B., Ponds, R. W. H. M., & Merten, T. (2013). Symptom validity and neuropsychological assessment: A survey of practices and beliefs on neuropsychologists in six European countries. Archives of Clinical Neuropsychology, 28(8), 771–873. doi:10.1093/arclin/act073
  • Daugherty, J. C., Puente, A. E., Lozano-Ruiz, A., & Perez-Garcia, M. (2020). Cultural accommodations for cutoff scores of embedded performance validity tests in a Spanish college population. Applied Neuropsychology: Adult. Advance online publication.
  • Davis, J. J. (2014). Further consideration of advanced clinical solutions word choice: comparison to the recognition memory test – words and classification accuracy on a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294. doi:10.1080/13854046.2014.975844
  • Davis, J. J., & Millis, S. R. (2014). Examination of performance validity test failure in relation to number of tests administered. The Clinical Neuropsychologist, 28(2), 199–214. doi:10.1080/13854046.2014.884633
  • De Bruin, A., Treccani, B., & Della Sala, S. (2015). Cognitive advantage in bilingualism: An example of publication bias? Psychological Science, 26(1), 99–107. doi:10.1177/0956797614557866
  • Denning, J. H. (2012). The efficiency and accuracy of the test of memory malingering trial 1, errors on the first 10 items of the test of memory malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432. doi:10.1093/arclin/acs044
  • Donders, J., & Hayden, A. (2020). Utility of the D-KEFS color word interference test as an embedded measure of performance validity after traumatic brain injury. Advance online publication. The Clinical Neuropsychologist, 1–11. doi:10.1080/13854046.2020.1861659
  • Dunn, A., Pyne, S., Tyson, B., Roth, R., Shahein, A., & Erdodi, L. A. (2021). Critical item analysis enhances the classification of the logical memory recognition trial as a performance validity indicator. Developmental Neuropsychology, 46(5), 327–346. doi:10.1080/87565641.2021.1956499
  • Elbaum, T., Golan, L., Lupu, T., Wagner, M., & Braw, Y. (2019). Establishing supplementary response time validity indicators in the Word Memory Test (WMT) and directions for future research. Applied Neuropsychology: Adult, 27(5), 403–413. doi:10.1080/23279095.2018.1555161
  • Erdodi, L. A. (2019). Aggregating validity indicators: The salience of domain specificity and the indeterminate range in multivariate models of performance validity assessment. Applied Neuropsychology: Adult, 26(2), 155–172. doi:10.1080/23279095.2017.1384925
  • Erdodi, L. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation, 49(2), 179–213. doi:10.3233/NRE-218020
  • Erdodi, L. A. (2022). Multivariate models of performance validity: The erdodi index captures the dual nature of non-credible responding (continuous and categorical). Assessment, 107319112211019. Advance online publication, doi:10.1177/10731911221101910
  • Erdodi, L. A., & Abeare, C. A. (2020). Stronger together: The Wechsler adult intelligence scale – fourth edition as a multivariate performance validity test in patients with traumatic brain injury. Archives of Clinical Neuropsychology, 35(2), 188–204. doi:10.1093/arclin/acz032/5613200
  • Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B., Kucharski, B, T., Zuccato, B. G., & Roth, R. M. (2017). WAIS-IV processing speed scores as measures of non-credible responding – The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157. doi:10.1037/pas0000319
  • Erdodi, L. A., Hurtubise, J. H., Brantuo, M., Cutler, L., Kennedy, A., & Hirst, R. (2021). Old vs new: The classic and D-KEFS Trails as embedded performance validity indicators and measures of psychomotor speed/executive function. Archives of Assessment Psychology, 11(1), 137–161.
  • Erdodi, L. A., Jongsma, K. A., & Issa, M. (2017). The 15-item version of the Boston naming test as an index of English proficiency. The Clinical Neuropsychologist, 31(1), 168–178. doi:10.1080/13854046.2016.1224392
  • Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014). Comparing the recognition memory test and the word choice test in a mixed clinical sample: Are they equivalent? Psychological Injury and Law, 7(3), 255–263. doi:10.1007/s12207-014-9197-8
  • Erdodi, L. A., Kirsch, N. L., Sabelli, A. G., & Abeare, C. A. (2018). The grooved pegboard test as a validity indicator – A study on psychogenic interference as a confound in performance validity research. Psychological Injury and Law, 11(4), 307–324. doi:10.1007/s12207-018-9337-7
  • Erdodi, L. A., & Lajiness-O’Neill, R. (2012). Humor perception in bilinguals: Is language more than a code? Humor, 25(4), 459–468. doi:10.1515/humor-2012-0024
  • Erdodi, L. A., & Lichtenstein, J. D. (2021). Information processing speed tests as PVTs. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective (pp. 218–247). New York, NY: Guilford.
  • Erdodi, L. A., Nussbaum, S., Sagar, S., Abeare, C. A., & Schwartz, E. S. (2017). Limited English proficiency increases failure rates on performance validity tests with high verbal mediation. Psychological Injury and Law, 10(1), 96–103. doi:10.1007/s12207-017-9282-x
  • Erdodi, L. A., & Roth, R. M. (2017). Low scores on BDAE Complex Ideational Material are associated with invalid performance in adults without aphasia. Applied Neuropsychology: Adult, 24(3), 264–274. doi:10.1080/23279095.2017.1298600
  • Erdodi, L. A., Seke, K. R., Shahein, A., Tyson, B. T., Sagar, S., & Roth, R. M. (2017). Low scores on the Grooved Pegboard Test are associated with invalid responding and psychiatric symptoms. Psychology and Neuroscience, 10(3), 325–344. https://doi.org/10.1037/pne0000103
  • Erdodi, L. A., Tyson, B. T., Abeare, C. A., Lichtenstein, J. D., Pelletier, C. L., Rai, J. K., & Roth, R. M. (2016). The BDAE Complex Ideational Material – A measure of receptive language or performance validity? Psychological Injury and Law, 9(2), 112–120. doi:10.1007/s12207-016-9254-6
  • Erdodi, L. A., Tyson, B. T., Shahein, A., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Roth, R. M. (2017). The power of timing: adding a time-to-completion cutoff to the word choice test and recognition memory test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383. doi:10.1080/13803395.2016.1230181
  • Eurostat. (2016). Foreign language skills statistics [Data file]. Retrieved from https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Foreign_language_skills_statistics
  • Franzen, S. European Consortium on Cross-Cultural Neuropsychology (ECCroN). (2021). Cross-cultural neuropsychological assessment in Europe: Position statement of the European Consortium on Cross-Cultural Neuropsychology (ECCroN). The Clinical Neuropsychologist. 36(3), 546-557. Advance online publication.
  • Gasquoine, P. ((1999)). Variables moderating cultural and ethnic differences in neuropsychological assessment: The case of Hispanic Americans. The Clinical Neuropsychologist, 13(3), 376–383. doi:10.1076/clin.13.3.376.1735
  • Gasquoine, P. G., Croyle, K. L., Cavazos-Gonzalez, C., & Sandoval, O. (2007). Language of administration and neuropsychological test performance in neurologically intact Hispanic American bilingual adults. Archives of Clinical Neuropsychology, 22(8), 991–1001. doi:10.1016/j.acn.2007.08.003
  • Gasquoine, P., Weimer, G., & Amador, A. (2017). Specificity rates for non-clinical, bilingual, Mexican Americans on three popular performance validity measures. The Clinical Neuropsychologist, 31(3), 587–597. doi:10.1080/13854046.2016.1277786
  • Gasquoine, P. G., Weimer, A. A., & Orta, M. (2019). Specificity rates for non-clinical, bilingual, Mexican Americans with California verbal learning test-3, verbal fluency, and Rey 15-IR performance validity measures. The Clinical Neuropsychologist, 33(8), 1445–1454. doi:10.1080/13854046.2018.1530374
  • Gladsjo, J. A., Schuman, C. C., Evans, J. D., Peavy, G. M., Miller, S. W., & Heaton, R. K. (1999). Norms for letter and category fluency: Demographic corrections for age, education, and ethnicity. Assessment, 6(2), 147–178. doi:10.1177/107319119900600204
  • Glassmire, D. M. B., Wisniewski, A. M., Green, R. L., Kennedy, J. E., Date, E., & Date, E. (2003). Using the WMS-III Faces subtest to detect malingered memory impairment. Journal of Clinical and Experimental Neuropsychology, 25(4), 465–481. doi:10.1076/jcen.25.4.465.13875
  • Gollan, T. H., Montoya, R. I., & Werner, G. A. (2002). Semantic and letter fluency in Spanish-English bilinguals. Neuropsychology, 16(4), 562–576. doi:10.1037/0894-4105.16.4.562
  • Goodglass, H., Kaplan, E., & Barresi, B. (2001). Boston diagnostic aphasia examination (3rd ed.). Philadelphia, PA: Lippincott Williams & Wilkins.
  • Goworowski, L., Vagt, D., Salazar, C., Mulligan, K., & Webbe, F. (2018). Normative values of the Rey Word Recognition Test in college athletes. Advance online publication Applied Neuropsychology: Adult, 27(1), 94–100. doi:10.1080/23279095.2018.1488716
  • Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218–224. 10.1037/1040-3590.6.3.218
  • Greve, K. W., Bianchini, K. J., & Doane, B. M. (2006). Classification accuracy of the test of memory malingering in traumatic brain injury: Results of a known-group analysis. Journal of Clinical and Experimental Neuropsychology, 28(7), 1176–1190. doi:10.1080/13803390500263550
  • Grundy, J. G., & Timmer, K. (2017). Bilingualism and working memory capacity: A comprehensive meta-analysis. Second Language Research, 33(3), 325–340. doi:10.1177/0267658316678286
  • Heinly, M. T., Greve, K. W., Bianchini, K., Love, J. M., & Brennan, A. (2005). WAIS Digit-Span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444. doi:10.1177/1073191105281099
  • Henry, J. D., & Crawford, J. R. (2004). A meta-analytic review of verbal fluency performance following focal cortical lesions. Neuropsychology, 18(2), 284–295. doi:10.1037/0894-4105.18.2.284
  • Hilchey, M. D., & Klein, R. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin & Review, 18(4), 625–658. doi:10.3758/s13423-011-0116-7
  • Holcomb, M. J., Roth, R. M., Tyson, B. T., & Erdodi, L. A. (2022). Critical item (CR) analysis expands the classification accuracy of performance validity tests based on the forced choice paradigm – replicating previously introduced CR cutoffs within the word choice test. Neuropsychology. Advance online publication. doi: 10.1037/neu0000834.
  • Hurtubise, J., Baher, T., Messa, I., Cutler, L., Shahein, A., Hastings, M., Erdodi, L. (2020). Verbal fluency and digit span variables as performance validity indicators in experimentally induced malingering and real world patients with TBI. Applied Neuropsychology: Child, 9(4), 337–354. doi:10.1080/21622965.2020.1719409
  • Ivanova, I., & Costa, A. (2008). Does bilingualism hamper lexical access in speech production? Acta Psychologica, 127(2), 277–288. doi:10.1016/j.actpsy.2007.06.003
  • Jasinski, L. J., Berry, D. T., Shandera, A. L., & Clark, J. A. (2011). Use of the Wechsler Adult Intelligence Scale Digit Span subtest for malingering detection: A meta-analytic review. Journal of Clinical and Experimental Neuropsychology, 33(3), 300–314.
  • Johnson, J. S., & Newport, E. L. (1989). Critical period effects in second language learning. The influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21(1), 60–99. doi:10.1016/0010-0285(89)90003-0
  • Jones, A. (2013). Test of memory malingering: Cutoff scores for psychometrically defined malingering groups in a military sample. The Clinical Neuropsychologist, 27(6), 1043–1059. doi:10.1080/13854046.2013.804949
  • Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., Zeller, M. A. (2010). The Warrington recognition memory test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25(1), 60–70. doi:10.1093/arclin/acp088
  • Kulas, J. F., Axelrod, B. N., & Rinaldi, A. R. (2014). Cross-validation of supplemental test of memory malingering scores as performance validity measures. Psychological Injury and Law, 7(3), 236–244. doi:10.1007/s12207-014-9200-4
  • Lafayette Instrument. (2015). Grooved pegboard user manual. Lafayette, IN.
  • Larrabee, G. J. (2012a). Assessment of malingering. In G. J. Larrabee (Ed.), Forensic neuropsychology: A scientific approach (Second ed., pp. 116–159). New York: Oxford University Press.
  • Larrabee, G. J. (2012b). Performance validity and symptom validity in neuropsychological assessment. Journal of International Neuropsychological Society, 18(4), 625–630. doi:10.1017/s1355617712000240
  • Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373. doi:10.1093/arclin/acu019
  • Larrabee, G. J., Rohling, M. L., & Meyers, J. E. (2019). Use of multiple performance and symptom validity measures: Determining the optimal per test cutoff for determination of invalidity, analysis of skew, and inter-test correlations in valid and invalid performance groups. The Clinical Neuropsychologist, 33(8), 1354. doi:10.1080/13854046.2019.1614227
  • Lehtonen, M., Soveri, A., Laine, A., Järvenpää, J., De Bruin, A., & Antfolk, J. (2018). Is bilingualism associated with enhanced executive functioning in adults? A meta-analytic review. Psychological Bulletin, 144(4), 394. doi:10.1037/bul0000142
  • Lezak, M. D. (1995). Neuropsychological assessment. New York: Oxford University Press.
  • Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment. New York: Oxford University Press.
  • Link, J. S., Lu, L. H., Armistead-Jehle, P., & Seegmiller, R. A. (2021). Validation of grooved pegboard cutoffs as an additional embedded measure of performance validity. The Clinical Neuropsychologist, 1–11. Advance online publication. doi:10.1080/13854046.2021.1942556
  • Liu, Z., Dong, J., Zhao, X., Chen, X., Lippa, S. M., Caroselli, J. S., & Fang, X. (2016). Assessment of feigned cognitive impairment in severe traumatic brain injury patients with the Forced‐Choice Graphics Memory Test. Brain and Behavior, 6(12), e00593. doi:10.1002/brb3.593
  • Love, C. M., Glassmire, D. M., Zanolini, S. J., & Wolf, A. (2014). Specificity and false positive rates of the test of memory malingering, Rey 15-Item Test, and Rey Word Recognition Test among forensic inpatients with intellectual disabilities. Assessment, 21(5), 618–627. doi:10.1177/1073191114528028
  • Luo, L., Luk, G., & Bialystok, E. (2010). Effect of language proficiency and executive control on verbal fluency performance in bilinguals. Cognition, 114(1), 29–41. doi:10.1016/j.cognition.2009.08.014
  • Lupu, T., Elbaum, T., Wagner, M., & Braw, Y. (2018). Enhanced detection of feigned cognitive impairment using per item response time measurements in the word memory test. Applied Neuropsychology: Adult, 25(6), 532–542. doi:10.1080/23279095.2017.1341410
  • MacAllister, W. S., Vasserman, M., & Armstrong, K. (2019). Are we documenting performance validity testing in pediatric neuropsychological assessment? A brief report. Child Neuropsychology, 25(8), 1035–1042. doi:10.1080/09297049.2019.1569606
  • Mack, W. J., Freed, D. M., Williams, B. W., & Henderson, V. W. (1992). Boston naming test: Shortened versions for use in Alzheimer’s disease. Journal of Gerontology, 47(3), 154–158. doi:10.1093/geronj/47.3.P154
  • Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–746. doi:10.1080/13854046.2015.1087597
  • Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the test of memory malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. doi:10.1080/13854046.2019.1637027
  • Medici, R. (2013). The use of multiple performance validity tests. Journal of Forensic Psychology Practice, 13(1), 68–78. doi:10.1080/15228932.2013.746909
  • Moran, M. D. (2003). Arguments for rejecting the sequential Bonferroni in ecological studies. Oikos, 100(2), 403–405. doi:10.1034/j.1600-0706.2003.12010.x
  • Morrison, C., Kamal, F., & Taler, V. (2019). The influence of working memory performance on event-related potentials in young and older adults. Cognitive Neuroscience, 10(3), 117–128. doi:10.1080/17588928.2019.1570104
  • Morse, C. L., Douglas-Newman, K., Mandel, S., & Swirsky-Sacchetti, T. (2013). Utility of the Rey-15 recognition trial to detect invalid performance in a forensic neuropsychological sample. The Clinical neuropsychologist 27(8), 1395-1407. doi: 10.1080/13854046.2013.832385.
  • Nitch, S., Boone, K. B., Wen, J., Arnold, G., & Alfano, K. (2006). The utility of the Rey Word recognition test in the detection of suspect effort. The Clinical Neuropsychologist, 20(4), 873–887. doi:10.1080/13854040590967603
  • Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8(1), 46–63. doi:10.1007/s12207-015-9216-4
  • Olla, O., Rykulski, N., Hurtubise, J. L., Bartol, S., Foote, R., Cutler, L., Erdodi, L. (2021). Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients. Applied Neuropsychology: Adult, 28(6), 647–657. doi:10.1080/23279095.2019.161.1681424
  • Paap, K. R., Johnson, H. A., & Sawi, O. (2015). Bilingual advantages in executive functioning either do not exist or are restricted to very specific and undetermined circumstances. Cortex, 69, 265–278. doi:10.1016/j.cortex.2015.04.014
  • Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV – technical manual. San Antonio, TX: Author.
  • Perneger, T. V. (1998). What’s wrong with Bonferroni adjustments. BMJ, 316, 1236–1238.
  • Poynter, K., Boone, K. B., Ermshar, A., Miora, D., Cottingham, M., Victor, T. L., Wright, M. (2019). Wait, there’s a baby in this bath water! Update on quantitative and qualitative cut-offs for Rey 15-Item Recall and recognition. Archives of Clinical Neuropsychology, 34(8), 1367–1380. doi:10.1093/arclin/acy087
  • Rai, J., & Erdodi, L. (2019). The impact of criterion measures on the classification accuracy of TOMM-1. Applied Neuropsychology: Adult, 28(2), 185–196. doi:10.1080/23279095.2019.161.1613994
  • Razani, J., Burciaga, J., Madore, M., & Wong, J. (2007). Effects of acculturation on tests of attention and information processing in an ethnically diverse group. Archives of Clinical Neuropsychology, 22(3), 333–341. doi:10.1016/j.acn.2007.01.008
  • Reitan, R. M. (1955). The relation of the Trail Making Test to organic brain damage. Journal of Consulting Psychology, 19(5), 393–394. doi:10.1037/h0044509
  • Rey, A. (1941). L’examen psychologique dans les cas d’encephalopathie traumatique [psychological examination in cases of traumatic encephalopathy]. Archives de Psychologie, 28, 286–340.
  • Rey, G., Feldman, E., Rivas-Vasquez, R., Levin, B., . E., & Benton, A. (1999). Neuropsychological test development and normative data on Hispanics. Archives of Clinical Neuropsychology, 14(7), 593–601. doi:10.1093/arclin/14.7.593
  • Rhoads, T., Leib, S. I., Resch, Z. J., Basurto, K. S., Castillo, L. R., Jennette, K. J., & Soble, J. R. (2021). Relative rates of invalidity for the test of memory malingering and the dot counting test among Spanish-speaking patients residing in the USA. Psychological Injury and Law, 14(4), 269–280. doi:10.1007/s12207-021-09423-z
  • Robles, L., López, E., Salazar, X., Boone, K. B., & Glaser, D. F. (2015). Specificity data for the b test, dot counting test, Rey-15 item plus recognition, and Rey word recognition test in monolingual Spanish-speakers. Journal of Clinical and Experimental Neuropsychology, 37(6), 614–621. doi:10.1080/13803395.2015.1039961
  • Roivainen, E. (2019). European and American WAIS IV norms: Cross‐national differences in perceptual reasoning, processing speed and working memory subtest scores. Scandinavian Journal of Psychology, 60(6), 513–519. doi:10.1111/sjop.12581
  • Ross, T. P., Poston, A. M., Rein, P. A., Salvatore, A. N., Wills, N. L., & York, T. M. (2016). Performance invalidity base rates among healthy undergraduate research participants. Archives of Clinical Neuropsychology, 31(1), 97–104. doi:10.1093/arclin/acv062
  • Rosselli, M., Ardila, A., Araujo, K., Weekes, V. A., Caracciolo, V., Padilla, M., & Ostrosky-Solí, F. (2000). Verbal fluency and repetition skills in healthy older Spanish-English bilinguals. Applied Neuropsychology, 7(1), 17–24. doi:10.1207/S15324826AN0701_3
  • Roye, S., Calamia, M., Bernstein, J. P., De Vito, A. N., & Hill, B. D. (2019). A multi-study examination of performance validity in undergraduate research participants. The Clinical Neuropsychologist, 33(6), 1138–1155. doi:10.1080/13854046.2018.1520303
  • Ryan, C. (2013). Language use in the United States: 2011. American Community Survey Reports, ACS-22. U.S. Census Bureau, Washington, DC.
  • Sakai, K. L. (2005). Language acquisition and brain development. Science, 310(5749), 815–819. doi:10.1126/science.1113530
  • Salazar, X. F., Lu, P. H., & Boone, K. B. (2021). The use of performance validity tests in ethnic-minority and non-English-dominant populations. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective (pp. 578–608). New York, NY: Guilford.
  • Salazar, X. F., Lu, P. H., Wen, J., & Boone, K. B. (2007). The use of effort tests in ethnic minorities and in non-English speaking and English as a second language populations. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 405–427). New York: Guilford.
  • Sanborn, V., Lace, J., Gunstad, J., & Galioto, R. (2021). Considerations regarding noncredible performance in the neuropsychological assessment of patients with multiple sclerosis: A case series. Applied Neuropsychology: Adult, 1–10. Advance online publication. doi:10.1080/23279095.2021.1971229
  • Sandoval, T. C., Gollan, T. H., Ferreira, V. S., & Salmon, D. P. (2010). What causes the bilingual disadvantage in verbal fluency? The dual-task analogy. Bilingualism: Language and Cognition, 13(2), 231–252. doi:10.1017/S1366728909990514
  • Santos, O. A., Kazakov, D., Reamer, M. K., Park, S. E., & Osmon, D. C. (2014). Effort in college undergraduate is sufficient on the Word Memory Test. Archives of Clinical Neuropsychology, 29(7), 609–613. doi:10.1093/arclin/acu039
  • Savoie, J., Root, K., Villers, J., Goldsmith, K. M., & Short, M. (2019). Boston naming test performance in French-speaking Acadians. Aphasiology, 33(5), 561–578. doi:10.1080/02687038.2018.1490387
  • Schroeder, R. W., Baade, L. E., Peck, C. P., VonDran, E. J., Brockman, C. J., Webster, B. K., & Heinrichs, R. J. (2012). Validation of MMPI-2-RF validity scales in criterion group neuropsychological samples. The Clinical Neuropsychologist, 26(1), 129–146. doi:10.1080/13854046.2011.639314
  • Schroeder, R. W., Boone, K. B., & Larrabee, G. J. (2021). Design methods in neuropsychological performance validity, symptom validity, and malingering research. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment. A neuropsychological perspective (pp. 11–34). New York, NY: Guilford.
  • Schroeder, R. W., & Marshall, P. S. (2010). Validation of the sentence repetition test as a measure of suspect effort. The Clinical Neuropsychologist, 24(2), 326–343. doi:10.1080/13854040903369441
  • Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. doi:10.1080/13854046.2018.1484517
  • Sharland, M. J., & Gfeller, J. D. (2007). A survey of neuropsychologists’ beliefs and practice with respect to the assessment of effort. Archives of Clinical Neuropsychology, 22(2), 213–223. doi:10.1016/j.acn.2006.12.004
  • Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, 35(6), 735–764. doi:10.1093/arclin/acaa019
  • Shura, R. D., Martindale, S. L., Taber, K. H., Higgins, A. M., & Rowland, J. A. (2020). Digit Span embedded validity indicators in neurologically-intact veterans. The Clinical Neuropsychologist, 34(5), 1025–1037. doi:10.1080/13854046.2019.1635209
  • Silk-Eglit, G. M., Stenclik, J. H., Gavett, B. E., Adams, J. W., Lynch, J. K., & Mccaffrey, R. J. (2014). Base rate of performance invalidity among non-clinical undergraduate research participants. Archives of Clinical Neuropsychology, 29(5), 415–421. doi:10.1093/arclin/acu028
  • Silk-Eglit, G. M., Stenclik, J. H., Miele, A. S., Lynch, J. K., & McCaffrey, R. J. (2015). Rates of false-positive classification resulting from the analysis of additional embedded performance validity measures. Applied Neuropsychology: Adult, 22(5), 335–347. doi:10.1080/23279095.2014.938809
  • Sirianni, C. D., Abeare, C. A., Ali, S., Razvi, P., Kennedy, A., Pyne, S. R., & Erdodi, L. A. (2021). The V-5 provides quick and accurate measures of psychiatric symptoms for single and repeated in-person and online assessments and is valid in culturally diverse examinees. Psychiatry Research, 298, 11365. doi:10.1016/j.psychres.2020.113651
  • Smith, K., Boone, K., Victor, T., Miora, D., Cottinghma, Z., Zeller, M, E., & Wright, M. (2014). Comparison of credible patients of very low intelligence and non-credible patients on neurocognitive performance validity indicators. The Clinical Neuropsychologist, 28(6), 1048–1070. doi:10.1080/13854046.2014.931465
  • Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity test (PVT) research. Psychological Injury and Law, 13(1), 44–56. doi:10.1007/s12207-019-09370-w
  • Stålhammar, J., Hellström, P., Eckerström, C., & Wallin, A. (2020). Neuropsychological test performance among native and non-native Swedes: Second language effects. Archives of Clinical Neuropsychology. Advance online publication. doi: 10.1093/arclin/acaa043.
  • Stevens, A., Bahlo, S., Licha, C., Liske, B., & Vossler-Thies, E. (2016). Reaction time as an indicator of insufficient effort: Development and validation of an embedded performance validity parameter. Psychiatry Research, 245, 74–82. doi:10.1016/j.psychres.2016.08.022
  • Strutt, A. M., Scott, B. M., Shrestha, S., & York, M. K. (2011). The Rey 15-Item memory test and Spanish-speaking older adults. The Clinical Neuropsychologist, 25(7), 1253–1265. doi:10.1080/13854046.2011.609839
  • Suarez, P. A., Gollan, T. H., Heaton, R., Grant, I., & Cherner, M.; HNRC Group. (2014). Second-language fluency predicts native language stroop effects: Evidence from Spanish–English bilinguals. Journal of the International Neuropsychological Society, 20(3), 342–348. doi:10.1017/S1355617714000058
  • Sugarman, M. A., & Axelrod, B. N. (2015). Embedded measures of performance validity using verbal fluency tests in a clinical sample. Applied Neuropsychology: Adult, 22(2), 141–146. doi:10.1080/23279095.2013.873439
  • Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Suhr, J. A., & Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6),1–54. Advance online publication.
  • Tombaugh, T. N. (1996). Test of Memory Malingering. New York, NY: Multi-Health Systems.
  • van der Heide, D., Boskovic, I., & Merckelbach, H. (2017). Standard symptom inventories for asylum seekers in a psychiatric hospital: Limited utility due to poor symptom validity. Psychological Injury and Law, 10(4), 358–367. doi:10.1007/s12207-017-9302-x
  • van der Heide, D., Boskovic, I., van Harten, Merckelbach, H., & Van Harten, P. (2020). Psychosis as a confounder of symptom credibility in a transcultural sample. Journal of Forensic Psychiatry and Psychology, 31(1), 64–75. doi:10.1080/14789949.2019.1663899
  • Vilar-López, R., Gómez-Río, M., Caracuel-Romero, A., Llamas-Elvira, J., & Pérez-García, M. (2008). Use of specific malingering measures in a Spanish sample. Journal of Clinical and Experimental Neuropsychology, 30(6), 710–722. doi:10.1080/13803390701684562
  • Vilar-López, R., Santiago-Ramajo, S., Gómez-Río, M., Verdejo-García, A., Llamas, J. M., & Pérez-García, M. (2007). Detection of malingering in a Spanish population using three specific malingering tests. Archives of Clinical Neuropsychology, 22(3), 379–388. doi:10.1016/j.acn.2007.01.012
  • Wauters, L., & Marquardt, T. P. (2018). Category, letter, and emotional verbal fluency in Spanish–English bilingual speakers: A preliminary report. Archives of Clinical Neuropsychology, 33(4), 444–457. doi:10.1093/arclin/acx063
  • Wechsler, D. (1997). Wechsler Adult Intelligence Scale (3rd ed.). San Antonio, TX: The Psychological Corporation.
  • Whitney, K. A., Davis, J. J., Shepard, P. H., Bertram, D. M., & Adams, K. M. (2009). Digit Span age scaled score in middle-aged military veterans: Is it more closely associated with TOMM failure than reliable digit span? Archives of Clinical Neuropsychology, 24(3), 263–272. doi:10.1093/arclin/acp034
  • Wisdom, N. M., Brown, W. L., Chen, D. K., & Collins, R. L. (2012). The use of all three Test of Memory Malingering trials in establishing the level of effort. Archives of Clinical Neuropsychology, 27(2), 208–212. doi:10.1093/arclin/acr107
  • Zuccato, B. G., Tyson, B. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment, 30(11), 1491–1498. doi:10.1037/pas0000596

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.