Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples

References

• Abramson, D. A., Resch, Z. J., Ovsiew, G. P., White, D. J., Bernstein, M. T., Basurto, K. S., & Soble, J. R. (2020). Impaired or invalid? Limitations of assessing performance validity using the Boston Naming Test. Applied Neuropsychology: Adult. Advance Online Publication. https://doi.org/10.1080/23279095.2020.1774378
   Google Scholar
• Allen, L. M., Conder, R. L., Green, P., & Cox, D. R. (1997). CARB’97 manual for the computerized assessment of response bias. CogniSyst.
   Google Scholar
• Alverson, W. A., O’Rourke, J. J. F., & Soble, J. R. (2019). The Word Memory Test Genuine Memory Impairment Profile discriminates genuine memory impairment from invalid performance in a mixed clinical sample with cognitive impairment. The Clinical Neuropsychologist, 33(8), 1420–1435. https://doi.org/10.1080/13854046.2019.1599071
   PubMed Web of Science ®Google Scholar
• Bailey, K. C., Soble, J. R., Bain, K. M., & Fullen, C. (2018a). Embedded performance validity tests in the Hopkins Verbal Learning Test-Revised and the Brief Visuospatial Memory Test-Revised: A replication study. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 33(7), 895–900. https://doi.org/10.1093/arclin/acx111
   PubMed Web of Science ®Google Scholar
• Bailey, K. C., Soble, J. R., & O’Rourke, J. J. F. (2018b). Clinical utility of the Rey 15-Item Test, recognition trial, and error scores for detecting noncredible neuropsychological performance in a mixed clinical sample of veterans. The Clinical Neuropsychologist, 32(1), 119–131. https://doi.org/10.1080/13854046.2017.1333151
   PubMed Web of Science ®Google Scholar
• Bain, K. M., & Soble, J. R. (2019). Validation of the Advanced Clinical Solutions Word Choice Test (WCT) in a mixed clinical sample: Establishing classification accuracy, sensitivity/specificity, and cutoff scores. Assessment, 26(7), 1320–1328. https://doi.org/10.1177/1073191117725172
   PubMed Web of Science ®Google Scholar
• Bain, K. M., Soble, J. R., Webber, T. A., Messerly, J. M., Bailey, K. C., Kirton, J. W., & McCoy, K. J. M. (2021). Cross-validation of three Advanced Clinical Solutions performance validity tests: Examining combinations of measures to maximize classification of invalid performance. Applied Neuropsychology: Adult, 28(1), 24–34. https://doi.org/10.1080/23279095.2019.1585352
   PubMed Web of Science ®Google Scholar
• Benedict, R. H. B. (1997). Brief Visuospatial Memory Test–Revised. Psychological Assessment Resources.
   Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
   Web of Science ®Google Scholar
• Boone, K. B. (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. Guildford Press.
   Google Scholar
• Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (2013). Clinical practice of forensic neuropsychology: An evidence-based approach. Guilford Press.
   Google Scholar
• Boone, K. B., Lu, P., & Herzberg, D. S. (2002). The Dot Counting Test manual. Western Psychological Services.
   Google Scholar
• Boone, K. B., Lu, P., & Wen, J. (2005). Comparison of various RAVLT scores in the detection of noncredible memory performance. Archives of Clinical Neuropsychology, 20(3), 301–319. https://doi.org/10.1016/j.acn.2004.08.001
   PubMed Web of Science ®Google Scholar
• Brennan, A. M., & Gouvier, W. D. (2006). Are we honestly studying malingering? A profile and comparison of simulated and suspected malingerers. Applied Neuropsychology, 13(1), 1–11. https://doi.org/10.1207/s15324826an1301_1
   PubMed Web of Science ®Google Scholar
• Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., Reynolds, C. R., & Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 20(4), 419–426. https://doi.org/10.1016/j.acn.2005.02.002
   PubMed Web of Science ®Google Scholar
• Critchfield, E., Soble, J. R., Marceaux, J. C., Bain, K. M., Chase Bailey, K., Webber, T. A., Alex Alverson, W., Messerly, J., Andrés González, D., & O’Rourke, J. J. F. (2019). Cognitive impairment does not cause performance validity failure: Analyzing performance patterns among unimpaired, impaired, and noncredible participants across six tests. The Clinical Neuropsychologist, 33(6), 1083–1101. https://doi.org/10.1080/13854046.2018.1508615
   PubMed Web of Science ®Google Scholar
• Crowell, T. A., Kieffer, K. M., Siders, C. A., & Vanderploeg, R. D. (2002). Neuropsychological findings in combat-related posttraumatic stress disorder. The Clinical Neuropsychologist, 16(3), 310–321. https://doi.org/10.1076/clin.16.3.310.13851
   PubMed Web of Science ®Google Scholar
• Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23(1), 133–152. https://doi.org/10.1080/13854040701819050
   PubMed Web of Science ®Google Scholar
• Demakis, G. J., Gervais, R. O., & Rohling, M. L. (2008). The effect of failure on cognitive and psychological symptom validity tests in litigants with symptoms of post-traumatic stress disorder. The Clinical Neuropsychologist, 22(5), 879–895. https://doi.org/10.1080/13854040701564482
   PubMed Web of Science ®Google Scholar
• Denning, J. H. (2012). The efficiency and accuracy of the Test of Memory Malingering Trial 1, errors on the first 10 items of the Test of Memory Malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 27(4), 417–432. https://doi.org/10.1093/arclin/acs044
   PubMed Web of Science ®Google Scholar
• Epker, J., & Ogden, M. (2013). The impact of pain and pain-related factors on cognitive functioning. In P. A. Arnett (Ed.), National Academy of Neuropsychology series on evidence-based practices. Secondary influences on neuropsychological test performance: Research findings and practical applications (pp. 142–165). Oxford University Press.
   Google Scholar
• Glickman, M. E., Rao, S. R., & Schultz, M. R. (2014). False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies . Journal of Clinical Epidemiology, 67(8), 850–857. https://doi.org/10.1016/j.jclinepi.2014.03.012
   PubMed Web of Science ®Google Scholar
• Golden, C. J. (1978). The Stroop color and word test: A manual for clinical and experimental uses. Stoelting.
   Google Scholar
• Green, P. (2003). Green’s Word Memory Test for Microsoft Windows: User’s manual. Green’s Publishing.
   Google Scholar
• Green, P. (2004). Green’s Medical Symptom Validity Test (MSVT) for Microsoft Windows: User’s manual. Green’s Publishing.
   Google Scholar
• Green, P., Rohling, M. L., Lees-Haley, P. R., III, & Allen, L. A. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060. https://doi.org/10.1080/02699050110088254
   PubMed Web of Science ®Google Scholar
• Greve, K. W., Ord, J., Curtis, K. L., Bianchini, K. J., & Brennan, A. (2008). Detecting malingering in traumatic brain injury and chronic pain: A comparison of three forced-choice symptom validity tests. The Clinical Neuropsychologist, 22(5), 896–918. https://doi.org/10.1080/13854040701565208
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources.
   Google Scholar
• Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G., Millis, S. R., & Participants, C. (2009). American academy of clinical neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129. https://doi.org/10.1080/13854040903155063
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22(4), 666–679. https://doi.org/10.1080/13854040701494987
   PubMed Web of Science ®Google Scholar
• Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). Oxford University Press.
   Google Scholar
• Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists' validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776.
   Google Scholar
• Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017
   PubMed Web of Science ®Google Scholar
• Martin, P. K., Schroeder, R. W., & Olsen, D. H. (2020a). Performance validity in the dementia clinic: Specificity of validity tests when used individually and in aggregate across levels of cognitive impairment severity. The Clinical Neuropsychologist, 1–24. https://doi.org/10.1080/13854046.2020.1778790
   Google Scholar
• Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020b). A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. https://doi.org/10.1080/13854046.2019.1637027
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., & Volbrecht, M. (2003). A validation of multiple malingering detection methods in a large clinical sample. Archives of Clinical Neuropsychology, 18(3), 261–276. https://doi.org/10.1093/arclin/18.3.261
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 26(1), 8–15. https://doi.org/10.1093/arclin/acq083
   PubMed Web of Science ®Google Scholar
• Ovsiew, G. P., Resch, Z. J., Nayar, K., Williams, C. P., & Soble, J. R. (2020). Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample. Journal of Clinical and Experimental Neuropsychology, 42(5), 473–484. https://doi.org/10.1080/13803395.2020.1758635
   PubMed Web of Science ®Google Scholar
• Patrick, S. D., Rapport, L. J., Kanser, R. J., Hanks, R. A., & Bashem, J. R. (2020). Performance validity assessment using response time on the Warrington Recognition Memory Test. The Clinical Neuropsychologist. Advanced online publication. https://doi.org/10.1080/13854046.2020.1716997
   Google Scholar
• Pliskin, J. I., De-Dios-Stern, S., Resch, Z. J., Saladino, K. F., Ovsiew, G. P., Carter, D. A., & Soble, J. R. (2020). Comparing the psychometric properties of 8 embedded performance validity tests in the Rey Auditory Verbal Learning Test, Wechsler Memory Scale Logical Memory, and Brief Visuospatial Memory Test-Revised recognition trials for detecting invalid neuropsychological test performance. Assessment. Advance online publication. https://doi.org/10.1177/1073191120929093
   Google Scholar
• Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. F. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 29(7), 614–624. https://doi.org/10.1093/arclin/acu044
   PubMed Web of Science ®Google Scholar
• Resch, Z. J., Pham, A. T., Abramson, D. A., White, D. J., DeDios-Stern, S., Ovsiew, G. P., Castillo, L., & Soble, J. R. (2020). Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance. Applied Neuropsychology: Adult. Advance online publication. https://doi.org/10.1080/23279095.2020.1742718
   Web of Science ®Google Scholar
• Rogers, R., & Bender, S. (Ed.). (2018). Clinical assessment of malingering and deception (4th ed.). Guilford Press.
   Google Scholar
• Rohling, M. L., Binder, L. M., Demakis, G. J., Larrabee, G. J., Ploetz, D. M., & Langhinrichsen-Rohling, J. (2011). A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al. (1997), Frencham et al. (2005), and Pertab et al. (2009). The Clinical Neuropsychologist, 25(4), 608–623. https://doi.org/10.1080/13854046.2011.565076
   PubMed Web of Science ®Google Scholar
• Schmidt, M. (1996). Rey Auditory Verbal Learning Test: A handbook. Western Psychological Services.
   Google Scholar
• Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517
   PubMed Web of Science ®Google Scholar
• Scott, J. C., Matt, G. E., Wrocklage, K. M., Crnich, C., Jordan, J., Southwick, S. M., Krystal, J. H., & Schweinsburg, B. C. (2015). A quantitative meta-analysis of neurocognitive functioning in posttraumatic stress disorder. Psychological Bulletin, 141(1), 105–140. https://doi.org/10.1037/a0038039
   PubMed Web of Science ®Google Scholar
• Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 35(6), 735–764. https://doi.org/10.1093/arclin/acaa019
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., Messerly, J., Highsmith, J. M., Bailey, K. C., Webber, T. A., & Marceaux, J. M. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity test (PVT) research. Psychological Injury and Law, 13(1), 44–56. https://doi.org/10.1007/s12207-019-09370-w
   Web of Science ®Google Scholar
• Soble, J. R., Bain, K. M., Bailey, K. C., Kirton, J. W., Marceaux, J. M., Critchfield, E. A., McCoy, K. J. M., & O’Rourke, J. J. F. (2019). Evaluating the accuracy of the Wechsler Memory Scale-Fourth Edition (WMS-IV) Logical Memory embedded validity index for detecting invalid test performance. Applied Neuropsychology: Adult, 26(4), 311–318. https://doi.org/10.1080/23279095.2017.1418744
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Critchfield, E. A., & O'Rourke, J. J. F. (2017). Neuropsychological evaluation in traumatic brain injury. Physical Medicine and Rehabilitation Clinics of North America, 28(2), 339–350. https://doi.org/10.1016/j.pmr.2016.12.009
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Webber, T. A., & Bailey, K. C. (in press). An overview of common standalone and embedded PVTs for practicing clinicians: Cutoffs, classification accuracy, and administration times. In R. W. Schroeder and P. K. Martin (Eds.), Neuropsychological validity assessment in non-forensic clinical practice. Guildford Press.
   Google Scholar
• Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science (New York, N.Y.), 240(4857), 1285–1293. https://doi.org/10.1126/science.3287615
   PubMed Web of Science ®Google Scholar
• Vickery, C. D., Berry, D. T., Inman, T. H., Harris, M. J., & Orey, S. A. (2001). Detection of inadequate effort on neuropsychological testing: A meta-analytic review of selected procedures. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 16(1), 45–73.
   PubMed Web of Science ®Google Scholar
• Webber, T. A., Critchfield, E. A., & Soble, J. R. (2020). Convergent, discriminant, and concurrent validity of non-memory-based performance validity tests. Assessment, 27(7), 1399–1415. https://doi.org/10.1177/1073191118804874
   PubMed Web of Science ®Google Scholar
• Webber, T. A., & Soble, J. R. (2018). Utility of various WAIS-IV Digit Span indices for identifying noncredible performance validity among cognitively impaired and unimpaired examinees. The Clinical Neuropsychologist, 32(4), 657–670. https://doi.org/10.1080/13854046.2017.1415374
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (2008). Administration and scoring manual for the Wechsler Adult Intelligence Scale (4th ed.). Pearson.
   Google Scholar
• Wechsler, D. (2009). Administration and scoring manual for the Wechsler Memory Scale (4th ed.). Pearson.
   Google Scholar
• White, D. J., Korinek, D., Bernstein, M. T., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2020). Cross-validation of non-memory-based embedded performance validity tests for detecting invalid performance among patients with and without neurocognitive impairment. Journal of Clinical and Experimental Neuropsychology, 42(5), 459–472. https://doi.org/10.1080/13803395.2020.1758634
   PubMed Web of Science ®Google Scholar