Examining independent and combined accuracy of embedded performance validity tests in the California Verbal Learning Test-II and Brief Visuospatial Memory Test-Revised for detecting invalid performance

Abstract

The California Verbal Learning Test-Second Edition (CVLT-II) Forced Choice Recognition (FC) and Brief Visuospatial Memory Test-Revised (BVMT-R) Recognition Discrimination Index (RD) are embedded performance validity tests (PVTs) assessing material-specific neuropsychological processes (i.e., verbal and visual memory, respectively). Prior research demonstrated the utility of these PVTs independently; however, no study has compared their diagnostic accuracy for identifying invalid performance relative to each other and in combination within a single sample. This cross-sectional study included an adult neuropsychiatric sample who underwent neuropsychological evaluation. Validity groups were determined via independent criterion PVT performance, and consisted of 103 participants with valid and 25 with invalid neurocognitive performance. FC and RD were not significantly correlated (r = .154), yet both differed between validity groups (η_p² = .14–.19). Previously established FC (≤14) and RD (≤4) cutoffs evidenced 32–40% sensitivity/90–98% specificity, though receiver operating characteristic (ROC) analyses indicated a more liberal FC cutoff (≤15) was optimal. Logistic regression models utilizing both embedded PVTs indicated that FC did not significantly improve classification accuracy above and beyond RD. Results support the clinical utility of existing cutoffs for FC and RD for independently identifying invalid performance, though the latter showed relatively better ability to detect invalid performance when both are used together.

Keywords:

• Assessment
• forensic
• memory
• performance validity
• psychometrics

Disclosure statement

The authors have no conflicts of interest to report, and none have any financial interest with the subject matter discussed in the manuscript.