Cultural accommodations for cutoff scores of embedded performance validity tests in a Spanish college population

Abstract

Objective

The objective of this study was to identify specific cutoff scores for three commonly used embedded performance validity tests (PVTs) for a Spanish speaking population. Culturally adapted cutoff scores for embedded PVTs were established using an analog study design. In addition, the psychometric properties of these measures when applying culturally adapted scores as compared to non-adapted scores were analyzed.

Method

Participants (N = 114) were administered three embedded PVTs (Reliable Digit Span, Phonetic Fluency Test, and Animal Semantic Fluency Test) in a randomized order. Following an analog design, control participants were instructed to perform to the best of their abilities and the analog group was instructed to simulate cognitive impairment.

Results

In keeping with guidelines for specificity and sensitivity, the most culturally appropriate scores of ≤6, ≤27, and ≤16 were determined for the Reliable Digit Span, Phonetic Fluency Test, and the Semantic Fluency Test, respectively.

Conclusions

This the first study addressing culturally sensitive cutoffs for commonly used embedded validity measures using a European Spanish population. While these findings cannot be generalized to forensic or clinical populations at the present time, they support the claim that specific cutoff scores that are sensitive to cultural variables are necessary in addressing embedded validity measures of the Reliable Digit Span, Phonetic Fluency Test, and Semantic Fluency Test.

Keywords:

• Base rate failure
• cross-cultural
• embedded validity tests
• forensic neuropsychology
• performance validity tests

Acknowledgments

We would like to give a special thanks to the students who participated in this study, and to Dina Bencrimo for her assistance in gathering data.

Disclosure statement

Two of the authors, Miguel Perez-Garcia and Antonio E. Puente, are authors of the Spanish adaptation of the TOMM but do not receive author royalties for their work. The remaining authors of the present study have no affiliations with or involvement in any organization or entity with any financial or non-financial interest in the information discussed in this study.