144
Views
0
CrossRef citations to date
0
Altmetric
Research Article

When Failing One Performance Validity Test Matters

References

  • Armistead-Jehle, P., & Buican, B. (2012). Evaluation context and symptom validity test performances in a U.S. military sample. Archives of Clinical Neuropsychology, 27(8), 828–839. https://doi.org/10.1093/arclin/acs086
  • Armistead-Jehle, P., & Buican, B. (2013). Comparison of select advanced clinical solutions embedded effort measures to the word memory test in the detection of suboptimal effort. Archives of Clinical Neuropsychology, 28(3), 297–301. https://doi.org/10.1093/arclin/act017
  • Ashendorf, L., & Sugarman, M. A. (2016). Evaluation of performance validity using a Rey Auditory Verbal Learning Test Forced-Choice trial. The Clinical Neuropsychologist, 30(4), 599–609. https://doi.org/10.1080/13854046.2016.1172668
  • Axelrod, B. N., & Schutte, C. (2010). Analysis of the dementia profile on the Medical Symptom Validity Test. The Clinical Neuropsychologist, 24(5), 873–881.https://doi.org/10.1080/13854040903527295
  • Benedict, R. H. B. (1997). Brief visuospatial memory test-revised. Psychological Assessment Resources.
  • Bhowmick, C., Hirst, R., & Green, P. (2021). Comparison of the word memory test and the test of memory malingering in detecting invalid performance in neuropsychological testing. Applied Neuropsychology. Adult, 28(4), 486–496. https://doi.org/10.1080/23279095.2019.1658585
  • Binder, L. M., Iverson, G. L., & Brooks, B. L. (2009). To err is human: “Abnormal” neuropsychological scores and variability are common in healthy adults. Archives of Clinical Neuropsychology, 24(1), 31–46. https://doi.org/10.1093/arclin/acn001
  • Boone, K. B. (2021). Assessment of feigned cognitive impairment: A neuropsychological perspective. The Guilford Press.
  • Cohen, C. D., Rhoads, T., Keezer, R. D., Jennette, K. J., Williams, C. P., Hansen, N. D., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2022). All of the accuracy in half of the time: Assessing abbreviated versions of the test of memory malingering in the context of verbal and visual memory impairment. The Clinical Neuropsychologist, 36(7), 1933–1949. https://doi.org/10.1080/13854046.2021.1908596
  • Constantinou, M., Bauer, L., Ashendorf, L., Fisher, J. M., & McCaffrey, R. J. (2005). Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tests? Archives of Clinical Neuropsychology, 20(2), 191–198. https://doi.org/10.1016/j.acn.2004.06.002
  • Dandachi-Fitzgerald, B., & Martin, P. K. (2022). Clinical judgment and clinically applied statistics: Description, benefits, and potential dangers when relying on either one individually in clinical practice. In R. W. Schroeder & P. K. Martin (eds.), Validity assessment in clinical neuropsychological practice: Evaluating and managing non-credible performance (pp. 107–125). Guilford Press.
  • Davis, J. J. (2021). Interpretation of data from multiple performance validity tests. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 283–305). The Guilford Press.
  • Deloria, R., Kivisto, A. J., Swier-Vosnos, A., & Elwood, L. (2023). Optimal per test cutoff scores and combinations of failure on multiple embedded performance validity tests in detecting performance invalidity in a mixed clinical sample. Applied Neuropsychology. Adult, 30(6), 716–726. https://doi.org/10.1080/23279095.2021.1973005
  • Denning, J. H. (2012). The efficiency and accuracy of the test of memory malingering trial 1, errors on the first 10 items of the test of memory malingering, and five embedded measures in predicting invalid test performance. Archives of Clinical Neuropsychology, 27(4), 417–432. https://doi.org/10.1093/arclin/acs044
  • Denning, J. H. (2014). Combining the test of memory malingering trial 1 with behavioral responses improves the detection of effort test failure. Applied Neuropsychology. Adult, 21(4), 269–277. https://doi.org/10.1080/23279095.2013.811076
  • Denning, J. H. (2021). When 10 is enough: Errors on the first 10 items of the test of memory malingering (TOMMe10) and administration time predict freestanding performance validity tests (PVTs) and underperformance on memory measures. Applied Neuropsychology. Adult, 28(1), 35–47. https://doi.org/10.1080/23279095.2019.1588122
  • Denning, J. H. (2023). The TOMM1 discrepancy index (TDI): A new performance validity test (PVT) that differentiates between invalid cognitive testing and those diagnosed with dementia. Applied Neuropsychology. Adult, 30(1), 83–90. https://doi.org/10.1080/23279095.2021.1910951
  • Denning, J. H., & Shura, R. D. (2019). Cost of malingering mild traumatic brain injury related cognitive deficits during compensation and pension evaluations in the veterans benefits administration. Applied Neuropsychology. Adult, 26(1), 1–16. https://doi.org/10.1080/23279095.2017.1350684
  • Donders, J., & Boonstra, T. (2007). Correlates of invalid neuropsychological test performance after traumatic brain injury. Brain Injury, 21(3), 319–326. https://doi.org/10.1080/02699050701253129
  • Donders, J., Lefebre, N., & Goldsworthy, R. (2021). Patterns of performance and symptom validity test findings after mild traumatic brain injury. Archives of Clinical Neuropsychology, 36(3), 394–402. https://doi.org/10.1093/arclin/acz057
  • Drane, D. L., Williamson, D. J., Stroup, E. S., Holmes, M. D., Jung, M., Koerner, E., Chaytor, N., Wilensky, A. J., & Miller, J. W. (2006). Cognitive impairment is not equal in patients with epileptic and psychogenic nonepileptic seizures. Epilepsia, 47(11), 1879–1886. https://doi.org/10.1111/j.1528-1167.2006.00611.x
  • Erdodi, L. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. NeuroRehabilitation, 49(2), 179–213. https://doi.org/10.3233/NRE-218020
  • Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6-7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119
  • Fox, D. D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. The Clinical Neuropsychologist, 25(3), 488–495. https://doi.org/10.1080/13854046.2011.554443
  • Galioto, R., Dhima, K., Berenholz, O., & Busch, R. (2020). Performance validity testing in multiple sclerosis. Journal of the International Neuropsychological Society, 26(10), 1028–1035. https://doi.org/10.1017/S1355617720000466
  • Green, P. (2004). Green’s Medical Symptom Validity Test (MSVT) for Windows: User’s manual. Green’s Publishing.
  • Green, P., Rohling, M. L., Lees-Haley, P. R., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060. https://doi.org/10.1080/02699050110088254
  • Grills, C. E., & Armistead-Jehle, P. (2016). Performance validity test and neuropsychological assessment battery screening module performances in an active-duty sample with a history of concussion. Applied Neuropsychology. Adult, 23(4), 295–301. https://doi.org/10.1080/23279095.2015.1079713
  • Guilmette, T. J., Sweet, J. J., Hebben, N., Koltai, D., Mahone, E. M., Spiegler, B. J., Stucky, K., Westerveld, M., & Conference Participants. (2020). American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34(3), 437–453.https://doi.org/10.1080/13854046.2020.1722244
  • Hacker, D. A., Jones, C. A., Michael, T., Hawkins, A., Clowes, Z., Yasin, E., Belli, A., O'Neill, N., Parnham, J., Ustianowski, M., & Wardall, H. (2022). Validation of the Neuropsychological Assessment Battery Screening Module (NAM-SM) in patients with traumatic brain injury. Applied Neuropsychology. Adult, 29(5), 1103–1111. https://doi.org/10.1080/23279095.2020.1852237
  • Hall, V. L., & Kalus, A. M. (2022). A comparative analysis of the base rate of malingering using Slick et al. (1999) and Sherman et al. (2020) multidimensional criteria for malingering in a uk litigant population. Psychological Injury and Law, 15(2), 141–150. https://doi.org/10.1007/s12207-021-09438-6
  • Harrison, A. G., & Edwards, M. J. (2010). Symptom exaggeration in post-secondary students: Preliminary base rates in a Canadian sample. Applied Neuropsychology, 17(2), 135–143. https://doi.org/10.1080/09084281003715642
  • Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Comprehensive norms for an expanded halstead-reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources.
  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S., & Conference Participants. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23(7), 1093–1129. https://doi.org/10.1080/13854040903155063
  • Horner, M. D., Denning, J. H., & Cool, D. L. (2023). Self-reported disability-seeking predicts PVT failure in veterans undergoing clinical neuropsychological evaluation. The Clinical Neuropsychologist, 37(2), 387–401. https://doi.org/10.1080/13854046.2022.2056923
  • Hromas, G., Rolin, S., & Davis, J. J. (2022). Racial differences in positive findings on embedded performance validity tests. Applied Neuropsychology. Adult. Advance online publication. https://doi.org/10.1080/23279095.2022.2146504
  • Jennette, K. J., Williams, C. P., Resch, Z. J., Ovsiew, G. P., Durkin, N. M., O'Rourke, J. J. F., Marceaux, J. C., Critchfield, E. A., & Soble, J. R. (2022). Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples. The Clinical Neuropsychologist, 36(7), 1915–1932. https://doi.org/10.1080/13854046.2021.1900398
  • Kalfon, T. B. O., Gal, G., Shorer, R., & Ablin, J. N. (2016). Cognitive functioning in fibromyalgia: The central role of effort. Journal of Psychosomatic Research, 87, 30–36. https://doi.org/10.1016/j.jpsychores.2016.06.004
  • Keary, T., Frazier, T. W., Belzile, C. J., Chapin, J. S., Naugle, R. I., Najm, I. M., & Busch, R. M. (2013). Working memory and intelligence are associated with Victoria symptoms validity test hard item performance in patients with intractable epilepsy. Journal of the International Neuropsychological Society, 19(3), 314–323. https://doi.org/10.1017/S1355617712001397
  • Kirkwood, M. W., Yeates, K. O., Randolph, C., & Kirk, J. W. (2012). The implications of symptom validity test failure for ability-based test performance in a pediatric sample. Psychological Assessment, 24(1), 36–45. https://doi.org/10.1037/a0024628
  • Lange, R. T., Iverson, G. I., Brooks, B. L., & Rennison, V. L. A. (2010). Influence of poor effort on self-reported symptoms and neurocognitive test performance following mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 32(9), 961–972. https://doi.org/10.1080/13803391003645657
  • Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421. https://doi.org/10.1080/13854046.2017.1406146
  • Locke, D. E. C., Smigielski, J. S., Powell, M. R., & Stevens, S. R. (2008). Effort issues in post-acute outpatient acquired brain injury rehabilitation seekers. NeuroRehabilitation, 23(3), 273–281.
  • Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017
  • Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the test of memory malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. https://doi.org/10.1080/13854046.2019.1637027
  • Martinez, K. A., Sayers, C., Hayes, C., Martin, P. K., Clark, C. B., & Schroeder, R. W. (2021). Normal cognitive test scores cannot be interpreted as accurate measures of ability in the context of failed performance validity testing: A symptom- and detection-coached simulation study. Journal of Clinical and Experimental Neuropsychology, 43(3), 301–309. https://doi.org/10.1080/13803395.2021.1926435
  • Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26(1), 8–15. https://doi.org/10.1093/arclin/acq083
  • Miele, A. S., Gunner, J. H., Lynch, J. K., & McCaffrey, R. J. (2012). Are embedded validity indices equivalent to free-standing symptom validity tests? Archives of Clinical Neuropsychology, 27(1), 10–22. https://doi.org/10.1093/arclin/acr084
  • Morris, N. M., Ingram, P. B., & Armistead-Jehle, P. (2022). Relationship of Personality Assessment Inventory (PAI) over-reporting scales to performance validity testing in a military neuropsychological sample. Military Psychology, 34(4), 484–493. https://doi.org/10.1080/08995605.2021.2013059
  • Nauta, I. M., Bertens, D., van Dam, M., Huiskamp, M., Driessen, S., Geurts, J., Uitdehaag, B., Fasotti, L., Hulst, H. E., de Jong, B. A., & Klein, M. (2022). Performance validity in outpatients with multiple sclerosis and cognitive complaints. Multiple Sclerosis, 28(4), 642–653. https://doi.org/10.1177/13524585211025780
  • Ovsiew, G. P., Resch, Z. J., Nayar, K., Williams, C. P., & Soble, J. R. (2020). Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample. Journal of Clinical and Experimental Neuropsychology, 42(5), 473–484. https://doi.org/10.1080/13803395.2020.1758635
  • Pliskin, J. I., DeDios Stern, S., Resch, Z. J., Saladino, K. F., Ovsiew, G. P., Carter, D. A., & Soble, J. R. (2021). Comparing the psychometric properties of eight embedded performance validity tests in the Rey Auditory Verbal Learning Test, Wechsler Memory Scale Logical Memory, and Brief Visuospatial Memory Test—Revised recognition trials for detecting invalid neuropsychological test performance. Assessment, 28(8), 1871–1881. https://doi.org/10.1177/1073191120929093
  • Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. F. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology, 29(7), 614–624. https://doi.org/10.1093/arclin/acu044
  • Resch, Z. J., Rhoads, T., Ovsiew, G. P., & Soble, J. R. (2022). A known-groups validation of the Medical Symptom Validity Test and analysis of the genuine memory impairment profile. Assessment, 29(3), 455–466. https://doi.org/10.1177/1073191120983919
  • Reslan, S., & Axelrod, B. N. (2017). Evaluating the Medical Symptom Validity Test (MSVT) in a sample of veterans between the ages of 18 to 64. Applied Neuropsychology. Adult, 24(2), 132–139. https://doi.org/10.1080/23279095.2015.1107565
  • Rhoads, T., Neale, A. C., Resch, Z. J., Cohen, C. D., Keezer, R. D., Cerny, B. M., Jennette, K. J., Ovsiew, G. P., & Soble, J. R. (2021). Psychometric implications of failure on one performance validity test: A cross-validation study to inform criterion group definition. Journal of Clinical and Experimental Neuropsychology, 43(5), 437–448. https://doi.org/10.1080/13803395.2021.1945540
  • Rowland, J. A., Miskey, H. M., Brearly, T. W., Martindale, S. L., & Shura, R. D. (2017). Word memory test performance across cognitive domains, psychiatric presentations, and mild traumatic brain injury. Archives of Clinical Neuropsychology, 32(3), 306–315. https://doi.org/10.1093/arclin/acw107
  • Salinsky, M., Binder, L., Storzbach, D., Parko, K., Rutecki, P., Goy, E., & Tadrous-Furnanz, S. (2020). Validity testing in veterans with epileptic seizures and psychogenic nonepileptic seizures. Epilepsy & Behavior, 111, 107246. https://doi.org/10.1016/j.yebeh.2020.107246
  • Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517
  • Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, 35(6), 735–764. https://doi.org/10.1093/arclin/acaa019
  • Sherry, N., Ernst, N., French, J. E., Eagle, S., Collins, M., & Kontos, A. (2022). Performance validity testing in patients presenting to a specialty clinic with a mild traumatic brain injury. The Journal of Head Trauma Rehabilitation, 37(3), E135–E143. https://doi.org/10.1097/HTR.0000000000000692
  • Shura, R. D., Denning, J. H., Armistead-Jehle, P., & Axelrod, B. A. (2022). Validity assessment within VA and active duty settings. In R. W. Schroeder & P. K. Martin (Eds.), Validity assessment in clinical neuropsychological practice: Evaluating and managing non-credible performance (pp. 235–253). Guilford Press.
  • Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gantz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology. Adult, 23(2), 94–104. https://doi.org/10.1080/23279095.2015.1014556
  • Silk-Eglit, G. M., Stenclik, J. H., Miele, A. S., Lynch, J. K., & McCaffrey, R. J. (2015). Rates of false-positive classification resulting from the analysis of additional embedded performance validity measures. Applied Neuropsychology. Adult, 22(5), 335–347. https://doi.org/10.1080/23279095.2014.938809
  • Smith, A., Thomas, J., Friedhoff, C., & Chin, E. (2022). The utility of the test of memory malingering trial 1 in differentiating neurocognitive, emotional, and behavioral functioning in a pediatric concussion population. Archives of Clinical Neuropsychology, 37(2), 322–337. https://doi.org/10.1093/arclin/acab065
  • Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’rourke, J. J. F., Messerly, J., Highsmith, J. H., Bailey, K. C., Webber, T. A., & Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in Performance Validity Test (PVT) research. Psychological Injury and Law, 13(1), 44–56. https://doi.org/10.1007/s12207-019-09370-w
  • Sollman, M. J., & Berry, D. T. T. (2011). Detection of inadequate effort on neuropsychological testing: A meta-analytic update and extension. Archives of Clinical Neuropsychology, 26(8), 774–789. https://doi.org/10.1093/arclin/acr066
  • Spencer, R. J., Axelrod, B. N., Drag, L. L., Waldron-Perrine, B., Pangilinan, P. H., & Bieliauskas, L. A. (2013). WAIS-IV reliable digit span is no more accurate than age corrected scaled score as an indicator of invalid performance in a veteran sample undergoing evaluation for mTBI. The Clinical Neuropsychologist, 27(8), 1362–1372. https://doi.org/10.1080/13854046.2013.845248
  • Suchy, Y., Chelune, G., Franchow, E. I., & Thorgusen, S. R. (2012). Confronting patients about insufficient effort: The impact on subsequent symptom validity and memory performance. The Clinical Neuropsychologist, 26(8), 1296–1311. https://doi.org/10.1080/13854046.2012.722230
  • Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwood, M. W., Schroeder, R. W., Suhr, J. A., & Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
  • The Psychological Corporation. (2001). Wechsler test of adult reading. Pearson.
  • Tierney, S. M., Taiwo, Z., Choudhury, T. K., Lippa, S. M., Troyanskaya, M., Pastorek, N. J., Miller, B., Romesser, J., & Sim, A. (2023). Varying failure criteria on performance validity tests influences interpretation of cognitive outcomes. Neuropsychology, 37(1), 93–103. https://doi.org/10.1037/neu0000857
  • Tombaugh, T. N. (1996). Test of memory malingering (TOMM) manual. Multi-Health Systems, Inc.
  • Van Egmond, J., Kummeling, I., & Balkom, T. A. (2005). Secondary gain as hidden motive for getting psychiatric treatment. European Psychiatry, 20(5-6), 416–421. https://doi.org/10.1016/j.eurpsy.2004.11.012
  • Whitney, K. A., Shepard, P. H., Mariner, J., Mossbarger, B., & Herman, S. M. (2010). Validity of the Wechsler Test of Adult Reading (WTAR): Effort considered in a clinical sample of U.S. military veterans. Applied Neuropsychology, 17(3), 196–204. https://doi.org/10.1080/09084282.2010.499787
  • Young, J. C., Roper, B. L., & Arentsen, T. J. (2016). Validity testing and neuropsychology practice in the VA healthcare system: Results from recent practitioner survey. The Clinical Neuropsychologist, 30(4), 497–514. https://doi.org/10.1080/13854046.2016.1159730
  • Young, J. C., Sawyer, R. J., Roper, B. L., & Baughman, B. C. (2012). Expansion and re-examination of digit span effort indices on the WAIS-IV. The Clinical Neuropsychologist, 26(1), 147–159. https://doi.org/10.1080/13854046.2011.647083
  • Zuccato, B. G., Tyson, B. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment, 30(11), 1491–1498. https://doi.org/10.1037/pas0000596

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.