Cross-validation of the Trail Making Test as a non-memory-based embedded performance validity test among veterans with and without cognitive impairment

References

• American Psychiatric Association. (2013) . Diagnostic and statistical manual of mental disorders (DSM-5). American Psychiatric Publishing.
   Google Scholar
• Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. https://doi.org/10.1080/13854046.2017.1285961
   PubMed Web of Science ®Google Scholar
• Ausloos-Lozano, J. E., Bing-Canar, H., Khan, H., Singh, P. G., Wisinger, A. M., Rauch, A. A., Ogram Buckley, C. M., Petry, L. G., Jennette, K. J., Soble, J. R., & Resch, Z. J. (2022). Assessing performance validity during attention-deficit/hyperactivity disorder evaluations: Cross-validation of select non-memory embedded validity indicators. Developmental Neuropsychology, 47(5), 247–257. https://doi.org/10.1080/87565641.2022.2096889
   PubMed Web of Science ®Google Scholar
• Bailey, K. C., Soble, J. R., Bain, K. M., & Fullen, C. (2018). Embedded performance validity tests in the Hopkins verbal learning test—Revised and the brief visuospatial memory test—Revised: A replication study. Archives of Clinical Neuropsychology, 33(7), 895–900. https://doi.org/10.1093/arclin/acx111
   PubMed Web of Science ®Google Scholar
• Bain, K. M., & Soble, J. R. (2019). Validation of the advanced Clinical solutions word choice test (WCT) in a mixed clinical sample: Establishing classification accuracy, sensitivity/specificity, and cutoff scores. Assessment, 26(7), 1320–1328. https://doi.org/10.1177/1073191117725172
   PubMed Web of Science ®Google Scholar
• Bernstein, M. T., Resch, Z. J., Ovsiew, G. P., & Soble, J. R. (2021). A systematic review and meta-analysis of the diagnostic accuracy of the advanced clinical solutions word choice test as a performance validity test. Neuropsychology Review, 31(2), 349–359. https://doi.org/10.1007/s11065-020-09468-y
   PubMed Web of Science ®Google Scholar
• Berthelson, L., Mulchan, S. S., Odland, A. P., Miller, L. J., & Mittenberg, W. (2013). False positive diagnosis of malingering due to the use of multiple effort tests. Brain Injury, 27(7–8), 909–916. https://doi.org/10.3109/02699052.2013.793400
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (2013). Clinical practice of forensic neuropsychology: An evidenced-based approach. Guilford Press.
   Google Scholar
• Boone, K. B., Lu, P., & Herzberg, D. S. (2002). The dot counting test manual. Western Psychological Services.
   Google Scholar
• Boone, K. B., Lu, P., & Wen, J. (2005). Comparison of various RAVLT scores in the detection of noncredible memory performance. Archives of Clinical Neuropsychology, 20(3), 301–319. https://doi.org/10.1016/j.acn.2004.08.001
   PubMed Web of Science ®Google Scholar
• Busse, M., & Whiteside, D. (2012). Detecting suboptimal cognitive effort: Classification accuracy of the conner’s continuous performance test-II, brief test of attention, and trail making test. The Clinical Neuropsychologist, 26(4), 675–687. https://doi.org/10.1080/13854046.2012.679623
   PubMed Web of Science ®Google Scholar
• Cohen, C. D., Rhoads, T., Keezer, R. D., Jennette, K. J., Williams, C. P., Hansen, N. D., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2022). All of the accuracy in half of the time: Assessing abbreviated versions of the test of memory malingering in the context of verbal and visual memory impairment. The Clinical Neuropsychologist, 36(7), 1933–1949. https://doi.org/10.1080/13854046.2021.1908596
   PubMed Web of Science ®Google Scholar
• Critchfield, E., Soble, J. R., Marceaux, J. C., Bain, K. M., Bailey, K. C., Webber, T. A., Alverson, W. A., Messerly, J., Gonzalez, D. A., & O’Rourke, J. J. F. (2019). Cognitive impairment does not cause performance validity failure: Analyzing performance patterns among unimpaired, impaired, and noncredible participants across six tests. The Clinical Neuropsychologist, 33(6), 1083–1101. https://doi.org/10.1080/13854046.2018.1508615
   PubMed Web of Science ®Google Scholar
• Davis, J. J., & Millis, S. R. (2014). Examination of performance validity test failure in relation to number of tests administered. The Clinical Neuropsychologist, 28(2), 199–214. https://doi.org/10.1080/13854046.2014.884633
   PubMed Web of Science ®Google Scholar
• Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23(1), 133–152. https://doi.org/10.1080/13854040701819050
   PubMed Web of Science ®Google Scholar
• Duering, M., Gesierich, B., Seiler, S., Pirpamer, L., Gonik, M., Hofer, E., Jouvent, E., Duchesnay, E., Chabriat, H., Ropele, S., Schmidt, R., & Dichgans, M. (2014). Strategic white matter tracts for processing speed deficits in age-related small vessel disease. Neurology, 82(22), 1946–1950. https://doi.org/10.1212/WNL.0000000000000475
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources.
   Google Scholar
• Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression. (3rd ed.) John Wiley & Sons.
   Google Scholar
• Jak, A. J., Bondi, M. W., Delano-Wood, L., Wierenga, C., Corey-Bloom, J., Salmon, D. P., & Delis, D. C. (2009). Quantification of five neuropsychological approaches to defining mild cognitive impairment. The American Journal of Geriatric Psychiatry, 17(5), 368–375. https://doi.org/10.1097/JGP.0b013e31819431d5
   PubMed Web of Science ®Google Scholar
• Jennette, K. J., Williams, C. P., Resch, Z. J., Ovsiew, G. P., Durkin, N. M., O’Rourke, J. J. F., Marceaux, J. C., Critchfield, E. C., & Soble, J. R. (2022). Assessment of differential neurocognitive performance based on the number of performance validity tests failures: A cross-validation study across multiple mixed clinical samples. The Clinical Neuropsychologist, 36(7), 1915–1932. https://doi.org/10.1080/13854046.2021.1900398
   PubMed Web of Science ®Google Scholar
• Kortte, K. B., Horner, M. D., & Windham, W. K. (2002). The trail making test, part B: Cognitive flexibility or ability to maintain set? Applied Neuropsychology, 9(2), 106–109. https://doi.org/10.1207/S15324826AN0902_5
   PubMedGoogle Scholar
• Kraemer, L. D. R., Soble, J. R., Phillips, J. I., Webber, T. A., Fullen, C. T., Highsmith, J. M., Alverson, W. A., & Critchfield, E. C. (2020). Minimizing evaluation time while maintaining accuracy: Cross-validation of the test of memory malingering (TOMM) trial 1 and first 10-item errors as briefer performance validity tests. Psychological Assessment, 32(5), 442–450. https://doi.org/10.1037/pas0000802
   PubMed Web of Science ®Google Scholar
• Lu, P. H., Rogers, S. A., & Boone, K. B. (2007). Use of standard memory tests to detect suspect effort. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 128–151). Guilford.
   Google Scholar
• Martin, P. K., Schroeder, R. W., & Olsen, D. H. (2022). Performance validity in the dementia clinic: Specificity of validity tests when used individually and in aggregate across levels of cognitive impairment severity. The Clinical Neuropsychologist, 36(1), 165–188. https://doi.org/10.1080/13854046.2020.1778790
   PubMed Web of Science ®Google Scholar
• Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the test of memory malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. https://doi.org/10.1080/13854046.2019.1637027
   PubMed Web of Science ®Google Scholar
• Miele, A. S., Gunner, J. H., Lynch, J. K., & McCaffrey, R. J. (2012). Are embedded validity indices equivalent to free-standing symptom validity tests? Archives of Clinical Neuropsychology, 27(1), 10–22. https://doi.org/10.1093/arclin/acr084
   PubMed Web of Science ®Google Scholar
• Neale, A. C., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2022). Feigning or forgetfulness: The effect of memory impairment severity on word choice test performance. The Clinical Neuropsychologist, 36(3), 584–599. https://doi.org/10.1080/13854046.2020.1799076
   PubMed Web of Science ®Google Scholar
• Onandia-Hinchado, I., Pardo-Palenzuela, N., & Diaz-Orueta, U. (2021). Cognitive characterization of adult attention deficit hyperactivity disorder by domains: A systematic review. Journal of Neural Transmission, 128(7), 893–937. https://doi.org/10.1007/s00702-021-02302-6
   PubMed Web of Science ®Google Scholar
• Ovsiew, G. P., Resch, Z. J., Nayar, K., Williams, C. P., & Soble, J. R. (2020). Not so fast! Limitations of processing speed and working memory indices as embedded performance validity tests in a mixed neuropsychiatric sample. Journal of Clinical and Experimental Neuropsychology, 42(5), 473–484. https://doi.org/10.1080/13803395.2020.1758635
   PubMed Web of Science ®Google Scholar
• Paredes, A. M., Carrasco, J., Kamalyan, L., Cherner, M., Umlauf, A., Rivera Mindt, M., Suarez, P., Fortuny, A. I., Franklin, L., Heaton, D., & Marquine, M. J. (2021). Demographically adjusted normative data for the Halstead category test in a Spanish-speaking adult population: Results from the Neuropsychological Norms for the U.S.-Mexico Border Region in Spanish (NP-NUMBRS). The Clinical Neuropsychologist, 35(2), 356–373. https://doi.org/10.1080/13854046.2019.1709660
   PubMed Web of Science ®Google Scholar
• Rabin, L. A., Barr, W. B., & Burton, L. A. (2005). Assessment practices of clinical neuropsychologists in the United States and Canada: A survey of INS, NAN, and APA division 40 members. Archives of Clinical Neuropsychology, 20(1), 33–65. https://doi.org/10.1016/j.acn.2004.02.005
   PubMed Web of Science ®Google Scholar
• Rao, S. M., St Aubin-Faubert, P., & Leo, G. J. (1989). Information processing speed in patients with multiple sclerosis. Journal of Clinical and Experimental Neuropsychology, 11(4), 471–477. https://doi.org/10.1080/01688638908400907
   PubMed Web of Science ®Google Scholar
• Reitan, R. M., & Wolfson, D. (1993). The Halstead–Reitan neuropsychological test battery: Theory and clinical applications (2nd ed.). Neuropsychology Press.
   Google Scholar
• Resch, Z. J., Webber, T. A., Bernstein, M. T., Rhoads, T., Ovsiew, G. P., & Soble, J. R. (2021). Victoria symptom validity test: A systematic review and cross-validation study. Neuropsychology Review, 31(2), 331–348. https://doi.org/10.1007/s11065-021-09477-5
   PubMed Web of Science ®Google Scholar
• Rhoads, T., Neale, A. C., Resch, Z. J., Cohen, C. D., Keezer, R. D., Cerny, B. M., Jennette, K. J., Ovsiew, G. P., & Soble, J. R. (2021). Psychometric implications of failure on one performance validity test: A cross-validation study to inform criterion group definition. Journal of Clinical and Experimental Neuropsychology, 43(5), 437–448. https://doi.org/10.1080/13803395.2021.1945540
   PubMed Web of Science ®Google Scholar
• Rohling, M. L., Binder, L. M., Demakis, G. J., Larrabee, G. J., Ploetz, D. M., & Langhinrichsen-Rohling, J. (2011). A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al. (1997), Frencham et al. (2005), and Pertab et al. (2009). The Clinical Neuropsychologist, 25, 608–623. https://doi.org/10.1080/13854046.2011.565076
   PubMed Web of Science ®Google Scholar
• Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517
   PubMed Web of Science ®Google Scholar
• Schroeder, R. W., Twumasi-Ankrah, P., Baade, L. E., & Marshall, P. S. (2012). Reliable digit span: A systematic review and cross-validation study. Assessment, 19(1), 21–30. https://doi.org/10.1177/1073191111428764
   PubMed Web of Science ®Google Scholar
• Sherman, E. M. S., Tan, J. E., & Hrabok, M. (2021). A compendium of neuropsychological tests: Fundamentals of neuropsychological assessment and test reviews for clinical practice (4th Ed.). Oxford University Press.
   Google Scholar
• Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gantz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with postdeployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology Adult, 23(2), 94–104. https://doi.org/10.1080/23279095.2015.1014556
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Alverson, W. A., Phillips, J. I., Critchfield, E. A., Fullen, C., O’Rourke, J. J. F., Marceaux, J. M., Highsmith, J. M., Bailey, K. C., Webber, T. A., & Marceaux, J. C. (2020). Strength in numbers or quality over quantity? Examining the importance of criterion measure selection to define validity groups in performance validity test (PVT) research. Psychological Injury and Law, 13(1), 44–56. https://doi.org/10.1007/s12207-019-09370-w
   Web of Science ®Google Scholar
• Soble, J. R., Santos, O. A., Bain, K. M., Kirton, J. W., Bailey, K. C., Critchfield, E. A., O’Rourke, J. J. F., Highsmith, J. M., & Gonzalez, D. A. (2018). The dot counting test adds up: Validation and response pattern analysis in a mixed clinical veteran sample. Journal of Clinical and Experimental Neuropsychology, 40(4), 317–325. https://doi.org/10.1080/13803395.2017.1342773
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Sharp, D. W., Carter, D. A., Jennette, K. J., Resch, Z. J., Ovsiew, G. P., & Critchfield, E. A. (2021). Cross-validation of a forced-choice validity indicator to enhance the clinical utility of the rey auditory verbal learning test. Psychological Assessment, 33(6), 568–573. https://doi.org/10.1037/pas0001018
   PubMed Web of Science ®Google Scholar
• Soble, J. R., Webber, T. A., & Bailey, K. C. (2021). An overview of common stand-alone and embedded PVTs for the practicing clinician: Cutoffs, classification accuracy, and administration times. In R. W. Schroeder & P. K. Martin (Eds.), Validity assessment in clinical neuropsychological practice: Evaluating and managing noncredible performance (pp. 126–149). Guilford.
   Google Scholar
• Strauss, E., Sherman, E. S., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary (3rd ed.). Oxford University Press.
   Google Scholar
• Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwood, M. W., Schroeder, R. W., Suhr, J. A., & the Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
   PubMed Web of Science ®Google Scholar
• Webber, T. A., & Soble, J. R. (2018). Utility of various WAIS-IV digit span indices for identifying noncredible performance validity among cognitively impaired and unimpaired examinees. The Clinical Neuropsychologist, 32(4), 657–670. https://doi.org/10.1080/13854046.2017.1415374
   PubMed Web of Science ®Google Scholar
• White, D. J., Korinek, D., Bernstein, M. T., Ovsiew, G. P., Resch, Z. J., & Soble, J. R. (2020). Cross-validation of non-memory-based embedded performance validity tests for detecting invalid performance among patients with and without neurocognitive impairment. Journal of Clinical and Experimental Neuropsychology, 42(5), 459–472. https://doi.org/10.1080/13803395.2020.1758634
   PubMed Web of Science ®Google Scholar