A multi-study examination of performance validity in undergraduate research participants

References

• Aita, S. L., Sofko, C. A., Hill, B. D., Musso, M. W., & Boettcher, A. C. (2017). Utility of the Personality Assessment Inventory in detecting feigned Attention-Deficit/Hyperactivity Disorder (ADHD): The Feigned Adult ADHD index. Archives of Clinical Neuropsychology, 1–13. doi: 10.1093/arclin/acx113
   PubMed Web of Science ®Google Scholar
• An, K. Y., Kaploun, K., Erdodi, L. A., & Abeare, C. A. (2017). Performance validity in undergraduate research participants: A comparison of failure rates across tests and cutoffs. The Clinical Neuropsychologist, 31(1), 193–206.
   PubMed Web of Science ®Google Scholar
• An, K. Y., Zakzanis, K. K., & Joordens, S. (2012). Conducting research with non-clinical healthy undergraduates: Does effort play a role in neuropsychological test performance? Archives of Clinical Neuropsychology, 27, 849–857.
   PubMed Web of Science ®Google Scholar
• Armistead-Jehle, P., & Hansen, C. L. (2011). Comparison of the Battery for the Assessment of Neuropsychological Status effort index and standalone symptom validity tests in a military sample. Archives of Clinical Neuropsychology, 26(7), 592–601.
   PubMed Web of Science ®Google Scholar
• Barker, M. D., Horner, M. D., & Bachman, D. L. (2010). Embedded indices of effort in the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in a geriatric sample. Clinical Neuropsychology, 24(6), 1064–1077.
   PubMed Web of Science ®Google Scholar
• Bennett, J., & Verney, S. P. (2018). Linguistic factors associated with phonemic fluency performance in a sample of bilingual Hispanic undergraduate students. Applied Neuropsychology: Adult, 1–14. doi: 10.1080/23279095.2017.1417309
   PubMed Web of Science ®Google Scholar
• Bernard, L. C., Houston, W., & Natoli, L. (1993). Malingering on neuropsychological memory tests: Potential objective indicators. Journal of Clinical Psychology, 49(1), 45–53.
   PubMed Web of Science ®Google Scholar
• Bianchini, K. J., Mathias, C. W., & Greve, K. W. (2001). Symptom validity testing: A critical review. The Clinical Neuropsychologist, 15(1), 19–45.
   PubMed Web of Science ®Google Scholar
• Boone, K. B. (2007). Assessment of feigned cognitive impairment: A neuropsychological perspective. New York, NY: Guilford Press.
   Google Scholar
• Boone, K. B., Lu, P., & Herzberg, D. S. (2002). The dot counting test manual. Los Angeles, CA: Western Psychological Services.
   Google Scholar
• Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23, 729–741.
   PubMed Web of Science ®Google Scholar
• Boone, K. B., Lu, P., Back, C., King, C., Lee, A., Philpott, L., … & Warner-Chacon, K. (2002). Sensitivity and specificity of the Rey Dot Counting Test in patients with suspect effort and various clinical samples. Archives of Clinical Neuropsychology, 17(7), 625–642.
   PubMed Web of Science ®Google Scholar
• Bortnik, K. E., Boone, K. B., Marion, S. D., Amano, S., Ziegler, E., Victor, T. L., & Zeller, M. A. (2010). Examination of various WMS-III logical memory scores in the assessment of response bias. The Clinical Neuropsychologist, 24(2), 344–357.
   PubMed Web of Science ®Google Scholar
• Brennan, A. M., Meyer, S., David, E., Pella, R., Hill, B. D., & Gouvier, W. D. (2009). The vulnerability to coaching across measures of effort. The Clinical Neuropsychologist, 23(2), 314–328.
   PubMed Web of Science ®Google Scholar
• Brooks, B. L. (2012). Victoria Symptom Validity Test performance in children and adolescents with neurological disorders. Archives of Clinical Neuropsychology, 27, 858–868.
   PubMed Web of Science ®Google Scholar
• Bryant, A. M., Lee, E., Howell, A., Morgan, B., Cook, C. M., Patel, K., … & Suhr, J. A. (2018). The vulnerability of self-reported disability measures to malingering: A simulated ADHD study. The Clinical Neuropsychologist, 32(1), 109–118.
   PubMed Web of Science ®Google Scholar
• Bush, S. S., & the NAN Policy & Planning Committee. (2005). Symptom validity assessment: Practice issues and medical necessity: Official statement of the national academy of neuropsychology. Archives of Clinical Neuropsychology, 20, 419–426.
   PubMed Web of Science ®Google Scholar
• Bush, S. S., Ruff, R. M., Troster, A. I., Barth, J. T., Koffler, S. P., Pliskin, N. H., … Silver, C. H. (2005). Symptom validity assessment: Practice issues and medical necessity NAN policy & planning committee. Archives of Clinical Neuropsychology, 20, 419–426.
   PubMed Web of Science ®Google Scholar
• Calamia, M., Roye, S., & Lemke, A. (2018). Does prior administration of the RBANS influence performance on subsequent neuropsychological testing? Applied Neuropsychology: Adult, 25(4), 340–343.
   PubMed Web of Science ®Google Scholar
• Dandachi-FitzGerald, B., Ponds, R. W., Peters, M. J., & Merckelbach, H. (2011). Cognitive underperformance and symptom over-reporting in a mixed psychiatric sample. The Clinical Neuropsychologist, 25(5), 812–828.
   PubMed Web of Science ®Google Scholar
• DeRight, J., & Jorgensen, R. S. (2015). I just want my research credit: Frequency of suboptimal effort in a non-clinical healthy undergraduate sample. The Clinical Neuropsychologist, 29(1), 101–117.
   PubMed Web of Science ®Google Scholar
• Donders, J., & Strong, C. A. H. (2011). Embedded effort indicators on the California verbal learning test–second edition (CVLT–II): An attempted cross-validation. The Clinical Neuropsychologist, 25(1), 173–184.
   PubMed Web of Science ®Google Scholar
• DuPaul, G. J., Weyandt, L. L., O’Dell, S. M., & Varejao, M. (2009). College students with ADHD: Current status and future directions. Journal of Attention Disorders, 13(3), 234–250.
   PubMed Web of Science ®Google Scholar
• Eisenberg, D., Gollust, S. E., Golberstein, E., & Hefner, J. L. (2007). Prevalence and correlates of depression, anxiety, and suicidality among university students. American Journal of Orthopsychiatry, 77(4), 534–542.
   PubMed Web of Science ®Google Scholar
• Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046.
   Google Scholar
• Franzen, M. D., Smith, S. S., Paul, D. S., & MacInnes, W. D. (1993). Order effects in the administration of the Booklet Category Test and Wisconsin Card Sorting Test. Archives of Clinical Neuropsychology, 8(2), 105–110.
   PubMed Web of Science ®Google Scholar
• Gallander Wintre, M., North, C., & Sugar, L. A. (2001). Psychologists’ response to criticisms about research based on undergraduate participants: A developmental perspective. Canadian Psychology/Psychologie Canadienne, 42(3), 216–225.
   Web of Science ®Google Scholar
• Green, P. (2003). Green’s Word Memory Test for Microsoft Windows: User’s Manual. Edmonton. Canada: Green’s Publishing Inc.
   Google Scholar
• Greve, K. W., Binder, L. M., & Bianchini, K. J. (2009). Rates of below-chance performance in forced-choice symptom validity tests. The Clinical Neuropsychologist, 23(3), 534–544.
   PubMed Web of Science ®Google Scholar
• Gorissen, M., Sanz, J. C., & Schmand, B. (2005). Effort and cognition in schizophrenia patients. Schizophrenia Research, 78(2–3), 199–208.
   PubMed Web of Science ®Google Scholar
• Gualtieri, C. T., & Boyd, A. (2008). Sensitivity & specificity of computerized testing for MCI. Poster presented at the International Conference for Alzheimer’s Disease, Chicago, IL.
   Google Scholar
• Gualtieri, C. T., & Johnson, L. G. (2006). Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21, 623–643.
   PubMed Web of Science ®Google Scholar
• Guise, B. J., Thompson, M. D., Greve, K. W., Bianchini, K. J., & West, L. (2014). Assessment of performance validity in the Stroop Color and Word Test in mild traumatic brain injury patients: A criterion‐groups validation design. Journal of Neuropsychology, 8(1), 20–33.
   PubMed Web of Science ®Google Scholar
• Guilmette, T. J., Hart, K. J., & Giuliano, A. J. (1993). Malingering detection: The use of a forced-choice method in identifying organic versus simulated memory impairment. Clinical Neuropsychologist, 7, 59–69.
   Web of Science ®Google Scholar
• Heaton, R. K., Miller, S. W., Taylor, M. J., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Lutz, FL: Psychological Assessment Resources.
   Google Scholar
• Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., Millis, S. R., & Conference Participants. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–129. doi: 10.1080/13854040903155063
   PubMed Web of Science ®Google Scholar
• Hiscock, M., & Hiscock, C. K. (1989). Refining the forced-choice method for the detection of malingering. Journal of Clinical and Experimental Neuropsychology, 11(6), 967–974.
   PubMed Web of Science ®Google Scholar
• Hill, B.D., & Aita, S. (2018). The positive side of effort: A review of the impact of motivation and engagement on neuropsychological performance. Applied Neuropsychology: Adult, 25(4), 312–317.
   PubMed Web of Science ®Google Scholar
• Hill, B.D., Womble, M.N., & Rohling, M.L. (2015). Logistic regression function for detection of suspicious performance during baseline evaluations using Concussion Vital Signs. Applied Neuropsychology, 22(3), 233–240.
   PubMed Web of Science ®Google Scholar
• Horn, L., Nevill, S., & Griffith, J. (2006). Profile of Undergraduates in US Postsecondary Education Institutions, 2003–04: With a Special Analysis of Community College Students. Statistical Analysis Report. NCES 2006–184. National Center for Education Statistics.
   Google Scholar
• Houck, Cherry K., et al. (1992). Students with learning disabilities in the university environment: A study of faculty and student perceptions. Journal of Learning Disabilities, 25(10), 678–684.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17, 410–425.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2007). Assessment of malingered neurocognitive deficits. New York, NY: Oxford University Press.
   Google Scholar
• Larrabee, G. J. (2008). Aggregation across multiple indicators improves the detection of malingering: Relationship to likelihood ratios. The Clinical Neuropsychologist, 22, 666– 679.
   PubMed Web of Science ®Google Scholar
• Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29, 364–373.
   PubMed Web of Science ®Google Scholar
• Lehman Blake, M., Ott, S., Villanyi, E., Kazhuro, K., & Schatz, P. (2015). Influence of Language of Administration on ImPACT Performance by Bilingual Spanish–English College Students. Archives of Clinical Neuropsychology, 30(4), 302–309.
   PubMed Web of Science ®Google Scholar
• Locke, D. E., Smigielski, J. S., Powell, M. R., & Stevens, S. R. (2008). Effort issues in post-acute outpatient acquired brain injury rehabilitation seekers. NeuroRehabilitation, 23(3), 273–281.
   PubMed Web of Science ®Google Scholar
• Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776.
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., & Volbrecht, M. E. (2003). A validation of multiple malingering detection methods in a large clinical sample. Archives of Clinical Neuropsychology, 18, 261–276.
   PubMed Web of Science ®Google Scholar
• Meyers, J. E., Volbrecht, M., Axelrod, B. N., & Reinsch-Boothby, L. (2011). Embedded symptom validity tests and overall neuropsychological test performance. Archives of Clinical Neuropsychology, 26(1), 8–15.
   PubMed Web of Science ®Google Scholar
• Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102.
   PubMed Web of Science ®Google Scholar
• Novitski, J., Steele, S., Karantzoulis, S., & Randolph, C. (2012). The Repeatable Battery for the Assessment of Neuropsychological Status effort scale. Archives of Clinical Neuropsychology, 27(2), 190–195.
   PubMed Web of Science ®Google Scholar
• Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8(1), 46–63.
   Web of Science ®Google Scholar
• Paulson, D., Horner, M. D., & Bachman, D. (2015). A comparison of four embedded validity indices for the RBANS in a memory disorders clinic. Archives of Clinical Neuropsychology, 30(3), 207–216.
   PubMed Web of Science ®Google Scholar
• Pella, R. D., Hill, B. D., Shelton, J. T., Elliott, E., & Gouvier, W. D. (2012). Evaluation of embedded malingering indexes in a non-litigating clinical sample using control, clinical, and derived groups. Archives of Clinical Neuropsychology, 27(1), 45–57.
   PubMed Web of Science ®Google Scholar
• Pearson, N. C. S. (2009). Advanced clinical solutions for WAIS-IV and WMS-IV: Administration and scoring manual. The Psychological Corporation, San Antonio.
   Google Scholar
• Pinxteren, R. V. (2016). Cognitive underperformance and symptom over-reporting in patients with acquired brain injury and neuropsychiatric problems (Master's thesis), Utrecht University.
   Google Scholar
• Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up 340 survey of INS and NAN members. Archives of Clinical Neuropsychology, 31, 206–230. doi: 10.1093/arclin/acw007
   PubMed Web of Science ®Google Scholar
• Randolph, C. (2012). RBANS update: Repeatable Battery for the Assessment of Neuropsychological Status. Bloomington, MN: NCS Pearson: PsychCorp.
   Google Scholar
• Rezaei, F., Hosseini Ramaghani, N. A., & Fazio, R. L. (2017). The effect of a third party observer and trait anxiety on neuropsychological performance: the Attentional Control Theory (ACT) perspective. The Clinical Neuropsychologist, 31(3), 632–643.
   PubMed Web of Science ®Google Scholar
• Resch, J., Driscoll, A., McCaffrey, N., Brown, C., Ferrara, M. S., Macciocchi, S., … & Walpert, K. (2013). ImPact test-retest reliability: reliably unreliable? Journal of Athletic Training, 48(4), 506–511.
   PubMed Web of Science ®Google Scholar
• Rey, A. (1964). L’examen clinique en psychologic [The clinical examination in psychology]. Paris: Presses Universitaires de France.
   Google Scholar
• Ross, T. P., Poston, A. M., Rein, P. A., Salvatore, A. N., Wills, N. L., & York, T. M. (2016). Performance invalidity base rates among healthy undergraduate research participants. Archives of Clinical Neuropsychology, 31(1), 97–104.
   PubMed Web of Science ®Google Scholar
• Santos, O. A., Kazakov, D., Reamer, M. K., Park, S. E., & Osmon, D. C. (2014). Effort in college undergraduate is sufficient on the Word Memory Test. Archives of Clinical Neuropsychology, 29, 609–613. doi: 10.1093/arclin/acu039
   PubMed Web of Science ®Google Scholar
• Schroeder, R. W., Twumasi-Ankrah, P., Baade, L. E., & Marshall, P. S. (2012). Reliable Digit Span: A systematic review and cross-validation study. Assessment, 19(1), 21–30.
   PubMed Web of Science ®Google Scholar
• Silk-Eglit, G. M., Stenclik, J. H., Gavett, B. E., Adams, J. W., Lynch, J. K., & McCaffrey, R. J. (2014). Base rate of performance invalidity among non-clinical undergraduate research participants. Archives of Clinical Neuropsychology, 29, 415–421.
   PubMed Web of Science ®Google Scholar
• Silverberg, N. D., Hanks, R. A., Buchanan, L., Fichtenberg, N., & Millis, S. R. (2008). Detecting response bias with performance patterns on an expanded version of the Controlled Oral Word Association Test. The Clinical Neuropsychologist, 22, 140–157. doi: 10.1080/13854040601160597
   PubMed Web of Science ®Google Scholar
• Silverberg, N. D., Wertheimer, J. C., & Fichtenberg, N. L. (2007). An effort index for the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). The Clinical Neuropsychologist, 21(5), 841–854.
   PubMed Web of Science ®Google Scholar
• Slick, D., Hopp, G., Strauss, E., & Thompson, G. B. (1997). Victoria Symptom Validity Test version 1.0 Professional Manual. Odessa, FL: Psychological Assessment Resources.
   Google Scholar
• Slick, D. J., Sherman, E. M. S., Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. Clinical Neuropsychologist, 13, 545–561.
   PubMed Web of Science ®Google Scholar
• Strauss, E., Sherman, E. M., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary. New York, NY: Oxford University Press.
   Google Scholar
• Sugarman, M. A., & Axelrod, B. N. (2015). Embedded measures of performance validity using verbal fluency tests in a clinical sample. Applied Neuropsychology: Adult, 22(2), 141–146.
   PubMed Web of Science ®Google Scholar
• Tombaugh, T. N. (1996). The Test of Memory Malingering (TOMM): Normative data from cognitively intact and cognitively impaired individuals. Psychological Assessment, 9, 260–268. doi: 10.1037/1040-3590.9.3.260
   Web of Science ®Google Scholar
• Wei, C., & Suhr, J. A. (2015). Examination of the role of expectancies on task performance in college students concerned about ADHD. Applied Neuropsychology: Adult, 22(3), 204–208.
   PubMed Web of Science ®Google Scholar