What does competently delivered neuropsychological assessment feedback look like? Development and validation of a competency evaluation tool

References

• Bennett-Levy, J., Klein-Boonschate, M. A., Batchelor, J., McCarter, R., & Walton, N. (1994). Encounters with Anna Thompson: The consumer’s experience of neuropsychological assessment. Clinical Neuropsychologist, 8(2), 219–238. https://doi.org/10.1080/13854049408401559
   Web of Science ®Google Scholar
• Carrier, S., Wong, D., Lawrence, K., & McKay, A. (2022). Preliminary validation of a new competency tool for evaluating assessment skills in professional psychology trainees. Training and Education in Professional Psychology, 16(2), 166–172. https://doi.org/10.1037/tep0000394
   Web of Science ®Google Scholar
• Cohen, J. (1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), 213–220. https://doi.org/10.1037/h0026256
   PubMed Web of Science ®Google Scholar
• Dennhag, I., Gibbons, M. B. C., Barber, J. P., Gallop, R., & Crits-Christoph, P. (2012). Do supervisors and independent judges agree on evaluations of therapist adherence and competence in the treatment of cocaine dependence? Psychotherapy Research: Journal of the Society for Psychotherapy Research, 22(6), 720–730. https://doi.org/10.1080/10503307.2012.716528
   PubMed Web of Science ®Google Scholar
• Dolan, C. P. (2019). The provision of psychological assessment feedback to children: A survey of practitioners [Dissertations & Theses], Antioch University, New England. 475. https://aura.antioch.edu/etds/475
   Google Scholar
• Donofrio, N., Piatt, A., Whelihan, W., & DiCarlo, M. (1999). Neuropsychological test feedback: Consumer evaluation and perceptions. Archives of Clinical Neuropsychology, 14(8), 721–721. https://doi.org/10.1093/arclin/14.8.721
   Web of Science ®Google Scholar
• Falender, C. A., & Shafranske, E. P. (2007). Competence in competency-based supervision practice: Construct and application. Professional Psychology: Research and Practice, 38(3), 232–240. https://doi.org/10.1037/0735-7028.38.3.232
   Web of Science ®Google Scholar
• Foran, A., Millar, E., & Dorstyn, D. (2016). Patient satisfaction with a hospital-based neuropsychology service. Australian Health Review: A Publication of the Australian Hospital Association, 40(4), 447–452. https://doi.org/10.1071/AH15054
   PubMed Web of Science ®Google Scholar
• Gamer, M., Lemon, J., Fellows, I., & Sing, P. (2010). irr: Various coefficients of interrater reliability and agreement (Version 0.84). http://CRAN.Rproject.org/package=irr
   Google Scholar
• Gass, C., & Brown, M. (1992). Neuropsychological test feedback to patients with brain dysfunction. Psychological Assessment, 4(3), 272–277. https://doi.org/10.1037/1040-3590.4.3.272
   Google Scholar
• Gisev, N., Bell, J. S., & Chen, T. F. (2013). Interrater agreement and interrater reliability: key concepts, approaches, and applications. Research in Social & Administrative Pharmacy: RSAP, 9(3), 330–338. https://doi.org/10.1016/j.sapharm.2012.04.004
   PubMed Web of Science ®Google Scholar
• Gonsalvez, C. J., Bushnell, J., Blackman, R., Deane, F., Bliokas, V., Nicholson-Perry, K., Shires, A., Nasstasia, Y., Allan, C., & Knight, R. (2013). Assessment of psychology competencies in field placements: Standardized vignettes reduce rater bias. Training and Education in Professional Psychology, 7(2), 99–111. https://doi.org/10.1037/a0031617
   Web of Science ®Google Scholar
• Gonsalvez, C. J., & Crowe, T. P. (2014). Evaluation of psychology practitioner competence in clinical supervision. American Journal of Psychotherapy, 68(2), 177–193. https://doi.org/10.1176/appi.psychotherapy.2014.68.2.177
   PubMedGoogle Scholar
• Gorske, T. T., & Smith, S. R. (2009). Collaborative therapeutic neuropsychological assessment. Springer.
   Google Scholar
• Gruters, A. A., Ramakers, I. H., Verhey, F. R., Kessels, R. P., & de Vugt, M. E. (2022). A scoping review of communicating neuropsychological test results to patients and family members. Neuropsychology Review, 32(2), 294–315. https://doi.org/10.1007/s11065-021-09507-2
   PubMed Web of Science ®Google Scholar
• Hatcher, R. L., Fouad, N. A., Campbell, L. F., McCutcheon, S. R., Grus, C. L., & Leahy, K. L. (2013). Competency-based education for professional psychology: Moving from concept to practice. Training and Education in Professional Psychology, 7(4), 225–234. https://doi.org/10.1037/a0033765
   Web of Science ®Google Scholar
• Heffelfinger, A. K., Janecek, J. K., Johnson, A., Miller, L. E., Nelson, A., & Pulsipher, D. T. (2022). Competency-based assessment in clinical neuropsychology at the post-doctoral level: Stages, milestones, and benchmarks as proposed by an APPCN work group. The Clinical Neuropsychologist, 36(6), 1209–1225. https://doi.org/10.1080/13854046.2020.1829070
   PubMed Web of Science ®Google Scholar
• Hessen, E., Hokkanen, L., Ponsford, J., Van Zandvoort, M., Watts, A., Evans, J., & Haaland, K. Y. (2018). Core competencies in clinical neuropsychology training across the world. The Clinical Neuropsychologist, 32(4), 642–656. https://doi.org/10.1080/13854046.2017.1413210
   PubMed Web of Science ®Google Scholar
• Hsu, C.-C., & Sandford, B. A. (2007). The Delphi technique: making sense of consensus. Practical Assessment. Research & Evaluation, 12(10), 1–8. doi: http://pareonline.net/getvn.asp?v=12&n=10
   Google Scholar
• Kuentzel, J. G. (2022). The feedback session. In Pediatric neuropsychology (pp. 184–200). Routledge.
   Google Scholar
• Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002). Content analysis in mass communication: Assessment and reporting of intercoder reliability. Human Communication Research, 28(4), 587–604. https://doi.org/10.1111/j.1468-2958.2002.tb00826.x
   Web of Science ®Google Scholar
• Longley, W. A., Tate, R. L., & Brown, R. F. (2022). The psychological benefits of neuropsychological assessment feedback as a psycho-educational therapeutic intervention: A randomized-controlled trial with cross-over in multiple sclerosis. Neuropsychological Rehabilitation, 1–30. https://doi.org/10.1080/09602011.2022.2047734
   Web of Science ®Google Scholar
• Martin, P. K., & Schroeder, R. W. (2021). Feedback with patients who produce invalid testing: Professional values and reported practices. The Clinical Neuropsychologist, 35(6), 1134–1153. https://doi.org/10.1080/13854046.2020.1722243
   PubMed Web of Science ®Google Scholar
• Martin, P. K., & Schroeder, R. W. (2022). Malingering: Maintaining a perspective of clinical care when patients feign. In R. W. Schroeder & P. K. Martin (Eds.), Validity assessment in clinical neuropsychological practice: Evaluating and managing noncredible performance (pp. 31–46). The Guilford Press.
   Google Scholar
• McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031
   PubMed Web of Science ®Google Scholar
• Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004). A randomized trial of methods to help clinicians learn motivational interviewing. Journal of Consulting and Clinical Psychology, 72(6), 1050–1062. https://doi.org/10.1037/0022-006x.72.6.1050
   PubMed Web of Science ®Google Scholar
• Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
   PubMed Web of Science ®Google Scholar
• Ponsford, J. (2016). The practice of clinical neuropsychology in Australia. The Clinical Neuropsychologist, 30(8), 1179–1192. https://doi.org/10.1080/13854046.2016.1195015
   PubMed Web of Science ®Google Scholar
• Postal, K. (2019). The multigenerational family system in dementia: Assessment and feedback. In Handbook on the neuropsychology of aging and dementia (pp. 131–144). Springer.
   Google Scholar
• Postal, K., & Armstrong, K. (2013). Feedback that sticks: The art of effectively communicating neuropsychological assessment results. Oxford University Press.
   Google Scholar
• PsyBA. (2022). Psychology Board of Australia registrant data. Reporting period: 01 April 2022 to 30 June 2022. Retrieved from Psychology Board of Australia: https://www.psychologyboard.gov.au/about/statistics.aspx
   Google Scholar
• Roberts, M., Borden, K. A., Christiansen, M. D., & Lopez, S. J. (2005). Fostering a culture shift: Assessment of competence in the education and careers of professional psychologists. Professional Psychology: Research and Practice, 36(4), 355–361. https://doi.org/10.1037/0735-7028.36.4.355
   Web of Science ®Google Scholar
• Rosado, D. L., Buehler, S., Botbol-Berman, E., Feigon, M., León, A., Luu, H., Carrión, C., Gonzalez, M., Rao, J., Greif, T., Seidenberg, M., & Pliskin, N. H. (2018). Neuropsychological feedback services improve quality of life and social adjustment. The Clinical Neuropsychologist, 32(3), 422–435. https://doi.org/10.1080/13854046.2017.1400105
   PubMed Web of Science ®Google Scholar
• Roth, A. D., & Pilling, S. (2008). Using an evidence-based methodology to identify the competences required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy, 36(2), 129–147. https://doi.org/10.1017/S1352465808004141
   Web of Science ®Google Scholar
• Rowe, G., & Wright, G. (1999). The Delphi technique as a forecasting tool: issues and analysis. International Journal of Forecasting, 15(4), 353–375. https://doi.org/10.1016/S0169-2070(99)00018-7
   Web of Science ®Google Scholar
• Skulmoski, G. J., Hartman, F., & Krahn, J. (2007). The Delphi method for graduate research. Journal of Information Technology Education: Research, 6(1), 001–021. https://doi.org/10.28945/199
   Google Scholar
• Smith, G., & CNS. (2019). Education and training in clinical neuropsychology: Recent developments and documents from the clinical neuropsychology synarchy. The Clinical Neuropsychologist, 33(3), 447–465. https://doi.org/10.1080/13854046.2018.1552437
   PubMed Web of Science ®Google Scholar
• Smith, S. R., Wiggins, C. M., & Gorske, T. T. (2007). A survey of psychological assessment feedback practices. Assessment, 14(3), 310–319. https://doi.org/10.1177/1073191107302842
   PubMed Web of Science ®Google Scholar
• Waldron-Perrine, B., Rai, J. K., & Chao, D. (2021). Therapeutic assessment and the art of feedback: A model for integrating evidence-based assessment and therapy techniques in neurological rehabilitation. NeuroRehabilitation, 49(2), 293–306. https://doi.org/10.3233/NRE-218027
   PubMed Web of Science ®Google Scholar
• Westervelt, H. J., Brown, L. B., Tremont, G., Javorsky, D. J., & Stern, R. A. (2007). Patient and family perceptions of the neuropsychological evaluation: How are we doing? The Clinical Neuropsychologist, 21(2), 263–273. https://doi.org/10.1080/13854040500519745
   PubMed Web of Science ®Google Scholar
• Wong, D., Pestell, C., Oxenham, V., Stolwyk, R., & Anderson, J. (2023). Competencies unique to clinical neuropsychology: A consensus statement of educators, practitioners, and professional leaders in Australia. The Clinical Neuropsychologist, DOI: 10.1080/13854046.2023.2200035.
   Web of Science ®Google Scholar
• Wong, D., Grace, N., Baker, K., & McMahon, G. (2019). Measuring clinical competencies in facilitating group-based rehabilitation interventions: development of a new competency checklist. Clinical Rehabilitation, 33(6), 1079–1087. https://doi.org/10.1177/0269215519831048
   PubMed Web of Science ®Google Scholar
• Wong, D., Kempnich, C., Bradshaw, J., Grayson, S., Lillywhite, L., O’Shea, M., Kim, J., Stolwyk, R., & Cadilhac, D. A. (2021). Real world implementation of a group-based memory rehabilitation program into stroke services: A knowledge translation evaluation. Topics in Stroke Rehabilitation, 28(6), 410–421. https://doi.org/10.1080/10749357.2020.1838084
   PubMed Web of Science ®Google Scholar
• Wong, D., McKay, A., Kazantzis, N., & Ponsford, J. (2020). Clinical translation of Cognitive Behavioural Therapy for anxiety and depression - Adapted for Brain Injury (CBT-ABI): How do we train competent clinicians? International Journal of Cognitive Therapy, 13(4), 379–395. https://doi.org/10.1007/s41811-020-00079-2
   Web of Science ®Google Scholar
• Wynn, M. J., Ju, C. H., & Carpenter, B. D. (2022). The relay of neuropsychological information: providing feedback. In A handbook of geriatric neuropsychology (pp. 445–457). Routledge.
   Google Scholar
• Zec, S., Soriani, N., Comoretto, R., & Baldi, I. (2017). High agreement and high prevalence: The paradox of Cohen’s kappa. The Open Nursing Journal, 11, 211–218. https://doi.org/10.2174/1874434601711010211
   PubMedGoogle Scholar