End-of-placement failure rates among clinical psychology trainees:exceptional training and outstanding trainees or poor gate-keeping?

References

• American Psychological Association (2018). Standards of accreditation for health service psychology and Accreditation operating procedures. https://www.apa.org/ed/accreditation/about/policies/standards-of-accreditation.pdf
   Google Scholar
• Association of State and Provincial Psychology Boards (2015). Supervision guidelines for education and training leading to licensure as a health service provider. http://www.asppb.org
   Google Scholar
• Australian Health Practitioner Regulation Agency. (2015). Annual report 2014/15: The Australian Health Practitioner Regulation Agency and the National Boards, reporting on the National Registration and Accreditation Scheme. https://www.ahpra.gov.au/annualreport/2015/downloads.html
   Google Scholar
• Australian Psychology Accreditation Council. (2010). Rules for accreditation and accreditation standards for psychology courses. https://www.psychologycouncil.org.au/sites/default/files/public/Standards_20180912_Published_Final_v1.2.pdf
   Google Scholar
• Australian Psychology Accreditation Council. (2019). Accreditation standards for psychology programs. https://www.psychologycouncil.org.au/sites/default/files/public/Standards_20180912_Published_Final_v1.2.pdf
   Google Scholar
• Bogo, M., Regehr, C., Power, R., Power, R., Woodford, M., & Regehr, G. (2004). Toward new approaches for evaluating student field performance: Tapping the implicit criteria used by experienced field instructors. Journal of Social Work Education, 40(3), 417–426. https://doi.org/https://doi.org/10.1080/10437797.2004.10672297
   Web of Science ®Google Scholar
• Falender, C., & Shafranske, A. (2012). The importance of competency-based clinical supervision and training in the Twenty-first Century: Why bother? Journal of Contemporary Psychotherapy, 42(3), 129–137. https://doi.org/https://doi.org/10.1007/s10879-011-9198-9
   Google Scholar
• Falender, C. A., Cornish, J. A. E., Goodyear, R., Hatcher, R., Kaslow, N. J., Leventhal, G., Shafranske, E., Sigmon, S. T., Stoltenberg, C., & Grus, C. (2004). Defining competencies in psychology supervision: A consensus statement. Journal of Clinical Psychology, 60(7), 771–785. https://doi.org/https://doi.org/10.1002/jclp.20013
   PubMed Web of Science ®Google Scholar
• Forrest, L., Elman, N. S., Huprich, S. K., Veilleux, J. C., Jacobs, S. C., & Kaslow, N. J. (2013). Training directors’ perceptions of faculty behaviors when dealing with trainee competence problems: A mixed method pilot study. Training and Education in Professional Psychology, 7(1), 23–32. https://doi.org/https://doi.org/10.1037/a0032068
   Web of Science ®Google Scholar
• Gonsalvez, C., Bushnell, J., Blackman, R., Deane, F., Bliokas, V., Nicholson Perry, K., Shires, A., Nasstasia, Y., Allan, C., & Knight, R. (2013). Assessment of psychology competencies in field placements: Standardized vignettes reduce rater bias. Training and Education in Professional Psychology, 7(2), 99–111. https://doi.org/https://doi.org/10.1037/a0031617
   Web of Science ®Google Scholar
• Gonsalvez, C., & Calvert, F. (2014). Competency‐based models of supervision: Principles and applications, promises and challenges. Australian Psychologist, 49(4), 200–208. https://doi.org/https://doi.org/10.1111/ap.12055
   Web of Science ®Google Scholar
• Gonsalvez, C. J., & Crowe, T. P. (2014). Evaluation of psychology practitioner competence in clinical supervision. American Journal of Psychotherapy, 68(2), 177–193. doi:https://doi.org/https://doi.org/10.1176/appi.psychotherapy.2014.68.2.177
   PubMedGoogle Scholar
• Gonsalvez, C. J., Deane, F. P., Blackman, R., Matthias, M., Knight, R., Nasstasia, Y., Bliokas, V. (2015). The hierarchical clustering of clinical psychology practicum competencies: A multisite study of supervisor ratings. Clinical Psychology: Science and Practice, 22(4), 390–403. https://doi.org/https://doi.org/10.1111/cpsp.12123
   Web of Science ®Google Scholar
• Gonsalvez, C. J., Deane, F. P., Terry, J., Nasstasia, Y., & Shires, A. (2021). Innovations in competence assessment: Design and initial validation of the Vignette Matching Assessment Tool (VMAT). Training and Education in Professional Psychology, 15(2), 106–116. https://doi.org/http://dx.doi.org/10.1037/tep0000302.
   Google Scholar
• Gonsalvez, C. J., & Freestone, J. (2007). Field supervisors’ assessments of trainee performance: Are they reliable and valid? Australian Psychologist, 42(1), 23–32. doi:https://doi.org/https://doi.org/10.1080/00050060600827615
   Web of Science ®Google Scholar
• Gonsalvez, C. J., Wahnon, T., & Deane, F. P. (2017). Goal‐setting, feedback, and assessment practices reported by Australian clinical supervisors. Australian Psychologist, 52(1), 21–30. https://doi.org/https://doi.org/10.1111/ap.12175
   Web of Science ®Google Scholar
• Henderson, K. L., & Dufrene, R. L. (2012). Student behaviors associated with remediation: A content analysis. Counseling Outcome Research and Evaluation, 3(1), 48–60. https://doi.org/https://doi.org/10.1177/2150137812437364
   Google Scholar
• Hitzeman, C., Gonsalvez, C. J., Britt, E., & Moses, K. (2020). Clinical psychology trainees’ self and supervisor assessments of practitioner competencies. Clinical Psychologist, 24, 18–29. https://doi.org/https://doi.org/10.1111/cp.12183
   Google Scholar
• Hoge, M. A., Morris, J. A., Daniels, A. S., Huey, L. Y., Stuart, G. W., Adams, N., Paris, M., Goplerud, E., Horgan, C. M., Kaplan, L., Storti, S. A., & Dodge, J. M. (2005). Report of recommendations: The annapolis coalition on behavioral health work force competencies. Administration and Policy in Mental Health, 32(5–6), 651–663. https://doi.org/https://doi.org/10.1007/s10488-005-3267-x
   Web of Science ®Google Scholar
• Jacobs, S., Huprich, S., Grus, C., Cage, E., Elman, N., Forrest, L., Schwartz-Mette, R., Shen-Miller, D. S., Van Sickle, K. S., & Kaslow, N. (2011). Trainees with professional competency problems: Preparing trainers for difficult but necessary conversations. Training and Education in Professional Psychology, 5(3), 175–184. https://doi.org/https://doi.org/10.1037/a0024656
   Web of Science ®Google Scholar
• Kaslow, N., Grus, C., Campbell, L., Fouad, N., Hatcher, R., & Rodolfa, E. (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology, 3(4, Suppl), S27–S45. https://doi.org/https://doi.org/10.1037/t33344-000
   Web of Science ®Google Scholar
• Kaslow, N. J. (2004). Competencies in professional psychology. American Psychologist, 59(8), 774–781. doi:https://doi.org/https://doi.org/10.1037/0003-066x.59.8.774
   PubMed Web of Science ®Google Scholar
• Kaslow, N. J., Borden, K. A., Collins, F. L., Jr, Forrest, L., Illfelder-Kaye, J., Nelson, P. D., Rallo, J. S., Vasquez, M. J. T., & Willmuth, M. E. (2004). Competencies conference: Future directions in education and credentialing in professional psychology. Journal of Clinical Psychology, 60(7), 699–712. https://doi.org/https://doi.org/10.1002/jclp.20016
   PubMed Web of Science ®Google Scholar
• Kaslow, N. J., Grus, C. L., Allbaugh, L. J., Shen-Miller, D., Bodner, K. E., Veilleux, J., & Van Sickle, K. (2018). Trainees with competence problems in the professionalism domain. Ethics & Behavior, 28(6), 429–449. https://doi.org/https://doi.org/10.1080/10508422.2018.1438897
   Web of Science ®Google Scholar
• Kaslow, N. J., Rubin, N., Bebeau, M., Leigh, I., Lichtenberg, J., Nelson, P., Portnoy, S. M., & Smith, L. (2007). Guiding principles and recommendations for the assessment of competence. Professional Psychology: Research & Practice, 38(5), 441–451. https://doi.org/https://doi.org/10.1037/0735-7028.38.5.441
   Web of Science ®Google Scholar
• Lichtenberg, J., Portnoy, S., Bebeau, M., Leigh, I. W., Nelson, P. D., Rubin, N. J., Smith, I. L., & Kaslow, N. J. (2007). Challenges to the assessment of competence and competencies. Professional Psychology: Research and Practice, 38(5), 474–478. https://doi.org/https://doi.org/10.1037/0735-7028.38.5.474.
   Web of Science ®Google Scholar
• Nicholson Perry, K., Donovan, M., Knight, R., & Shires, A. (2017). Addressing professional competency problems in clinical psychology trainees. Australian Psychologist, 52(2), 121–129. https://doi.org/https://doi.org/10.1111/ap.12268
   Web of Science ®Google Scholar
• O’Donovan, A., Halford, W., & Walters, B. (2011). Towards best practice supervision of clinical psychology trainees. Australian Psychologist, 46(2), 101–112. https://doi.org/https://doi.org/10.1111/j.1742-9544.2011.00033.x
   Web of Science ®Google Scholar
• Oliver, M., Bernstein, J., Anderson, K., Blashfield, R., & Roberts, M. (2004). An exploratory examination of student attitudes toward “impaired” peers in clinical psychology training programs. Professional Psychology: Research and Practice, 35(2), 141–147. https://doi.org/https://doi.org/10.1037/t26149-000
   Web of Science ®Google Scholar
• Omoregbee, I., Morrison, B. W., & Morrison, N. M. V. (2016). A case for using ability-based emotional intelligence measures in the selection of trainee psychologists. Business Perspectives and Research, 4(1), 1–14. https://doi.org/https://doi.org/10.1177/2278533715605425
   Google Scholar
• Pachana, N., Sofranoff, K., Scott, T., & Helmes, E. (2011). Attainment of competencies in clinical psychology training: Ways forward in the Australian context. Australian Psychologist, 46(2), 67–76. https://doi.org/https://doi.org/10.1111/j.1742-9544.2011.00029.x
   Web of Science ®Google Scholar
• Psychology Board of Australia (2010). Guidelines on areas of practice endorsements. http://www.psychologyboard.gov.au/index.php
   Google Scholar
• Psychology Board of Australia. (2013). Guidelines for supervisors and supervisor training providers. http://www.psychologyboard.gov.au/Standards-and-Guidelines/Codes-Guidelines-Policies.aspx
   Google Scholar
• Qualtrics. (2017). Qualtrics. https://www.qualtrics.com
   Google Scholar
• Regehr, G., Bogo, M., Regehr, C., & Power, R. (2007). Can we build a better mousetrap? Improving the measures of practice performance in the field. Journal of Social Work Education, 43(2), 327–344. https://doi.org/https://doi.org/10.5175/JSWE.2007.200600607
   Web of Science ®Google Scholar
• Rieck, T., & Callahan, J. L. (2013). Emotional intelligence and psychotherapy outcomes in the training clinic. Training and Education in Professional Psychology, 7(1), 42–52. https://doi.org/https://doi.org/10.1037/a0031659
   Web of Science ®Google Scholar
• Robiner, W. N., Saltzman, S. R., Hoberman, H. M., Semrud-Clikeman, M., & Schirvar, J. A. (1998). Psychology supervisors’ bias in evaluations and letters of recommendation. Clinical Supervisor, 16(2), 49–72. https://doi.org/https://doi.org/10.1300/J001v16n02_04
   Google Scholar
• Rosenberg, J., Arcinue, F., Getzelman, M., & Oren, C. (2005). An exploratory look at students’ experiences of problematic peers in academic professional psychology programs. Professional Psychology: Research and Practice, 36(6), 665–673. https://doi.org/https://doi.org/10.1037/0735-7028.36.6.665
   Web of Science ®Google Scholar
• Royal Australian and New Zealand College of Psychiatrists (RANZCP). (2019). Training and assessment update: RANZCP fellowship program (End-year 2019). https://www.ranzcp.org/files/publications/education-reports/2019-end-year-training-and-assessment-update.aspx
   Google Scholar
• Schwartz-Mette, R. A. (2009). Challenges in addressing graduate student impairment in academic professional psychology programs. Ethics & Behavior, 19(2), 91–102. https://doi.org/https://doi.org/10.1080/10508420902768973
   Web of Science ®Google Scholar
• Scott, T. L., Pachana, N. A., & Sofranoff, K. (2011). Survey of current curriculum practices within Australian post-graduate clinical training programs: Students’ and program directors’ perspectives. Australian Psychologist, 46(2), 77–89. https://doi.org/https://doi.org/10.1111/j.1742-9544.2011.00030.x
   Web of Science ®Google Scholar
• Sharpless, B., & Barber, J. (2009). The Examination for Professional Practice in Psychology (EPPP) in the era of evidence-based practice. Professional Psychology: Research and Practice, 40(4), 333–340. https://doi.org/https://doi.org/10.1037/a0013983
   Web of Science ®Google Scholar
• Sharpless, B., & Barber, J. (2013). Predictors of program performance on the Examination for Professional Practice in Psychology (EPPP). Professional Psychology: Research and Practice, 44(4), 208–217. https://doi.org/https://doi.org/10.1037/a0031689
   Web of Science ®Google Scholar
• Templer, D. I., & Tangen, K. (2013). Examination for professional practice in psychology. SAGE Open, 3(2), 215824401348968. https://doi.org/https://doi.org/10.1177/2158244013489689
   Google Scholar
• Terry, J., Gonsalvez, C., & Deane, F. P. (2017). Brief online training with standardised vignettes reduces inflated supervisor ratings of trainee practitioner competencies. Australian Psychologist, 52(2), 130–139. https://doi.org/https://doi.org/10.1111/ap.12250
   PubMed Web of Science ®Google Scholar
• Trimble,L. D., Stroebel,S., Krieg,F., & Rubenstein,R. (2012). Problematic students of NASP‐approved programs: An exploratory study of graduate student views. Psychology in the Schools, 49(6), 589–605. https://doi.org/https://doi.org/10.1002/pits.21619
   Web of Science ®Google Scholar
• Vacha-Haase, T., Davenport, D., & Kerewsky, S. (2004). Problematic students: Gatekeeping practices of academic professional psychology programs. Professional Psychology: Research and Practice, 35(2), 115–122. https://doi.org/https://doi.org/10.1037/0735-7028.35.2.115
   Web of Science ®Google Scholar
• Veilleux, J. C., January, A. M., Vanderveen, J. W., Reddy, L. F., & Klonoff, E. A. (2012). Differentiating amongst characteristics associated with problems of professional competence: Perceptions of graduate student peers. Training and Education in Professional Psychology, 6(2), 113–121. https://doi.org/https://doi.org/10.1037/a0028337
   Web of Science ®Google Scholar
• Vinton, L., & Wilke, D. J. (2011). Leniency bias in evaluating clinical social work student interns. Clinical Social Work Journal, 39(3), 288–295. https://doi.org/https://doi.org/10.1007/s10615-009-0221-5
   Web of Science ®Google Scholar