Brief Online Training with Standardised Vignettes Reduces Inflated Supervisor Ratings of Trainee Practitioner Competencies

References

• Bogo, M., Regehr, C., Hughes, J., Power, R., & Globerman, J. (2002). Evaluating a measure of student field performance in direct service: Testing reliability and validity of explicit criteria. Journal of Social Work Education, 38(3), 385–401.
   Web of Science ®Google Scholar
• Bogo, M., Regehr, C., Roxanne, P., & Regehr, G. (2007). When values collide. The Clinical Supervisor, 26, 99–117. doi:10.1300/j001v26n01_08
   Google Scholar
• Chafouleas, S. M., Riley‐tillman, T. C., Jaffery, R., Miller, F. G., & Harrison, S. E. (2015). Preliminary investigation of the impact of a web‐based module on direct behavior rating accuracy. School Mental Health, 7, 92–104. doi:10.1007/s12310-014-9130-z
   Web of Science ®Google Scholar
• Dudek, N. L., Marks, M. B., & Regehr, G. (2005). Failure to fail: The perspectives of clinical supervisors. Academic Medicine, 80(10), S84–S87. doi:10.1097/00001888-200510001-00023
   PubMed Web of Science ®Google Scholar
• Forrest, L., Elman, N., Gizara, S., & Vacha‐haase, T. (1999). Trainee impairment: A review of identification, remediation, dismissal, and legal issues. Counseling Psychologist, 27, 627–686. doi:10.1177/0011000099275001
   Web of Science ®Google Scholar
• Fouad, N. A., Grus, C. L., Hatcher, R. L., Kaslow, N. J., Hutchings, P. S., Madson, M. B., … Crossman, R. E. (2009). Competency benchmarks: A model for understanding and measuring competence in professional psychology across training levels. Training and Education in Professional Psychology, 3(4 SUPPL. 1), S5–S26. doi:10.1037/a0015832
   Web of Science ®Google Scholar
• Gonsalvez, C. J., Bushnell, J., Blackman, R., Deane, F., Bliokas, V., Nicholson‐perry, K., … Knight, R. (2013). Assessment of psychology competencies in field placements: Standardized vignettes reduce rater bias. Training and Education in Professional Psychology, 7, 99–111. doi:10.1037/a0031617
   Web of Science ®Google Scholar
• Gonsalvez, C., & Crowe, T. (2014). Evaluation of psychology practitioner competence in clinical supervision. American Journal of Psychotherapy, 68(2), 177–193.
   PubMedGoogle Scholar
• Gonsalvez, C., Deane, F., Knight, R., Nasstasia, Y., Shires, A., Nicholson perry, K., … Bliokas, V. (2015). The hierarchical clustering of clinical psychology practicum competencies: A multisite study of supervisor ratings. Clinical Psychology, 22(4), 390–403. doi:10.1111/cpsp.12123
   Google Scholar
• Gonsalvez, C. J., & Freestone, J. (2007). Field supervisors' assessments of trainee performance: Are they reliable and valid? Australian Psychologist, 42(1), 23–32. doi:10.1080/00050060600827615
   Web of Science ®Google Scholar
• Gonsalvez, C., Wahnon, T., & Deane, F. P. (2016). Goal‐setting, feedback, and evaluation practices reported by clinical supervisors. Australian Psychologist. doi:10.1111/ap.12175
   Web of Science ®Google Scholar
• Jelley, R. B., & Goffin, R. D. (2001). Can performance‐feedback accuracy be improved? Effects of rater priming and rating‐scale format on rating accuracy. Journal of Applied Psychology, 86(1), 134–144. doi:10.1037//0021-9010.86.1.134
   Web of Science ®Google Scholar
• Nelson, P. D. (2007). Striving for competence in the assessment of competence: Psychology's professional education and credentialing journey of public accountability. Training and Education in Professional Psychology, 1, 3–12. doi:10.1037/1931-3918.1.1.3
   Web of Science ®Google Scholar
• Olsen, H., Donaldson, A. J., & Hudson, S. D. (2010). Online professional development: Choices for early childhood educators. Dimensions of Early Childhood, 38, 12–17.
   Google Scholar
• Overholser, J. C., & Fine, M. A. (1990). Defining the boundaries of professional competence: Managing subtle cases of clinical incompetence. Professional Psychology: Research and Practice, 21(6), 462–469. doi:10.1037/0735-7028.21.6.462
   Web of Science ®Google Scholar
• Pease, B. B. (1988). The ABCs of social work student evaluation. Journal of Teaching in Social Work, 2(2), 35–50. doi:10.1300/j067v02n02_04
   Google Scholar
• Robiner, W. N., Fuhrman, M. J., & Ristvedt, S. (1993). Evaluation difficulties in supervising psychology interns. Clinical Psychologist, 46, 3–13. doi:10.1037/e554872011-003
   Google Scholar
• Robiner, W. N., Saltzman, S. R., Hoberman, H. M., Semrud‐clikeman, M., & Schirvar, J. A. (1998). Psychology supervisors' bias in evaluations and letters of recommendation. Clinical Supervisor, 16(2), 49–72. doi:10.1300/j001v16n02_04
   Google Scholar
• Rodolfa, E. R., Bent, R. J., Eisman, E., Nelson, P. D., & Ritchie, P. (2005). A cube model for competency development: Implications for psychology educators and regulators. Professional Psychology: Research and Practice, 36, 347–354. doi:10.1037/0735-7028.36.4.347
   Web of Science ®Google Scholar
• Schanche, E., Høstmark nielsen, G., Mccullough, L., Valen, J., & Mykletun, A. (2010). Training graduate students as raters in psychotherapy process research: Reliability of ratings with the Achievement of Therapeutic Objectives Scale (ATOS). Nordic Psychology, 62(3), 4–20. doi:10.1027/1901-2276/a000013
   Web of Science ®Google Scholar
• Stamoulis, D. T., & Hauenstein, N. M. A. (1993). Rater training and rating accuracy: Training for dimensional accuracy versus training for ratee differentiation. Journal of Applied Psychology, 78(6), 994–1003. doi:10.1037/0021-9010.78.6.994
   Web of Science ®Google Scholar
• Støre‐valen, J., Ryum, T., Pedersen, G. A., Pripp, A. H., Jose, P. E., & Karterud, S. (2015). Does a web‐based feedback training program result in improved reliability in clinicians’ ratings of the Global Assessment of Functioning (GAF) scale? Psychological Assessment, 27(3), 865–873. doi:10.1037/pas0000086
   Web of Science ®Google Scholar
• Thornton, G. C., & Zorich, S. (1980). Training to improve observer accuracy. Journal of Applied Psychology, 65, 351–354. doi:10.1037/0021-9010.65.3.351
   Web of Science ®Google Scholar
• Tweed, A., Graber, R., & Wang, M. (2010). Assessing trainee clinical psychologists’ clinical competence. Psychology Learning and Teaching, 9(2), 50–60. doi:10.2304/plat.2010.9.2.50
   Google Scholar
• Vinton, L., & Wilke, D. J. (2011). Leniency bias in evaluating clinical social work student interns. Clinical Social Work Journal, 39(3), 288–295. doi:10.1007/s10615-009-0221-5
   Web of Science ®Google Scholar
• Wolf, K. (2015). Leniency and halo bias in industry‐based assessments of student competencies: A critical, sector‐based analysis. Higher Education Research and Development, 34(5), 1045–1059. doi:10.1080/07294360.2015.1011096
   Web of Science ®Google Scholar