Assessing Advanced Communication Skills via Objective Structured Clinical Examination: A Comparison of Faculty Versus Self, Peer, and Standardized Patient Assessors

References

• Etheridge L, Bouriscot K. Performance and workplace assessment. In: Dent JA, Harden RM, eds. A Practical Guide For Medical Teachers. 4th ed. New York: Elsevier; 2013. 307–313.
   Google Scholar
• Khan R, Payne MWC, Chahine S. Peer assessment in the objective structured clinical examination: a scoping review. Med Teach. 2017;39(7):745–756. doi:10.1080/0142159X.2017.1309375.
   PubMed Web of Science ®Google Scholar
• Talwalkar JS, Cyrus KD, Fortin AH. Twelve tips for running an effective session with standardized patients. Med Teach. 2019;1–6. [Epub ahead of print] doi:10.1080/0142159X.2019.1607969.
   PubMed Web of Science ®Google Scholar
• Turner JL, Dankoski ME. Objective structured clinical exams: a critical review. Fam Med. 2008;40(8):574–578.
   PubMed Web of Science ®Google Scholar
• Iblher P, Zupanic M, Karsten J, et al. May student examiners be reasonable substitute examiners for faculty in an undergraduate OSCE on medical emergencies?. Med Teach. 2015;37(4):374–378. doi:10.3109/0142159X.2014.956056.
   PubMed Web of Science ®Google Scholar
• Humphrey-Murto S, Smee S, Touchie C, et al. A comparison of physician examiners and trained assessors in a high-stakes OSCE setting. Acad Med. 2005;80(Supplement):S59–S62. doi:10.1097/00001888-200510001-00017.
   PubMedGoogle Scholar
• Basehore PM, Pomerantz SC, Gentile M. Reliability and benefits of medical student peers in rating complex clinical skills. Med Teach. 2014;36(5):409–414. doi:10.3109/0142159X.2014.889287.
   PubMed Web of Science ®Google Scholar
• Chenot J-F, Simmenroth-Nayda A, Koch A, et al. Can student tutors act as examiners in an objective structured clinical examination?. Med Educ. 2007;41(11):1032–1038. doi:10.1111/j.1365-2923.2007.02895.x.
   PubMed Web of Science ®Google Scholar
• Ellman MS, Putnam A, Green M, et al. Demonstrating medical student competency in palliative care: Development and evaluation of a new objective structured clinical examination station. J Palliat Med. 2016;19(7):706–711. doi:10.1089/jpm.2015.0462.
   PubMed Web of Science ®Google Scholar
• Dickter DN, Stielstra S, Lineberry M. Interrater reliability of standardized actors versus nonactors in a simulation based assessment of interprofessional collaboration. Sim Healthcare. 2015;10(4):249–255. doi:10.1097/SIH.0000000000000094.
   PubMedGoogle Scholar
• Kaplonyi J, Bowles K, Nestel D, et al. Understanding the impact of simulated patients on health care learners’ communication skills: a systematic review. Med Educ. 2017;51(12):1209–1219. doi:10.1111/medu.13387.
   PubMed Web of Science ®Google Scholar
• Newlin-Canzone ET, Scerbo MW, Gliva-McConvey G, et al. The cognitive demands of standardized patients: Understanding limitations in attention and working memory with the decoding of nonverbal behavior during improvisations. Sim Healthcare. 2013;8(4):207–214. doi:10.1097/SIH.0b013e31828b419e.
   PubMedGoogle Scholar
• Wilby KJ, Dolmans D, Austin Z, et al. Assessors’ interpretations of narrative data on communication skills in a summative OSCE. Med Educ. 2019;53(10):1003–1012. [Epub ahead of print]. doi:10.1111/medu.13924.
   PubMed Web of Science ®Google Scholar
• Chou CL, Masters DE, Chang A, et al. Effects of longitudinal small-group learning on delivery and receipt of communication skills feedback. Med Educ. 2013;47(11):1073–1079. doi:10.1111/medu.12246.
   PubMed Web of Science ®Google Scholar
• Cave J, Washer P, Sampson P, et al. Explicitly linking teaching and assessment of communication skills. Med Teach. 2007;29(4):317–322. doi:10.1080/01421590701509654.
   PubMed Web of Science ®Google Scholar
• Engerer C, Berberat PO, Dinkel A, et al. Integrating 360° behavior-orientated feedback in communication skills training for medical undergraduates: concept, acceptance and students’ self-ratings of communication competence. BMC Med Educ. 2016;16(1)doi:10.1186/s12909-016-0792-0.
   PubMedGoogle Scholar
• Aronson L. Twelve tips for teaching reflection at all levels of medical education. Med Teach. 2011;33(3):200–205. doi:10.3109/0142159X.2010.507714.
   PubMed Web of Science ®Google Scholar
• Ward M, Gruppen L, Regehr G. Measuring self-assessment: current state of the art. Adv Health Sci Educ. 2002;7(1):63–80. doi:10.1023/A:1014585522084.
   PubMed Web of Science ®Google Scholar
• Quick KK. The role of self- and peer Assessment in dental students’ reflective practice using standardized patient encounters. J Dent Educ. 2016;80(8):924–929.
   PubMed Web of Science ®Google Scholar
• White CB, Ross PT, Gruppen LD. Remediating students’ failed OSCE performances at one school: the effects of self-assessment, reflection, and feedback. Acad Med. 2009;84(5):651–654. doi:10.1097/ACM.0b013e31819fb9de.
   PubMed Web of Science ®Google Scholar
• Madrazo L, Lee CB, McConnell M, et al. Self-assessment differences between genders in a low-stakes objective structured clinical exam (OSCE). BMC Res Notes.. 2018;11(1):393. doi:10.1186/s13104-018-3494-3.
   PubMedGoogle Scholar
• Yu T-C, Wilson NC, Singh PP, et al. Medical students-as-teachers: A systematic review of peer-assisted teaching during medical school. Adv Med Educ Pract. 2011;2:157–172. doi:10.2147/AMEP.S14383.
   PubMedGoogle Scholar
• Faustinella F, Jacobs RJ. The decline of clinical skills: a challenge for medical schools. Int J Med Educ. 2018;9:195–197. doi:10.5116/ijme.5b3f.9fb3.
   PubMed Web of Science ®Google Scholar
• Sanson-Fisher RW, Rolfe IE, Williams N. Competency based teaching: The need for a new approach to teaching clinical skills in the undergraduate medical education course. Med Teach. 2005;27(1):29–36. doi:10.1080/01421590400019500.
   PubMed Web of Science ®Google Scholar
• Glynn LG, MacFarlane A, Kelly M, et al. Helping each other to learn - a process evaluation of peer assisted learning. BMC Med Educ. 2006;6(1)doi:10.1186/1472-6920-6-18.
   PubMedGoogle Scholar
• Field M, Burke JM, McAllister D, et al. Peer-assisted learning: a novel approach to clinical skills learning for medical students. Med Educ. 2007;41(4):411–418. doi:10.1111/j.1365-2929.2007.02713.x.
   PubMed Web of Science ®Google Scholar
• Moineau G, Power B, Pion AJ, et al. Comparison of student examiner to faculty examiner scoring and feedback in an OSCE. Med Educ. 2011;45(2):183–191. doi:10.1111/j.1365-2923.2010.03800.x.
   PubMed Web of Science ®Google Scholar
• Silbert BI, Lake FR. Peer-assisted learning in teaching clinical examination to junior medical students. Med Teach. 2012;34(5):392–397. doi:10.3109/0142159X.2012.668240.
   PubMed Web of Science ®Google Scholar
• Brazeau C, Boyd L, Crosson J. Changing an existing OSCE to a teaching tool: The making of a teaching OSCE. Acad Med. 2002;77(9):932. doi:10.1097/00001888-200209000-00036.
   PubMedGoogle Scholar
• Burgess AW, Roberts C, Black KI, et al. Senior medical student perceived ability and experience in giving peer feedback in formative long case examinations. BMC Med Educ. 2013;13(1)doi:10.1186/1472-6920-13-79.
   PubMedGoogle Scholar
• Cushing A, Abbott S, Lothian D, et al. Peer feedback as an aid to learning – What do we want? Feedback. When do we want it? Now!. Med Teach. 2011;33(2):e105–e112. doi:10.3109/0142159X.2011.542522.
   PubMed Web of Science ®Google Scholar
• Langenau EE, Zhang X, Roberts WL, et al. Clinical skills assessment of procedural and advanced communication skills: Performance expectations of residency program directors. Med Educ Online. 2012;17.
   PubMed Web of Science ®Google Scholar
• Baran CN, Sanders JJ. Communication skills: delivering bad news, conducting a goals of care family meeting, and advance care planning. Prim Care. 2019;46(3):353–372.
   PubMed Web of Science ®Google Scholar
• Meyer EC, Sellers DE, Browning DM, et al. Difficult conversations: improving communication skills and relational abilities in health care. Pediatr Crit Care Med. 2009;10(3):352–359. doi:10.1097/PCC.0b013e3181a3183a.
   PubMed Web of Science ®Google Scholar
• MacDonald E. Difficult Conversations in Medicine. New York: Oxford University Press; 2004.
   Google Scholar
• Stillman PL, Brown DR, Redfield DL, et al. Construct validation of the Arizona Clinical Interview Rating Scale. Educ Psychol Meas. 1977;37(4):1031–1038. doi:10.1177/001316447703700427.
   Web of Science ®Google Scholar
• Baldwin JD, Cox J, Wu ZH, et al. Delivery and measurement of high-value care in standardized patient encounters. J Grad Med Educ. 2017;9(5):449–645. doi:10.4300/JGME-D-17-00016.1.
   Google Scholar
• Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–174. doi:10.2307/2529310.
   PubMed Web of Science ®Google Scholar
• Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment. 1994;6(4):284–290. doi:10.1037/1040-3590.6.4.284.
   Google Scholar
• Davis DA, Mazmanian PE, Fordis M, et al. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA. 2006;296(9):1094–1102. doi:10.1001/jama.296.9.1094.
   PubMed Web of Science ®Google Scholar
• Tai J, Molloy E, Haines T, et al. Same-level peer-assisted learning in medical clinical placements: a narrative systemic review. Med Educ. 2016;50(4):469–484. doi:10.1111/medu.12898.
   PubMed Web of Science ®Google Scholar
• Chandawarkar RY, Ruscher KA, Krajewski A, et al. Pretraining and posttraining assessment of residents’ performance in the fourth Accreditation Council for Graduate Medical Education competency. Arch Surg. 2011;146(8):916–921. doi:10.1001/archsurg.2011.167.
   PubMedGoogle Scholar
• Pfeiffer CA, Kosowicz LY, Holmboe E, et al. Face-to-face clinical skills feedback: Lessons from the analysis of standardized patient' work. Teach Learn Med. 2005;17(3):254–256. doi:10.1207/s15328015tlm1703_9.
   PubMed Web of Science ®Google Scholar
• Wagner JA, Pfeiffer CA, Harrington KL. Evaluation of online instruction to improve medical and dental students’ communication and counseling skills. Eval Health Prof.. 2011;34:383–397. doi:10.1177/0163278710380612.
   PubMed Web of Science ®Google Scholar
• Burgess A, McGregor D, Mellis C. Medical students as peer tutors: a systematic review. BMC Med Educ. 2014;14(1)doi:10.1186/1472-6920-14-115.
   Google Scholar
• Ross MT, Cumming AD. Peer-assisted learning In: Dent JA, Harden RM, eds. A Practical Guide for Medical Teachers. Fourth Ed. New York: Elsevier; 2013. 134.
   Google Scholar