A Novel Approach to Assessing Professionalism in Preclinical Medical Students Using Multisource Feedback Through Paired Self- and Peer Evaluations

References

• Swick HM, Szenas P, Danoff D, Whitcomb ME. Teaching professionalism in undergraduate medical education. Journal of the American Medical Association 1999;282:830–2.
   PubMed Web of Science ®Google Scholar
• Epstein RM, Hundert EM. Defining and assessing professional competence. Journal of the American Medical Association 2002;287:226–35.
   PubMed Web of Science ®Google Scholar
• Pulito AR Donnelly MB, Plymale M, Mentzer RM Jr. What do faculty observe of medical students' clinical performance? Teaching and Learning in Medicine 2006;18:99–104.
   PubMed Web of Science ®Google Scholar
• Barrett A, Galvin R, Steinert Y, Scherpbier A, O'Shaughnessy A, Horgan M, et al. A BEME review of the use of workplace-based assessment in identifying and remediating underperformance among postgraduate medical trainees. Medical Teacher 2016;18:1188–98.
   Web of Science ®Google Scholar
• Donnon T, Al Ansary A, Al Alawi S, Violato C. The reliability, validity, and feasibility of multisource feedback physician assessment: A systematic review. Academic Medicine 2014;89:511–6.
   PubMed Web of Science ®Google Scholar
• Naidoo S, Lopes S, Patterson F, Mead HM, and MacLeod S. Can colleagues', patients', and supervisors' assessments predict successful completion of postgraduate medical training? Medical Education. Epub 2016 November 23.
   Google Scholar
• Warm EJ, Schauer D, Revis B, Boex JR. Multisource feedback in the ambulatory setting. Journal of Graduate Medical Education 2010;2:269–77.
   PubMedGoogle Scholar
• Eva KW. Assessing tutorial-based assessment. Advances in Health Sciences Education 2001;6:243–57.
   PubMed Web of Science ®Google Scholar
• Arnold L. Assessing professional behavior: Yesterday, today, and tomorrow. Academic Medicine 2002;77:502–15.
   PubMed Web of Science ®Google Scholar
• Bryan RE, Krych AJ, Carmichael SW, Viggiano TR, Pawlina W. Assessing professionalism in early medical education: Experience with peer evaluation and self-evaluation in the gross anatomy course. Annals, Academy of Medicine, Singapore 2005;34:486–91.
   PubMed Web of Science ®Google Scholar
• Dannefer EF, Henson LC, Bierer SB, Grady–Weliky TA, Meldrum S, Nofziger AC, et al. Peer assessment of professional competence. Medical Education 2005;39:713–22.
   PubMed Web of Science ®Google Scholar
• Cottrell S, Diaz S, Cather A, Shumway J. Assessing medical student professionalism: An analysis of peer assessment. Medical Education Online 2006;11:8.
   Google Scholar
• Lurie SJ, Lambert DR, Nofziger AC, Epstein RM, Grady-Weliky TA. Relationship between peer assessment during medical school, dean's letter rankings, and ratings by internship directors. Journal of General Internal Medicine 2007;22:13–16.
   PubMed Web of Science ®Google Scholar
• Papinczak T, Young L, Groves M, Haynes M. An analysis of peer, self, and tutor assessment in problem-based learning tutorials. Medical Teacher 2007;29:e122–32.
   PubMed Web of Science ®Google Scholar
• Kamp RJA, Dolmans DHJM, van Berkel HJM, Schmidt HG. Can students adequately evaluate the activities of their peers in PBL? Medical Teacher 2011;33:145–50.
   PubMed Web of Science ®Google Scholar
• Speyer R, Pilz W, van der Kruis J, Brunngs JW. Reliability and validity of student peer assessment in medical education: A systematic review. Medical Teacher 2011;33:e572–85.
   PubMed Web of Science ®Google Scholar
• Colthart I, Bagnall G, Evans A, Allbutt H, Haig A, Illing J, et al. The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide No. 10. Medical Teacher 2008;30:124–45.
   PubMed Web of Science ®Google Scholar
• Rose JS, Waibel BH, Schenarts PJ. Disparity between resident and faculty surgeons' perceptions of preoperative preparation, intraoperative teaching, and postoperative feedback. Journal of Surgical Education 2011;68:459–64.
   PubMed Web of Science ®Google Scholar
• Lipsett PA, Harris I, Downing S. Resident self-other assessor agreement. Archives of Surgery 2011;146:901–6.
   PubMedGoogle Scholar
• Gow KW. Self-evaluation: How well do surgery residents judge performance on a rotation? The American Journal of Surgery 2013;205:557–62.
   PubMed Web of Science ®Google Scholar
• Kruger J, Dunning D. Unskilled and unware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 1999;77:1121–34.
   PubMed Web of Science ®Google Scholar
• Morihara SK, Jackson DS, Chun MB. Making the professional curriculum for undergraduate medical education more relevant. Medical Teacher 2013;35:908–14.
   PubMed Web of Science ®Google Scholar
• ten Cate O, Chen HC. The parts, the sum and the whole—Evaluating students in teams. Medical Teacher 2016;38:639–41.
   PubMed Web of Science ®Google Scholar
• Rees CE, Knight LV. The trouble with assessing students' professionalism: Theoretical insights from sociocognitive psychology. Academic Medicine 2007;82:46–50.
   PubMed Web of Science ®Google Scholar
• Parmelee DX, Hudes P. Team-based learning: A relevant strategy in health professionals' education. Medical Teacher 2012;34:411–3.
   PubMed Web of Science ®Google Scholar
• Levine RE. Peer evaluation in team-based learning. In L Michaelsen, D Parmelee, KK McMahon, RE Levine (Eds.), Team-based learning for health professions education: A guide to using small groups for improved learning. Sterling: Stylus, 2007.
   Google Scholar
• Agresti A. Categorical data analysis. New York: Wiley & Sons, 1990.
   Google Scholar
• SAS® 9.3. System Options. 2nd Ed. Cary, NC: SAS Institute, 2011.
   Google Scholar
• Norcini J, Burch V. Workplace-based assessments as an education tool: AMEE Guide No. 31. Medical Teacher 2007;29:855–71.
   PubMed Web of Science ®Google Scholar
• McSweeney K. Assessment for learning: From theory to practice: Final report. September 2012.
   Google Scholar
• Holmoboe ES. Faculty and the observation of trainees' clinical skills: Problems and opportunities. Academic Medicine 2004;79:16–22.
   PubMed Web of Science ®Google Scholar
• Epstein RM. Assessment in medical education. The New England Journal of Medicine 2007;356:387–96.
   PubMed Web of Science ®Google Scholar
• Ferris H, O'Flynn D. Assessment in medical education: What are we trying to achieve? International Journal of Higher Education 2015;4:139–44.
   Google Scholar
• Lockyer J. Multisource feedback: Can it meet criteria for good assessment? Journal of Continuing Education in the Health Professions 2013;33:89–98.
   PubMed Web of Science ®Google Scholar
• Epstein RM, Dannefer EF, Nofziger AC, Hansen JT, Schultz SH, Jospe N, et al. Comprehensive assessment of professional competence: The Rochester Experiment. Teaching and Learning in Medicine 2004;16:186–96.
   PubMed Web of Science ®Google Scholar
• Al-Wardy NM. Assessment methods in undergraduate medical education. QU Medical Journal 2010;10:203–9.
   Google Scholar
• Hauer KE, Ciccone A, Henzel TR, Katsufrakis P, Miller SH, Norcross WA, et al. Remediation of the deficiencies of physicians across the continuum from medical school to practice: A thematic review of the literature. Academic Medicine 2009;84:1822–32.
   PubMed Web of Science ®Google Scholar
• Ziring D, Danoff D, Grosseman S, Langer D, Esposito A, Jan MK, et al. How do medical schools identify and remediate professionalism lapses in medical students? A study of U.S. and Canadian medical schools. Academic Medicine 2015;90:913–20.
   PubMed Web of Science ®Google Scholar
• Yates J, James D. Predicting the “strugglers”: A case-control study of students at Nottingham University Medical School. British Medical Journal 2006;332:1009–13. doi:10.1136/bmj.38730.678310.63
   PubMed Web of Science ®Google Scholar
• Cleland J, Arnold R, Chesser Al. Failing finals is often a surprise for the student but not the teacher: Identifying difficulties and supporting students with academic difficulties. Medical Teacher 2005;27:504–8.
   PubMed Web of Science ®Google Scholar
• Cleland J, Leggett H, Sandars J, Costa MJ, Patel R, Moffat M. The remediation challenge: Theoretical and methodological insights from a systematic review. Medical Education 2013;47:242–51.
   PubMed Web of Science ®Google Scholar
• Fargen KM, Drolet BC, Philibert I. Unprofessional behaviors among tomorrow's physicians: Review of the literature with a focus on risk factors, temporal trends, and future directions. Academic Medicine 2016;91:858–64.
   PubMed Web of Science ®Google Scholar
• Papadakis MA, Hodgson CS, Tererani A, Kohatsu ND. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Academic Medicine 2004;79:244–9.
   PubMed Web of Science ®Google Scholar
• Papadakis MA, Teherani A, Branch MA, Knetter TR Rattner SL, Stern DT, et al. Disciplinary action by medical boards and prior behavior in medical school. The New England Journal of Medicine 2005;353:2673–82.
   PubMed Web of Science ®Google Scholar
• Papadakis MA, Loeser H, Heady K. Early detection and evaluation of professionalism deficiencies in medical students: One school's approach. Academic Medicine 2001;76:1100–6.
   PubMed Web of Science ®Google Scholar
• Spandorfer J, Puklus T, Rose V, Vahedi M, Collins L, Giordano C, et al. Peer assessment among first year medical students in anatomy. Anatomical Sciences Education 2014;7:144–52.
   PubMed Web of Science ®Google Scholar
• Antonelli MA. Accuracy of second-year medical students' self-assessment of clinical skills. Academic Medicine 1997;72:563–5.
   PubMed Web of Science ®Google Scholar
• Tousignant M, DesMarchais JE. Accuracy of student self-assessment ability compared to their own performance in a problem-based learning medical program: A correlation study. Advances in Health Sciences Education 2002;7:19–27.
   PubMed Web of Science ®Google Scholar
• Roberts C, Stark P. Readiness for self-directed change in professional behaviors: Factorial validation of the Self-reflection and Insight Scale. Medical Education 2008;42:1054–63.
   PubMed Web of Science ®Google Scholar