Assessment of medical professionalism: Who, what, when, where, how, and … why?

References

• http://www.aamc.org/meded/msop/, AAMC. 1998. Report 1. Learning objectives for medical student education: Guidelines for medical schools
   Google Scholar
• ABIM Foundation. American Board of Internal Medicine, ACP-ASIM Foundation, European Federation of Internal Medicine: Medical professionalism in the new millennium: A physician charter. Ann Intern Med 2002; 136: 243–246
   PubMed Web of Science ®Google Scholar
• http://www.acgme.org/outcome/comp/GeneralCompetenciesStandards21307.pdf, ACGME. 2007. Common program requirements: General competencies standards 21307
   Google Scholar
• Albanese M. Rating educational quality: Factors in the erosion of professional standards. Acad Med 1999; 74(6)652–658
   PubMed Web of Science ®Google Scholar
• Archer JC, Norcini J, Davies HA. Use of SPRAT for peer review of paediatricians in training. Br Med J 2005; 330(7502)1251–1253
   PubMed Web of Science ®Google Scholar
• Arnold L. Assessing professional behavior: Yesterday, today and tomorrow. Acad Med 2002; 77(6)502–515
   PubMed Web of Science ®Google Scholar
• Arnold EL, Blank LL, Race KEH, Cipparrone N. Can professionalism be measured? The development of a scale for use in the medical environment. Acad Med 1998; 73(10)1119–1121
   PubMed Web of Science ®Google Scholar
• Arnold L, Stern DT. What is Medical Professionalism?. Measuring medical professionalism, Stern DT. Oxford University Press, New York, NY 2006; 15–37
   Google Scholar
• Bonke B. Unprofessional or problematic behaviour of medical students outside the learning environment. Med Teach 2006; 28(5)440–442
   PubMed Web of Science ®Google Scholar
• Boon K, Turner J. Ethical and professional conduct of medical students: A review of current assessment measures and controversies. J Med Ethics 2004; 30(2)221–226
   PubMed Web of Science ®Google Scholar
• Brinkman WB, Geraghty SR, Lanphear BP, Khoury JC, Gonzalez JA, DeWitt TG, Britto MT. The effect of multisource feedback on resident communication skills and professionalism. Arch Pediatr Adolesc Med 2007; 161(1)44–49
   PubMedGoogle Scholar
• Butterfield PS, Mazzaferri EL. A new rating form for use by nurses in assessingresidents’ humanistic behavior. J Gen Intern Med 1991; 6(2)155–161
   PubMed Web of Science ®Google Scholar
• Colliver JA, Willis MS, Robbs RS, Cohen DS, Swartz MH. Assessment of empathy in a standardized-patient examination. Teach Learn Med 1998; 10(1)8–11
   Web of Science ®Google Scholar
• Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. Effect of rater training on reliability and accuracy of mini-CEX scores: A randomized, controlled trial. J Gen Intern Med 2008; 24(1)74–79
   PubMed Web of Science ®Google Scholar
• Coulehan J, Williams PC. Vanquishing virtue: The impact of medical education. Acad Med 2001; 76(6)598–605
   PubMed Web of Science ®Google Scholar
• Cruess RL, Cruess SR. Teaching professionalism: General principles. Med Teach 2006; 28(3)205–208
   PubMed Web of Science ®Google Scholar
• Cruess R, McIlroy JH, Cruess S, Ginsburg S, Steinert Y. The Professionalism Mini-Evaluation Exercise: A preliminary investigation. Acad Med 2006; 81(10 Suppl)S74–S78
   PubMed Web of Science ®Google Scholar
• Dannefer EF, Henson LC, Bierer SB, Grady-Weliky TA, Meldrum S, Nofzigerv AC, Barclay C, Epstein RM. Peer assessment of professional competence. Med Educ 2005; 39(7)713–722
   PubMed Web of Science ®Google Scholar
• Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: A systematic review. JAMA 2006; 296(9)1094–1102
   PubMed Web of Science ®Google Scholar
• DeLisa JA, Foye PM, Jain SS, Kirshblum S, Christodoulou C. Measuringprofessionalism in a physiatry residency training program. Am J Phys Med Rehabil 2001; 80(3)225–229
   PubMed Web of Science ®Google Scholar
• Eva KW, Regehr G. Self-assessment in the health professions: A reformulation and research agenda. Acad Med 2005; 80(suppl 10)S46–S54
   PubMed Web of Science ®Google Scholar
• Friedman Ben David M, Davis MH, Harden RM, Howie PW, Ker J, Pippard MJ. AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment. Med Teach 2001; 23(6)535–551
   PubMed Web of Science ®Google Scholar
• Feudtner C, Christakis DA, Christakis NA. Do clinical clerks suffer ethical erosion? Students’ perceptions of their ethical development and personal development. Acad Med 1994; 69(8)670–679
   PubMed Web of Science ®Google Scholar
• http://en.wikipedia.org/wiki/Five_Ws, Five Ws. 2008 Wikipedia
   Google Scholar
• Gerrity MS, Mahaffy J. Evaluating change in medical school curricula: How did we know where we were going?. Acad Med 1998; 73(suppl 9)S55–S59
   PubMed Web of Science ®Google Scholar
• Ginsburg S, Regehr G, Hatala R, McNaughton N, Frohna A, Hodges B, Lingard L, Stern D. Context, conflict and resolution: A new conceptual framework for evaluating professionalism. Acad Med 2000; 75(Suppl 10)S6–S11
   PubMed Web of Science ®Google Scholar
• Ginsburg S, Rehehr G, Lingard L. Basing the evaluation of professionalism on observable behaviors: A cautionary tale. Acad Med 2004; 10(suppl)S1–S4
   Web of Science ®Google Scholar
• Goldie J. Integrating professionalism teaching into undergraduate medical education in the UK setting. Med Teach 2008; 30(5)513–527
   PubMed Web of Science ®Google Scholar
• https://gmpusa.org/, Guide to Good Medical Practice – USA (2008). Version 1.0, September 6, 2008
   Google Scholar
• Hafferty FW, Franks R. The hidden curriculum, ethics teaching, and the structure of medical education. Acad Med 1994; 69(11)861–871
   PubMed Web of Science ®Google Scholar
• Haidet P, Kelly A, Chou C, the Communication, Curriculum and Culture Study Group. Characterizing the patient-centeredness of hidden curricula in medical schools: Development and validation of a new measure. Acad Med 2005; 80(1)44–50
   PubMed Web of Science ®Google Scholar
• Hall W, Violato C, Lewkonia R, Lockyer J, Fidler H, Toews J, Jennett P, Donoff M, Moores D. Assessment of physician performance in Alberta: The Physician Achievement Review. CMAJ 1999; 161(1)52–7
   PubMed Web of Science ®Google Scholar
• Harden RM. How to assess students: An overview. Med Teach 1979; 1(2)65–70
   PubMed Web of Science ®Google Scholar
• Hauenstein NMA. Training raters to increase the accuracy of appraisals and the usefulness of feedback. Performance appraisal: State of the art in practice, JW Smithers. Jossey-Bass Inc, San Francisco, CA 1998; 404–442
   Google Scholar
• Hawkins RE, Holmboe ES. Constructing an evaluation system for an educational program. A practical guide to the evaluation of clinical competence, ES Holmboe, RE Hawkins. Elsevier, Philadelphia, PA 2008; 216–237
   Google Scholar
• Hemmer PA, Hawkins R, Jackson JL, Pangaro LN. Assessing how well three evaluation methods detect deficiencies in medical student's professionalism in two settings of an internal medicine clerkship. Acad Med 2000; 75(2)167–173
   PubMed Web of Science ®Google Scholar
• Herbers JE, Noel GL, Cooper GS, Harvey J, Pangaro LN, Weaver MJ. How accurate are faculty evaluations of clinical competence?. J Gen Intern Med 1989; 4(3)202–204
   PubMed Web of Science ®Google Scholar
• Hewson MG, Little ML. Giving feedback in medical education: Verification of recommended techniques. J Gen Intern Med 1998; 13(2)111–116
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Hawkins RE. Effects of training in direct observation of medical residents’ clinical competence; A randomized trial. Ann Intern Med 2004; 140(11)874–881
   PubMed Web of Science ®Google Scholar
• Kalet A, Earp JA, Kowlowitz V. How well do faculty evaluate the interviewing skills of medical students?. J Gen Intern Med 1992; 7(5)499–505
   PubMed Web of Science ®Google Scholar
• Kane MT. Validation. Educational measurement, RL Brennan. American Council on Education and Praeger Publishers, Westport, CT 2006; 17–64
   Google Scholar
• Kroboth FJ, Hanusa BH, Parker S, Coulehan JL, Kapoor WN, Brown FH, Karpf M, Levey GS. The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 1992; 7(2)174–179
   PubMed Web of Science ®Google Scholar
• Lievens F, Sanchez JI. Can training improve the quality of inferences made by raters in competency modeling? A quasi-experiment. J Appl Psychol 2007; 92(3)812–819
   PubMed Web of Science ®Google Scholar
• Lipner RS, Blank LL, Leas BF, Fortna GS. The value of patient and peer ratings in recertification. Acad Med 2002; 77(Suppl 10)S64–S66
   PubMed Web of Science ®Google Scholar
• Littlefield J, Paukert J, Schoolfield J. Quality assurance data for residents’ global performance ratings. Acad Med 2001; 76(suppl 10)S102–S104
   PubMed Web of Science ®Google Scholar
• Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof 2003; 23(1)4–12
   PubMedGoogle Scholar
• Lockyer JM, Clyman SG. Multisource Feedback (360-degree Evaluation). A practical guide to the evaluation of clinical competence, ES Holmboe, RE Hawkins. Elsevier, Philadelphia, PA 2008; 75–85
   Google Scholar
• Lockyer JM, Violato C, Fidler H. A multi source feedback program for Anesthesiologists. Can J Anesthesiol 2006; 53(1)33–39
   PubMed Web of Science ®Google Scholar
• Lynch DC, Surdyk PM, Eiser AR. Assessing professionalism: A review of the literature. Med Teach 2004; 26(4)366–373
   PubMed Web of Science ®Google Scholar
• Mazor K, Canavan C, Farrell M, Margolis MJ, Clauser BE. Collecting validity evidence for an assessment of professionalism: Findings from think-aloud interviews. Acad Med 2008; 83(Suppl 10)S9–S12
   PubMed Web of Science ®Google Scholar
• Mazor K, Clauser B, Field T, Yood R, Gurwitz J. A demonstration of the impact of response bias on patient satisfaction surveys. Health Serv Res 2002; 37(5)1403–1417
   PubMed Web of Science ®Google Scholar
• Mazor K, Clauser BE, Holtman M, Margolis M. Evaluation of missing data in an assessment of professional behaviors. Acad Med 2007; 82(suppl 10)S44–S47
   PubMed Web of Science ®Google Scholar
• McIntyre RM, Smith DE, Hasset CE. Accuracy of performance ratings as affected by rater training and purpose of rating. J Appl Psychol 1984; 69(1)147–156
   Web of Science ®Google Scholar
• Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990; 65(Suppl 9)S63–S67
   PubMed Web of Science ®Google Scholar
• http://professionalbehaviors.nbme.org/2008ListofBehaviors.pdf, NBME (2007) Assessment of professional behaviors project: List of behaviors
   Google Scholar
• Noel GL, Herbers JE, Caplow MP, Cooper GS, Pangaro LN, Harvey J. How well do internal medicine faculty members evaluate the clinical skills of residents?. Ann Intern Med 1992; 117(9)757–65
   PubMed Web of Science ®Google Scholar
• Noonan LE, Sulsky LM. Impact of frame-of-reference and behavioral observation training on alternative training effectiveness criteria in a Canadian military sample. Hum Perform 2001; 14(1)3–26
   Web of Science ®Google Scholar
• Norcini JJ. Peer assessment of competence. Med Educ 2003; 37(6)539–543
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Holmboe ES, Hawkins RE. Evaluation challenges in the era of outcomes-based education. A practical guide to the evaluation of clinical competence, ES Holmboe, RE Hawkins. Elsevier, Philadelphia, PA 2008; 1–9
   Google Scholar
• Papadakis M, Loeser H. Using critical incident reports and longitudinal observations to assess professionalism. Measuring medical professionalism, DT Stern. Oxford University Press, New York, NY 2006; 159–173
   Google Scholar
• Prislin MD, Lie D, Shapiro J, Boker J, Radecki S. Using standardized patients to assess medical students’ professionalism. Acad Med 2001; 76(suppl 10)S90–S92
   PubMed Web of Science ®Google Scholar
• Ramsey PG, Carline JD, Blank LL, Wenrich MD. Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physicians. Acad Med 1996; 71(4)364–370
   PubMed Web of Science ®Google Scholar
• Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA 1993; 269(13)1655–1660
   PubMed Web of Science ®Google Scholar
• Raymond MR. Job analysis and the specification of content for licensure and certification examinations. Appl Meas Educ 2001; 14(4)369–415
   Web of Science ®Google Scholar
• Reddy ST, Farnan JM, Yoon JD, Troy L, Upadhyay GA, Humphrey HJ, Arora VM. Third-year medical students’ participation in and perceptions of unprofessional behaviors. Acad Med 2007; 82(Suppl 10)S35–S39
   PubMed Web of Science ®Google Scholar
• Rees C, Shepherd M. The acceptability of 360-degree judgements as a method of assessing undergraduate medical students’ personal and professional behaviors. Med Educ 2005; 39(1)49–57
   PubMed Web of Science ®Google Scholar
• Robins LS, White CB, Alexander GL, Gruppen LD, Grum CM. Assessing medical students awareness of and sensitivity to diverse health beliefs using a standardized patient station. Acad Med 2001; 76(1)76–80
   PubMed Web of Science ®Google Scholar
• Roch SG, O'Sullivan BJ. Frame of reference rater training issues: Recall, time and behavior observation training. Int J Training Dev 2003; 7(2)93–107
   Google Scholar
• Sergeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J. Challenges in multisource feedback: Intended and unintended outcomes. Med Educ 2007; 41(6)583–591
   PubMed Web of Science ®Google Scholar
• Scott T, Mannion R, Davies H, Marshall M. The quantitative measurement of organizational culture in healthcare: A review of the available instruments. Health Serv Res 2003; 38(3)923–945
   PubMed Web of Science ®Google Scholar
• Shumway JM, Harden RM. AMEE Guide No. 25: The assessment of learning outcomes for the competent and reflective physician. Med Teach 2003; 25(6)56–584
   Web of Science ®Google Scholar
• Singer PA, Cohen R, Rothman A. The ethics objective structured clinical examination. J Gen Intern Med 1993; 8(1)23–28
   PubMed Web of Science ®Google Scholar
• Smith DE. Training programs for performance appraisal: A review. Acad Manage Rev 1986; 11(1)22–40
   Web of Science ®Google Scholar
• Srinivasan M, Litzelman D, Seshadri R, Lane K, Zhou W, Bogdewic S, Gaffney M, Galvin M, Mitchell G, Treadwell P, et al. Developing an OSTE to address lapses in learners’ professional behavior and an instrument to code educators’ responses. Acad Med 2004; 79(9)888–896
   PubMed Web of Science ®Google Scholar
• Steinert Y, Cruess S, Cruess R, Snell L. Faculty development for teaching and evaluating professionalism: From programme design to curriculum change. Med Educ 2005; 39(2)127–136
   PubMed Web of Science ®Google Scholar
• Stern DT. A framework for measuring professionalism. Measuring medical professionalism, DT Stern. Oxford University Press, New York, NY 2006; 3–13
   Google Scholar
• Stern DT, Frohna AZ, Gruppen LD. The prediction of professional behavior. Med Educ 2005; 39(1)75–82
   PubMed Web of Science ®Google Scholar
• Sulsky LM, Day DV. Frame-of-reference training and cognitive categorization: An empirical investigation of rater memory issues. J Appl Psychol 1992; 77(4)501–510
   PubMed Web of Science ®Google Scholar
• Ten Cate TJ, De Haes JCJM. Summative assessment of medical students in the affective domain. Med Teach 2000; 22(1)40–43
   Web of Science ®Google Scholar
• Van Zanten M, Boulet JR, Norcini JJ, McKinley D. Using a standardized patient assessment to measure professional attributes. Med Educ 2005; 39(1)20–29
   PubMed Web of Science ®Google Scholar
• Veloski JJ, Fields SK, Boex JR, Blank LL. Measuring professionalism: A review of studies with instruments reported in the literature between 1982 and 2002. Acad Med 2005; 80(4)3–370
   Web of Science ®Google Scholar
• Violato C, Lockyer J. Self and peer assessment of pediatricians, psychiatrists and medicine specialists: Implications for self-directed learning. Adv Health Sci Educ 2006; 11(3)235–244
   PubMed Web of Science ®Google Scholar
• Violato C, Lockyer J, Fidler H. Multisource feedback: A method of assessing surgical practice. Br Med J 2003; 326(7388)546–8
   PubMed Web of Science ®Google Scholar
• Violato C, Lockyer JM, Fidler H. Assessment of pediatricians by a regulatory authority. Pediatrics 2006; 117(3)796–802
   PubMed Web of Science ®Google Scholar
• Violato C, Marini A, Toews J, Lockyer J, Fidler H. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians. Acad Med 1997; 72(Suppl 10)S82–S84
   PubMed Web of Science ®Google Scholar
• Wenrich MD, Carline JD, Giles LM, Ramsey PG. Ratings of the performance of practicing internists by hospital-based registered nurses. Acad Med 1993; 68(9)680–687
   PubMed Web of Science ®Google Scholar
• Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med 2003; 15(4)270–292
   PubMed Web of Science ®Google Scholar
• Woehr DJ, Huffcutt AI. Rater training for performance appraisal: A quantitative review. J Occup Organ Psychol 1994; 67: 189–205
   Web of Science ®Google Scholar
• Woodward CA. Program evaluation. International handbook of research in Medical Education, GR Norman, CPM van der Vleuten, DI Newble. Kluwer Academic Publishers, Dordrecht 2002; 127–155
   Google Scholar
• Woolliscroft JO, Howell JD, Patel BP, Swanson DB. Resident–patient interactions: The humanistic qualities of internal medicine residents assessed by patients, attending physicians, program supervisors, and nurses. Acad Med 1994; 69(3)216–224
   PubMed Web of Science ®Google Scholar