Influences on the implementation of Mini-CEX and DOPS for postgraduate medical trainees’ learning: A grounded theory study

References

• Archer JC. 2010. State of the science in health professional education: effective feedback. Med Educ. 44:101–108.
   PubMed Web of Science ®Google Scholar
• Billett S. 2008. Learning throughout working life: a relational interdependence between personal and social agency. Br J Educ Stu. 56:39–58.
   Web of Science ®Google Scholar
• Bindal T, Wall D, Goodyear H. 2011. Trainee doctors' views on workplace-based assessments: are they just a tick box exercise? Med Teach. 33:919–927.
   PubMed Web of Science ®Google Scholar
• Black P, Wiliam D. 2009. Developing the theory of formative assessment. Educ Asse Eval Acc. 21:5–31.
   Web of Science ®Google Scholar
• Bok HGJ, Jaarsma DADC, Spruijt A, Van Beukelen P, Van Der Vleuten CPM, Teunissen PW. 2016. Feedback-giving behaviour in performance evaluations during clinical clerkships. Med Teach. 38:88–95.
   PubMed Web of Science ®Google Scholar
• Boud D. 2015. Feedback: ensuring that it leads to enhanced learning. Clin Teach. 12:3–7.
   PubMed Web of Science ®Google Scholar
• Brazil V, Ratcliffe L, Zhang J, Davin L. 2012. Mini-CEX as a workplace-based assessment tool for interns in an emergency department–does cost outweigh value? Med Teach. 34:1017–1023.
   PubMed Web of Science ®Google Scholar
• Castanelli DJ, Jowsey T, Chen Y, Weller JM. 2016. Perceptions of purpose, value, and process of the mini-clinical evaluation exercise in anesthesia training. Can J Anesth/J Can Anesth. 63:1345.
   PubMed Web of Science ®Google Scholar
• Charmaz K. 2006. Constructing grounded theory: a practical guide through qualitative analysis. Thousand Oaks: Sage.
   Google Scholar
• Durlak JA, DuPre EP. 2008. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Commun Psychol. 41:327–350.
   PubMed Web of Science ®Google Scholar
• Fleming VM, Schindler N, Martin GJ, DaRosa DA. 2005. Separate and equitable promotion tracks for clinician-educators. JAMA. 294:1101–1104.
   PubMed Web of Science ®Google Scholar
• Flottorp S, Håvelsrud K, Oxman AD. 2003. Process evaluation of a cluster randomized trial of tailored interventions to implement guidelines in primary care—why is it so hard to change practice? Family Pract. 20:333–339.
   PubMed Web of Science ®Google Scholar
• FMH. 2017. Workplace-based assessment sheet. https://www.fmh.ch/files/pdf16/assessmentbogen_kombi_gen_JB_d_20131010.pdf.
   Google Scholar
• Grol R, Grimshaw J. 2003. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 362:1225–1230.
   PubMed Web of Science ®Google Scholar
• Grol R, Wensing M. 2004. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 180:S57
   PubMed Web of Science ®Google Scholar
• Hauer KE, Holmboe ES, Kogan JR. 2011. Twelve tips for implementing tools for direct observation of medical trainees’ clinical skills during patient encounters. Med Teach. 33:27–33.
   PubMed Web of Science ®Google Scholar
• Hengameh H, Afsaneh R, Morteza K, Hosein M, Marjan SM, Ebadi A. 2015. The effect of applying Direct Observation of Procedural Skills (DOPS) on nursing students’ clinical skills: a randomized clinical trial. GJHS. 7:17–21.
   Google Scholar
• Jackson D, Wall D. 2010. An evaluation of the use of the Mini-CEX in the foundation programme. Br J Hosp Med (Lond). 71:584–588.
   PubMed Web of Science ®Google Scholar
• Karanth KL, Kanagasabai S, Ibrahim SB, Najimuddin M, Marasinghe DK, De S. 2015. Structured program for final-year undergraduate students to improve clinical skills to prepare for effective patient management. Internet J Gynecol Obstet. 19. DOI:10.5580/IJGO.28355
   Google Scholar
• Kim S, Willett LR, Noveck H, Patel MS, Walker JA, Terregino CA. 2016. Implementation of a Mini-CEX requirement across all third-year clerkships. Teach Learn Med. 28:424–431.
   PubMed Web of Science ®Google Scholar
• Kluger A, DeNisi A. 1996. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 119:254–284.
   Web of Science ®Google Scholar
• Kogan JR, Conforti LN, Bernabeo EC, Durning SJ, Hauer KE, Holmboe ES. 2012. Faculty staff perceptions of feedback to residents after direct observation of clinical skills. Med Educ. 46:201–215.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Hatala R, Hauer KE, Holmboe E. 2017. Guidelines: the do’s, don’ts and don’t knows of direct observation of clinical skills in medical education. Perspect Med Educ. 6:286–305.
   PubMed Web of Science ®Google Scholar
• Kotter JP. 1995. Leading change: why transformation efforts fail. Harvard Business Review.
   Google Scholar
• Lau Yanting S, Sinnathamby A, Wang D, Tan Mong Heng M, Leong Wen Hao J, Lee SS, Yeo SP, Samarasekera DD. 2016. Conceptualizing workplace based assessment in Singapore: undergraduate mini-clinical evaluation exercise experiences of students and teachers. Tzu Chi Med J. 28:113–120.
   Web of Science ®Google Scholar
• Lefroy J, Watling C, Teunissen PW, Brand P. 2015. Guidelines: the do's, don'ts and don't knows of feedback for clinical education. Perspect Med Educ. 4:284–299.
   PubMed Web of Science ®Google Scholar
• Lingard L, Albert M, Levinson W. 2008. Grounded theory, mixed methods, and action research. BMJ. 337:a567.
   PubMed Web of Science ®Google Scholar
• Lörwald AC, Lahner F-M, Greif R, Berendonk C, Norcini J, Huwendiek S. 2018. Factors influencing the educational impact of Mini-CEX and DOPS: a qualitative synthesis. Med Teach. 40:414–420.
   PubMed Web of Science ®Google Scholar
• Lörwald AC, Lahner F-M, Nouns ZM, Berendonk C, Norcini J, Greif R, Huwendiek S. 2018. The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its association with implementation: a systematic review and meta-analysis. PloS One. 13:e0198009.
   PubMed Web of Science ®Google Scholar
• Lovell B. 2018. What do we know about coaching in medical education? A literature review. Med Educ. 52:376–390.
   PubMed Web of Science ®Google Scholar
• Malhotra S, Hatala R, Courneya CA. 2008. Internal medicine residents' perceptions of the mini-clinical evaluation exercise. Med Teach. 30:414–419.
   PubMed Web of Science ®Google Scholar
• Morris A, Hewitt J, Roberts CM. 2006. Practical experience of using directly observed procedures, mini clinical evaluation examinations, and peer observation in pre-registration house officer (FY1) trainees. Postgrad Med J. 82:285–288.
   PubMed Web of Science ®Google Scholar
• Nair BR, Alexander HG, McGrath BP, Parvathy MS, Kilsby EC, Wenzel J, Frank IB, Pachev GS, Page GG. 2008. The Mini Clinical Evaluation Exercise (Mini-CEX) for assessing clinical performance of international medical graduates. Med J Aust. 189:159–161.
   PubMed Web of Science ®Google Scholar
• Norcini J, Burch V. 2007. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 29:855–871.
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Blank LL, Arnold GK, Kimball HR. 1995. The Mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med. 123:795–799.
   PubMed Web of Science ®Google Scholar
• Pelgrim EA, Kramer AW, Mokkink HG, van der Vleuten CP. 2012. The process of feedback in workplace-based assessment: organisation, delivery, continuity. Med Educ. 46:604–612.
   PubMed Web of Science ®Google Scholar
• Ridder JM, McGaghie WC, Stokking KM, Cate OTJ. 2015. Variables that affect the process and outcome of feedback, relevant for medical training: a meta‐review. Med Educ. 49:658–673.
   PubMed Web of Science ®Google Scholar
• Roghieh N, Fateme H, Hamid S, Hamid H. 2013. The effect of formative evaluation using “Direct Observation of Procedural Skills” (DOPS) method on the extent of learning practical skills among nursing students in the ICU. Iran J Nurs Midwifery Res. 18:290–293.
   PubMedGoogle Scholar
• Sabey A, Harris M. 2011. Training in hospitals: what do GP specialist trainees think of workplace-based assessments? Educ Primary Care. 22:90–99.
   PubMedGoogle Scholar
• SIWF. 2016. Weiterbildungsordnung (WBO). https://www.fmh.ch/files/pdf19/wbo_d.pdf: SIWF.
   Google Scholar
• Steinert Y, Cruess RL, Cruess SR, Boudreau JD, Fuks A. 2007. Faculty development as an instrument of change: a case study on teaching professionalism. Acad Med. 82:1057–1064.
   PubMed Web of Science ®Google Scholar
• Suhoyo Y, Schönrock-Adema J, Rahayu GR, Kuks JBM, Cohen-Schotanus J. 2014. Meeting international standards: a cultural approach in implementing the Mini-CEX effectively in Indonesian clerkships. Med Teach. 36:894–902.
   PubMed Web of Science ®Google Scholar
• Telio S, Ajjawi R, Regehr G. 2015. The “educational alliance” as a framework for reconceptualizing feedback in medical education. Acad Med. 90:609–614.
   PubMed Web of Science ®Google Scholar
• Veloski J, Boex JR, Grasberger MJ, Evans A, Wolfson DB. 2006. Systematic review of the literature on assessment, feedback and physicians’ clinical performance: BEME Guide No. 7. Med Teach. 28:117–128.
   PubMed Web of Science ®Google Scholar
• VERBI Software – Consult – Sozialforschung GmbH B, Germany. 1989-2017. MAXQDA, software for qualitative data analysis.
   Google Scholar
• Voyer S, Cuncic C, Butler DL, MacNeil K, Watling C, Hatala R. 2016. Investigating conditions for meaningful feedback in the context of an evidence-based feedback programme. Med Educ. 50:943–954.
   PubMed Web of Science ®Google Scholar
• Watling C, Driessen E, van der Vleuten CP, Vanstone M, Lingard L. 2013. Beyond individualism: professional culture and its influence on feedback. Med Educ. 47:585–594.
   PubMed Web of Science ®Google Scholar
• Watling C, Driessen E, van der Vleuten CPM, Lingard L. 2012. Learning from clinical work: the roles of learning cues and credibility judgements. Med Educ. 46:192–200.
   PubMed Web of Science ®Google Scholar
• Watling C, Driessen E, Vleuten CPM, Lingard L. 2014. Learning culture and feedback: an international study of medical athletes and musicians. Med Educ. 48:713–723.
   PubMed Web of Science ®Google Scholar
• Watling CJ, Lingard L. 2012. Grounded theory in medical education research: AMEE Guide No. 70. Med Teach. 34:850–861.
   PubMed Web of Science ®Google Scholar
• Weller JM, Jolly B, Misur MP, Merry AF, Jones A, Crossley JGM, Pedersen K, Smith K. 2009. Mini-clinical evaluation exercise in anaesthesia training. Br J Anaesth. 102:633–641.
   PubMed Web of Science ®Google Scholar
• Weller JM, Jones A, Merry AF, Jolly B, Saunders D. 2009. Investigation of trainee and specialist reactions to the mini-clinical evaluation exercise in anaesthesia: implications for implementation. Br J Anaesth. 103:524–530.
   PubMed Web of Science ®Google Scholar
• Weston PS, Smith CA. 2014. The use of Mini-CEX in UK foundation training six years following its introduction: lessons still to be learned and the benefit of formal teaching regarding its utility. Med Teach. 36:155–163.
   PubMed Web of Science ®Google Scholar
• Wragg A, Wade W, Fuller G, Cowan G, Mills P. 2003. Assessing the performance of specialist registrars. Clin Med (Lond). 3:131–134.
   PubMed Web of Science ®Google Scholar