The utility of mini-Clinical Evaluation Exercise in undergraduate and postgraduate medical education: A BEME review: BEME Guide No. 59

References

• Abadie Y, Battolla J, Zubieta A, Dartiguelongue J, Pascual C, Elías Costa C, Vassallo JC, Rodríguez S. 2015. Uso de descriptores durante la implementación de mini-cex en la residencia de pediatría. Medicina. 75(5):289–296.
   PubMed Web of Science ®Google Scholar
• Alves de Lima A, Barrero C, Baratta S, Castillo Costa Y, Bortman G, Carabajales J, Conde D, Galli A, Degrange G, Van DER Vleuten C. 2007. Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency training. Med Teach. 29(8):785–790.
   PubMed Web of Science ®Google Scholar
• Alves de Lima A, Conde D, Aldunate L, van der Vleuten C. 2010. Teachers’ experiences of the role and function of the mini clinical evaluation exercise in postgraduate training. Int J Med Educ. 1:68–73.
   Google Scholar
• Alves de Lima A, Conde D, Costabel J, Corso J, Van der Vleuten C. 2013. A laboratory study on the reliability estimations of the mini-CEX. Adv in Health Sci Educ. 18(1):5–13.
   PubMed Web of Science ®Google Scholar
• Alves de Lima A, Henquin R, Thierer J, Paulin J, Lamari S, Belcastro F, Van der Vleuten CP. 2005. A qualitative study of the impact on learning of the mini clinical evaluation exercise in postgraduate training. Med Teach. 27(1):46–52.
   PubMed Web of Science ®Google Scholar
• Ansari A, Ali SK, Donnon T. 2013. The construct and criterion validity of the mini-CEX: a meta-analysis of the published research. Acad Med. 88(3):413–420.
   PubMed Web of Science ®Google Scholar
• Berendonk C, Rogausch A, Gemperli A, Himmel W. 2018. Variability and dimensionality of students' and supervisors' mini-CEX scores in undergraduate medical clerkships a multilevel factor analysis. BMC Med Educ. 18(1):100.
   PubMed Web of Science ®Google Scholar
• Brazil V, Ratcliffe L, Zhang J, Davin L. 2012. Mini-CEX as a workplace-based assessment tool for interns in an emergency department–does cost outweigh value? Med Teach. 34(12):1017–1023.
   PubMed Web of Science ®Google Scholar
• Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C, et al. 2009. The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME guide no. 11. Med Teach. 31(4):282–298.
   PubMed Web of Science ®Google Scholar
• Castanelli DJ, Jowsey T, Chen Y, Weller JM. 2016. Perceptions of purpose, value, and process of the mini-Clinical Evaluation Exercise in anesthesia training. Can J Anesth/J Can Anesth. 63(12):1345–1356.
   PubMed Web of Science ®Google Scholar
• Chang Y-C, Chen C-K, Chen J-C, Liao C-H, Lee C-H, Chen Y-C, Ng C-J, Huang J-L, Lee S-T. 2013. Implementation of the mini-clinical evaluation exercise in postgraduate Year 1 residency training in emergency medicine: Clinical experience at Chang Gung Memorial Hospital. J Acute Med. 3(3):110–115.
   Google Scholar
• Chang YC, Lee CH, Chen CK, Liao CH, Ng CJ, Chen JC, Chaou CH. 2017. Exploring the influence of gender, seniority and specialty on paper and computer-based feedback provision during mini-CEX assessments in a busy emergency department. Adv in Health Sci Educ. 22(1):57–67.
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ. 2009. Does scale length matter? A comparison of nine- versus five-point rating scales for the mini-CEX. Adv in Health Sci Educ. 14(5):655–664.
   PubMed Web of Science ®Google Scholar
• Cook DA, Beckman TJ, Mandrekar JN, Pankratz VS. 2010. Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizability. Adv in Health Sci Educ. 15(5):633–645.
   PubMed Web of Science ®Google Scholar
• Cook DA, Bordage G, Schmidt HG. 2008. Description, justification and clarification: a framework for classifying the purposes of research in medical education. Med Educ. 42(2):128–133.
   PubMed Web of Science ®Google Scholar
• Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. 2009. Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial. J Gen Intern Med. 24(1):74–79.
   PubMed Web of Science ®Google Scholar
• Cruess R, McIlroy JH, Cruess S, Ginsburg S, Steinert Y. 2006. The Professionalism Mini-evaluation Exercise: a preliminary investigation. Acad Med. 81(Suppl):S74–S78.
   PubMed Web of Science ®Google Scholar
• Donato AA, Pangaro L, Smith C, Rencic J, Diaz Y, Mensinger J, Holmboe E. 2008. Evaluation of a novel assessment form for observing medical residents: a randomised, controlled trial. Med Educ. 42(12):1234–1242.
   PubMed Web of Science ®Google Scholar
• Durlak JA, DuPre EP. 2008. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Commun Psychol. 41(3–4):327–350.
   PubMed Web of Science ®Google Scholar
• Durning SJ, Cation LJ, Markert RJ, Pangaro LN. 2002. Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training. Acad Med. 77(9):900–904.
   PubMed Web of Science ®Google Scholar
• Ergin S, Özdemir S, Büke AS, Cüneyt OK, Kaçar N. 2013. Mezuniyet öncesi dermatoveneroloji eğitiminde mini klinik değerlendirme uygulaması: Pamukkale Üniversitesi Tıp Fakültesi’nin deneyimi. Arch Turkish Dermatol Venerol. 47(1):54–58.
   Google Scholar
• Eriksen JG, Simonsen D, Bastholt L, Aspegren K, Vinther C, Kruse K, Kodal T. 2009. Mini clinical evaluation exercise as evaluation tool of communicative and cooperative skills in the outpatient clinic. Ugeskr Laeger. 171(12):1003–1006.
   PubMedGoogle Scholar
• Ferenchick GS, Foreback J, Towfiq B, Kavanaugh K, Solomon D, Mohmand A. 2010. The implementation of a mobile problem-specific electronic CEX for assessing directly observed student-patient encounters. Med Educ Online. 29:15.
   Google Scholar
• Fernández Galvez GM. 2011. Evaluación de las competencias clínicas en una residencia de pediatría con el Mini-CEX (Mini-Clinical Evaluation Exercise). Arch Argentinos de Pediatria. 109(4):314–320.
   PubMed Web of Science ®Google Scholar
• Fernando N, Cleland J, McKenzie H, Cassar K. 2008. Identifying the factors that determine feedback given to undergraduate medical students following formative mini-CEX assessments. Med Educ. 42:89–95.
   PubMed Web of Science ®Google Scholar
• Gade SA, Chari SN, Chalak A. 2017. Use of mini-CEX as a teaching learning method in physiology for undergraduate medical students. Natl J Physiol Pharm Pharm. 7(4):1–5.
   Google Scholar
• Gingerich A, Ramlo SE, van der Vleuten CPM, Eva KW, Regehr G. 2017. Inter-rater variability as mutual disagreement: identifying raters' divergent points of view. Adv in Health Sci Educ. 22(4):819–838.
   PubMed Web of Science ®Google Scholar
• Goel A, Singh T. 2015. The usefulness of Mini Clinical Evaluation Exercise as a learning tool in different pediatric clinical settings. Int J Appl Basic Med Res. 5(4):32–34.
   Google Scholar
• Gohel M, Singh US, Bhanderi D, Phatak A. 2016. Developing and pilot testing of a tool for “clinicosocial case study” assessment of community medicine residents. Educ Health. 29(2):68–74.
   PubMedGoogle Scholar
• Golnik KC, Goldenhar L, Gittinger JW, Jr, Lustbader JM. 2004. The Ophthalmic Clinical Evaluation Exercise (OCEX). Ophthalmology. 111(7):1271–1274.
   PubMed Web of Science ®Google Scholar
• Gordon M, Gibbs T. 2014. STORIES statement: publication standards for healthcare education evidence synthesis. BMC Med. 12(1):143.
   PubMed Web of Science ®Google Scholar
• Gupta S, Sharma M, Singh T. 2017. The acceptability and feasibility of mini-clinical evaluation exercise as a learning tool for pediatric postgraduate students. Int J App Basic Med Res. 7(5):19.
   Google Scholar
• Han PK, Keranen LB, Lescisin DA, Arnold RM. 2005. The palliative care clinical evaluation exercise (CEX): an experience-based intervention for teaching end-of-life communication skills. Acad Med. 80(7):669–676.
   PubMed Web of Science ®Google Scholar
• Hatala R, Ainslie M, Kassen BO, Mackie I, Roberts JM. 2006. Assessing the mini-clinical evaluation exercise in comparison to a national specialty examination. Med Educ. 40(10):950–956.
   PubMed Web of Science ®Google Scholar
• Hauer KE, Holmboe ES, Kogan JR. 2011. Twelve tips for implementing tools for direct observation of medical trainees' clinical skills during patient encounters. Med Teach. 33(1):27–33.
   PubMed Web of Science ®Google Scholar
• Hawkins RE, Margolis MJ, Durning SJ, Norcini JJ. 2010. Constructing a validity argument for the mini-clinical evaluation exercise: a review of the research. Acad Med. 85(9):1453–1461.
   PubMed Web of Science ®Google Scholar
• Higgins, JPT, Green, S., editors. 2011. Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration. Available from http://handbook.cochrane.org.
   Google Scholar
• Hill F, Kendall K. 2007. Adopting and adapting the mini‐CEX as an undergraduate assessment and learning tool. Clin Teach. 4(4):244–248.
   Google Scholar
• Hill F, Kendall K, Galbraith K, Crossley J. 2009. Implementing the undergraduate mini-CEX: a tailored approach at Southampton University. Med Educ. 43(4):326–334.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Huot S, Chung J, Norcini J, Hawkins RE. 2003. Construct validity of the miniclinical evaluation exercise (miniCEX). Acad Med. 78(8):826–830.
   PubMed Web of Science ®Google Scholar
• Holmboe ES, Yepes M, Williams F, Huot SJ. 2004. Feedback and the mini clinical evaluation exercise. J Gen Intern Med. 19(5 Pt 2):558–561.
   PubMed Web of Science ®Google Scholar
• Humphrey-Murto S, Côté M, Pugh D, Wood TJ. 2018. Assessing the validity of multidisciplinary mini-clinical evaluation exercise. Teach Learn Med. 30(2):152–161.
   PubMed Web of Science ®Google Scholar
• Jackson D, Wall D. 2010. An evaluation of the use of the mini-CEX in the foundation programme. Br J Hosp Med. 71(10):584–588.
   Web of Science ®Google Scholar
• Joshi MK, Singh T, Badyal DK. 2017. Acceptability and feasibility of mini-clinical evaluation exercise as a formative assessment tool for workplace-based assessment for surgical postgraduate students. J Postgrad Med. 63(2):100–105.
   PubMed Web of Science ®Google Scholar
• Karanth KL, Kanagasabai S, Ibrahim SB, Najimuddin M, Marasinghe DK, De S. 2015. Structured program for final-year undergraduate students to improve clinical skills to prepare for effective patient management. Internet J Gynecol Obstet. 19:1–9.
   Google Scholar
• Khalil S, Aggarwal A, Mishra D. 2017. Implementation of a mini-clinical evaluation exercise (mini-CEX) program to assess the clinical competence of postgraduate trainees in pediatrics. Indian Pediatr. 54(4):284–287.
   PubMed Web of Science ®Google Scholar
• Kim S, Willett LR, Noveck H, Patel MS, Walker JA, Terregino CA. 2016. Implementation of a mini-CEX requirement across all third-year clerkships. Teach Learn Med. 28(4):424–431.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Bellini LM, Shea JA. 2003. Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Acad Med. 78(Supplement):S33–S5.
   PubMed Web of Science ®Google Scholar
• Kogan JR, Holmboe ES, Hauer KE. 2009. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 302(12):1316–1326.
   PubMed Web of Science ®Google Scholar
• Liao KC, Pu SJ, Liu MS, Yang CW, Kuo HP. 2013. Development and implementation of a mini-clinical evaluation exercise (mini-CEX) program to assess the clinical competencies of internal medicine residents: from faculty development to curriculum evaluation. BMC Med Educ. 26(13):31.
   Web of Science ®Google Scholar
• Lie D, Encinas J, Frances S, Michael P. 2010. Do faculty show the 'halo effect' in rating students compared with standardized patients during a clinical examination? Internet J Fam Practice. 8(2):1–8.
   Google Scholar
• Lin C, Chiu T, Yen D, Chong C. 2012. Mini-clinical evaluation exercise and feedback on postgraduate trainees in the emergency department: a qualitative content analysis. J Acute Med. 2(1):1–7.
   Google Scholar
• Lörwald AC, Lahner FM, Greif R, Berendonk C, Norcini J, Huwendiek S. 2018. Factors influencing the educational impact of Mini-CEX and DOPS: a qualitative synthesis. Med Teach. 40(4):414–420.
   PubMed Web of Science ®Google Scholar
• Lörwald AC, Lahner FM, Nouns ZM, Berendonk C, Norcini J, Greif R, Huwendiek S. 2018. The educational impact of mini-clinical evaluation exercise (mini-CEX) and direct observation of procedural skills (DOPS) and its association with implementation: a systematic review and meta-analysis. PLoS One. 13(6):e0198009.
   PubMed Web of Science ®Google Scholar
• Malhotra S, Hatala R, Courneya CA. 2008. Internal medicine residents' perceptions of the mini-clinical evaluation exercise. Med Teach. 30(4):414–419.
   PubMed Web of Science ®Google Scholar
• Margolis MJ, Clauser BE, Cuddy MM, Ciccone A, Mee J, Harik P, Hawkins RE. 2006. Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Acad Med. 81(Suppl):S56–S60.
   PubMed Web of Science ®Google Scholar
• Meresh E, Daniels D, Sharma A, Rao M, Mehta K, Schilling D. 2018. Review of mini-clinical evaluation exercise (mini-CEX) in a psychiatry clerkship. AMEP. 9:279–283.
   Web of Science ®Google Scholar
• Miller A, Archer J. 2010. Impact of workplace based assessment on doctors' education and performance: a systematic review. BMJ. 341:c5064.
   PubMed Web of Science ®Google Scholar
• Mills E, Blenkinsopp A, McKinley RK, Black P. 2011. The assessment of observed practice: a literature review. Keele: University of Keele.
   Google Scholar
• Montagne S, Rogausch A, Gemperli A, Berendonk C, Jucker-Kupper P, Beyeler C. 2014. The mini-clinical evaluation exercise during medical clerkships: are learning needs and learning goals aligned? Med Educ. 48(10):1008–1019.
   PubMed Web of Science ®Google Scholar
• Mortaz Hejri S, Jalili M, Shirazi M, Masoomi R, Nedjat S, Norcini J. 2017. The utility of mini-Clinical Evaluation Exercise (mini-CEX) in undergraduate and postgraduate medical education: protocol for a systematic review. Syst Rev. 6(1):146.
   PubMed Web of Science ®Google Scholar
• Musick DW, Bockenek WL, Massagli TL, Miknevich MA, Poduri KR, Sliwa JA, Steiner M. 2010. Reliability of the physical medicine and rehabilitation resident observation and competency assessment tool: a multi-institution study. Am J Phys Med Rehab. 89(3):235–244.
   PubMed Web of Science ®Google Scholar
• Nair BR, Alexander HG, McGrath BP, et al. 2008. The mini clinical evaluation exercise (mini-CEX) for assessing clinical performance of international medical graduates. Med J Aust. 189(3):159–161.
   PubMed Web of Science ®Google Scholar
• Ney EM, Shea JA, Kogan JR. 2009. Predictive validity of the mini-clinical evaluation exercise (mCEX): do medical students' mCEX ratings correlate with future clinical exam performance? Acad Med. 84(Supplement):S17–S20.
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Blank LL, Arnold GK, Kimball HR. 1995. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Annals of Internal Medicine. 123(10):795–799.
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Blank LL, Arnold GK, Kimball HR. 1997. Examiner differences in the mini-CEX. Adv Health Sci Educ Theory Practice. 2(1):27–33.
   PubMed Web of Science ®Google Scholar
• Norcini JJ, Blank LL, Duffy FD, Fortna GS. 2003. The mini-CEX: a method for assessing clinical skills. Ann Intern Med. 138(6):476–481.
   PubMed Web of Science ®Google Scholar
• Olascoaga AC, Riquelme A. 2017. Aplicación longitudinal del Mini Clinical Examination (Mini-CEX) enmédicos residentes. Educ Med. 20:25–28.
   Google Scholar
• Paravicini I, Peterson CK. 2015. Introduction, development, and evaluation of the miniclinical evaluation exercise in postgraduate education of chiropractors. J Chiropractic Educ. 29(1):22–28.
   PubMed Web of Science ®Google Scholar
• Pelgrim EAM, Kramer AWM, Mokkink HGA, van den Elsen L, Grol RP, van der Vleuten C. 2011. In-training assessment using direct observation of single-patient encounters: a literature review. Adv Health Sci Educ. 16(1):131–142.
   PubMed Web of Science ®Google Scholar
• Pernar LIM, Peyre SE, Warren LEG, Gu X, Lipsitz S, Alexander EK, Ashley SW, Breen EM. 2011. Mini-clinical evaluation exercise as a student assessment tool in a surgery clerkship: lessons learned from a 5-year experience. Surgery. 150(2):272–277.
   PubMed Web of Science ®Google Scholar
• Playford D, Kirke A, Maley M, Worthington R. 2013. Longitudinal assessment in an undergraduate longitudinal integrated clerkship: the mini Clinical Evaluation Exercise (mCEX) profile. Med Teach. 35(8):e1416–e1421.
   PubMed Web of Science ®Google Scholar
• Pottier P, Cohen AF, Steichen O, Desprets M, Pha M, Espitia A, Georgin-Lavialle S, Morel A, Hardouin JB. 2018. Validité et reproductibilité de deux grilles d’observation des compétences cliniques des internes en DES de médecine interne. La Rev Méd Interne. 39(1):4–9.
   PubMed Web of Science ®Google Scholar
• Rodriguez MC, Maeda Y. 2006. Meta-analysis of coefficient alpha. Psychol Methods. 11(3):306–322.
   PubMed Web of Science ®Google Scholar
• Rogausch A, Beyeler C, Montagne S, Jucker-Kupper P, Berendonk C, Huwendiek S, Gemperli A, Himmel W. 2015. The influence of students' prior clinical skills and context characteristics on mini-CEX scores in clerkships–a multilevel analysis. BMC Med Educ. 15(1):208.
   PubMed Web of Science ®Google Scholar
• Saeed N, Tariq N, Jaffery T. 2015. Mini-CEX (clinical evaluation exercise) as an assessment tool at Shifa College of Medicine, Islamabad, Pakistan. Rawal Med J. 40(2):220–224.
   Web of Science ®Google Scholar
• Sandilands DD, Zumbo BD. 2014. (Mis)Alignment of medical education validation research with contemporary validity theory: the mini-CEX as an example. In: Zumbo BD, Chan EKH, editors. Validity and validation in social, behavioral, and health sciences. Cham: Springer. p. 289–310.
   Google Scholar
• Singh T, Sharma M. 2010. Mini-clinical examination (CEX) as a tool for formative assessment. The National Medical Journal of India. 23(2):100–102.
   PubMed Web of Science ®Google Scholar
• Suhoyo Y, Schönrock-Adema J, Rahayu GR, Kuks JB, Cohen-Schotanus J. 2014. Meeting international standards: a cultural approach in implementing the mini-CEX effectively in Indonesian clerkships. Med Teach. 36(10):894–902.
   PubMed Web of Science ®Google Scholar
• Torre DM, Simpson DE, Elnicki DM, Sebastian JL, Holmboe ES. 2007. Feasibility, reliability and user satisfaction with a PDA-based mini-CEX to evaluate the clinical skills of third-year medical students. Teach Learn Med. 19(3):271–277.
   PubMed Web of Science ®Google Scholar
• Torre DM, Treat R, Durning S, Elnicki DM. 2011. Comparing PDA- and paper-based evaluation of the clinical skills of third-year students. Wilkinson Med J. 110(1):9–13.
   Google Scholar
• Urman G, Folgueral S, Gasparri M, et al. 2011. Assessment of competence in pediatric postgraduate education: implementation of a pediatric version of the mini-CEX. Arch Argent Pediat. 109(06):492–498.
   PubMed Web of Science ®Google Scholar
• Van der Vleuten C. 1996. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1(1):41–67.
   PubMed Web of Science ®Google Scholar
• Weller JM, Castanelli DJ, Chen Y, Jolly B. 2017. Making robust assessments of specialist trainees' workplace performance. Br J Anaesth. 118(2):207–214.
   PubMed Web of Science ®Google Scholar
• Weller JM, Jolly B, Misur MP, Merry AF, Jones A, Crossley JGM, Pedersen K, Smith K. 2009. Mini-clinical evaluation exercise in anaesthesia training. Br J Anaesth. 102(5):633–641.
   PubMed Web of Science ®Google Scholar
• Weller JM, Jones A, Merry AF, Jolly B, Saunders D. 2009. Investigation of trainee and specialist reactions to the mini-clinical evaluation exercise in anaesthesia: implications for implementation. Br J Anaesth. 103(4):524–530.
   PubMed Web of Science ®Google Scholar
• Weller JM, Misur M, Nicolson S, Morris J, Ure S, Crossley J, Jolly B. 2014. Can I leave the theatre? A key to more reliable workplace-based assessment. Br J Anaesth. 112(6):1083–1091.
   PubMed Web of Science ®Google Scholar
• Weston PS, Smith CA. 2014. The use of mini-CEX in UK foundation training six years following its introduction: lessons still to be learned and the benefit of formal teaching regarding its utility. Med Teach. 36(2):155–163.
   PubMed Web of Science ®Google Scholar
• Yanting SL, Sinnathamby A, Wang D, Heng MTM, Hao JLW, Lee SS, Yeo SP, Samarasekera DD. 2016. Conceptualizing workplace based assessment in Singapore: undergraduate mini-clinical evaluation exercise experiences of students and teachers. Tzu Chi Med J. 28(3):113–120.
   Web of Science ®Google Scholar
• Yeates P, O’Neill P, Mann K, Eva K. 2013. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv Health Sci Educ. 18(3):325–341.
   PubMed Web of Science ®Google Scholar
• Yusuf L, Ahmed A, Yasmin R. 2018. Educational impact of mini-clinical evaluation exercise: a game changer. Pak J Med Sci. 34(2):405–411.
   PubMed Web of Science ®Google Scholar