Twelve tips for developing simulation-based mastery learning clinical skills checklists

References

• Adler MD, Vozenilek JA, Trainor JL, Eppich WJ, Wang EE, Beaumont JL, Aitchison PR, Pribaz PJ, Erickson T, Edison M, et al. 2011. Comparison of checklist and anchored global rating instruments for performing rating of simulated pediatric emergencies. Simul Healthc. 6(1):18–24. doi:10.1097/SIH.0b013e318201aa90.
   PubMedGoogle Scholar
• Amick AE, Feinsmith SE, Davis EM, Sell J, Macdonald V, Trinquero P, Moore AG, Gappmeier V, Colton K, Cunningham A, et al. 2022. Simulation-based mastery learning improves ultrasound-guided peripheral intravenous catheter insertion skills of practicing nurses. Simul Healthc. 17(1):7–14. doi:10.1097/SIH.0000000000000545.
   PubMedGoogle Scholar
• Barsuk JH, Cohen ER, Caprio T, McGaghie WC, Simuni T, Wayne DB. 2012. Simulation-based education with mastery learning improves residents’ lumbar puncture skills. Neurology. 79(2):132–137. doi:10.1212/WNL.0b013e31825dd39d.
   PubMed Web of Science ®Google Scholar
• Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. 2011. Unexpected collateral effects of simulation-based medical education. Acad Med. 86(12):1513–1517. doi:10.1097/ACM.0b013e318234c493.
   PubMed Web of Science ®Google Scholar
• Barsuk JH, Cohen ER, Vozenilek JA, O'Connor LM, McGaghie WC, Wayne DB. 2012. Simulation-based education with mastery learning improves paracentesis skills. J Grad Med Educ. 4(1):23–27. doi:10.4300/JGME-D-11-00161.1.
   PubMedGoogle Scholar
• Barsuk JH, Cohen ER, Wayne DB, McGaghie WC, Yudkowsky R. 2018. A comparison of approaches for mastery learning standard setting. Acad Med. 93(7):1079–1084. doi:10.1097/ACM.0000000000002182.
   PubMed Web of Science ®Google Scholar
• Barsuk JH, Cohen ER, Wayne DB, Siddall VJ, McGaghie WC. 2016. Developing a simulation-based mastery learning curriculum: lessons from 11 years of Advanced Cardiac Life Support. Simul Healthc. 11(1):52–59. doi:10.1097/SIH.0000000000000120.
   PubMedGoogle Scholar
• Barsuk JH, Harap RS, Cohen ER, Cameron KA, Grady KL, Wilcox JE, Shanklin KB, Wayne DB. 2019. The effect of judge selection on standard setting using the Mastery Angoff method during development of a ventricular assist device self-care curriculum. Clin Simul Nurs. 27:39–47.e4. doi:10.1016/j.ecns.2018.10.005.
   PubMed Web of Science ®Google Scholar
• Barsuk JH, McGaghie WC, Cohen ER, Balachandran JS, Wayne DB. 2009. Use of simulation-based mastery learning to improve the quality of central venous catheter placement in a medical intensive care unit. J Hosp Med. 4(7):397–403. doi:10.1002/jhm.468.
   PubMed Web of Science ®Google Scholar
• Burian BK, Clebone A, Dismukes K, Ruskin KJ. 2018. More than a tick box: medical checklist development, design, and use. Anesth Analg. 126(1):223–232. doi:10.1213/ANE.0000000000002286.
   PubMed Web of Science ®Google Scholar
• Clayton MJ. 1997. Delphi: a technique to harness expert opinion for critical decision-making tasks in education. Educ Psychol. 17(4):373–386. doi:10.1080/0144341970170401.
   Google Scholar
• Cook D, Hatala R. 2016. Validation of educational assessments: a primer for simulation and beyond. Adv Simul (Lond). 1(1):31. doi:10.1186/s41077-016-0033-y.
   PubMedGoogle Scholar
• De Champlain A. 2004. Ensuring that the competent are truly competent: an overview of common methods and procedures used to set standards on high-stakes examinations. J Vet Med Educ. 31(1):61–65. doi:10.3138/jvme.31.1.61.
   PubMed Web of Science ®Google Scholar
• Downing S, Tekian A, Yudkowsky R. 2006. Procedures for establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med. 18(1):50–57. doi:10.1207/s15328015tlm1801_11.
   PubMed Web of Science ®Google Scholar
• Downing S. 2004. Reliability: on the reproducibility of assessment data. Med Educ. 38(9):1006–1012. doi:10.1111/j.1365-2929.2004.01932.x.
   PubMed Web of Science ®Google Scholar
• Faudeux C, Tran A, Dupont A, Desmontils J, Montaudié I, Bréaud J, Braun M, Fournier J-P, Bérard E, Berlengi N, et al. 2017. Development of reliable and validated tools to evaluate technical resuscitation skills in a pediatric simulation setting: resuscitation and emergency simulation checklist for assessment in pediatrics. J Pediatr. 188:252–257.e6. doi:10.1016/j.jpeds.2017.03.055.
   PubMed Web of Science ®Google Scholar
• Feldman M, Lazzara EH, Vanderbilt AA, DiazGranados D. 2012. Rater training to support high-stakes simulation-based assessments. J Contin Educ Health Prof. 32(4):279–286. doi:10.1002/chp.21156.
   PubMed Web of Science ®Google Scholar
• Gawande A. 2011. The checklist manifesto. London (UK): Profile Books.
   Google Scholar
• Hasson F, Keeney S, McKenna H. 2000. Research guidelines for the Delphi survey technique. J Adv Nurs. 32(4):1008–1015. doi:10.1046/j.1365-2648.2000.t01-1-01567.x.
   PubMed Web of Science ®Google Scholar
• House JB, Dooley-Hash S, Kowalenko T, Sikavitsas A, Seeyave DM, Younger JG, Hamstra SJ, Nypaver MM. 2012. Prospective comparison of live and video review in the evaluation of operator performance in a pediatric emergency airway simulation. J Grad Med Educ. 4(3):312–316. doi:10.4300/JGME-D-11-00123.1.
   PubMedGoogle Scholar
• Keeney S, Hasson F, McKenna H. 2006. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 53(2):205–212. doi:10.1111/j.1365-2648.2006.03716.x.
   PubMed Web of Science ®Google Scholar
• Klein M, Schmitz Z, Adler M, et al. 2021. Development of a rigorously-designed procedural checklist for assessment of emergency medicine resident performance of temporary transvenous cardiac pacing. AEM Educ Train. 5(3):e10566.
   PubMedGoogle Scholar
• Klein MR, Schmitz ZP, Adler MD, Salzman DH. 2022. Simulation-based mastery learning improves emergency medicine residents’ ability to perform temporary transvenous cardiac pacing. West J Emerg Med. 24(1):43–49. doi:10.5811/westjem.2022.10.57773.
   PubMed Web of Science ®Google Scholar
• McGaghie W, Barsuk J, Wayne D, eds. 2020. Comprehensive healthcare simulation: mastery learning in health professions education. Switzerland: Springer. .
   Google Scholar
• McGaghie W, Harris I. 2018. Learning theory foundations of simulation-based mastery learning. Simul Healthc. 13(3S Suppl 1):S15–S20. doi:10.1097/SIH.0000000000000279.
   PubMedGoogle Scholar
• McGaghie W. 2015. Mastery learning: it is time for medical education to join the 21st century. Acad Med. 90(11):1438–1441. doi:10.1097/ACM.0000000000000911.
   PubMed Web of Science ®Google Scholar
• McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. 2014. A critical review of simulation-based mastery learning with translational outcomes. Med Educ. 48(4):375–385. doi:10.1111/medu.12391.
   PubMed Web of Science ®Google Scholar
• Mikhaeil-Demo Y, Barsuk JH, Culler GW, Bega D, Salzman DH, Cohen ER, Templer JW, Gerard EE. 2020. Use of a simulation-based mastery learning curriculum for neurology residents to improve the identification and management of status epilepticus. Epilepsy Behav. 111:107247. doi:10.1016/j.yebeh.2020.107247.
   PubMed Web of Science ®Google Scholar
• Miller DT, Pokrajac N, Ngo J, Gallegos M, Dixon W, Roszczynialski KN, Ng K, Taleghani N, Gisondi MA. 2022. Simulation-based mastery learning improves performance of donning and doffing of personal protective equipment by medical students. West J Emerg Med. 23(3):318–323. doi:10.5811/westjem.2022.2.54748.
   PubMed Web of Science ®Google Scholar
• Norcini J, Shea J. 1997. The credibility and comparability of standards. Appl Measure Educ. 10(1):39–59. doi:10.1207/s15324818ame1001_3.
   Web of Science ®Google Scholar
• O’Brien C, Adler M, McGaghie W, McGaghie W, Barsuk J, Wayne D. 2020. Assessment in Mastery Learning. In Comprehensive healthcare simulation: mastery learning in health professions education. Switzerland: Springer; p. 98–100.
   Google Scholar
• Papanagnou D, Klein MR, Zhang XC, Cameron KA, Doty A, McCarthy DM, Rising KL, Salzman DH. 2021. Developing standardized patient-based cases for communication training: lessons learned from training residents to communicate diagnostic uncertainty. Adv Simul (Lond). 6(1):26. doi:10.1186/s41077-021-00176-y.
   PubMedGoogle Scholar
• Petrosoniak A, Lu M, Gray S, Hicks C, Sherbino J, McGowan M, Monteiro S. 2019. Perfecting practice: a protocol for assessing simulation-based mastery learning and deliberate practice versus self-guided practice for bougie-assisted cricothyrotomy performance. BMC Med Educ. 19(1):100. doi:10.1186/s12909-019-1537-7.
   PubMedGoogle Scholar
• Rising KL, Cameron KA, Salzman DH, Papanagnou D, Doty AMB, Piserchia K, Leiby BE, Shimada A, McGaghie WC, Powell RE, et al. 2023. Communicating diagnostic uncertainty at emergency department discharge: a simulation-based mastery learning randomized trial. Acad Med. 98(3):384–393. doi:10.1097/ACM.0000000000004993.
   PubMed Web of Science ®Google Scholar
• Rising KL, Powell RE, Cameron KA, Salzman DH, Papanagnou D, Doty AMB, Latimer L, Piserchia K, McGaghie WC, McCarthy DM, et al. 2020. Development of the uncertainty communication checklist: a patient-centered approach to patient discharge from the emergency department. Acad Med. 95(7):1026–1034. doi:10.1097/ACM.0000000000003231.
   PubMed Web of Science ®Google Scholar
• Salzman DH, Rising KL, Cameron KA, Powell RE, Papanagnou D, Doty A, Piserchia K, Latimer L, McGaghie WC, McCarthy DM, et al. 2020. Setting a minimum passing standard for the uncertainty communication checklist through patient and physician engagement. J Grad Med Educ. 12(1):58–65. doi:10.4300/JGME-D-19-00483.1.
   PubMedGoogle Scholar
• Schmutz J, Eppich WJ, Hoffmann F, Heimberg E, Manser T. 2014. Five steps to develop checklists for evaluating performance: an integrative approach. Acad Med. 89(7):996–1005. doi:10.1097/ACM.0000000000000289.
   PubMed Web of Science ®Google Scholar
• Schroedl CJ, Frogameni A, Barsuk JH, Cohen ER, Sivarajan L, Wayne DB. 2020. Simulation-based mastery learning improves resident skill managing mechanical ventilators. ATS Sch. 2(1):34–48. doi:10.34197/ats-scholar.2020-0023OC.
   PubMedGoogle Scholar
• Schwab B, Teitelbaum EN, Barsuk JH, Soper NJ, Hungness ES. 2018. Single-stage laparoscopic management of choledocholithiasis: an analysis after implementation of a mastery learning resident curriculum. Surgery. 163(3):503–508. doi:10.1016/j.surg.2017.10.006.
   PubMed Web of Science ®Google Scholar
• Stufflebeam D. 2000. Guidelines for developing evaluation checklists: the checklists development checklist. https://wmich.edu/sites/default/files/attachments/u350/2014/guidelines_cdc.pdf.
   Google Scholar
• Thomas P, Kern D, Hughes M, Tackett S, Chen B. 2022. Curriculum development for medical education: a six-step approach. 4th ed. Baltimore (MD): Johns Hopkins University Press.
   Google Scholar
• Vermylen JH, Wood GJ, Cohen ER, Barsuk JH, McGaghie WC, Wayne DB. 2019. Development of a simulation-based mastery learning curriculum for breaking bad news. J Pain Symptom Manage. 57(3):682–687. doi:10.1016/j.jpainsymman.2018.11.012.
   PubMed Web of Science ®Google Scholar
• Waggoner J, Carline J, Durning S. 2016. Is there a consensus on consensus methodology? Descriptions and recommendations for future consensus research. Acad Med. 91(5):663–668. doi:10.1097/ACM.0000000000001092.
   PubMed Web of Science ®Google Scholar
• Wayne D, Cohen E, Barsuk J. 2020. Standard setting for mastery learning. In W. McGaghie & J. Barsuk & D. Wayne (Eds.), Comprehensive healthcare simulation: mastery learning in health professions education. Switzerland: Springer; p. 119.
   Google Scholar
• Wayne DB, Butter J, Siddall VJ, Fudala MJ, Wade LD, Feinglass J, McGaghie WC. 2006. Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice. J Gen Intern Med. 21(3):251–256. doi:10.1111/j.1525-1497.2006.00341.x.
   PubMed Web of Science ®Google Scholar
• Yudkowsky R, Park YS, Lineberry M, Knox A, Ritter EM. 2015. Setting mastery learning standards. Acad Med. 90(11):1495–1500. doi:10.1097/ACM.0000000000000887.
   PubMed Web of Science ®Google Scholar
• Yudkowsky R, Tumuluru S, Casey P, Herlich N, Ledonne C. 2014. A patient safety approach to setting pass/fail standards for basic procedural skills checklists. Simul Healthc. 9(5):277–282. doi:10.1097/SIH.0000000000000044.
   PubMedGoogle Scholar
• Zaidi HQ, Dhake SS, Miller DT, Sista P, Pirotte MJ, Fant AL, Salzman DH. 2019. Emergency department thoracotomy: development of a reliable, validated checklist for procedural training. AEM Educ Train. 4(2):139–146. doi:10.1002/aet2.10387.
   PubMedGoogle Scholar