Reliability of the Behaviorally Anchored Rating Scale (BARS) for assessing non-technical skills of medical students in simulated scenarios

References

• Fletcher G, McGeorge P, Flin R, et al. The Role of non-technical skills in anaesthesia: a review of current literature. Br J Anaesth. 2002;88(3):418–7.
   PubMed Web of Science ®Google Scholar
• Jones C, Fawker-Corbett J, Groom P, et al. Human factors in preventing complications in anaesthesia: a systematic review. Anaesthesia. 2018;73(Suppl. 1):12–24.
   PubMedGoogle Scholar
• Kohn L, Corrigan J, Donaldson M. To Err is human: building a safer health system. Washington, D.C.: National Academy Press; 2000.
   Google Scholar
• Fanning R, Goldhaber-Fiebert S, Udani A, et al. Crisis resource management. In: Levine A, DeMaria S, Schwartz A, et al., editors. The Comprehensive textbook of healthcare simulation. New York: Springer-Verlag; 2013. p. 95–109.
   Google Scholar
• Blackwood J, Duff J, Nettel-Aguirre A, et al. Does teaching crisis resource management skills improve resuscitation performance in pediatric residents? Pediatr Crit Care Med. 2014;15(4):168–174.
   Google Scholar
• Burden A, Pukenas E, Deal E, et al. Using simulation education with deliberate practice to teach leadership and resource management skills to senior resident code leaders. J Grad Med Educ. 2014;6(3):463–469.
   PubMedGoogle Scholar
• Hughes K, Benenson R, Krichten A, et al. A crew resource management program tailored to trauma resuscitation improves team behavior and communication. J Am Coll Surg. 2014;219(3):545–551.
   PubMedGoogle Scholar
• Mancuso M, Dziadkowiec O, Kleiner C, et al. Crew resource management for obstetric and neonatal teams to improve communication during cesarean births. Journal of Obstetric, Gynecologic & Neonatal Nursing. 2016;45(4):502–514.
   PubMed Web of Science ®Google Scholar
• McCulloch P, Mishra A, Handa A, et al. The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre. Qual Saf Health Care. 2009;18(2):109–115.
   PubMedGoogle Scholar
• Zausig Y, Grube C, Boeker-Blum T, et al. Inefficacy of simulator-based training on anaesthesiologists’ non-technical skills. Acta Anaesthesiol Scand. 2009;53(5):611–619.
   PubMedGoogle Scholar
• Yee B, Naik V, Joo H, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology. 2005;103(2):241–248.
   PubMed Web of Science ®Google Scholar
• Boet S, Bould M, Fung L, et al. Transfer of learning and patient outcome in simulated crisis resource management: a systematic review. Can J Anaesth. 2014;61(6):571–582.
   PubMed Web of Science ®Google Scholar
• Yeung J, Ong G, Davies R, et al. Factors affecting team leadership skills and their relationship with quality of cardiopulmonary resuscitation. Crit Care Med. 2012;40(9):2617–2621.
   PubMedGoogle Scholar
• Doumouras A, Hamidi M, Lung K, et al. Non-technical skills of surgeons and anaesthetists in simulated operating theatre crises. Br J Surg. 2017;104(8):1028–1036.
   PubMed Web of Science ®Google Scholar
• Neily J, Mills P, Young-Xu Y, et al. Association between implementation of a medical team training program and surgical mortality. JAMA. 2010;304(15):1693–1700.
   PubMed Web of Science ®Google Scholar
• Greif R, Lockey A, Breckwoldt J, et al. European Resuscitation Council guidelines 2021: education for resuscitation. Resuscitation. 2021;161:388–407.
   PubMed Web of Science ®Google Scholar
• Nicolaides M, Cardillo L, Theodoulou I, et al. Developing a novel framework for non-technical skills learning strategies for undergraduates: a systematic review. Ann Med Surg. 2018;36:29–40.
   PubMed Web of Science ®Google Scholar
• Yedidia M. Effect of communications training on medical student performance. JAMA. 2003;290(9):1157–1165.
   PubMed Web of Science ®Google Scholar
• Evans L, Crimmins A, Bonz J, et al. A comprehensive, simulation-based approach to teaching clinical skills: the medical students’ perspective. Yale J Biol Med. 2014;87(4):575–581.
   PubMedGoogle Scholar
• Cha J, Anton N, Mizota T, et al. Use of non-technical skills can predict medical student performance in acute care simulated scenarios. Am J Surg. 2019;217(2):323–328.
   PubMedGoogle Scholar
• Haffner L, Mahling M, Muench A, et al. Improved recognition of ineffective chest compressions after a brief Crew Resource Management (CRM) training: a prospective, randomised simulation study. BMC Emerg Med. 2017;17(1). 10.1186/s12873-017-0117-6
   PubMedGoogle Scholar
• Fletcher G, Flin R, McGeorge P, et al. Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth. 2003;90(5):580–588.
   PubMed Web of Science ®Google Scholar
• Jung J, Borkhoff C, Jüni P, et al. Non-Technical Skills for Surgeons (NOTSS): critical appraisal of its measurement properties. Am J Surg. 2018;216(5):990–997.
   PubMedGoogle Scholar
• Watkins S, Roberts D, Boulet J, et al. Evaluation of a simpler tool to assess nontechnical skills during simulated critical events. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 2017;12(2):69–75
   Google Scholar
• Askew K, Weiner D, Murphy C, et al. Consensus development of a pediatric emergency medicine clerkship curriculum. West J Emerg Med. 2014;15(6):647–651.
   PubMedGoogle Scholar
• Harris P, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381.
   PubMed Web of Science ®Google Scholar
• Krippendorff K (2011). Computing Krippendorff’s Alpha-Reliability. Retrieved from https://repository.upenn.edu/asc_papers/43.
   Google Scholar
• Krippendorff K. Reliability in Content Analysis. Human Communication Research. 2004;30(3):411–433.
   Web of Science ®Google Scholar
• Gordon M, Baker P, Catchpole K, et al. Devising a consensus definition and framework for non-technical skills in healthcare to support educational design: a modified Delphi study. Med Teach. 2015;37(6):572–577.
   PubMed Web of Science ®Google Scholar
• Gordon M, Farnan J, Grafton-Clarke C, et al. Non-technical skills assessments in undergraduate medical education: a focused BEME systematic review: BEME guide no. 54. Med Teach. 2019;41(7):732–745.
   PubMed Web of Science ®Google Scholar
• Moll-Khosrawi P, Kamphausen A, Hampe W, et al. Anaesthesiology students’ non-technical skills: development and evaluation of a behavioural marker system for students (AS-NTS). BMC Med Educ. 2019;19(1):205.
   PubMedGoogle Scholar
• Schulte-Uentrop L, Cronje J, Zollner C, et al. Correlation of medical students’ situational motivation and performance of non-technical skills during simulation-based emergency training. BMC Med Educ. 2020;20(1):351.
   PubMed Web of Science ®Google Scholar
• Moll-Khosrawi P, Zollner C, Cencin N, et al. Flipped learning enhances non-technical skill performance in simulation-based education: a randomised controlled trial. BMC Med Educ. 2021;21(1):353.
   PubMedGoogle Scholar
• Hayes C, Rhee A, Detsky M, et al. Residents feel unprepared and unsupervised as leaders of cardiac arrest teams in teaching hospitals: a survey of internal medicine residents. Crit Care Med. 2007;35(7):1668–1672.
   PubMed Web of Science ®Google Scholar
• Illing J, Morrow G, Rothwell Nee Kergon C, et al. Perceptions of UK medical graduates’ preparedness for practice: a multi-centre qualitative study reflecting the importance of learning on the job. BMC Med Educ. 2013;13(1). 10.1186/1472-6920-13-34
   PubMedGoogle Scholar
• Fessler HE. Undergraduate medical education in critical care. Crit Care Med. 2012;40(11):3065–3069.
   PubMedGoogle Scholar
• DeWaay D, McEvoy M, Alexander L, et al. Simulation curriculum can improve medical student assessment and management of acute coronary syndrome during a clinical practice exam. Am J Med Sci. 2014;347(6):452–456.
   PubMedGoogle Scholar
• McCoy C, Menchine M, Anderson C, et al. Prospective randomized crossover study of simulation vs. didactics for teaching medical students the assessment and management of critically ill patients. J Emerg Med. 2011;40(4):448–455.
   PubMed Web of Science ®Google Scholar
• Steadman R, Coates W, Huang Y, et al. Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Crit Care Med. 2006;34(1):151–157.
   PubMed Web of Science ®Google Scholar
• Pillow M, Stader D, Nguyen M, et al. Perceptions of basic, advanced, and pediatric life support training in a USA medical school. J Emerg Med. 2014;46(5):695–700.
   PubMedGoogle Scholar