Pivot to online learning for adapting or continuing workplace-based clinical learning in medical education following the COVID-19 pandemic: A BEME systematic review: BEME Guide No. 70

References

• Abraham HN, Opara IN, Dwaihy RL, Acuff C, Brauer B, Nabaty R, Levine DL. 2020. Engaging third-year medical students on their internal medicine clerkship in telehealth during COVID-19. Cureus. 12(6):e8791. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7381847/.
   PubMed Web of Science ®Google Scholar
• Adams CC, Shih R, Peterson PG, Lee MH, Heltzel DA, Lattin GE. Jr 2021. The impact of a virtual radiology medical student rotation: maintaining engagement during COVID-19 mitigation. Mil Med. 186(1–2):e234–e240.
   Web of Science ®Google Scholar
• Ali FM, Caesar JG, Chowdhury MMU. 2021. Electronic Learning for Healthcare e-Dermatology modules as a key educational tool for trainees during the COVID-19 pandemic: a regional experience. Clin Exp Dermatol. 46(2):371–372.
   PubMed Web of Science ®Google Scholar
• Alpert JB, Young MG, Lala SV, McGuinness G. 2021. Medical student engagement and educational value of a remote clinical radiology learning environment: creation of virtual read-out sessions in response to the COVID-19 pandemic. Acad Radiol. 28(1):112–118.
   PubMed Web of Science ®Google Scholar
• Baker DM, Bhatia S, Brown S, Cambridge W, Kamarajah SK, McLean KA, Brindl N, Lapolla P, Pérez-Ajates S, Raubenheimer K, et al. 2020. Medical student involvement in the COVID-19 response. Lancet. 395(10232):1254.
   PubMed Web of Science ®Google Scholar
• Bandi F, Karligkiotis A, Mellia J, Gallo S, Turri-Zanoni M, Battaglia P, Castelnuovo P. 2020. Strategies to overcome limitations in otolaryngology residency training during the COVID-19 pandemic. Eur Arch Otorhinolaryngol. 277(12):3503–3504.
   PubMed Web of Science ®Google Scholar
• Bautista CA, Huang I, Stebbins M, Floren LC, Wamsley M, Youmans SL, Hsia SL. 2020. Development of an interprofessional rotation for pharmacy and medical students to perform telehealth outreach to vulnerable patients in the COVID-19 pandemic. J Interprof Care. 34(5):694–697.
   PubMed Web of Science ®Google Scholar
• Belzer A, Olamiju B, Antaya RJ, Odell ID, Bia M, Perkins SH, Cohen JM. 2021. A novel medical student initiative to enhance provision of teledermatology in a resident continuity clinic during the COVID-19 pandemic: a pilot study. Int J Dermatol. 60(1):128–129.
   PubMed Web of Science ®Google Scholar
• Bramer WM, Giustini D, de Jonge GB, Holland L, Bekhuis T. 2016. De-duplication of database search results for systematic reviews in EndNote. J Med Libr Assoc. 104(3):240–243.
   PubMed Web of Science ®Google Scholar
• Cain R, Klink DS, Yunus S. 2020. Telemedicine implementation in family medicine: undergraduate clerkship during COVID-19 pandemic. Med Educ. 54(11):1064–1065.
   PubMed Web of Science ®Google Scholar
• Carson S, Peraza LR, Pucci M, Huynh J. 2020. Student hotline improves remote clinical skills and access to rural care. PRiMER. 4:22.
   PubMedGoogle Scholar
• Chandra S, Laoteppitaks C, Mingioni N, Papanagnou D. 2020. Zooming-out COVID-19: virtual clinical experiences in an emergency medicine clerkship. Med Educ. 54(12):1182–1183.
   PubMed Web of Science ®Google Scholar
• Chin KE, Kwon D, Gan Q, Ramalingam PX, Wistuba II, Prieto VG, Aung PP. 2021. Transition from a standard to a hybrid on-site and remote anatomic pathology training model during the coronavirus disease 2019 (COVID-19) pandemic. Arch Pathol Lab Med. 145(1):22–31.
   PubMed Web of Science ®Google Scholar
• Clarke V, Braun V. 2013. Teaching thematic analysis: overcoming challenges and developing strategies for effective learning. Psychologist. 26(2):120–123.
   Web of Science ®Google Scholar
• Coffey CS, MacDonald BV, Shahrvini B, Baxter SL, Lander L. 2020. Student perspectives on remote medical education in clinical core clerkships during the COVID-19 pandemic. Med Sci Educ. 30(4):1–8. https://pubmed.ncbi.nlm.nih.gov/33078085/.
   PubMedGoogle Scholar
• Cook DA, Bordage G, Schmidt HG. 2008. Description, justification and clarification: a framework for classifying the purposes of research in medical education. Med Educ. 42(2):128–133.
   PubMed Web of Science ®Google Scholar
• Custer JW, Simone S, Bhutta AT. 2021. Bedside rounds in intensive care units during the COVID-19 pandemic and beyond. J Pediatr Intensive Care. 10(03):210–215.
   PubMed Web of Science ®Google Scholar
• Daccache J, Khoury M, Habibi C, Bennett S. 2020. More than just soup: use of a student-led COVID-19 social pediatrics initiative to propose the integration of social medicine electives in undergraduate medical education. J Med Educ Curric Dev. 7:2382120520973210.
   Web of Science ®Google Scholar
• Dako F, Awan OA. 2021. The radiology readout: how much does it matter? Radiographics. 41(1):316–317.
   PubMed Web of Science ®Google Scholar
• Daniel M, Gordon M, Patricio M, Hider A, Pawlik C, Bhagdev R, Ahmad S, Alston S, Park S, Pawlikowska T, et al. 2021. An update on developments in medical education in response to the COVID-19 pandemic: a BEME scoping review: BEME Guide No. 64. Med Teach. 0(0):1–52.
   Google Scholar
• Darnton R, Lopez T, Anil M, Ferdinand J, Jenkins M. 2021. Medical students consulting from home: a qualitative evaluation of a tool for maintaining student exposure to patients during lockdown. Med Teach. 43(2):160–167.
   PubMed Web of Science ®Google Scholar
• De Ponti R, Marazzato J, Maresca AM, Rovera F, Carcano G, Ferrario MM. 2020. Pre-graduation medical training including virtual reality during COVID-19 pandemic: a report on students' perception. BMC Med Educ. 20(1):332.
   PubMed Web of Science ®Google Scholar
• DePietro DM, Santucci SE, Harrison NE, Kiefer RM, Trerotola SO, Sudheendra D, Shamimi-Noori S. 2021. Medical student education during the COVID-19 pandemic: initial experiences implementing a virtual interventional radiology elective course. Acad Radiol. 28(1):128–135.
   PubMed Web of Science ®Google Scholar
• DeWitt DE. 2020. Fighting COVID-19: enabling graduating students to start internship early at their own medical school. Ann Intern Med [Internet]. [accessed 2021 Feb 14]. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7151353/.
   Google Scholar
• Dong A, Simpson F, Qu W, Javidfar J. 2021. Clinical medical education: cardiothoracic surgery in the era of COVID-19. J Card Surg. 36(1):409–410.
   PubMed Web of Science ®Google Scholar
• Dornan T, Pearson E, Carson P, Helmich E, Bundy C. 2015. Emotions and identity in the figured world of becoming a doctor. Med Educ. 49(2):174–185.
   PubMed Web of Science ®Google Scholar
• Dow N, Wass V, Macleod D, Muirhead L, McKeown J. 2020. GP Live’- recorded General Practice consultations as a learning tool for junior medical students faced with the COVID-19 pandemic restrictions. Educ Prim Care. 31(6):377–381.
   PubMed Web of Science ®Google Scholar
• Durfee SM, Goldenson RP, Gill RR, Rincon SP, Flower E, Avery LL. 2020. Medical student education roadblock due to COVID-19: virtual radiology core clerkship to the rescue. Acad Radiol. 27(10):1461–1466.
   PubMed Web of Science ®Google Scholar
• Gallardo FC, Martin C, Targa Garcia AA, Bustamante JL, Nuñez M, Feldman SE. 2020. Home program for acquisition and maintenance of microsurgical skills during the coronavirus disease 2019 outbreak. World Neurosurg. 143:557–563.e1.
   PubMed Web of Science ®Google Scholar
• Gill D, Whitehead C, Wondimagegn D. 2020. Challenges to medical education at a time of physical distancing. Lancet. 396(10244):77–79.
   PubMed Web of Science ®Google Scholar
• Gomez E, Azadi J, Magid D. 2020. Innovation born in isolation: rapid transformation of an in-person medical student radiology elective to a remote learning experience during the COVID-19 pandemic. Acad Radiol. 27(9):1285–1290.
   PubMed Web of Science ®Google Scholar
• Gordon M, Farnan J, Grafton-Clarke C, Ahmed R, Gurbutt D, McLachlan J, Daniel M. 2019. Non-technical skills assessments in undergraduate medical education: a focused BEME systematic review: BEME Guide No. 54. Med Teach. 41(7):732–745.
   PubMed Web of Science ®Google Scholar
• Gordon M, Gibbs T. 2014. STORIES statement: publication standards for healthcare education evidence synthesis. BMC Med. 12:143. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4243720/.
   PubMed Web of Science ®Google Scholar
• Gordon M, Grafton-Clarke C, Uraiby H, Rees E, Clarke N, Pammi M, Alston S, Khamees D, Peterson W, Stojan J, et al. 2021. Pivot to online learning for adapting or continuing workplace-based clinical learning in medical education following the COVID-19 pandemic-a BEME systematic review [Internet]. https://bemecollaboration.org/Reviews+In+Progress/Pivot+to+online+learning/.
   Google Scholar
• Gordon M, Hill E, Stojan JN, Daniel M. 2018. Educational interventions to improve handover in health care: an updated systematic review. Acad Med. 93(8):1234–1244.
   PubMed Web of Science ®Google Scholar
• Gordon M, Patricio M, Horne L, Muston A, Alston SR, Pammi M, Thammasitboon S, Park S, Pawlikowska T, Rees EL, et al. 2020. Developments in medical education in response to the COVID-19 pandemic: a rapid BEME systematic review: BEME Guide No. 63. Med Teach. 42(11):1202–1215.
   PubMed Web of Science ®Google Scholar
• Ha E, Zwicky K, Yu G, Schechtman A. 2020. Developing a telemedicine curriculum for a family medicine residency. PRiMER. 4:21.
   PubMedGoogle Scholar
• Hammick M, Dornan T, Steinert Y. 2010. Conducting a best evidence systematic review. Part 1: from idea to data coding. BEME Guide No. 13. Med Teach. 32(1):3–15.
   PubMed Web of Science ®Google Scholar
• Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, Welch V. 2020. Cochrane handbook for systematic reviews of interventions version 6.1 [Internet]. www.training.cochrane.org/handbook.
   Google Scholar
• Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JAC. 2011. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ. 343:d5928.
   PubMed Web of Science ®Google Scholar
• Hofmann H, Harding C, Youm J, Wiechmann W. 2020. Virtual bedside teaching rounds with patients with COVID-19. Med Educ. 54(10):959–960.
   PubMed Web of Science ®Google Scholar
• Huffman LC, Feldman HM, Hubner LM. 2020. Fellows front and center: tele-training and telehealth. Acad Pediatr. 20(6):764–765.
   PubMed Web of Science ®Google Scholar
• Jack MM, Gattozzi DA, Camarata PJ, Shah KJ. 2021. Live-streaming surgery for medical student education – educational solutions in neurosurgery during the COVID-19 pandemic. J Surg Educ. 78(1):99–103.
   PubMed Web of Science ®Google Scholar
• Kahn JM, Fields EC, Pollom E, Wairiri L, Vapiwala N, Nabavizadeh N, Thomas CR, Jimenez RB, Chandra RA. 2021. Increasing medical student engagement through virtual rotations in radiation oncology. Adv Radiat Oncol. 6(1):100538.
   PubMedGoogle Scholar
• Khamees D, Peterson W, Madalena P, Commissaris C, Austin A, Davis M, Spadafore M, Hider A, Stojan J, Grafton-Clarke C, et al. 2021. Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic: a BEME systematic review. [under review]
   Google Scholar
• Kirkpatrick J, Kirkpatrick W. 2016. Kirkpatrick’s four levels of training evaluation [Internet]. Association for Talent Development; [accessed 2021 Feb 17]. https://blackwells.co.uk/bookshop/product/Kirkpatricks-Four-Levels-of-Training-Evaluation-by-.
   Google Scholar
• Krawiec C, Myers A. 2020. Remote assessment of video-recorded oral presentations centered on a virtual case-based module: a COVID-19 feasibility study. Cureus. 12(6):e8726. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7372193/.
   PubMed Web of Science ®Google Scholar
• Lal A, Bell G, Curseen K, Kavalieratos D. 2020. Teaching telepalliative care: an elective rotation for medical students during the COVID-19 pandemic. J Palliat Med. 24(3):318–319. https://pubmed.ncbi.nlm.nih.gov/33107773/.
   Google Scholar
• Matalon SA, Souza DAT, Gaviola GC, Silverman SG, Mayo-Smith WW, Lee LK. 2020. Trainee and attending perspectives on remote radiology readouts in the era of the COVID-19 pandemic . Acad Radiol. 27(8):1147–1153.
   PubMed Web of Science ®Google Scholar
• McHugh ML. 2012. Interrater reliability: the kappa statistic. Biochem Med. 22(3):276–282.
   PubMed Web of Science ®Google Scholar
• McRoy C, Patel L, Gaddam DS, Rothenberg S, Herring A, Hamm J, Chelala L, Weinstein J, Smith E, Awan O. 2020. Radiology education in the time of COVID-19: a novel distance learning workstation experience for residents. Acad Radiol. 27(10):1467–1474.
   PubMed Web of Science ®Google Scholar
• Michener A, Fessler E, Gonzalez M, Miller RK. 2020. The 5 M's and more: a new geriatric medical student virtual curriculum during the COVID-19 pandemic. J Am Geriatr Soc. 68(11):E61–E63.
   PubMed Web of Science ®Google Scholar
• Munusamy T, Karuppiah R, Bahuri NFA, Sockalingam S, Cham CY, Waran V. 2021. Telemedicine via smart glasses in critical care of the neurosurgical patient-COVID-19 pandemic preparedness and response in neurosurgery. World Neurosurg. 145:e53–e60.
   PubMed Web of Science ®Google Scholar
• Nagji A, Yilmaz Y, Zhang P, Dida J, Cook‐Chaimowitz L, Dong JK, Colpitts L, Beecroft J, Chan TM. 2020. Converting to connect: a rapid RE-AIM evaluation of the digital conversion of a clerkship curriculum in the age of COVID-19. AEM Educ Train. 4(4):330–339.
   PubMedGoogle Scholar
• O’Doherty D, Dromey M, Lougheed J, Hannigan A, Last J, McGrath D. 2018. Barriers and solutions to online learning in medical education – an integrative review. BMC Med Educ. 18(1):130.
   PubMed Web of Science ®Google Scholar
• Pasricha ND, Haq Z, Ahmad TR, Chan L, Redd TK, Seitzman GD, Parikh N, Kim TN, Schallhorn JM, Ramanathan S. 2020. Remote corneal suturing wet lab: microsurgical education during the COVID-19 pandemic. J Cataract Refract Surg. 46(12):1667–1673.
   PubMed Web of Science ®Google Scholar
• Pennell CE, Kluckow H, Chen SQ, Wisely KM, Walker BL. 2020. Live-streamed ward rounds: a tool for clinical teaching during the COVID-19 pandemic. Med J Aust. 213(7):306–308.e1.
   PubMed Web of Science ®Google Scholar
• PRISMA. 2015. Preferred reporting items for systematic reviews and meta-analyses (PRISMA) [Internet]. http://prisma-statement.org/.
   Google Scholar
• Recht MP, Fefferman NR, Bittman ME, Dane B, Fritz J, Hoffmann JC, Hood J, Mercado CL, Mahajan S, Sheth MM. 2020. Preserving radiology resident education during the COVID-19 pandemic: the simulated daily readout. Acad Radiol. 27(8):1154–1161.
   PubMed Web of Science ®Google Scholar
• Reed D, Price EG, Windish DM, Wright SM, Gozu A, Hsu EB, Beach MC, Kern D, Bass EB. 2005. Challenges in systematic reviews of educational intervention studies. Ann Intern Med. 142(12 Pt 2):1080–1089.
   PubMed Web of Science ®Google Scholar
• Salcedo D, Huang W-C, Suk F-M, Lin C-W. 2020. Enhanced telepresence for clinical training in high-risk environments. Med Educ. 54(11):1063–1064.
   PubMed Web of Science ®Google Scholar
• Samueli B, Sror N, Jotkowitz A, Taragin B. 2020. Remote pathology education during the COVID-19 era: crisis converted to opportunity. Ann Diagn Pathol. 49:151612.
   PubMed Web of Science ®Google Scholar
• Sandhu N, Frank J, von Eyben R, Miller J, Obeid J-P, Kastelowitz N, Panjwani N, Soltys S, Bagshaw HP, Donaldson SS, et al. 2020. Virtual radiation oncology clerkship during the COVID-19 pandemic and beyond. Int J Radiat Oncol Biol Phys. 108(2):444–451.
   PubMed Web of Science ®Google Scholar
• Server S, Uddin S, GoodSmith M, Zhang A, Sherer R, Lio J. 2020. Learning at a social distance: a medical student telehealth service for COVID-19 patients. MedEdPublish. 9(1):290. https://www.mededpublish.org/manuscripts/3492.
   Google Scholar
• Shibata J, Weingrow D, Tabibnia A, Lim G, Chiem A. 2020. Ultrasound treasure hunt: a novel teaching method that overcomes direct-patient care restrictions brought on by the COVID-19 pandemic. AEM Educ Train. 5(1):99–101.
   PubMedGoogle Scholar
• Shin TH, Klingler M, Han A, Mocsiran JL, Vilchez V, Naples R, French J, Lipman JM, Rosenblatt S. 2020. Efficacy of virtual case-based general surgery clerkship curriculum during COVID-19 distancing. Med Sci Educ. 31(1):1–8.
   Google Scholar
• Singh K, Chandra A, Lonergan K, Bhatt A. 2020. Using simulation to assess cardiology fellow performance of transthoracic echocardiography: lessons for training in the COVID-19 pandemic. J Am Soc Echocardiogr. 33(11):1421–1423.
   PubMed Web of Science ®Google Scholar
• Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I, et al. 2016. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 355:i4919.
   PubMed Web of Science ®Google Scholar
• Stojan J, Haas M, Thammasitboon S, Lander L, Evans S, Pawlik C, Pawilkowska T, Lew M, Khamees D, Peterson W, et al. 2021. Remote learning developments in undergraduate medical education in response to the COVID-19 pandemic: a BEME systematic review. [under review]
   Google Scholar
• Trujillo CJ, Tirado PA, Vivas GE, Eulufi FC, Cohen JV. 2020. Surgical training during COVID-19: a validated solution to keep on practicing. BJS Br J Surg. 107(11):e468–e469.
   PubMed Web of Science ®Google Scholar
• Tsang ACO, Lee PP-W, Chen JY, Leung GKK. 2020. From bedside to webside: a neurological clinical teaching experience. Med Educ. 54(7):660.
   PubMed Web of Science ®Google Scholar
• Yang T, Buck S, Evans L, Auerbach M. 2021. A telesimulation elective to provide medical students with pediatric patient care experiences during the COVID pandemic. Pediatr Emerg Care. 37(2):119–122.
   PubMed Web of Science ®Google Scholar