Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic – A BEME systematic review: BEME Guide No. 71

References

• Astani SA, Langroudi TF, Haghighatkhah H, Keshavarz E, Bahrami-Motlagh H, Haseli S, Bagheri AK, Taheri MS. 2020. Radiology department and residency program response and adaption to COVID 19. Acad Radiol. 27(7):1054–1055.
   PubMed Web of Science ®Google Scholar
• Aulakh G, Duggal S, Sutton D. 2022. Findings from an OMFS journal club: is COVID-19 the catalyst we have needed to embrace technology? Br J Oral Maxillofac Surg. 60(1):46–51.
   PubMed Web of Science ®Google Scholar
• Balakrishnan R, Singh K, Harigopal M, Fineberg S. 2020. A novel “Google classroom”-based pathology education tool for trainees during the COVID-19 pandemic: impactful learning while social Distancing. Arch Pathol Lab Med. 144(12):1445b–11447.
   PubMed Web of Science ®Google Scholar
• Beer L, Gray M, Carbajal MM, French H, Vasquez M, Bauserman M, Bonachea EM. 2020. “Megaflip,” a novel approach to national collaboration for flipped classroom education.” Acad Pediatr. 20(6):758–759.
   PubMed Web of Science ®Google Scholar
• Bhashyam AR, Dyer GS. 2020. “Virtual” boot camp: orthopaedic intern education in the time of COVID-19 and beyond. J Am Acad Orthop Surg. 28(17):e735–E743.
   PubMed Web of Science ®Google Scholar
• Brader T. 2020. 367TF bilevel positive airway pressure basics for the emergency medicine resident. Ann Emerg Med. 76(4):142.
   Web of Science ®Google Scholar
• Bramer WM, Giustini D, de Jonge GB, Holland L, Bekhuis T. 2016. De-duplication of database search results for systematic reviews in EndNote. J Med Libr Assoc. 104(3):240–243.
   PubMed Web of Science ®Google Scholar
• Branch RM. 2009. Instructional design: the ADDIE approach. New York, NY: Springer.
   Google Scholar
• Buckley H. 2020. Faculty development in the COVID-19 pandemic: so close - yet so far. Med Educ. 54(12):1189–1190.
   PubMed Web of Science ®Google Scholar
• Carroll T, Mooney C, Horowitz R. 2021. Re-ACT: remote advanced communication training in a time of crisis. J Pain Symptom Manage. 61(2):364–368.
   PubMed Web of Science ®Google Scholar
• Cates A, Krueger J, Simpson S, Stobart-Gallagher M. 2020. Comparing the effectiveness of a virtual toxicology escape room at two emergency medicine residencies. Cureus. 12(10):e11262.
   PubMed Web of Science ®Google Scholar
• Clark JM, Sanders S, Carter M, Honeyman D, Cleo G, Auld Y, Booth D, Condron P, Dalais C, Bateup S, et al. 2020. Improving the translation of search strategies using the Polyglot Search Translator: a randomized controlled trial. J Med Libr Assoc. 108(2):195–207.
   PubMed Web of Science ®Google Scholar
• Clarke V, Braun V. 2013. Teaching thematic analysis: overcoming challenges and developing strategies for effective learning. Psychology. 26(2):120–123.
   Google Scholar
• Cook DA, Reed DA. 2015. Appraising the quality of medical education research methods: the medical education research study quality instrument and the Newcastle-Ottawa scale-education. Acad Med. 90(8):1067–1076.
   PubMed Web of Science ®Google Scholar
• Daniel M, Gordon M, Patricio M, Hider A, Pawlik C, Bhagdev R, Ahmad S, Alston S, Park S, Pawlikowska T, et al. 2021. An update on developments in medical education in response to the COVID-19 pandemic: a BEME scoping review: BEME Guide No. 64. Med Teach. 43(3):253–271.
   PubMed Web of Science ®Google Scholar
• Dedeilia A, Sotiropoulos MG, Hanrahan JG, Janga D, Dedeilia P, Sideris M. 2020. Medical and surgical education challenges and innovations in the COVID-19 era: a systematic review. In Vivo. 34(3):1603–1611.
   PubMed Web of Science ®Google Scholar
• Domen CH, Collins RL, Davis JJ. 2021. The APPCN multisite didactic initiative: development, benefits, and challenges. Clin Neuropsychol. 35(1):115–132.
   PubMed Web of Science ®Google Scholar
• Duggan MC, Goroncy A, Christmas C, Chippendale R. 2020. Staying afloat in the COVID-19 Storm: GERIAtrics fellows learning online and together (GERI-A-FLOAT). J Am Geriatr Soc. 68(10):E54–E56.
   PubMed Web of Science ®Google Scholar
• Durrani M. 2020. Debate style lecturing to engage and enrich resident education virtually. Med Educ. 54(10):955–956.
   PubMed Web of Science ®Google Scholar
• Elledge R, Williams R, Fowell C, Green J. 2020. Maxillofacial education in the time of COVID-19: the West Midlands experience. Br J Oral Maxillofac Surg. 4356(20):30373–30379.
   Google Scholar
• Elsayes KM, Marks RM, Kamel S, Towbin AJ, Kielar AZ, Patel P, Chernyak V, Fowler KJ, Nassar S, Soliman MA, et al. 2021. Online liver imaging course; pivoting to transform radiology education during the SARS-CoV-2 pandemic. Acad Radiol. 28(1):119–127.
   PubMed Web of Science ®Google Scholar
• Eltayar AN, Eldesoky NI, Khalifa H, Rashed S. 2020. Online faculty development using cognitive apprenticeship in response to COVID-19. Med Educ. 54(7):665–666.
   PubMed Web of Science ®Google Scholar
• Eusuf DV, England EL, Charlesworth M, Shelton CL, Thornton SJ. 2020. Maintaining education and professional development for anaesthesia trainees during the COVID-19 pandemic: the Self-isolAting Virtual Education (SAVEd) project. Br J Anaesth. 125(5):e432–E434.
   PubMed Web of Science ®Google Scholar
• Evans AJ, Depeiza N, Allen S, Fraser K, Shirley S, Chetty R. 2021. Use of whole slide imaging (WSI) for distance teaching. J Clin Pathol. 74(7):425–428.
   PubMed Web of Science ®Google Scholar
• Gordon M, Daniel M, Patricio M. 2019. What do we mean by ‘systematic’ in health education systematic reviews and why it matters!! Med Teach. 41(8):956–957.
   PubMed Web of Science ®Google Scholar
• Gordon M, Farnan J, Grafton-Clarke C, Ahmed R, Gurbutt D, McLachlan J, Daniel M. 2019. Non-technical skills assessments in undergraduate medical education: a focused BEME systematic review: BEME Guide No. 54. Med Teach. 41(7):732–745.
   PubMed Web of Science ®Google Scholar
• Gordon M, Gibbs T. 2014. STORIES statement: publication standards for healthcare education evidence synthesis. BMC Med. 12(1):143.
   PubMed Web of Science ®Google Scholar
• Gordon M, Hill E, Stojan J, Daniel M. 2018. Educational interventions to improve handover in health care: an updated systematic review. Acad Med. 93(8):1234–1244.
   PubMed Web of Science ®Google Scholar
• Gordon M, Patricio M, Horne L, Muston A, Alston S, Pammi M, Thammasitboon S, Park S, Pawlikowska T, Rees E, et al. 2020. Developments in medical education in response to the COVID-19 pandemic: a rapid BEME systematic review: BEME Guide No. 63. Med Teach. 42(11):1202–1215.
   PubMed Web of Science ®Google Scholar
• Grafton-Clarke C, Uraiby H, Gordon M, Rees E, Clarke N, Park S, Pammi M, Alston S, Khamees D, Peterson W, et al. 2021. Pivot to online learning for adapting or continuing workplace-based clinical learning in medical education following the COVID-19 pandemic: BEME Guide No. 70. Med Teach. DOI:https://doi.org/10.1080/0142159X.2021.1992372.
   Web of Science ®Google Scholar
• Hahn TW. 2020. Virtual noon conferences: providing resident education and wellness during the COVID-19 pandemic. PRiMER. 4:17.
   PubMedGoogle Scholar
• Hammick M, Dornan T, Steinert Y. 2010. Conducting a best evidence systematic review. Part 1: from idea to data coding. BEME guide no. 13. Med Teach. 32(1):3–15.
   PubMed Web of Science ®Google Scholar
• Henderson D, Woodcock H, Mehta J, Khan N, Shivji V, Richardson C, Aya H, Ziser S, Pollara G, Burns A. 2020. Keep calm and carry on learning: using microsoft teams to deliver a medical education programme during the COVID-19 pandemic. Future Healthc J. 7(3):e67–E70.
   PubMedGoogle Scholar
• Hodges C, Moore S, Lockee B, Trust T, Bond A. 2020. The difference between emergency remote teaching and online learning. Educause review. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning.
   Google Scholar
• Huang E, Pulice C, Sullivan A. 2020. Primary care mock codes during a pandemic: interprofessional team-based emergency education while maintaining social distance. Acad Pediatr. 20(6):759–760.
   PubMed Web of Science ®Google Scholar
• Johns Hopkins Coronavirus Resource Center. 2021. COVID-19 map. Johns Hopkins University and Medicine. [accessed 22 Feb 2021]. https://coronavirus.jhu.edu/map.html.
   Google Scholar
• Johnson KA, Stone BS, Murphy ME, Mattar MC. 2020. Web-based comparison of traditional didactics and flipped classroom on the management of Clostridioides difficile infection among internal medicine interns. Am J Gastroenterol. 115(1):643.
   Google Scholar
• Khamees D, Peterson W, Hider A, Commissaris C, Griffith M, Austin A, Spadafore M, Davis M, Stojan J, Pawlikowska T, et al. 2020. Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic: a BEME systematic review protocol. https://bemecollaboration.org/Reviews±In±Progress/Remote±learning±developments±in±postgraduate±medical±education/.
   Google Scholar
• Kimmons R, Graham CR, West RE. 2020. The PICRAT model for technology integration in teacher preparation. Contemp Issu Technol Teach Educ. 20(1):176–198.
   Google Scholar
• Kirkpatrick JD, Kirkpatrick WK. 2016. Kirkpatrick's four levels of training evaluation. Alexandria (VA): ATD Press.
   Google Scholar
• Lai L, Sato R, He S, Ouchi K, Leiter R, deLima Thomas J, Lawton A, Landman AB, Zhang H(M). 2020. Usage patterns of a web-based palliative care content platform (PalliCOVID) during the COVID-19 pandemic. J Pain Symptom Manage. 60(4):e20–E27.
   PubMed Web of Science ®Google Scholar
• Laksov KB, Dornan T, Teunissen PW. 2017. Making theory explicit – an analysis of how medical education researchers describe how they connect to theory. BMC Med Educ. 17(1):18.
   PubMed Web of Science ®Google Scholar
• Laloo R, Giorga A, Williams A, Biyani CS, Yiasemidou M. 2020. Virtual surgical education for core surgical trainees in the Yorkshire deanery during the COVID-19 pandemic. Scott Med J. 65(4):138–143.
   PubMed Web of Science ®Google Scholar
• Lang A, Burger B, Doraiswamy V, Peterson R, Shore D, Vithalani V, Pfarr M. 2020. POPCoRN one-pagers: educational materials for pediatric providers caring for adults. Acad Pediatr. 20(6):757–758.
   PubMed Web of Science ®Google Scholar
• Lau KHV. 2014. Computer-based teaching module design: principles derived from learning theories. Med Educ. 48(3):247–254.
   PubMed Web of Science ®Google Scholar
• Lee T, King L, Patel A, Zhang C, Patel YA, Kothari D. 2020. Education innovation during COVID-19 pandemic: using an interactive instant message application to enhance GI fellowship education. Am. J. Gastroenterol. 115(1):622–623.
   Google Scholar
• Lee Y, Park H, Pyun S, Yoon YW. 2020. Enforced format change to medical education webinar during the Coronavirus disease 2019 pandemic. Korean J Med Educ. 32(2):101–102.
   PubMedGoogle Scholar
• Lin SD. 2021. A virtual point‐of‐care ultrasound course during the COVID-19 pandemic. AEM Educ. Train. 5(1):102–104.
   PubMedGoogle Scholar
• Lingum NR, Sokoloff LG, Meyer RM, Gingrich S, Sodums DJ, Santiago AT, Feldman S, Guy S, Moser A, Shaikh S, et al. 2021. Building long-term care staff capacity during COVID-19 through just-in-time learning: evaluation of a modified ECHO model. J Am Med Dir Assoc. 22(2):238–244.e1.
   PubMed Web of Science ®Google Scholar
• Maeda Y, Takeda K, Hayama M, Tsuda T, Shikina T, Nishiike S, Kawashima K, Inohara H. 2020. Experience with online lectures about endoscopic sinus surgery using a video conferencing app. Auris Nasus Larynx. 47(6):1083–1085.
   PubMed Web of Science ®Google Scholar
• Martin-Gorgojo A, Bernabeu-Wittel J, Linares-Barrios M, Russo-de la Torre F, Garcia-Doval I, Del Rio-de la Torre E. 2020. Attendee survey and practical appraisal of a Telegram®-based dermatology congress during the COVID-19 confinement. Actas Dermosifiliogr (Engl Ed). 111(10):852–860.
   PubMed Web of Science ®Google Scholar
• Mayer RE. 2014. The Cambridge handbook of multimedia learning. 2nd ed. New York, NY: Cambridge University Press.
   Google Scholar
• McHugh ML. 2012. Interrater reliability: the kappa statistic. Biochem Med. 22(3):276–282.
   PubMed Web of Science ®Google Scholar
• McMahon CJ, Tretter JT, Faulkner T, Krishna Kumar R, Redington AN, Windram JD. 2021. Are e-learning webinars the future of medical education? An exploratory study of a disruptive innovation in the COVID-19 era. Cardiol Young. 31(5):734–710.
   PubMed Web of Science ®Google Scholar
• McNally K, Elahi N, Slome M, Ganti L, Lebowitz D, Macintosh T. 2020. Virtual telemedicine training for emergency medicine residents during the COVID-19 pandemic. Ann Emerg Med. 76(4):60.
   Web of Science ®Google Scholar
• Merali Z, Carayannopoulos KL, Lai A. 2020. All hands on deck: creation of an online internal medicine redeployment curriculum. Med Educ. 54(10):958–959.
   PubMed Web of Science ®Google Scholar
• Millwood R. 2013. Learning theories map. Holistic approach to technology-enhanced learning. [accessed 25 Feb 2021]. from http://hotel-project.eu/content/learning-theories-map-richard-millwood.
   Google Scholar
• Moyle A, Ross S, Jones M, Zhou J, Fitzpatrick C, Richardson D. 2020. Education hour’: online sexual health continuing professional development during the COVID-19 pandemic provides opportunities and inclusivity. Sex Transm Dis. 97:391.
   Web of Science ®Google Scholar
• Nasca TJ. 2020. ACGME's early adaptation to the COVID-19 pandemic: principles and lessons learned. J Grad Med Educ. 12(3):375–378.
   PubMedGoogle Scholar
• O’Connell A, Tomaselli PJ, Stobart-Gallagher M. 2020. Effective use of virtual gamification during COVID-19 to deliver the OB-GYN core curriculum in an emergency medicine resident conference. Cureus. 12(6):e8397.
   PubMed Web of Science ®Google Scholar
• Patel SM, Miller CR, Schiavi A, Toy S, Schwengel DA. 2020. The sim must go on: adapting resident education to the COVID-19 pandemic using telesimulation. Adv Simul. 5(1):11.
   PubMedGoogle Scholar
• Raber J, He S, Shayer D, Lai D, Raja A, Martin A. 2020. Get waivered remote: comment analysis of an interactive digital educational course for physicians obtaining a DEA-X waiver. Ann Emerg Med. 76(4):72–73.
   Web of Science ®Google Scholar
• Rasouli JJ, Shin JH, Than KD, Gibbs WN, Baum GR, Baaj AA. 2020. Virtual spine: a novel, international teleconferencing program developed to increase the accessibility of spine education during the COVID-19 pandemic. World Neurosurg. 140:e367–E372.
   PubMed Web of Science ®Google Scholar
• Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. 2007. Association between funding and quality of published medical education research. JAMA. 298(9):1002–1009.
   PubMed Web of Science ®Google Scholar
• Reed D, Price E, Windish D, Wright S, Gozu A, Hsu E, Beach MC, Kern D, Bass EB. 2005. Challenges in systematic reviews of educational intervention studies. Ann Intern Med. 142(12 Pt 2):1080–1099.
   PubMed Web of Science ®Google Scholar
• Rose C, Mott S, Alvarez A, Lin M. 2020. Physically distant, educationally connected: interactive conferencing in the era of COVID-19. Med Educ. 54(8):758–759.
   PubMed Web of Science ®Google Scholar
• Rotoli J, Bodkin R, Pereira J, Adler D, Lou V, Moriarty J, Williams J, Nobay F. 2020. Emergency medicine residency curricular innovations: creating a virtual emergency medicine didactic conference. AEM Educ Train. 4(3):270–274.
   PubMedGoogle Scholar
• Seow YT, Teo SC, Yap W, Foo Z, Tan KH. 2020. Interactive videoconferencing in the redesign of a health-care quality improvement workshop for the coronavirus disease 2019 pandemic. Proc Singapore Healthc. 30:201010582096179.
   Web of Science ®Google Scholar
• Shayer D, Raber J, He S, Raja A, Martin A. 2020. Get waivered remote: a nationwide, remote, and interactive educational conference designed in response to COVID-19. Ann Emerg Med. 76(4):73.
   Web of Science ®Google Scholar
• Shiang T, Cerniglia C, Lin H, Lo HS. 2021. Radiology podcasting as a model for asynchronous remote learning in the COVID-19 era. Clin Imaging. 71:147–154.
   PubMed Web of Science ®Google Scholar
• Singhi EK, Dupuis MM, Ross JA, Rieber AG, Bhadkamkar NA. 2020. Medical hematology/oncology Fellows’ perceptions of online medical education during the COVID-19 pandemic. J Cancer Educ. 35(5):1034–1040.
   PubMed Web of Science ®Google Scholar
• Srivastava V, Pandey V, Tiwari P, Patel S, Ansari MA, Shukla VK. 2020. Utility of real-time online teaching during COVID era among surgery postgraduates. Indian J Surg. 82(5):762–768.
   PubMed Web of Science ®Google Scholar
• Steeves-Reece AL, Elder NC, Graham TA, Wolf ML, Stock I, Davis MM, Stock RD. 2021. Rapid deployment of a statewide COVID-19 ECHO program for frontline clinicians: early results and lessons learned. J Rural Health. 37(1):227–230.
   PubMed Web of Science ®Google Scholar
• Stojan J, Haas M, Thammasitboon S, Lander L, Evans S, Pawlik C, Pawilkowska T, Lew M, Khamees D, Peterson W, et al. 2022. Online learning developments in undergraduate medical education in response to the COVID-19 pandemic: a BEME systematic review: BEME Guide No. 69. Med Teach. 44(2):109–129.
   PubMed Web of Science ®Google Scholar
• Tang PY, New LM, Leow WQ. 2021. Zooming for cells: tele-education of histopathology residents during the COVID-19 pandemic. Proc Singapore Healthc. 30(1):71–75.
   Web of Science ®Google Scholar
• Teele SA, Sindelar A, Brown D, Kane DA, Thatte N, Williams RJ, Gueverra J, Wolbrink TA. 2021. Online education in a hurry: delivering pediatric graduate medical education during COVID-19. Prog Pediatr Cardiol. 60:101320.
   PubMed Web of Science ®Google Scholar
• Turner S, Pham T, Robledo K, Turner S, Brown C, Sundaresan P. 2020. Rapid adaptation of cancer education in response to the COVID-19 pandemic: evaluation of a live virtual statistics and research skills workshop for oncology trainees. J Cancer Educ. DOI:https://doi.org/10.1007/s13187-020-01898-9.
   Web of Science ®Google Scholar
• Wlodarczyk JR, Alicuben ET, Hawley L, Sullivan M, Ault GT, Inaba K. 2020. Development and emergency implementation of an online surgical education curriculum for a general surgery program during a global pandemic: the University of Southern California experience. Am J Surg. 221:962–972
   PubMed Web of Science ®Google Scholar
• Yadala S, Nalleballe K, Sharma R, Lotia M, Kapoor N, Veerapaneni KD, Kovvuru S, Onteddu S. 2020. Resident education during COVID-19 pandemic: effectiveness of virtual electroencephalogram learning. Cureus. 12(10):e11094.
   PubMed Web of Science ®Google Scholar