494
Views
0
CrossRef citations to date
0
Altmetric
BEME Guide

A narrative review of course evaluation methods for continuing professional development: The case of paediatric and neonatal acute-care in-service courses in low and lower-middle income countries: BEME Guide No. 76

ORCID Icon, ORCID Icon, , ORCID Icon, , ORCID Icon, ORCID Icon, , ORCID Icon, , , , & ORCID Icon show all

References

  • Acker P, Newberry JA, Hattaway LB, Socheat P, Raingsey PP, Strehlow MC. 2016. Implementing an innovative prehospital care provider training course in nine Cambodian provinces. Cureus. 8(6):e656.
  • Arlington L, Kairuki AK, Isangula KG, Meda RA, Thomas E, Temu A, Mponzi V, Bishanga D, Msemo G, Azayo M, et al. 2017. Implementation of “Helping Babies Breathe”: a 3-year Experience in Tanzania. Pediatrics. 139(5):e20162132.
  • Ayieko P, Ntoburi S, Wagai J, Opondo C, Opiyo N, Migiro S, Wamae A, Mogoa W, Were F, Wasunna A, et al. 2011. A multifaceted intervention to implement guidelines and improve admission paediatric care in Kenyan district hospitals: a cluster randomised trial. PLOS Med. 8(4):e1001018.
  • Bang A, Patel A, Bellad R, Gisore P, Goudar SS, Esamai F, Liechty EA, Meleth S, Goco N, Niermeyer S, et al. 2016. Helping Babies Breathe (HBB) training: what happens to knowledge and skills over time? BMC Pregnancy Childbirth. 16(1):364.
  • Banke-Thomas A, Maua J, Madaj B, Ameh C, van den Broek N. 2020. Perspectives of stakeholders on emergency obstetric care training in Kenya: a qualitative study. Int Health. 12(1):11–18.
  • Barasa E, Ayieko P, Cleary S, English M. 2012. A multifaceted intervention to improve the quality of care of children in district hospitals in Kenya: a cost-effectiveness analysis. PLOS Med. 9(6):e1001238.
  • Becker M, Boon RL, Daman-Willems C, Langton J, Schapira D, Ntigurirwa P, Wachira J, Lissauer T. 2015. Does an emergency triage assessment and treatment plus admission (ETAT+) course followed by repeat visits of UK consultant paediatricians to district hospitals in a low income country improve children’s care? Arch Dis Child. 100(Suppl 3):A106–A108.
  • Bellad RM, Akash B, Carlo WA, McClure EM, Meleth S, Goco N, Goudar SS, Derman RJ, Hibberd PL, Patel A, for the HBB Study Group, et al. 2016. A pre-post study of a multi-country scale up of resuscitation training of facility birth attendants: does Helping Babies Breathe training save lives? BMC Pregnancy Childbirth. 16(1):1–10.
  • Berkley JA, Ross A, Mwangi I, Osier FHA, Mohammed M, Shebbe M, Lowe BS, Marsh K, Newton CRJC. 2003. Prognostic indicators of early and late death in children admitted to district hospital in Kenya: cohort study. BMJ. 326(7385):361.
  • Boyd N, Sharkey E, Nabukenya M, Tumukunde J, Sipuka N, Zyambo M, Walker I, Hart J, Byrne‐Davis L. 2019. The Safer Anaesthesia from Education (SAFE)® paediatric anaesthesia course: educational impact in five countries in East and Central Africa. Anaesthesia. 74(10):1290–1297.
  • Brennan MM, Fitzpatrick JJ, McNulty SR, Campo T, Welbeck J, Barnes G. 2013. Paediatric resuscitation for nurses working in Ghana: an educational intervention. Int Nurs Rev. 60(1):136–143.
  • Burnett F, Thuranira L. 2017. Utilising ETAT + to improve the management of gastroenteritis in a district general hospital in Kenya. Arch Dis Child. 102(S1):A123–A124.
  • Carlo W, Goudar S, Jehan I, Chomba E, Tshefu A, Garces A, Parida S, Althabe F, McClure E, Derman R, First Breath Study Group, et al. 2010. High mortality rates for very low birth weight infants in developing countries despite training. Pediatrics. 126(5):e1072-1080–e1080.
  • Carlo W, Goudar S, Jehan I, Chomba E, Tshefu A, Garces A, Parida S, Althabe F, McClure E, Derman R, First Breath Study Group, et al. 2010. Newborn-care training and perinatal mortality in developing countries. N Engl J Med. 362(7):614–623.
  • Carlo WA, McClure EM, Chomba E, Chakraborty H, Hartwell T, Harris H, Lincetto O, Wright LL. 2010. Newborn care training of midwives and neonatal and perinatal mortality rates in a developing country. Pediatrics. 126(5):e1064–e1071.
  • Carlo WA, Wright LL, Chomba E, McClure EM, Carlo ME, Bann CM, Collins M, Harris H, Carlo WA, Wright LL, et al. 2009. Educational impact of the neonatal resuscitation program in low-risk delivery centers in a developing country. J Pediatr. 154(4):504–508.e505.
  • Cavicchiolo ME, Daverio M, Lanzoni P, Segafredo G, Pizzol D, Putoto G, Trevisanuto D. 2017. Participants’ opinions of the limited impact of an adapted neonatal resuscitation course in a low-resource setting. Acta Paediatr. 106(2):344–344.
  • Chen CC, Werne AL, Osborn KA, Vo H, George U, Sawe H, Addo N, Cruz AT. 2019. Effectiveness of a pediatric emergency medicine curriculum in a public Tanzanian referral hospital. West J Emerg Med. 21(1):134–140.
  • Chomba E, McClure EM, Wright LL, Carlo WA, Chakraborty H, Harris H. 2008. Effect of WHO newborn care training on neonatal mortality by education. Ambul Pediatr. 8(5):300–304.
  • Clark M, Spry E, Daoh K, Baion D, Skordis-Worrall J. 2012. Reductions in inpatient mortality following interventions to improve emergency hospital care in Freetown, Sierra Leone. PLOS One. 7(9):e41458.
  • Close K, Karel M, White M. 2016. A pilot program of knowledge translation and implementation for newborn resuscitation using US Peace Corps volunteers in rural Madagascar. Global Health. 12(1):73–73.
  • Deorari AK, Paul VK, Singh M, Vidyasagar D. 2000. The national movement of neonatal resuscitation in India. J Trop Pediatr. 46(5):315–317.
  • Diaz JV, Ortiz JR, Lister P, Shindo N, Adhikari NK, collaborators W, WHO Critical Care Training Short Course orators 2018. Development of a short course on management of critically ill patients with acute respiratory infection and impact on clinician knowledge in resource‐limited intensive care units. Influenza Other Respir Viruses. 12(5):649–655.
  • Drake M, Bishanga DR, Temu A, Njozi M, Thomas E, Mponzi V, Arlington L, Msemo G, Azayo M, Kairuki A, et al. 2019. Structured on-the-job training to improve retention of newborn resuscitation skills: a national cohort Helping Babies Breathe study in Tanzania. BMC Pediatr. 19(1):1–8.
  • Eblovi D, Kelly P, Afua G, Agyapong S, Dante S, Pellerite M. 2017. Retention and use of newborn resuscitation skills following a series of helping babies breathe trainings for midwives in rural Ghana. Glob Health Action. DOI:10.1080/16549716.2017.1387985.
  • Evans CL, Bazant E, Atukunda I, Williams E, Niermeyer S, Hiner C, Zahn R, Namugerwa R, Mbonye A, Mohan D. 2018. Peer-assisted learning after onsite, low-dose, high-frequency training and practice on simulators to prevent and treat postpartum hemorrhage and neonatal asphyxia: a pragmatic trial in 12 districts in Uganda. PLOS One. 13(12):e0207909.
  • Ezhumalai G, Jayashree M, Nallasamy K, Bansal A, Bharti B. 2020. Referrals to a pediatric emergency department of a tertiary care teaching hospital before and after introduction of a referral education module-a quality improvement study. BMC Health Serv Res. 20(1):1–7.
  • Forsetlund L, O'Brien MA, Forsén L, Reinar LM, Okwen MP, Horsley T, Rose CJ.,. 2021. Continuing education meetings and workshops: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 9(9):Cd003030.
  • Frye AW, Hemmer PA. 2012. Program evaluation models and related theories: AMEE Guide No. 67. Med Teach. 34(5):e288–e299.
  • Gurung R, Gurung A, Sunny AK, Basnet O, Shrestha SK, Gomo ØH, Myklebust H, Girnary S, Ashish K. 2019. Effect of skill drills on neonatal ventilation performance in a simulated setting-observation study in Nepal. BMC Pediatr. 19(1):1–8.
  • Hagg E, Dahinten VS, Currie LM. 2018. The emerging use of social media for health-related purposes in low and middle-income countries: a scoping review. Int J Med Inform. 115:92–105.
  • Haug IA, Holte K, Chang CL, Purington C, Eilevstjønn J, Yeconia A, Kidanto H, Ersdal HL. 2020. Video analysis of newborn resuscitations after simulation-based Helping Babies Breathe training. Clin Simul Nurs. 44:68–78.
  • Hoban R, Bucher S, Neuman I, Chen M, Tesfaye N, Spector JM. 2013. Helping Babies Breathe’ training in sub-Saharan Africa: educational impact and learner impressions. J Trop Pediatr. 59(3):180–186.
  • Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, et al. 2014. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 348:g1687.
  • Hole MK, Olmsted K, Kiromera A, Chamberlain L. 2012. A neonatal resuscitation curriculum in Malawi, Africa: did it change in-hospital mortality? Int J Pediatr. 2012:408689.
  • Hosokawa S. 2011. Impact of neonatal resuscitation training workshop in Mongolia. Int Medical J. 18(2):133–136.
  • Isangula KG, Kassick ME, Kairuki AK, Meda RA, Thomas E, Temu A, Msemo G, Azayo M, Nelson BD. 2018. Provider experiences with the large-scale 'Helping Babies Breathe’ training programme in Tanzania. Paediatr Int Child Health. 38(1):46–52.
  • Kamath-Rayne BD, Thukral A, Visick MK, Schoen E, Amick E, Deorari A, Cain CJ, Keenan WJ, Singhal N, Little GA, et al. 2018. Helping babies breathe: a model for strengthening educational programs to increase global newborn survival. Glob Health Sci Pract. 6(3):538–551.
  • Kern DE. 2015. A six-step approach to curriculum development. Third edition. New York: Springer Publishing Company; p. 5–9.
  • Kirkpatrick D, Kirkpatrick J. 2006. Evaluating training programs: the four levels. San Francisco: Berrett-Koehler Publishers.
  • Kumar V, Kumar R, Khurana JL. 1989. Assessment of the effect of training on management of acute diarrhoea in a primary health care setting. J Diarrhoeal Dis Res. 7(3–4):70–76.
  • Leaf A, Clark E, Mohan V. 2017. Helping Babies Breathe in Madagascar: neonatal resuscitation training in the era of sustainable development goals. Infant. 13(6):250–254.
  • Liese KL, Maeder AB. 2018. Safer Muslim motherhood: social conditions and maternal mortality in the Muslim world. Glob Public Health. 13(5):567–581.
  • Manasyan A, Chomba E, McClure EM, Wright LL, Krzywanski S, Carlo WA, Eunice Kennedy Shriver National Institute of Child Health and Human Development Global Network for Women’s and Children’s Health Research. 2011. Cost-effectiveness of essential newborn care training in urban first-level facilities. Pediatrics. 127(5):e1176–e1181.
  • Manasyan A, Saleem S, Koso-Thomas M, Althabe F, Pasha O, Chomba E, Goudar S, Patel A, Esamai F, Garces A, for the EmONC Trial Group, et al. 2013. Assessment of obstetric and neonatal health services in developing country health facilities. Amer J Perinatol. 30(09):787–794.
  • Mduma ER, Ersdal H, Terje Kvaloy JAN, Svensen E, Mdoe P, Perlman J, Lessio Kidanto H, Soreide E. 2018. Using statistical process control methods to trace small changes in perinatal mortality after a training program in a low-resource setting. Int J Qual Health Care. 30(4):271–275.
  • Msemo G, Massawe A, Mmbando D, Rusibamayila N, Manji K, Kidanto HL, Mwizamuholya D, Ringia P, Ersdal HL, Perlman J. 2013. Newborn mortality and fresh stillbirth rates in Tanzania after helping babies breathe training. Pediatrics. 131(2):e353-360–e360.
  • Mukhtar-Yola M, Audu LI, Olaniyan O, Akinbi HT, Dawodu A, Donovan EF. 2018. Decreasing birth asphyxia: utility of statistical process control in a low-resource setting. BMJ Open Qual. 7(3):e000231.
  • Newble DI, Cannon RA. 2001. A handbook for medical teachers. Berlin (Germany): Springer Science & Business Media.
  • Nolan T, Angos P, Cunha AJ, Muhe L, Qazi S, Simoes EA, Tamburlini G, Weber M, Pierce NF. 2001. Quality of hospital care for seriously ill children in less-developed countries. Lancet. 357(9250):106–110.
  • Odongkara B, Tylleskär T, Pejovic N, Achora V, Mukunya D, Ndeezi G, Tumwine JK, Nankabirwa V. 2020. Adding video-debriefing to Helping-Babies-Breathe training enhanced retention of neonatal resuscitation knowledge and skills among health workers in Uganda: a cluster randomized trial. Glob Health Action. 13(1):1743496.
  • Olayo B, Kirigia CK, Oliwa JN, Agai ON, Morris M, Benckert M, Adudans S, Murila F, Wilson PT. 2019. Effective training-of-trainers model for the introduction of continuous positive airway pressure for neonatal and paediatric patients in Kenya. Paediatr Int Child Health. 39(3):193–200.
  • Olness K, Sinha M, Herran M, Cheren M, Pairojkul S. 2005. Training of health care professionals on the special needs of children in the management of disasters: experience in Asia, Africa, and Latin America. Ambul Pediatr. 5(4):244–248.
  • Olson K, Caldwell A, Sihombing M, Guarino AJ, Nelson BD. 2012. Community-based newborn resuscitation among frontline providers in a low-resource country. Int J Gynaecol Obstet. 119(3):244–247.
  • Olson KR, Caldwell A, Sihombing M, Guarino AJ, Nelson BD, Petersen R. 2015. Assessing self-efficacy of frontline providers to perform newborn resuscitation in a low-resource setting. Resuscitation. 89:58–63.
  • Opiyo N, Were F, Govedi F, Fegan G, Wasunna A, English M. 2008. Effect of newborn resuscitation training on health worker practices in Pumwani Hospital, Kenya. PLOS One. 3(2):e1599.
  • Pasha O, McClure E, Wright L, Saleem S, Goudar S, Chomba E, Patel A, Esamai F, Garces A, Althabe F, EMONC Trial Investigators, et al. 2013. A combined community- and facility-based approach to improve pregnancy outcomes in low-resource settings: a global network cluster randomized trial. BMC Med. 11:215.
  • Peck C, McCall M, McLaren B, Rotem T. 2000. Continuing medical education and continuing professional development: international comparisons. BMJ. 320(7232):432–435.
  • Pejovic NJ, Myrnerts Höök S, Byamugisha J, Alfvén T, Lubulwa C, Cavallin F, Nankunda J, Ersdal H, Blennow M, Trevisanuto D, et al. 2020. A randomized trial of laryngeal mask airway in neonatal resuscitation. N Engl J Med. 383(22):2138–2147.
  • Raven J, Utz B, Roberts D, van den Broek N. 2011. The 'Making it Happen’ programme in India and Bangladesh. BJOG. 118(Suppl 2):100–103.
  • Reed DA, Cook DA, Beckman TJ, Levine RB, Kern DE, Wright SM. 2007. Association between funding and quality of published medical education research. JAMA. 298(9):1002–1009.
  • Reed JE, Kaplan HC, Ismail SA. 2018. A new typology for understanding context: qualitative exploration of the model for understanding success in quality (MUSIQ). BMC Health Serv Res. 18(1):584.
  • Rice J, Shilofski N, Crichlow A, Hosein M, Jung J. 2015. A brief simulation-based educational intervention improves pediatric resuscitation performance among postgraduate trainees in Uganda. Acad Emerg Med. 1:S236.
  • Ryan R. 2013. Cochrane consumers and communication review group: data synthesis and analysis. Cochr Consum Commun Rev. (accessed 2022 Oct). http://cccrg.cochrane.org.
  • Sankar J, Das RR, Mahapatro S, Sankar MJ. 2019. Effect of a training strategy in improving medication fallacies during pediatric cardiopulmonary resuscitation: a before-and-after study from a developing country. Pediatr Emerg Care. 35(4):278–282.
  • Seto TL, Tabangin ME, Josyula S, Taylor KK, Vasquez JC, Kamath-Rayne BD. 2015. Educational outcomes of Helping Babies Breathe training at a community hospital in Honduras. Perspect Med Educ. 4(5):225–232.
  • Seto TL, Tabangin ME, Taylor KK, Josyula S, Vasquez JC, Kamath-Rayne BD. 2017. Breaking down the objective structured clinical examination: an evaluation of the Helping Babies Breathe OSCEs. Simul Healthc. 12(4):226–232.
  • Shilkofski N, Edwardson J, Adewale R, Ababon F, Tupas G. 2016. Evaluation of simulation-based neonatal/obstetric resuscitation training in a resourcepoor setting. Crit Care Med. 44(12):89–89.
  • Shrestha GS, Goffi A, Aryal D. 2016. Delivering neurocritical care in resource-challenged environments. Curr Opin Crit Care. 22(2):100–105.
  • Shrestha S, Petrini M, Turale S. 2013. Newborn care in Nepal: the effects of an educational intervention on nurses’ knowledge and practice. Int Nurs Rev. 60(2):205–211.
  • Sigalet EL, Lufesi N, Dubrowski A, Haji F, Khan R, Grant D, Weinstock P, Wishart I, Molyneux E, Kissoon N. 2021. Simulation and active learning decreases training time of an emergency triage assessment and treatment course in pilot study in Malawi: implications for increasing efficiency and workforce capacity in low-resource settings. Pediatr Emerg Care. 37(12):e1259–e1264.
  • Stufflebeam DL. 2007. CIPP evaluation model checklist. 2nd ed. (accessed 2022 Oct). https://wmich.edu/sites/default/files/attachments/u350/2014/cippchecklist_mar07.pdf.
  • Tabangin ME, Josyula S, Taylor KK, Vasquez JC, Kamath-Rayne BD. 2018. Resuscitation skills after Helping Babies Breathe training: A comparison of varying practice frequency and impact on retention of skills in different types of providers. Int Health. 10(3):163–171.
  • Tiruneh GT, Karim AM, Avan BI, Zemichael NF, Wereta TG, Wickremasinghe D, Keweti ZN, Kebede Z, Betemariam WA. 2018. The effect of implementation strength of basic emergency obstetric and newborn care (BEmONC) on facility deliveries and the met need for BEmONC at the primary health care level in Ethiopia. BMC Pregnancy Childbirth. 18(1):123.
  • Tosif S, Jatobatu A, Maepioh A, Gray A, Gilbert K, Hodgson J, Duke T. 2020. Implementation lessons from a multifaceted national newborn program in Solomon Islands: a mixed-methods study. Am J Trop Med Hyg. 102(3):667–675.
  • Trevisanuto D, Bertuola F, Lanzoni P, Cavallin F, Matediana E, Manzungu OW, Gomez E, Da Dalt L, Putoto G. 2015. Effect of a neonatal resuscitation course on healthcare providers’ performances assessed by video recording in a low-resource setting. PLOS One. 10(12):e0144443.
  • Trevisanuto D, Ibrahim SA, Doglioni N, Salvadori S, Ferrarese P, Zanardo V. 2007. Neonatal resuscitation courses for pediatric residents: comparison between Khartoum (Sudan) and Padova (Italy). Paediatr Anaesth. 17(1):28–31.
  • Tyndall P, Seddon E, Somwe SW, Seddon P. 2013. Evaluating the impact of introducing advanced paediatric life support training in a teaching hospital in Zambia. Arch Dis Child Educ Pract Ed. 98(Suppl 1):A68–A69.
  • Umunyana J, Sayinzoga F, Ricca J, Favero R, Manariyo M, Kayinamura A, Tayebwa E, Khadka N, Molla Y, Kim Y-M. 2020. A practice improvement package at scale to improve management of birth asphyxia in Rwanda: a before-after mixed methods evaluation. BMC Pregnancy Childbirth. 20(1):1–10.
  • United Nations. 2015. General Assembly Resolution A/RES/70/1. Transforming our world: the 2030 agenda for sustainable development. New York: UN Publishing. (accessed 2022 Oct). https://sdgs.un.org/sites/default/files/publications/21252030%20Agenda%20for%20Sustainable%20Development%20web.pdf.
  • Urayeneza O, Mujyarugamba P, Rukemba Z, Nyiringabo V, Ntihinyurwa P, Baelani JI, Kwizera A, Bagenda D, Mer M, Musa N, Sepsis in Resource-Limited Nations Workgroup of the Surviving Sepsis Campaign, et al. 2018. Increasing evidence-based interventions in patients with acute infections in a resource-limited setting: a before-and-after feasibility trial in Gitwe, Rwanda. Intensive Care Med. 44(9):1436–1446.
  • Urbano J, Matamoros MM, López-Herce J, Carrillo AP, Ordóñez F, Moral R, Mencía S. 2010. A paediatric cardiopulmonary resuscitation training project in Honduras. Resuscitation. 81(4):472–476.
  • Van Hecke A, Duprez V, Pype P, Beeckman D, Verhaeghe S. 2020. Criteria for describing and evaluating training interventions in healthcare professions – CRe-DEPTH. Nurse Educ Today. 84:104254.
  • Wang Y, Shipman C, Thahane L, Sanders J, Collins EM. 2018. A Helping Babies Breathe course: four-year follow-up in Lesotho and Malawi. Pediatrics. 142(1):524–524.
  • White MC, Rakotoarisoa T, Cox NH, Close KL, Kotze J, Watrous A. 2019. A mixed-method design evaluation of the SAFE obstetric anaesthesia course at 4 and 12–18 months after training in the Republic of Congo and Madagascar. Anesth Analg. 129(6):1707–1714.
  • Woods J, Gagliardi L, Nara S, Phally S, Varang O, Viphou N, Grundmann C, Liljestrand J. 2015. An innovative approach to in-service training of maternal health staff in Cambodian hospitals. Int J Gynaecol Obstet. 129(2):178–183.
  • World Bank. 2021. World Bank country and lending groups [accessed Dec 2021]. https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
  • Zafar S, Hafeez A, Qureshi F, Arshad N, Southall D. 2009. Structured training in the management of emergencies in mothers, babies and children in a poorly resourced health system: logbooks to document skill use. Resuscitation. 80(4):449–452.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.