1,537
Views
9
CrossRef citations to date
0
Altmetric
Research Article

Perceptions and valuation of a community-based education and service (COBES) program in Uganda

, , , , , , , , , , & show all
Pages e9-e15 | Published online: 23 Dec 2010

Abstract

Background: Community-based education and service (COBES) has been promoted to improve the education of health professionals, particularly in low-resource settings. However, few evaluations have been performed to guide program development.

Aim: This study assessed student and educator perceptions and valuation of a Ugandan COBES program.

Methods: We administered an internet-based survey to students, faculty, and site tutors associated with the Makerere University College of Health Sciences COBES program.

Results: 255 surveys were completed. Response rates varied (students, 188/684, 27.5%; faculty-site supervisors, 15/23, 65.2%; faculty general, 38/312, 12.2%; site tutors, 14/27, 51.9%). Students valued the COBES program (93.5% some/high value). Tutors enjoyed their work (92.9% agreeing/strongly agreeing). Faculty (n = 53) felt COBES was valuable (90.2% agreeing/strongly agreeing). High student valuation was associated with high quality accommodation (aOR 4.7, 95% CI = 1.6–13.4), free accommodation (aOR 2.9, 95% CI = 1.2–6.8), and tutors who demonstrated enthusiasm for teaching (aOR 3.4, 95% CI = 1.1–10.0). Areas identified for improvement included financial support, student preparation, and tutor training, feedback, and supervision.

Conclusion: In this study, COBES was perceived positively by students and educators and learning environment and quality of teaching both contributed to valuation of COBES. Well-implemented COBES programs may offer an opportunity to enhance health sciences education.

Introduction

Community-based education and service (COBES) is a strategy for health sciences education that was originally developed at Ilorin University in Nigeria in the 1960s (Bollag et al. Citation1982; Hamilton & Ogunbode Citation1991). Key principles of this approach are that students spend time in community placements (typically in rural settings), learning and service are interconnected, and students are attached to community-based health institutions where they are supervised by community-based site tutors (Bollag et al. Citation1982; Hamilton & Ogunbode Citation1991).

Makerere University College of Health Sciences (MUCHS) in Kampala, Uganda, underwent an extensive curricula evaluation and change in 2003 (Kiguli-Malwadde et al. Citation2006). One of the important changes implemented during this period was the development and integration of COBES into the health sciences clinical degree programs (medicine, dentistry, nursing, radiography, and pharmacy; Mubuuke et al. Citation2008; Ozgediz et al. Citation2008). Students in these programs now participate in COBES rotations every year, rotating among over 50 community-based sites.

While COBES has been promoted as a key initiative to improve health sciences education in Uganda and other low-resource settings, few evaluations have been performed of student, faculty and site tutors’ perceptions and valuation of their COBES experience. These types of evaluations are crucial in identifying strengths and weaknesses of current COBES programs to better guide future development of this educational strategy. Therefore, we conducted an internet-based survey of current COBES students, tutors, and associated faculty to assess their perceptions and valuation of COBES training at MUCHS.

Methods

Study setting and participants

Makerere University, the largest university in Uganda, was founded in 1922 and is considered to be one of the leading universities in Africa. MUCHS was established in December 2007, evolving from a medical school affiliated with the University College of London in the early 1900s, to a medicine faculty of Makerere University, and finally to a constituent college of the University. MUCHS consists of four schools: the School of Medicine, the School of Public Health, the School of Bio-medical Sciences, and the School of Health Sciences.

COBES has been implemented at MUCHS since 2003. During their first academic year, students participating in the COBES program initially undergo a 1 week orientation program at MUCHS that focuses on key aspects of community-based health education. Subsequently, they are sent in interdisciplinary teams to community-based sites, typically government or faith-based health facilities, where they spend about 4–6 weeks at a time. At each site, students are supervised by tutors, all of whom received prior tutor training at MUCHS. Site tutors lead students through problem-based learning sessions specific to the rotation. While at their sites, students are also expected to provide services to the community (such as helping with vaccinations). During their second to fourth academic years, students continue rotating through the COBES program on a yearly basis. Students typically return to the same site and, in addition to their previous responsibilities, are tasked to perform a community needs assessments and eventually design and implement a community project.

This survey was focused on three key target groups at MUCHS: (1) current medicine, dentistry, nursing, radiography, and pharmacy students who had already participated in at least one COBES rotation, (2) current site tutors who were responsible for supervising students and leading them in problem-based learning sessions at the community-based COBES sites, and (3) current Makerere faculty COBES site supervisors who were responsible for making regular site visits and ensuring that each site was running properly. General faculty who were not currently serving as faculty site supervisors were also surveyed, as they form the pool of potential future COBES site supervisors and are involved in related aspects of the students’ training.

Survey tool

We developed three separate, individualized multi-domain surveys for the three target groups using established principles of survey development (Kern et al. Citation1998). Content domains surveyed included stipends (referred to locally as “facilitation”), accommodations, feedback, supervision, readiness, educational content, tutor quality, and future plans. The surveys contained Likert scale questions (1 = disagree strongly/no value, 3 = neutral, 5 = agree strongly/high value), categorical questions, and free text questions. We pilot tested these surveys in Uganda among the study team and with volunteer students to assess face and content validity, then administered the survey using the internet-based survey software SurveyMonkey.com with Secure Sockets Layer (SSL) encryption.

Survey administration

The survey was administered from November 2, 2009 to December 4, 2009. Adapting standardized survey definitions for calculating response rate to this internet-based format (Aday & Cornelius Citation2006), our original sample size was 723 students, 39 site tutors, 23 faculty site supervisors, and 333 general faculty. Eligible units were defined as those persons with working email addresses which were available for 94.6% of students (684/723), 69.2% of site tutors (27/39), 100% of faculty site supervisors (23/23), and 93.7% of general faculty (312/333). Response rate was calculated as the number of surveys responded to divided by the number of eligible units. We used a variety of methods to improve response rates including reminder emails, flyers in student gathering locations, reminder short text message (SMS) text messages (using Frontline SMS, a free SMS messaging software tool, www.frontlinesms.com), reminder voice calls, letters, workshops, and personal reminders. An incentive for participation was provided in the form of entry into a lottery for USB flash drives. General faculty were not considered a priority group and only received email reminders.

Quantitative analysis

Demographics, other participant characteristics, and most categorical questions were analyzed descriptively. Wilcoxon rank sum tests were used to evaluate differences in mean response scores across different groups for several Likert responses. Univariate and multivariate logistic regression were used to calculate odds ratios for assigning high valuation (5) of COBES by students with various independent variables. As most responses were skewed towards higher values, we dichotomized most of the independent variables as “agree/strongly agree” (4, 5) versus “less than agree” (1, 2, or 3). Questions about students predicted likelihood of practicing in a rural setting were dichotomized as “greater than 50%” and “50% or less”. We a priori focused our univariate analysis on variables that we expected would be most predictive of key outcomes including demographic characteristics (gender, year in program, and degree program) as well as responses to Likert scale questions on stipends, accommodations, tutor qualities, and content of the COBES experience. Those variables that were significant at p < 0.05 in univariate analysis were entered into a multivariate model. Results for faculty were combined (n = 53) for ease of presentation. However, if there were significant differences in responses between site supervisors and general faculty, these were noted. All quantitative analyses were performed with SAS 9.2 (SAS Institute Inc., Cary, NC).

Qualitative analysis

Participants were also asked a number of free text questions which were qualitatively assessed through thematic analysis. Two study team members read all responses and collaboratively developed a codebook to reflect major themes identified from the data. Codes were then applied independently and summary statements were developed; differences in interpretation were resolved through discussion and consensus. Findings are presented by major identified themes (presented in ‘Results’ section in italics).

Ethics

This study was approved by the institutional review boards of Makerere University and the Johns Hopkins School of Medicine.

Results

A total of 255 surveys were completed. Response rates varied by target group (students, 188/684, 27.5%; faculty-site supervisors, 15/23, 65.2%; faculty general, 38/312, 12.2%; site tutors, 14/27, 51.9%). Characteristics of surveys respondents are listed in .

Table 1.  Characteristics of survey respondents

Students

shows student responses to Likert scale questions, student assessment of tutors, and importance placed on tutor characteristics. Students reported high valuation of the COBES experience and rated their tutors highly on most characteristics. However, they noted challenges with stipends, preparation for their posting, and accommodations.

Table 2.  Student responses to Likert scale questionsa

shows univariate and multivariate analyses of factors associated with high student valuation of COBES. Only factors found to be statistically significant at p < 0.05 are included in this table. No association with high student valuation was found for gender, year in program, type of degree program, or any other student responses’ to Likert scale questions (all p-values >0.05). Multivariate analyses found that three factors were significantly associated with high student valuation: accommodations of high quality, free accommodations, and a tutor who demonstrated enthusiasm for teaching.

Table 3.  Univariate and multivariate analyses of factors associated with high student valuation of COBES

In categorical responses, almost all students (93%, 174/188) indicated they did not receive their stipend before their COBES rotation began. Almost half (48%, 74/154) received free accommodations. About half (56%, 104/186) did not speak the native language of the community. Most students (86%, 160/186) recommended their COBES site to future students with most (86%, 159/186) also recommending their tutors. Half of the students (50%, 93/187) felt they saw the right amount of patients, with a significant minority (35%, 65/187) responding that they saw too many patients and some (16%, 29/187) reporting too few patient encounters. Most students (80%, 148/185) felt they interacted the right amount with community members. Also, shows student responses to the likelihood they would work in a rural setting after graduating; the most common response was a 50% chance of working in a rural setting (42.8%, 80/187).

Figure 1. Student rankings of likelihood they will pursue work in a rural setting after they graduate (n = 187).

Figure 1. Student rankings of likelihood they will pursue work in a rural setting after they graduate (n = 187).

In free text responses, almost all students (155/188) said that the best thing about COBES was the opportunity for a real-world experience where they were able to apply their medical education in a community-based setting. As one student stated, the best thing about COBES was “being able to see the relevancy of my medical school training to the communities in our country”. A significant number of students (52/188) cited the excitement of travel and adventure as a positive aspect of COBES as they were exposed to a “new environment, culture, way of living”. Students also noted (29/188) the positive benefits of friendships and teamwork developed through COBES.

The worst things about COBES which were frequently cited (130/188) included poor facilitation (stipends), i.e., lack of adequate financial support for students and tutors, and delays in receiving this facilitation. As one student described it, the worst thing about COBES was “poor facilitation, which greatly limits our ability to do as much as we could have been able to do, which in turn demoralizes us”. Poor accommodation was also frequently noted (67/188), as well as language barriers (31/188), and poor learning conditions (62/188), such as not having internet or adequately trained tutors at the COBES sites. When asked how student preparation for COBES placement could be improved, students reported that increased and more timely facilitation (127/188) and an improved learning environment (83/188) through provision of laptops, more orientation materials, better trained tutors, and more careful site selection would have been helpful.

Tutors

shows faculty and tutor responses to Likert scale questions. These responses demonstrated that most tutors enjoyed being a tutor and felt adequately prepared for their jobs, but many still wanted additional trainings. Categorical responses found that only half of tutors (50%, 7/14) indicated they received feedback from Makerere on their performance; just over half (57%, 8/14) received feedback from Makerere on the quality of their site. Most tutors (71%, 10/14) did not receive their stipend before the start of their last COBES rotation. However, despite these challenges, most (79%, 11/14) indicated they planned to be COBES tutors again in the future.

Table 4.  Faculty and tutor responses to Likert scale questions

Free text responses found that tutors felt the best things about COBES were most often (11/14) centered around perceived personal benefits such as “learned a lot of new things from students”. Worst things about COBES included poor facilitation (insufficient or delayed stipends) for both students and tutors (10/14). When asked what could have been done to help tutors better prepare for COBES, most (10/14) asked for more training and some specifically mentioned more supervision and feedback (4/14) and better facilitation (5/14).

Faculty

shows combined faculty responses to Likert scale questions. Faculty who were current site supervisors generally answered questions more positively than faculty non-site supervisors. In free text responses, faculty (43/53) said that the best thing about COBES was that it provided a community-based experience for students, e.g., “contextual learning is the ultimate leverage of COBES”. The worst things about COBES included poor facilitation (23/53) of tutors and students. Also mentioned was poor supervision (8/53), inadequate learning resources (7/53), and poor accommodations (6/53). Suggestions for improving COBES centered on increasing financial support (18/53), increasing learning resources (11/53) such as internet access and textbooks, and more trainings (14/53) of tutors and students.

Finally, shows student, faculty, and tutor responses to statements about the content of the COBES experience. Responses were generally positive across all groups. However, students were more likely to indicate that they did not see a wide range of medical conditions, that they did see a poor balance between men and women, and did not see a wide range of infectious diseases (all p-values < 0.05). Faculty who were current site supervisors tended to answer more positively than faculty who were not current site supervisors.

Table 5.  Student, faculty, and tutor responses to COBES experience statements

Discussion

An internet-based survey of students, faculty, and tutors participating in a Ugandan COBES program found that all groups generally perceived the program positively and valued the COBES experience. Survey participants felt a variety of real-world content was present in the COBES experience – content which is consistent with COBES principles of providing a diverse, community-based learning environment (Kiguli-Malwadde et al. Citation2006). However, this study also identified several key areas for improvement, including the need for better stipends/facilitation, improved accommodations, more training and better preparation for tutors and students, and improved learning conditions and resources.

Our findings indicate that both social and educational issues need to be addressed in order to improve the COBES experience. For example, accommodation, both its quality and cost, was positively associated with student valuation of COBES and was frequently mentioned by tutors and faculty as needing improvement. These results highlight the importance of providing a holistically supportive learning environment for students, involving physical resources such as accommodations as well as building upon strongly valued team and community interactions (Williams et al. Citation1999).

Students’ perceptions of their tutors’ characteristics indicated that certain characteristics were important to them and influenced how they valued the overall COBES experience. These characteristics, particularly enthusiasm for teaching, may serve as a model of ideal tutor behavior during future COBES training activities. These findings are consistent with previous reports that student satisfaction with tutors impacts their valuation of clinical training (Sisson et al. Citation2007).

Students repeatedly cited the benefits of learning in a real-world environment, the positive aspects of working in a team, and the opportunity to explore new areas of Uganda they had not visited before. However, they also noted several negative aspects of their experience. Inadequate stipends were frequently cited, an area challenging to address in low-resource settings. Many students felt they were unprepared for the COBES experience indicating the need for improvements in pre-COBES orientation and logistical support. Language barriers were also noted; pairing students with local bilingual community members may offer one solution to this problem.

Interestingly, many students indicated a greater than 50% likelihood they would work in a rural setting after graduating. Tutors and faculty also generally believed that the COBES program would encourage students to work in a rural setting in the future. Little is known about practice patterns after graduating from a COBES program (Ranmuthugala et al. Citation2007), and it will be important to follow cohorts such as this one to see if students do eventually end up working in rural, low-resource settings rather than contributing further to “brain drain” (List Citation2009; Zachariah et al. Citation2009).

Faculty responses were mostly positive toward various aspects of COBES. It is notable that responses from current site supervisors (whose efforts are compensated) were often more positive than from non site supervisors, pointing to the importance of surveying a variety of persons involved with such programs in order to gain a more complete understanding of perceptions. Faculty also indicated the need for tutors to have more trainings and the under-resourced nature of the program. Tutor responses indicated they enjoyed their experience though were also challenged by issues such as poor stipends. Tutors strongly indicated their desire and need for more training, supervision, and feedback, indicating an opportunity for targeted, evidence-based tutor trainings (Baroffio et al. Citation2007).

Study limitations include our response rates which, while consistent with internet-based survey response rates in the developed world, were still lower than we had hoped (Cook et al. Citation2000; Sheehan Citation2001; Nulty Citation2008; Shih & Xitao Citation2008). Our sub-optimal response rate may have resulted in a biased sample and limits generalizability within our participant groups. We also had difficulty finding working email addresses for many potentially eligible participants which may have been an additional source of bias. In particular, the number of working email addresses from tutors was small, an indication of the difficulty this program has with consistently communicating with tutors in areas which sometime lack electricity and often lack internet capacity. Further research on methods to reach hard to access subjects and improve response rates would be informative. However, to our knowledge, this study is one of the first reports of an internet-based survey performed in sub-Saharan Africa, and it confirms that it is feasible to conduct these types of surveys. Finally, our study was limited to assessing perceptions and valuation and was unable to measure more objective outcomes such as what environments students ultimately end up working in or competencies gained from the COBES experience. Future studies addressing these outcomes would be informative.

Conclusion

In summary, a multi-domain internet-based survey of students, tutors, and faculty involved with the COBES program at MUCHS in Uganda found a generally positive perception of the program and significant valuation by all groups. However, key areas needing improvement were also identified, most of which will require dedicated resources, human and financial, to address. Studies such as this one are useful in assessing current satisfaction, perceptions, and valuation of health education program participants and contribute important guidance for future iterations of these training strategies. This study's findings provide evidence that well supported and administered COBES programs offer an excellent opportunity to enhance the health sciences educational experience in this and similar low-resource settings.

Acknowledgments

This study was funded by a grant from the Bill and Melinda Gates Foundation. We thank the survey participants for their contributions. We also thank Ann Kasozi Nambi for her invaluable administrative and logistical support of this project.

Declaration of interest: The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article.

References

  • Aday LA, Cornelius LJ. Designing and conducting health surveys: A comprehensive guide. Jossey-Bass, San Francisco 2006
  • Baroffio A, Nendaz MR, Perrier A, Vu NV. Tutor training, evaluation criteria and teaching environment influence students’ ratings of tutor feedback in problem-based learning. Adv Health Sci Educ Theory Pract 2007; 12: 427–439
  • Bollag U, Schmidt H, Fryers T, Lawani J. Medical education in action: Community-based experience and service in Nigeria. Med Educ 1982; 16: 282–289
  • Cook C, Heath F, Thompson RL. A meta-analysis of response rates in web- or internet-based surveys. Educ Psychol Meas 2000; 60: 821–836
  • Hamilton JD, Ogunbode O. Medical education in the community: A Nigerian experience. Lancet 1991; 338: 99–102
  • Kern DE, Thomas PA, Howard DM, Bass EB. Curriculum development for medical education: A six-step approach. The Johns Hopkins University Press, Baltimore, MD 1998; 118–119
  • Kiguli-Malwadde E, Kijjambu S, Kiguli S, Galukande M, Mwanika A, Luboga S, Sewankambo N. Problem based learning, curriculum development and change process at Faculty of Medicine, Makerere University, Uganda. Afr Health Sci 2006; 6: 127–130
  • List JM. Justice and the reversal of the healthcare worker ‘brain-drain’. Am J Bioeth 2009; 9: 10–12
  • Mubuuke AG, Kiguli-Malwadde E, Byanyima R, Businge F. Evaluation of community based education and service courses for undergraduate radiography students at Makere University, Uganda. Rural Remote Health 2008; 8: 976
  • Nulty DD. The adequacy of response rates to online and paper surveys: What can be done?. Asses Eval High Educ 2008; 33: 301–314
  • Ozgediz D, Galukande M, Mabweijano J, Kijjambu S, Mijumbi C, Dubowitz G, Kaggwa S, Luboga S. The neglect of the global surgical workforce: Experience and evidence from Uganda. World J Surg 2008; 32: 1208–1215
  • Ranmuthugala G, Humphreys J, Solarsh B, Walters L, Worley P, Wakerman J, Dunbar JA, Solarsh G. Where is the evidence that rural exposure increases uptake of rural medical practice?. Aust J Rural Health 2007; 15: 285–288
  • Sheehan KB. E-mail survey response rates: A review. J Comput Mediat Commun 2001; 6: 0
  • Shih T-H, Xitao F. Comparing response rates from web and mail surveys: A meta-analysis. Field Methods 2008; 20: 249–271
  • Sisson SD, Boonyasai R, Baker-Genaw K, Silverstein J. Continuity clinic satisfaction and valuation in residency training. J Gen Intern Med 2007; 22: 1704–1710
  • Williams RL, Reid SJ, Myeni C, Pitt L, Solarsh G. Practical skills and valued community outcomes: The next step in community-based education. Med Educ 1999; 33: 730–737
  • Zachariah R, Ford N, Philips M, Lynch S, Massaquoi M, Janssens V, Harries AD. Task shifting in HIV/AIDS: Opportunities, challenges and proposed actions for sub-Saharan Africa. Trans R Soc Trop Med Hyg 2009; 103: 549–558

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.