Monitoring and evaluation of sport-based HIV/AIDS awareness programmes: Strengthening outcome indicators

Figures & data

Table 1. Proposed outcome indicators for knowledge of HIV/AIDS.

Objective: To improve knowledge of HIV/AIDS
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Improved knowledge of HIV/AIDS amongst participants	Percentage of participants who identify correct modes and dispels myths about how HIV/AIDS is transmitted	Grassroot Soccer (2014)	Data to be collected through surveys using HIV knowledge questions Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
	Percentage of participants who correctly identify ways of preventing sexual transmission of HIV/AIDS and who reject major misconceptions about HIV/AIDS	Carter (2006) Peacock-Villada et al. (2006) Mercy Corps (2007) United Nations MDG (2008) Maro et al. (2009) Fuller et al. (2010, 2011) Farrar and Math (2010, 2012) Luppe (2010) DBE (2012) Kaufman et al. (2012) USAID (2013) UNAIDS (2013, 2014, 2015)

Table 2. Proposed outcome indicators for HIV risk behaviours.

Objective: To raise awareness of HIV risk behaviours
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Improved knowledge of benefits associated with delaying sexual intercourse	Percentage of participants who identify benefits associated with delaying sexual intercourse	This study	Data to be collected through surveys using HIV risk behaviours questions Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
Positive attitude towards delaying sexual intercourse	Percentage of participants reporting positive attitude towards delaying sexual intercourse
Positive intention to delay sexual intercourse	Percentage of participants reporting to have intention to delay sexual intercourse	Delva et al. (2010) Farrar and Math (2010)
Improved knowledge of risks associated with having multiple concurrent sexual partners	Percentage of participants who identify risks associated with having multiple concurrent sexual partners	Grassroot Soccer (2014)
Improved knowledge of risks associated with engaging in transactional sex (provision of sex in exchange for material things, for example, money, airtime, clothing, lunch etc.	Percentage of participants who identify risks associated with engaging in transactional sex	This study
Improved knowledge of risks associated with age disparate sex/cross-generational sex	Percentage of participants who identify risks associated with having non-marital sex with a partner 10 years older or more than themselves
	Percentage of adolescents participants who identify risks associated with dating a partner 5 years older than themselves
	Percentage of participants who identify risks associated with having older sexual partners
Improved knowledge of risks associated with alcohol and drugs misuse	Percentage of participants who identify risks associated with having sex under the influence of alcohol and drugs misuse
	Percentage of participants who identify risks associated with having a relationship with a partner who misuses alcohol and drugs

Table 3. Proposed outcome indicators for condom use.

Objective: To raise awareness and access to condoms (male and female condoms)
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Improved knowledge of benefits associated with condom use	Percentage of participants who identify how to correctly use a condom and what benefits it provides	Grassroot Soccer (2014)	Data to be collected through surveys using HIV risk behaviours questions associated with condom use Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
Improved knowledge of benefits associated with consistent condom use	Percentage of participants believing that consistent condom use reduces risks of HIV	Keating et al. (2006)
Improved knowledge of benefits associated with consistent condom use	Percentage of participants believing that consistent condom use reduces risks of HIV infection, STIs and unwanted pregnancy	This study
Positive attitude towards condom use	Percentage of participants who feel that a partner is justified in refusing unsafe sex or proposing condom use if they know their partner has STI
Positive intention to use condom	Percentage of participants reporting intention to use condom at their first sexual intercourse, of those reporting to be not sexual active	Clark et al. (2006) Mercy Corps, (2007) Maro et al. (2009)
Increased perceived self-efficacy to negotiate condom use with a partner	Percentage of participants reporting perceived self-efficacy to negotiate condom use with a partner	This study
	Percentage of participants reporting perceived efficacy to refuse unprotected sex	Farrar and Math (2010) Maro et al. (2009)
Increased awareness about where to access condoms	Percentage of participants reporting to know where to access condoms	Delva et al. (2010)
	Percentage of participants reporting having easy access to condoms	This study
	Percentage of participants reporting to be not ashamed to collect or buy condoms

Table 4. Proposed generic outcome indicators for HCT.

Objective: To promote uptake of HCT
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Improved knowledge of benefits associated with taking an HIV test	Percentage of participants who identify benefits associated with taking an HIV test	This study	Data to be collected through surveys using questions associated with uptake of HCT Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
Positive attitude towards uptake of HCT	Percentage of participants reporting willing to go for an HIV test	Carter (2006) Farrar and Math (2010) Grassroot Soccer (2014)
Increased uptake of HCT services	Percentage of participants graduated from sport-based HIV/AIDS awareness programme tested for HIV and receive/know their result	Grassroot Soccer (2014)	Data to be collected from the Department of Health (DOH) HCT forms that are normally used by testing NGOs, clinics and other testing centres A short surveys can be used during testing campaigns/events asking if a person have ever tested for HIV. This will assist to determine percentage of those who tested for HIV for the first time The DOH HCT forms has a question asking if someone is getting tested for the first time Indicators should be disaggregated by gender and age The HCT data can be compared from the current and the previous years (and targets could be set)
	Percentage of participants graduated from sport-based HIV/AIDS awareness programme first ever tested for HIV	This study
	Percentage of participants tested for HIV at sport events and receive/know their result
	Percentage of participants tested for HIV at sport events first ever tested for HIV at sport events

Table 5. Proposed generic outcome indicators for gender norms.

Objective: To raise awareness about gender norms that increase risk of HIV infection
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Reduction in gender norms that increase risk of HIV infections	Percentage of participants express gender equity-primarily in regard to gender-based violence	Grassroot Soccer (2014)	Data to be collected through surveys using gender norms as related to HIV/AIDS questions Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
	Percentage of participants reporting to be against sexual violence	Farrar and Math (2010)
	Percentage of participants reporting to believe in equality in a relationship
	Percentage of participants reporting to believe that girls should be respected	Fuller et al. (2010, 2011)
	Percentage of participants reporting that boys should protect and not harm girls
	Percentage of participants reporting to believe that football is for boys only	Fuller et al. (2011)
	Percentage of participants reporting to believe that rugby is for boys only	This study

Table 6. Proposed generic outcome indicators for HIV treatment, care and support.

Objective: To promote uptake of HIV treatment, care and support Eligible individuals: participants who test HIV positive through sport-based HIV/AIDS awareness programmes
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Increased percentage of participants referred: HIV care and support services	Percentage of participants who test HIV positive and referred for a tertiary test, clinic enrolment, CD4 counts and ART. Every participant who tests HIV positive should receive one of the service referrals	Grassroot Soccer (2014)	Data to be collected through registers as well as one-one interviews with HIV positive participants Confidentiality should be kept at all stages of communication Indicators should be disaggregated by gender and age
Improved knowledge of benefits associated with taking ARV/HIV treatment	Percentage of HIV positive participants who identify benefits associated with taking ARV/HIV treatment	This study
Improved knowledge of benefits associated with adhering to ARV/HIV treatment	Percentage of HIV-positive participants who identify benefits associated with adhering to ARV/HIV treatment
Increased follow-up with HIV positive participants	Percentage of HIV positive participants receive follow-up from the NGOs	Grassroot Soccer (2014)

Table 7. Proposed outcome indicators for VMMC.

Objective: To promote uptake of VMMC Eligible individuals: MCUTS 1 and 11 trial participants: This topic should be touched on in all sport-based HIV/AIDS awareness curricular, but the referrals should be explicitly offered only in MCUTS
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Improved knowledge of benefits associated with VMMC	Percentage of male participants who identify the benefits of VMMC and where this service is offered	Grassroot Soccer (2014)	Data to be collected through surveys Pre & post for intervention group If possible have a control group and do pre & post
Increased percentage of male participants referred: VMMC	Percentage of male participants who access information, request, and receive counselling, and are referred for VMMC procedures	Grassroot Soccer (2014)	Data to be collected through registers as well as one-one interviews with male participants Confidentiality should be kept at all stages of communication
	Percentage of male participants reporting to have uptake circumcision after being motivated at the intervention or referred	This study

Table 8. Proposed outcome indicators for the use of health services.

Objective: To promote the use of health services Eligible individuals: Any participants reached with sport-based HIV/AIDS awareness intervention
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Increased awareness about health services	Percentage of participants reporting to be aware of any of the following services in their communities: services: HCT, ART, VMMC, PMTCT, STI, antenatal care, post exposure prophylaxis, TB, family planning services and services that deals with gender-based violence	Clark et al. (2006) Grassroot Soccer (2014)	Data to be collected through surveys Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
	Percentage of participants who have asked coaches/coordinators for referral to HCT, ART, VMMC, PMTCT, STI, antenatal care, post exposure prophylaxis, TB, family planning services and services that deals with gender-based violence	Grassroot Soccer (2014)	Data to be collected through registers as well as one-one interviews with HIV positive participants Confidentiality should be kept at all stages of communication Indicators should be disaggregated by gender and age
	Percentage of participants that have actually been linked to the referred services	This study

Table 9. Proposed generic outcome indicators for stigma and discrimination.

Objective 1: To reduce HIV stigma and discrimination towards PLWHA
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Reduced HIV stigma and discriminatory attitude towards PLWHA	Percentage of participants who report accepting attitude towards PLWHA	Carter (2006) Clark et al. (2006) Peacock-Villada et al. (2006) Mercy Corps (2007) DBE (2012) USAID (2013) UNAIDS (2013, 2014, 2015)	Data to be collected through surveys using questions related to HIV stigma and discrimination Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
	Percentage of participants who are willing to talk, care for, and identify with someone who has HIV/AIDS
Positive intention to communicate about HIV/AIDS with peers and family	Percentage of participants reported intention to communicate with someone outside of a programme about HIV/AIDS	Clark et al. (2006) Grassroot Soccer (2014)
Increased percentage of HIV positive participants who report to feel comfortable to disclose HIV status	Percentage of HIV positive participants who express a positive ability to feel comfortable to disclose their HIV status to their sexual partners and/or any person they trust	This study	Data to be collected through registers as well as one-one interviews with HIV positive participants Confidentiality should be kept at all stages of communication Indicator should be disaggregated by gender and age

Table 10. Proposed generic outcome indicators for positive attitude.

Objective 1: To encourage positive attitude towards future, health and lifestyle Eligible individuals: participants reached with sport-based HIV/AIDS awareness intervention/reached with HIV/AIDS and health awareness messages during/at sport events, tournaments, training as well as at hubs/centres/sites Participants should at least report positive change in attitude towards one of the three: future, health and lifestyle
Generic anticipated outcome	Generic outcome indicator	Source	Notes
Positive attitude towards future, health and lifestyle	Percentage of participants reported positive change in attitude towards future, health and lifestyle	This study	Data to be collected through surveys (might be challenging to collect data during mass sport events/tournaments) Indicators should be disaggregated by gender and age

Table 11. Proposed outcome indicators for using sport events and tournaments.

Objective 2: To attract participants reached during mass participation at sport events and tournaments to come and participate in small group HIV/AIDS awareness sessions offered at hubs/centres/ sites Eligible individuals: Participants reached with HIV/AIDS and health awareness messages during mass sport events and tournaments
Generic anticipated outcome	Generic outcome indicator	Source	Notes
Increased percentage of participants reached with small group sport-based HIV/AIDS awareness interventions	Percentage of participants reached during mass sport events and tournaments who came and attended small group HIV/AIDS awareness sessions offered at hubs/centres/sites	This study	Data to be collected through surveys asking a question about where did they hear about the programme, whether they have been reached with HIV/AIDS and health messages during mass events and tournaments offered by specific NGO Indicator should be disaggregated by gender and age

Table 12. Proposed outcome indicators for predictors of HIV risk behaviours.

Objective: To reduce HIV risk behaviours
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Delayed sexual debut	Percentage of participants reporting to have had sexual intercourse before the age of 15	Delva et al. (2010) DBE (2012) Shisana et al. (2014) USAID (2013) UNAIDS (2013, 2014, 2015)	Data to be collected through surveys using self-reported HIV risk behaviours questions Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
Decreased number of multiple sexual concurrent partners	Percentage of participants reporting to have had more than one partner in the past 12 months	Shisana et al. (2014) United Nations, MDG (2008) USAID (2013) UNAIDS (2013, 2014, 2015)
Increase condom use	Percentage of participants reporting to have had more than one partner in the past 12 months who report the use of condom during their last sexual intercourse	DBE (2012) Shisana et al. (2014) United Nations, MDG (2008) USAID (2013) UNAIDS (2013, 2014, 2015)
	Percentage of participants reporting to have had more than one partner who report the use of condom the first time they ever had sex, of those whose first sexual encounter happened after being reached with the intervention	Maro et al. (2009) Delva et al. (2010)
	Percentage of participants reporting to have had more than one partner who report the use of condom during their last sexual intercourse
Reduction in age-disparate sex/cross-generational sex	Percentage of participants reporting to have had non-marital sex with a partner 10 years older or more than themselves in the last 12 months, of all those who have had non-marital sex in the last 12 months	USAID (2013)

Table 13. Continuation of proposed indicators for predictors of HIV risk behaviours.

Objective: To reduce HIV risk behaviours
Generic anticipated outcomes	Generic outcome indicators	Sources	Notes
Reduction in transactional sex (provision of sex in exchange for material things such as money, airtime, clothing and lunch)	Percentage of participants reporting having transactional sex in the last 12 months	Soul City Institute Health and Development (2010)	Data to be collected through surveys using self-reported HIV risk behaviours questions Pre & post for intervention group If possible have a control group and do pre & post Indicators should be disaggregated by gender and age
Reduction in in alcohol and substance abuse	Percentage of adolescents participants reporting to have had used alcohol or illicit drugs in the past 30 days	Office of Disease Prevention and Health Promotion (2014)

Grassroot Soccer. (2014). Quarterly operational KPI dashboard: 2014 annual summary. South Africa: GRS South Africa.

 Google Scholar

Carter, J. (2006). HIV knowledge in ‘coaching for hope’ participants compared with non-participants: Coaching for hope Burkina Faso evaluation report. Burkina Faso.

 Google Scholar

Peacock-Villada, P., DeCelles, J., & Banda, P. S. (2006). Grassroot soccer resiliency pilot program: Building resiliency through sport-based education in Zambia and South Africa. New Directions for Youth Development, 116, 141–154.

 Google Scholar

Mercy Corps. (2007). Commitment to practice: A playbook for practitioners in HIV, youth and sport. Edinburgh: Author.

 Google Scholar

United Nations Millennium Declaration. (2008). The millennium development goals and targets: Official list of MDG indicators. New York, NY: United Nations.

 Google Scholar

Maro, C. N., Roberts, G. C., & Sørensen, M. (2009). Using sport to promote HIV/AIDS education for at-risk youths: An intervention using peer coaches in football. Scandinavian Journal of Medicine Science Sports, 19, 129–141. doi: 10.1111/j.1600-0838.2007.00744.x

 PubMed Web of Science ®Google Scholar

Fuller, C. W., Junge, A., DeCelles, J., Donald, J., Jankelowitz, R., & Dvorak, J. (2010). ‘Football for health’ – a football-based health-promotion programme for children in South Africa: A parallel cohort study. British Journal of Sports Medicine, 44, 546–554. doi: 10.1136/bjsm.2010.072223

 PubMed Web of Science ®Google Scholar

Fuller, C. W., Junge, A., Dorasami, C., DeCelles, J., & Dvorak, J. (2011). ‘11 for health’, a football-based health education programme for children: A two-cohort study in Mauritius and Zimbabwe. British Journal of Sports Medicine, 45, 612–618. doi: 10.1136/bjsm.2011.084905

 PubMed Web of Science ®Google Scholar

Farrar, T., & Math, M. (2010). Whizzkids United: Evaluating the Whizzkids United “on the ball” intervention special report. Durban.

 Google Scholar

Farrar, T., & Math, M. (2012). Whizzkids United: Final evaluation report, “on the ball” intervention, Northern EThekwini youth friendly clinics projects. Durban.

 Google Scholar

Luppe, T. (2010). Evaluation of the Grassroot soccer club HIV/AIDS programme in Musina (Unpublished Master of Public Health-thesis). University of Witwatersrand, Gauteng.

 Google Scholar

Department of Basic Education. (2012). Integrated strategy on HIV, STIs and TB 2012–2016 (summary version). Pretoria: Government Printer.

 Google Scholar

Kaufman, Z. A., Welsch, R. L., Ericksond, J. D., Craig, S., Adams, L. V., & Ross, D. A. (2012). Effectiveness of a sports-based HIV prevention intervention in the Dominican Republic: A quasi-experimental study. AIDS Care: Psychological and Socio-medical Aspects of AIDS/HIV, 24(3), 377–385. doi: 10.1080/09540121.2011.608789

 PubMed Web of Science ®Google Scholar

United States Agency for International Development. (2013). The President’s emergency plan for AIDS relief: Next generation indicators reference guide. Washington, DC: PEPFAR. Retrieved from http://www.pepfar.gov/. 

 Google Scholar

UNAIDS. (2013). Global AIDS response progress reporting: Construction of core indicators for monitoring the 2011 United Nation Political Declaration on HIV/AIDS. Geneva: Joint United Nations Programme on HIV/AIDS.

 Google Scholar

UNAIDS. (2014). Global AIDS response progress reporting: Construction of core indicators for monitoring the 2011 United Nation Political Declaration on HIV/AIDS. Geneva: Joint United Nations Programme on HIV/AIDS.

 Google Scholar

UNAIDS. (2015). Global AIDS response progress reporting: Construction of core indicators for monitoring the 2011 United Nation Political Declaration on HIV/AIDS. Geneva: Joint United Nations Programme on HIV/AIDS.

 Google Scholar

Delva, W., Michielsen, K., Meulders, B., Groeninck, S., Wasonga, E., Ajwang, P., … Vanreusel, B. (2010). HIV prevention through sport: The case of the Mathare Youth Sport Association in Kenya. AIDS Care: Psychological and Socio-medical Aspects of AIDS/HIV, 22(8), 1012–1020. doi: 10.1080/09540121003758606

 PubMed Web of Science ®Google Scholar

Keating, J., Meekers, D., & Adewuyi, A. (2006). Assessing effects of a media campaign on HIV/AIDS awareness and prevention in Nigeria: Results from the VISION Project. Bio Medical Central, 6((123), 1–12.

 Google Scholar

Clark, T. S., Friedrich, G. K., Ndlovu, M., Neilands, T. B., & McFarland, W. (2006). An adolescent-targeted HIV prevention project using African professional soccer players as role models and educators in Bulawayo, Zimbabwe. AIDS Behaviour, 10, 77–83. doi: 10.1007/s10461-006-9140-4

 PubMed Web of Science ®Google Scholar

Shisana, O., Rehle, T., Simbayi, L. C., Zuma, K., Jooste, K., Zungu, N. P., et al. (2014). South African national HIV prevalence, incidence and behaviour survey 2012. Cape Town: Human Science Research Council Press.

 Google Scholar

Soul City Institute Health and Development. (2010). One love South Africa evaluation report. Johannesburg: Soul City Institute.

 Google Scholar

Office of Disease Prevention and Health. (2014). Retrieved from http://www.healthypeople.gov/2020/health-indicators/2020/Substance-Abuse

 Google Scholar