Assessing the impact of mHealth interventions in low- and middle-income countries – what has been shown to work?

References

• Sachs J. The digital war on poverty. 2008; London: The Guardian. Available from: http://www.guardian.co.uk/commentisfree/2008/aug/21/digitalmedia.mobilephones [cited 24 July 2014].
   Google Scholar
• World Bank. Country and lending groups. 2014. Available from: http://data.worldbank.org/about/country-and-lending-groups [cited 3 July 2014]..
   Google Scholar
• World Health Organization. mHealth: new horizons for health through mobile technologies: second global survey on eHealth. 2011; Geneva: WHO.
   Google Scholar
• World Bank. Information and communications for development: maximizing mobile. 2012; Washington, DC: World Bank.
   Google Scholar
• Groupe Speciale Mobile Association. The mobile economy 2014. 2014; London: GSMA.
   Google Scholar
• Byass P, D'Ambruoso L. Cellular telephone networks in developing countries. Lancet. 2008; 371: 650.
   Google Scholar
• Free C, Phillips G, Watson L, Galli L, Felix L, Edwards P, etal. The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013; 10: e1001363.
   Google Scholar
• Labrique AB, Vasudevan L, Kochi E, Fabricant R, Mehl G. mHealth innovations as health system strengthening tools: 12 common applications and a visual framework. Glob Health Sci Pract. 2013; 1: 160–71.
   Google Scholar
• United States Agency for International Development (USAID). mHealth evidence. Baltimore, MD: k4health, The Johns Hopkins University. 2011
   Google Scholar
• Groupe Speciale Mobile Association (GSMA). Available from: http://www.gsma.com [cited 27 July 2014]..
   Google Scholar
• The Johns Hopkins University. Global mHealth initiative. 2014; Baltimore, MD: The Johns Hopkins University.
   Google Scholar
• Rowe AK, Onikpo F, Lama M, Osterholt DM, Rowe SY, Deming MS. A multifaceted intervention to improve health worker adherence to integrated management of childhood illness guidelines in Benin. Am J Public Health. 2009; 99: 837–46.
   Google Scholar
• Armstrong K, Liu F, Seymour A, Mazhani L, Littman-Quinn R, Fontelo P, etal. Evaluation of txt2MEDLINE and development of short messaging service-optimized, clinical practice guidelines in Botswana. Telemed J E Health. 2012; 18: 14–17.
   Google Scholar
• Chang AY, Ghose S, Littman-Quinn R, Anolik RB, Kyer A, Mazhani L, etal. Use of mobile learning by resident physicians in Botswana. Telemed J E Health. 2012; 18: 11–13.
   Google Scholar
• Goldbach H, Chang AY, Kyer A, Ketshogileng D, Taylor L, Chandra A, etal. Evaluation of generic medical information accessed via mobile phones at the point of care in resource-limited settings. J Am Med Inform Assoc. 2014; 21: 37–42.
   Google Scholar
• Quinley KE, Gormley RH, Ratcliffe SJ, Shih T, Szep Z, Steiner A, etal. Use of mobile telemedicine for cervical cancer screening. J Telemed Telecare. 2011; 17: 203–9.
   Google Scholar
• Tran K, Ayad M, Weinberg J, Cherng A, Chowdhury M, Monir S, etal. Mobile teledermatology in the developing world: implications of a feasibility study on 30 Egyptian patients with common skin diseases. J Am Acad Dermatol. 2011; 64: 302–9.
   Google Scholar
• Gisore P, Shipala E, Otieno K, Rono B, Marete I, Tenge C, etal. Community based weighing of newborns and use of mobile phones by village elders in rural settings in Kenya: a decentralised approach to health care provision. BMC Pregnancy Childbirth. 2012; 12: 15.
   Google Scholar
• Githinji S, Kigen S, Memusi D, Nyandigisi A, Wamari A, Muturi A, etal. Using mobile phone text messaging for malaria surveillance in rural Kenya. Malar J. 2014; 13: 107.
   Google Scholar
• Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, etal. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet. 2010; 376: 1838–45.
   Google Scholar
• Rajput ZA, Mbugua S, Amadi D, Chepngeno V, Saleem JJ, Anokwa Y, etal. Evaluation of an android-based mHealth system for population surveillance in developing countries. J Am Med Inform Assoc. 2012; 19: 655–9.
   Google Scholar
• Vahdat HL, L'Engle KL, Plourde KF, Magaria L, Olawo A. There are some questions you may not ask in a clinic: providing contraception information to young people in Kenya using SMS. Int J Gynaecol Obstet. 2013; 123: e2–6.
   Google Scholar
• Wakadha H, Chandir S, Were EV, Rubin A, Obor D, Levine OS, etal. The feasibility of using mobile-phone based SMS reminders and conditional cash transfers to improve timely immunization in rural Kenya. Vaccine. 2013; 31: 987–93.
   Google Scholar
• Zurovac D, Sudoi RK, Akhwale WS, Ndiritu M, Hamer DH, Rowe AK, etal. The effect of mobile phone text-message reminders on Kenyan health workers’ adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011; 378: 795–803.
   Google Scholar
• Mahmud N, Rodriguez J, Nesbit J. A text message-based intervention to bridge the healthcare communication gap in the rural developing world. Technol Health Care. 2010; 18: 137–44. [PubMed Abstract].
   Google Scholar
• Odigie VI, Yusufu LM, Dawotola DA, Ejagwulu F, Abur P, Mai A, etal. The mobile phone as a tool in improving cancer care in Nigeria. Psychooncology. 2012; 21: 332–5.
   Google Scholar
• Chin CD, Cheung YK, Laksanasopin T, Modena MM, Chin SY, Sridhara AA, etal. Mobile device for disease diagnosis and data tracking in resource-limited settings. Clin Chem. 2013; 59: 629–40.
   Google Scholar
• Ngabo F, Nguimfack J, Nwaigwe F, Mugeni C, Muhoza D, Wilson DR, etal. Designing and implementing an innovative SMS-based alert system (RapidSMS-MCH) to monitor pregnancy and reduce maternal and child deaths in Rwanda. Pan Afr Med J. 2012; 13: 31. [PubMed Abstract] [PubMed CentralFull Text].
   Google Scholar
• Nsanzimana S, Ruton H, Lowrance DW, Cishahayo S, Nyemazi JP, Muhayimpundu R, etal. Cell phone-based and internet-based monitoring and evaluation of the National Antiretroviral Treatment Program during rapid scale-up in Rwanda: TRACnet, 2004–2010. J Acquir Immune Defic Syndr. 2012; 59: e17–23.
   Google Scholar
• Bird J, Byass P, Kahn K, Mee P, Fottrell E. A matter of life and death: practical and ethical constraints in the development of a mobile verbal autopsy tool. 1489–98. 1489–98. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 27 April–2 May 2013, Paris, France.
   Google Scholar
• Broomhead S, Mars M. Retrospective return on investment analysis of an electronic treatment adherence device piloted in the Northern Cape Province. Telemed J E Health. 2012; 18: 24–31.
   Google Scholar
• Rotheram-Borus MJ, Tomlinson M, Gwegwe M, Comulada WS, Kaufman N, Keim M. Diabetes buddies: peer support through a mobile phone buddy system. Diabetes Educ. 2012; 38: 357–65.
   Google Scholar
• Tomlinson M, Solomon W, Singh Y, Doherty T, Chopra M, Ijumba P, etal. The use of mobile phones as a data collection tool: a report from a household survey in South Africa. BMC Med Inform Decis Mak. 2009; 9: 51.
   Google Scholar
• Jian WS, Hsu MH, Sukati H, Syed-Abdul S, Scholl J, Dube N, etal. LabPush: a pilot study of providing remote clinics with laboratory results via short message service (SMS) in Swaziland, Africa. PLoS One. 2012; 7: e44462.
   Google Scholar
• Kliner M, Knight A, Mamvura C, Wright J, Walley J. Using no-cost mobile phone reminders to improve attendance for HIV test results: a pilot study in rural Swaziland. Infect Dis Poverty. 2013; 2: 12.
   Google Scholar
• DeRenzi B, Findlater L, Payne J, Birnbaum B, Mangilima J, Parikh T, etal. Improving community health worker performance through automated SMS. 25–34. 25–34. Proceedings of the 5th International Conference on Information and Communication Technologies and Development; ACM; 12–15 March 2012, Atlanta, USA.
   Google Scholar
• Lund S, Hemed M, Nielsen BB, Said A, Said K, Makungu MH, etal. Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG. 2012; 119: 1256–64.
   Google Scholar
• Lund S, Nielsen BB, Hemed M, Boas IM, Said A, Said K, etal. Mobile phones improve antenatal care attendance in Zanzibar: a cluster randomized controlled trial. BMC Pregnancy Childbirth. 2014; 14: 29.
   Google Scholar
• Chang LW, Kagaayi J, Arem H, Nakigozi G, Ssempijja V, Serwadda D, etal. Impact of a mHealth intervention for peer health workers on AIDS care in rural Uganda: a mixed methods evaluation of a cluster-randomized trial. AIDS Behav. 2011; 15: 1776–84.
   Google Scholar
• Chib A, Wilkin H, Hoefman B. Vulnerabilities in mHealth implementation: a Ugandan HIV/AIDS SMS campaign. Glob Health Promot. 2013; 20: 26–32.
   Google Scholar
• Chib A, Wilkin H, Ling LX, Hoefman B, Van Biejma H. You have an important message! Evaluating the effectiveness of a text message HIV/AIDS campaign in Northwest Ugandam. J Health Commun. 2012; 17: 146–57.
   Google Scholar
• Fruhauf J, Hofman-Wellenhof R, Kovarik C, Mulyowa G, Alitwala C, Soyer HP, etal. Mobile teledermatology in sub-Saharan Africa: a useful tool in supporting health workers in low-resource centres. Acta Derm Venereol. 2013; 93: 122–3. [PubMed Abstract].
   Google Scholar
• Kunutsor S, Walley J, Katabira E, Muchuro S, Balidawa H, Namagala E, etal. Using mobile phones to improve clinic attendance amongst an antiretroviral treatment cohort in rural Uganda: a cross-sectional and prospective study. AIDS Behavior. 2010; 14: 1347–52.
   Google Scholar
• Siedner MJ, Haberer JE, Bwana MB, Ware NC, Bangsberg DR. High acceptability for cell phone text messages to improve communication of laboratory results with HIV-infected patients in rural Uganda: a cross-sectional survey study. BMC Med Inform Decis Mak. 2012; 12: 56.
   Google Scholar
• Tuijn CJ, Hoefman BJ, van Beijma H, Oskam L, Chevrollier N. Data and image transfer using mobile phones to strengthen microscopy-based diagnostic services in low and middle income country laboratories. PLoS One. 2011; 6: e28348.
   Google Scholar
• Blaschke S, Bokenkamp K, Cosmaciuc R, Denby M, Hailu B, Short R. Using mobile phones to improve child nutrition surveillance in Malawi. Brooklyn, NY: UNICEF Malawi, UNICEF Innovations, Mobile Development Solutions. 2009. Available from: https://sipa.columbia.edu/sites/default/files/UNICEFFinalReport_2009_0.pdf [cited 27 July 2014]..
   Google Scholar
• HealthUnbound. mUbuzima. 2012. Available from: http://healthunbound.org/node/1994 [cited 16 June 2014]..
   Google Scholar
• Jamison JC, Karlan D, Raffler P. Mixed method evaluation of a passive mHealth sexual information texting service in Uganda. Working Paper 19107, National Bureau of Economic Research, Cambridge, MA. 2013. Available from: http://www.nber.org/papers/w19107 [cited 27 July 2014]..
   Google Scholar
• UNICEF. Innovations. UNICEF Uganda. 2014. Available from: http://www.unicef.org/uganda/9903.html [cited 19 June 2014]..
   Google Scholar
• UNICEF. UNICEF Uganda 2012 statement. 2012; Kampala, Uganda: United Nations Children's Fund. Available from: http://www.unicef.org/uganda/UNICEF_Uganda_2012_Statement__FINAL.pdf [cited 19 June 2014]..
   Google Scholar
• da Costa TM, Salomao PL, Martha AS, Pisa IT, Sigulem D. The impact of short message service text messages sent as appointment reminders to patients’ cell phones at outpatient clinics in Sao Paulo, Brazil. Int J Med Inform. 2010; 79: 65–70.
   Google Scholar
• Lozano-Fuentes S, Wedyan F, Hernandez-Garcia E, Sadhu D, Ghosh S, Bieman JM, etal. Cell phone-based system (Chaak) for surveillance of immatures of dengue virus mosquito vectors. J Med Entomol. 2013; 50: 879–89.
   Google Scholar
• Bernabe-Ortiz A, Curioso WH, Gonzales MA, Evangelista W, Castagnetto JM, Carcamo CP, etal. Handheld computers for self-administered sensitive data collection: a comparative study in Peru. BMC Med Inform Decis Mak. 2008; 8: 11.
   Google Scholar
• Dammert AC, Galdo JC, Galdo V. Preventing dengue through mobile phones: evidence from a field experiment in Peru. J Health Econ. 2014; 35: 147–61.
   Google Scholar
• Zolfo M, Iglesias D, Kiyan C, Echevarria J, Fucay L, Llacsahuanga E, etal. Mobile learning for HIV/AIDS healthcare worker training in resource-limited settings. AIDS Res Ther. 2010; 7: 35.
   Google Scholar
• Lorent N, Choun K, Thai S, Kim T, Huy S, Pe R, etal. Community-based active tuberculosis case finding in poor urban settlements of Phnom Penh, Cambodia: a feasible and effective strategy. PLoS One. 2014; 9: e92754.
   Google Scholar
• Huang D, Sangthong R, McNeil E, Chongsuvivatwong V, Zheng W, Yang X. Effects of a phone call intervention to promote adherence to antiretroviral therapy and quality of life of HIV/AIDS patients in Baoshan, China: a randomized controlled trial. AIDS Res Treat. 2013; 2013: 580974. [PubMed Abstract] [PubMed CentralFull Text].
   Google Scholar
• Chib A. The Aceh Besar midwives with mobile phones project: design and evaluation perspectives using the information and communication technologies for healthcare development model. J Comput Mediat Commun. 2010; 15: 500–25.
   Web of Science ®Google Scholar
• Lee S, Chib A, Kim JN. Midwives’ cell phone use and health knowledge in rural communities. J Health Commun. 2011; 16: 1006–23.
   Google Scholar
• Seear M, Gandhi D, Carr R, Dayal A, Raghavan D, Sharma N. The need for better data about counterfeit drugs in developing countries: a proposed standard research methodology tested in Chennai, India. J Clin Pharm Ther. 2011; 36: 488–95.
   Google Scholar
• Ramanchandran A, Snehalatha C, Ram J, Selvam S, Simon M, Nanditha A, etal. Effectiveness of mobile phone messaging in prevention of type 2 diabetes by lifestyle modification in men in India: a prospective, parallel-group, randomised control trial. Lancet Diabetes Endocrinol. 2013; 1: 191–8.
   PubMed Web of Science ®Google Scholar
• Khan AJ, Khowaja S, Khan FS, Qazi F, Lotia I, Habib A, etal. Engaging the private sector to increase tuberculosis case detection: an impact evaluation study. Lancet Infect Dis. 2012; 12: 608–16.
   Google Scholar
• Hunchangsith P, Barendregt JJ, Vos T, Bertram M. Cost-effectiveness of various tuberculosis control strategies in Thailand. Value Health. 2012; 15: S50–5.
   Google Scholar
• Meankaew P, Kaewkungwal J, Khamsiriwatchara A, Khunthong P, Singhasivanon P, Satimai W. Application of mobile-technology for disease and treatment monitoring of malaria in the “Better Border Healthcare Programme.”. Malar J. 2010; 9: 237.
   Google Scholar
• Center for Health Market Innovations. Aponjon. Center for Health Market Innovations, Washington, DC. 2012. Available from: http://healthmarketinnovations.org/program/aponjon [cited 17 June 2014].
   Google Scholar
• Center for Health Market Innovations. Health Management and Research Institute (HMRI). Center for Health Market Innovations, Washington, DC. 2012. Available from: http://healthmarketinnovations.org/program/health-management-and-research-institute-hmri [cited 27 July 2014]..
   Google Scholar
• UNICEF. Birth registration using SMS technology. 2013. Available from: http://unicefinnovation.org/projects/birth-registration-using-sms-technology [cited 17 June 2014]..
   Google Scholar
• Florez-Arango JF, Iyengar MS, Dunn K, Zhang J. Performance factors of mobile rich media job aids for community health workers. J Am Med Inform Assoc. 2011; 18: 131–7.
   Google Scholar
• Iyengar MS, Florez-Arango JF. Decreasing workload among community health workers using interactive, structured, rich-media guidelines on smartphones. Technol Health Care. 2013; 21: 113–23.
   Google Scholar
• Breslauer DN, Maamari RN, Switz NA, Lam WA, Fletcher DA. Mobile phone based clinical microscopy for global health applications. PLoS One. 2009; 4: e6320.
   Google Scholar
• Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One. 2014; 9: e88166.
   Google Scholar
• Labrique AB, Pereira S, Christian P, Murthy N, Bartlett L, Mehl G. Pregnancy registration systems can enhance health systems, increase accountability and reduce mortality. Reprod Health Matters. 2012; 20: 113–17.
   Google Scholar
• Skandarajah A, Reber CD, Switz NA, Fletcher DA. Quantitative imaging with a mobile phone microscope. PLoS One. 2014; 9: e96906.
   Google Scholar
• Darmstadt GL, Lee AC, Cousens S, Sibley L, Bhutta ZA, Donnay F, etal. 60 Million non-facility births: who can deliver in community settings to reduce intrapartum-related deaths?. Int J Gynaecol Obstet. 2009; 107: S89–112.
   Google Scholar
• Fottrell E, Byass P. Verbal autopsy: methods in transition. Epidemiol Rev. 2010; 32: 38–55.
   Google Scholar
• Horvath T, Azman H, Kennedy GE, Rutherford GW. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev. 2012; 3: Cd009756. [PubMed Abstract].
   Google Scholar
• Jennings L, Gagliardi L. Influence of mHealth interventions on gender relations in developing countries: a systematic literature review. Int J Equity in Health. 2013; 12: 85.
   PubMed Web of Science ®Google Scholar
• Nglazi MD, Bekker LG, Wood R, Hussey GD, Wiysonge CS. Mobile phone text messaging for promoting adherence to anti-tuberculosis treatment: a systematic review. BMC Infect Dis. 2013; 13: 566.
   Google Scholar
• Pellowski JA, Kalichman SC. Recent advances (2011–2012) in technology-delivered interventions for people living with HIV. Curr HIV AIDS Rep. 2012; 9: 326–34.
   PubMed Web of Science ®Google Scholar
• McCarthy M. Handheld device for counterfeit drug detection to be tested in Africa. BMJ. 2013; 346: f2732.
   Google Scholar
• Qiang CZ, Yamamichi M, Hausman V, Miller R, Altman D. Mobile applications for the health sector. 2012; Washington, DC: World Bank.
   Google Scholar
• Rosenberg T. The fight against fake drugs. Opinionator, The New York Times. 2014. Available from: http://opinionator.blogs.nytimes.com/2014/06/04/the-fight-against-fake-drugs [cited 27 July 2014]..
   Google Scholar
• UNICEF. Every child's birth right: inequities and trends in birth registration. 2013; New York: UNICEF.
   Google Scholar
• Forster D, Behrens RH, Campbell H, Byass P. Evaluation of a computerised field data collection system for health surveys. Bull World Health Organ. 1991; 69: 107–11. [PubMed Abstract] [PubMed CentralFull Text].
   Google Scholar