References
- Abdinnour-Helm, S., & Chaparro, B. S. (2007). A balanced usability checklist approach to evaluate Palestinian hotel websites. Electronic Journal of Information Systems in Developing Countries, 31(2), 1–12. https://doi.org/10.1002/j.1681-4835.2007.tb00211.x
- Adam, L., & Wood, F. (1999). An investigation of the impact of information and communication technologies in sub-Saharan Africa. Journal of Information Science, 25(4), 307–318. https://doi.org/https://doi.org/10.1177/016555159902500407
- Akeel, H., Wynn, M., & Zhang, S. (2013). Information systems deployment in Libyan oil companies: Two case studies. Electronic Journal of Information Systems in Developing Countries, 59(4), 1–18. https://doi.org/https://doi.org/10.1002/j.1681-4835.2013.tb00418.x
- Alam, M. M., & Wagner, C. (2016). The relative importance of monetary and non-monetary drivers for information and communication technology acceptance in rural agribusiness. Information Technology for Development, 22(4), 654–671. https://doi.org/https://doi.org/10.1080/02681102.2016.1155142
- Ali, S. (2013). Terminal evaluation of the project: National environmental information management system.
- Alshawi, S., & Alalwany, H. (2009). E-government evaluation: Citizen’s perspective in developing countries. Information Technology for Development, 15(3), 193–208. https://doi.org/https://doi.org/10.1002/itdj.20125
- Andersson, A., & Hatakka, M. (2010). Increasing interactivity in distance educations: Case studies Bangladesh and Sri Lanka. Information Technology for Development, 16(1), 16–33. https://doi.org/https://doi.org/10.1080/02681100903533719
- Andersson, B., Nfuka, E. N., Sumra, S., Uimonen, P., & Pain, A. (2014). Evaluation of implementation of ICT in teachers’ colleges project in Tanzania: Final report.
- Andoh-Baidoo, F. K., & Osatuyi, B. (2009). Examining online banking initiatives in Nigeria: A value network approach. Electronic Journal of Information Systems in Developing Countries, 38(1), 1–14. https://doi.org/https://doi.org/10.1002/j.1681-4835.2009.tb00264.x
- Anh, P., Nhung, T., & Binh, T. N. (2004). Local radio project in Viet Nam, 2000–2003.
- Arenas, A. (2016). Strengthening climate information and early warning systems in Tanzania for climate resilient development and adaptation to climate change project.
- Avgerou, C. (2017). Theoretical framing of ICT4D research. Proceedings of the14th IFIP WG 9.4 International Conference on Social Implications of Computers in Developing Countries – ICT4D 2017 (pp. 10–23). Springer.
- Ayoung, D. A., Abbott, P., & Kashefi, A. (2016). The influence of intangible (‘soft’) constructs on the outcome of community ICT initiatives in Ghana: A gap archetype analysis. Electronic Journal of Information Systems in Developing Countries, 77(3), 1–22. https://doi.org/https://doi.org/10.1002/j.1681-4835.2016.tb00562.x
- Bailur, S. (2006). Using stakeholder theory to analyze telecenter projects. Information Technologies & International Development, 3(3), 61–80. https://doi.org/https://doi.org/10.1162/itid.2007.3.3.61
- Bass, J. M., & Heeks, R. (2011). Changing computing curricula in African universities: Evaluating progress and challenges via design-reality gap analysis. Electronic Journal of Information Systems in Developing Countries, 48(5), 1–39. https://doi.org/https://doi.org/10.1002/j.1681-4835.2011.tb00341.x
- Batchelor, S. J., & Norrish, P. (2005). Framework for the assessment of ICT pilot projects: Beyond monitoring and evaluation to applied research.
- Bello-Bravo, J., Tamò, M., Dannon, E. A., & Pittendrigh, B. R. (2018). An assessment of learning gains from educational animated videos versus traditional extension presentations among farmers in Benin. Information Technology for Development, 24(2), 224–244. https://doi.org/https://doi.org/10.1080/02681102.2017.1298077
- Bergek, A., Jacobsson, S., Carlsson, B., Lindmark, S., & Rickne, A. (2008). Analyzing the functional dynamics of technological innovation systems: A scheme of analysis. Research Policy, 37(3), 407–429. https://doi.org/https://doi.org/10.1016/j.respol.2007.12.003
- Berghout, E., & Renkema, T.-J. (2001). Methodologies for IT investment evaluation: A review and assessment. In W. Van Grembergen (Ed.), Information technology evaluation methods and management (pp. 78–97). Idea Group Publishing.
- Bernardi, R., & de Chiara, F. (2011). ICTs and monitoring of MDGs: A case study of Kenya HIV/AIDS monitoring and evaluation in a donor multi-agency context. Information Technology for Development, 17(1), 24–41. https://doi.org/https://doi.org/10.1080/02681102.2010.511699
- Bhatnagar, S. C., & Singh, N. (2010). Assessing the impact of e-government: A study of projects in India. Information Technologies & International Development, 6(2), 109–127.
- Borena, B., & Negash, S. (2016). IT infrastructure role in the success of a banking system: The case of limited broadband access. Information Technology for Development, 22(2), 265–278. https://doi.org/https://doi.org/10.1080/02681102.2014.979392
- Breetzke, T., & Flowerday, S. V. (2016). The usability of IVRs for smart city crowdsourcing in developing cities. Electronic Journal of Information Systems in Developing Countries, 73(2), 1–14. https://doi.org/https://doi.org/10.1002/j.1681-4835.2016.tb00527.x
- Burrell, J., & Toyama, K. (2009). What constitutes good ICTD research? Information Technologies and International Development, 5(3), 82–94.
- Bwalya, K. J. (2009). Factors affecting adoption of e-government in Zambia. Electronic Journal of Information Systems in Developing Countries, 38(4), 1–13. https://doi.org/https://doi.org/10.1002/j.1681-4835.2009.tb00267.x
- Century, J., Rudnick, M., & Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31(2), 199–218. https://doi.org/https://doi.org/10.1177/1098214010366173
- Chatfield, A. T., & Alhujran, O. (2007). An analysis of e-government maturity models from a user-centric perspective: Toward a public value proposition. Proceedings of EEE’07 – the 2007 International Conference on e-Learning, e-Business, Enterprise Information Systems, and e-Government. CSREA Press.
- Chatfield, A. T., & Alhujran, O. (2009). A cross-country comparative analysis of e-government service delivery among Arab countries. Information Technology for Development, 15(3), 151–170. https://doi.org/https://doi.org/10.1002/itdj.20124
- Chopra, S., & Rajan, P. (2016). Modeling intermediary satisfaction with mandatory adoption of e-government technologies for food distribution. Information Technologies & International Development, 12(1), 15–34.
- Clarke, J. S. (2015). 7 reasons the SDGs will be better than the MDGs. The Guardian. https://www.theguardian.com/global-development-professionals-network/2015/sep/26/7-reasons-sdgs-will-be-better-than-the-mdgs
- Cook, T. D., Leviton, L. C., & Shadish, W. R. (1985). Program evaluation. In G. Lindzey & E. Aronson (Eds.), Handbook of social psychology (3rd ed., pp. 699–777). Random House.
- Corbett, J. M., & Keller, C. P. (2004). Empowerment and participatory geographic information and multimedia systems: Observations from two communities in Indonesia. Information Technologies & International Development, 2(2), 25–44. https://doi.org/https://doi.org/10.1162/1544752044193425
- Dabelstein, N., & Patton, M. Q. (2013). The Paris declaration on aid effectiveness: History and significance. The Canadian Journal of Program Evaluation, 27(3), 19–36.
- Dasuki, S. I., & Abbott, P. (2015). A socio-technical analysis of ICT investments in developing countries: A capability perspective. Electronic Journal of Information Systems in Developing Countries, 67(6), 1–29. https://doi.org/https://doi.org/10.1002/j.1681-4835.2015.tb00484.x
- Dasuki, S. I., Quaye, A. M. G., & Abubakar, N. H. (2017). An evaluation of information systems students internship programs in Nigeria: A capability perspective. Electronic Journal of Information Systems in Developing Countries, 83(6), 1–19. https://doi.org/https://doi.org/10.1002/j.1681-4835.2017.tb00614.x
- Davis, F. D. (1989, September). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly.
- Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982–1003. https://doi.org/https://doi.org/10.1287/mnsc.35.8.982
- Dearden, A., & Tucker, W. D. (2016). Moving ICTD research beyond bungee jumping: Practical case studies and recommendations. IEEE Technology and Society Magazine, 35(3), 36–43. https://doi.org/https://doi.org/10.1109/MTS.2016.2593267
- DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3(1), 60–95. https://doi.org/https://doi.org/10.1287/isre.3.1.60
- DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30. https://doi.org/https://doi.org/10.1080/07421222.2003.11045748
- de Vreede, G.-J., Mgaya, R. J. S., & Qureshi, S. (2003). Field experiences with collaboration technology: A comparative study in Tanzania and South Africa. Information Technology for Development, 10(3), 201–219. https://doi.org/https://doi.org/10.1002/itdj.1590100306
- Dey, B. L., Newman, D. R., & Prendergast, R. (2010). Ethnographic approach to user-centred evaluation of telecentres. International Journal of Innovation in the Digital Economy, 1(3), 22–39. https://doi.org/https://doi.org/10.4018/jide.2010070102
- Dianka, M. (2017). Final evaluation of the project of strengthening environmental management information system for coastal development to meet Rio convention objectives.
- Dodson, L., Sterling, S. R., & Bennett, J. K. (2013). Considering failure: Eight years of ITID research. Information Technologies & International Development, 9(2), 19–34.
- Earl, S., Carden, F., & Smutylo, T. (2001). Outcome mapping: Building learning and reflection into development programs.
- Economist Intelligence Unit. (2003). The 2003 e-readiness rankings: A white paper from the Economist Intelligence Unit.
- Emmanuel, E. A., & N., M. H. (2010). A user interface for micro-entrepreneurs in a rural community. Electronic Journal of Information Systems in Developing Countries, 43(2), 1–19. https://doi.org/https://doi.org/10.1002/j.1681-4835.2010.tb00306.x
- Farbey, B., Land, F., & Targett, D. (1999). Moving IS evaluation forward: Learning themes and research issues. Journal of Strategic Information Systems, 8(2), 189–207. https://doi.org/https://doi.org/10.1016/S0963-8687(99)00021-9
- Fenenga, C., & de Jager, A. (2007). Cordaid-IICD health programme Uganda: Health management information systems as a tool for organisational development. Electronic Journal of Information Systems in Developing Countries, 31(3), 1–14. https://doi.org/https://doi.org/10.1002/j.1681-4835.2007.tb00212.x
- Fetterman, D. M. (2001). Foundations of empowerment evaluation. SAGE Publications.
- Fetterman, D. M., & Wandersman, A. (2005). Empowerment evaluation principles in practice. Guilford Press.
- Figueroa, M. E., Kincaid, D. L., Rani, M., & Lewis, G. (2002). Communication for social change: An integrated model for measuring the process and its outcomes (No. 1; Communication for Social Change Working Paper Series).
- Finnish Consulting Group. (2012). Final evaluation of municipal ICT programme in Nicaragua.
- Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). Pearson Education.
- Gable, G. G., Sedera, D., & Chan, T. (2008). Re-conceptualizing information system success: The IS-impact measurement model. Journal of the Association for Information Systems, 9(7), 377–408. https://doi.org/https://doi.org/10.17705/1jais.00164
- Ghosh, I., Haseki, M., Mudavanhu, S., & Van Belle, J.-P. (2015). A critical evaluation of past IDIA research: Lessons learnt for IDIA and ICT4D researchers. In J. Steyn & J. P. Van Belle (Eds.), Proceedings of the 9th IDIA conference – IDIA 2015 (pp. 1–18).
- Gigler, B.-S. (2004, September 5-7). Including the excluded – Can ICTs empower poor communities? Towards an alternative evaluation framework based on the capability approach. Proceedings of the 4th International Conference on the Capability Approach, University of Pavia, Italy, Paper presentation.
- Gomez, J. (2003). Voice and data communications infrastructure for the Ministry of Justice of Rwanda: Final evaluation.
- Gomez, R. (2013). The changing field of ICTD: Growth and maturation of the field, 2000-2010. Electronic Journal of Information Systems in Developing Countries, 58(1), 1–21. https://doi.org/https://doi.org/10.1002/j.1681-4835.2013.tb00408.x
- Gomez, R., & Pather, S. (2012). ICT evaluation: Are we asking the right questions? Electronic Journal of Information Systems in Developing Countries, 50(5), 1–14. https://doi.org/10.1002/j.1681-4835.2012.tb00355.x
- Gomez, R., Reed, P., & Chae, H. Y. (2013). Assessment of community wellness outcomes to measure ICT impact. Proceedings of the Sixth International Conference on Information and Communications Technologies and Development-ICTD 2013, 37–40. https://doi.org/10.1145/2517899.2517907
- Goodhue, D. L. (1995). Understanding user evaluations of information systems. Management Science, 41(12), 1827–1844. https://doi.org/https://doi.org/10.1287/mnsc.41.12.1827
- Gorla, N. (2009). A survey of rural e-government projects in India: Status and benefit. Information Technology for Development, 15(1), 52–58. https://doi.org/https://doi.org/10.1002/itdj.20064
- Gredler, M. E. (1996). Program evaluation. Prentice-Hall.
- Grimshaw, D. J., & Gudza, L. D. (2010). Local voices enhance knowledge uptake: Sharing local content in local voices. Electronic Journal of Information Systems in Developing Countries, 40(3), 1–12. https://doi.org/https://doi.org/10.1002/j.1681-4835.2010.tb00285.x
- Grossman, G., Platas, M., & Rodden, J. (2017). Endline impact evaluation: Can text messages improve local governance? An impact evaluation of the U-bridge program in Uganda.
- Guclu, A. N., & Bilgen, S. (2011). Modelling and assessment of the effectiveness of government information technologies value space approach with a public sector case study in Turkey. Electronic Journal of Information Systems in Developing Countries, 45(4), 1–30. https://doi.org/https://doi.org/10.1002/j.1681-4835.2011.tb00320.x
- Hallikainen, P., & Chen, L. (2005). A holistic framework on information systems evaluation with a case analysis. Electronic Journal of Information Systems Evaluation, 9(2), 57–64.
- Hamajoda, A. (2016). Informing and interacting with citizens: A strategic communication review of the websites of the ECOWAS parliaments. Electronic Journal of Information Systems in Developing Countries, 74(7), 1–13. https://doi.org/10.1002/j.1681-4835.2016.tb00541.x
- Harris, R., Apikul, C., Mahiuddin, K. M., & Mostafa, M. (2015). Report on the mid-term evaluation of the access to information – II project (a2i) for United Nations Development Programme Bangladesh.
- Harriss, J. (2014). Development theories. In B. Currie-Alder, R. Kanbur, D. M. Malone, & R. Medhora (Eds.), International development: Ideas, experience, and prospects (pp. 35–49). Oxford University Press.
- Harry, R., Sewchurran, K., & Brown, I. (2014). Introducing a mobile payment system to an emerging economy’s mobile phone subscriber market. An actor network perspective. Electronic Journal of Information Systems in Developing Countries, 62(4), 1–26. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00442.x
- Hatakka, M., Thapa, D., & Sæbø, Ø. (2016, December 11). A framework for understanding the link between ICT and development: How affordances influence capabilities. Proceedings of SIG GlobDev Ninth Annual Workshop, Dublin, Ireland, Paper presentation.
- Hayes, N., & Westrup, C. (2012). Context and the processes of ICT for development. Information and Organization, 22(1), 23–36. https://doi.org/https://doi.org/10.1016/j.infoandorg.2011.10.001
- Heeks, R. (2010). An ICT4D journal ranking table. Information Technologies & International Development, 6(4), 71–75.
- Heeks, R. (2018). Information and communication technology for development (ICT4D). Routledge.
- Heeks, R., & Molla, A. (2009). Impact assessment of ICT-for-development projects: A compendium of approaches (No. 36; Development Informatics Working Paper Series).
- Hekkert, M. P., Suurs, R. A. A., Negro, S. O., Kuhlmann, S., & Smits, R. E. H. M. (2007). Functions of innovation systems: A new approach for analysing technological change. Technological Forecasting & Social Change, 74(4), 413–432. https://doi.org/https://doi.org/10.1016/j.techfore.2006.03.002
- Henderson, J. C., & Venkatraman, N. (1999). Strategic alignment: Leveraging information technology for transforming organizations. IBM Systems Journal, 38(2–3), 472–484. https://doi.org/https://doi.org/10.1147/SJ.1999.5387096
- Hodge, S. J. (2017). Mid-term evaluation: Generating, accessing and using information and knowledge related to the three Rio conventions.
- House, E. R., & Howe, K. R. (2000). Deliberative democratic evaluation in practice. In D. L. Stufflebeam, G. F. Madaus, & T. Kellaghan (Eds.), Evaluation models: Viewpoints on educational and human services evaluation (pp. 409–421). Kluwer Academic Publishers.
- Hudson, H. E. (2001). Telecentre evaluation: Issues and strategies. In C. Latchem & D. Walker (Eds.), Telecentres: Case studies and key issues (pp. 169–182). The Commonwealth of Learning.
- Inter-Parliamentary Union. (2009). Guidelines for parliamentary websites.
- Irani, Z., & Love, P. E. D. (2001). Information systems evaluation: Past, present and future. European Journal of Information Systems, 10(4), 183–188. https://doi.org/https://doi.org/10.1057/palgrave.ejis.3000408
- Irani, Z., & Love, P. E. D. (2002). Developing a frame of reference for ex-ante IT/IS investment evaluation. European Journal of Information Systems, 11(1), 74–82. https://doi.org/https://doi.org/10.1057/palgrave.ejis.3000411
- Jamison, J. C., Karlan, D., & Raffler, P. (2013). Mixed-method evaluation of a passive mhealth sexual information texting service in Uganda. Information Technologies & International Development, 9(3), 1–28. https://doi.org/https://doi.org/10.4018/jiit.2013070101
- Janelidze, P. (2017). Terminal evaluation of GEF project: Strengthening capacity for an environmental information management and monitoring system in Tajikistan.
- Japan International Cooperation Agency (JICA) Bhutan Office. (2013). Internal ex-post evaluation for grant aid project: The project for improvement of equipment of bhutan broadcasting service corporation.
- Jobe, W., & Hansson, P.-O. (2014). Putting a MOOC for human rights in the hands of Kenyans: The Haki Zangu case for non-formal learning. Electronic Journal of Information Systems in Developing Countries, 65(3), 1–17. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00465.x
- Jones, S. (2008). Social dimension of IT/IS evaluation: Views from the public sector. In Z. Irani & P. E. D. Love (Eds.), Evaluating information systems: Public and private sector (pp. 236–256). Butterworth-Heinemann.
- Kaplan, R. S., & Norton, D. P. (1996). Using the balanced scorecard as a strategic management system. Harvard Business Review, 74(1), 75–85.
- Kaplan, R. S., & Norton, D. P. (2006). Alignment: Using the balanced scorecard to create corporate synergies. Harvard Business School Press.
- Kettani, D., Moulin, B., Gurstein, M., & El Mahdi, A. (2008). E-government and local good governance: A pilot project in Fez, Morocco. Electronic Journal of Information Systems in Developing Countries, 35(1), 1–18. https://doi.org/https://doi.org/10.1002/j.1681-4835.2008.tb00238.x
- Kirkpatrick, D. (1996). Great ideas revisited. Training & Development, 50(1), 54–59.
- Kirkpatrick, D. L. (1998). Evaluating training programs: The four levels (2nd ed.). Berrett-Koehler Publishers Inc.
- Kirkpatrick, D. L. (2006). Seven keys to unlock the four levels of evaluation. Performance Improvement, 45(7), 5–8. https://doi.org/https://doi.org/10.1002/pfi.2006.4930450702
- Kivunike, F. N., Ekenberg, L., Danielson, M., & Tusubira, F. F. (2015). Using a structured approach to evaluate ICT4D: Healthcare delivery in Uganda. Electronic Journal of Information Systems in Developing Countries, 66(8), 1–16. https://doi.org/https://doi.org/10.1002/j.1681-4835.2015.tb00478.x
- Kleine, D. (2013). Technologies of choice? ICTs, development, and the capabilities approach. MIT Press.
- Kookmin Institute for Strategic Governance. (2012a). Ex-post evaluation report on the project for establishing government integrated data center in Nepal.
- Kookmin Institute for Strategic Governance. (2012b). Ex-post evaluation report on the two e-government projects in Mongolia.
- Kookmin University. (2013a). Ex-post evaluation report on the project for establishment of an e-procurement pilot system in Vietnam.
- Kookmin University. (2013b). Ex-post evaluation report on the project for modernization of communication and information system of the state ministries of the Republic of Paraguay.
- Kookmin University. (2014). 몽골 전자정부 구축사업 사후평가 보고서 [Ex-post evaluation on the e-government project in Mongolia].
- Korea Global Development Consulting Center (KGDC). (2014). 방글라데시, 모로코 교사 ICT 역량강화사업 사후평가 보고서 [Ex-post evaluation on the project for the establishment of Bangladesh-Korea ICT Training Center for Education (BKITCE) and a Morocco-Korean ICT Training Center for Moroccan Teachers (CMCF TICE)].
- Korea International Cooperation Agency (KOICA). (2008). 라오스 전자정부 구축 지원 사업 사후평가 보고서 [Ex-post evaluation of e-government plan project in the Lao PDR].
- Korean Association of ICT Professional Engineers (KAIPER). (2011). ICT 훈련센터 건립사업 사후평가 보고서 [Ex-post evaluation report on the project for establishing ICT training center].
- Kust, G. (2012). Terminal evaluation report: Developing institutional and legal capacity to optimise information and monitoring system for global environmental management in Armenia.
- Lane, M. S., Van Der Vyver, G., Delpachitra, S., & Howard, S. (2004). An electronic commerce initiative in regional Sri Lanka: The vision for the central province electronic commerce portal. Electronic Journal of Information Systems in Developing Countries, 16(1), 1–18. https://doi.org/https://doi.org/10.1002/j.1681-4835.2004.tb00102.x
- Larghi, S. B., Lemus, M., Moguillansky, M., & Welschinger, N. (2015). Digital and social inequalities: A qualitative assessment of the impact of the connecting equality program on Argentinean youth. Electronic Journal of Information Systems in Developing Countries, 69(2), 1–20. https://doi.org/https://doi.org/10.1002/j.1681-4835.2015.tb00496.x
- Latifov, M. A., & Sahay, S. (2012). Data warehouse approach to strengthen actionability of health information systems: Experiences from Tajikistan. Electronic Journal of Information Systems in Developing Countries, 53(4), 1–19. https://doi.org/https://doi.org/10.1002/j.1681-4835.2012.tb00377.x
- Lennie, J., & Tacchi, J. (2013). Evaluating communication for development: A framework for social change. Routledge.
- Lennie, J., Tacchi, J., Wilmore, M., & Koirala, B. (2015). A holistic, learning-centred approach to building evaluation capacity in development organizations. Evaluation, 21(3), 325–343. https://doi.org/https://doi.org/10.1177/1356389015590219
- Lin, C., & Pervan, G. P. (2001). A review of IS/IT investment evaluation and benefits management issues, problems and processes. In W. Van Grembergen (Ed.), Information technology evaluation methods and management (pp. 2–24). Idea Group Publishing.
- Lind, P., Sepúlveda, E., & Nuñez, J. (2000). On the applicability of a computer model for business performance analysis in SMEs: A case study from Chile. Information Technology for Development, 9(1), 33–44. https://doi.org/https://doi.org/10.1080/02681102.2000.9525319
- Linnan, L., & Steckler, A. (2002). Process evaluation for public health interventions and research: An overview. In A. Steckler & L. Linnan (Eds.), Process evaluation for public health interventions and research (pp. 1–23). Jossey-Bass.
- Madon, S. (2004). Evaluating the developmental impact of e-governance initiatives: An exploratory framework. Electronic Journal of Information Systems in Developing Countries, 20(5), 1–13. https://doi.org/https://doi.org/10.1002/j.1681-4835.2004.tb00132.x
- Mamba, M. S. N., & Isabirye, N. (2015). A framework to guide development through ICTs in rural areas in South Africa. Information Technology for Development, 21(1), 135–150. https://doi.org/https://doi.org/10.1080/02681102.2013.874321
- Mchombu, K. (1995). Impact of information on rural development: Background, methodology, and progress. In P. McConnell (Ed.), Making a difference: Measuring the impact of information on development (pp. 87–102). International Development Research Centre.
- Melkote, S. R., & Steeves, H. L. (2015). Communication for development: Theory and practice for empowerment and social justice (3rd ed.). Sage.
- Mertens, D. M. (2003). Mixed methods and the politics of human research: The transformative-emancipatory perspective. In A. Tashakkori & C. Teddle (Eds.), Handbook of mixed methods in social & behavioral research (pp. 135–164). Sage.
- Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide (1st ed.). The Guilford Press.
- Milis, K., & Mercken, R. (2004). The use of the balanced scorecard for the evaluation of information and communication technology projects. International Journal of Project Management, 22(2), 87–97. https://doi.org/https://doi.org/10.1016/S0263-7863(03)00060-7
- Minges, M., Raihan, A., & Raina, R. (2011). Bangladesh: Access to information (A2I) evaluation.
- Miscione, G. (2007). Telemedicine in the upper Amazon: Interplay with local health care practices. MIS Quarterly, 31(2), 403–425. https://doi.org/https://doi.org/10.2307/25148797
- Molla, A., & Bhalla, A. (2006). ERP and competitive advantage in developing countries: The case of an Asian company. Electronic Journal of Information Systems in Developing Countries, 24(1), 1–19. https://doi.org/https://doi.org/10.1002/j.1681-4835.2006.tb00156.x
- Mooketsi, B. E., & Chigona, W. (2014). Different shades of success: Educator perceptions of government strategy on e-education in South Africa. Electronic Journal of Information Systems in Developing Countries, 64(8), 1–15. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00461.x
- Mooketsi, B., & Leonard, M. (2013). Factors influencing the usage of the tribal land information management system for land management and administration: The case of Mogoditshane subordinate land-board. Electronic Journal of Information Systems in Developing Countries, 59(1), 1–17. https://doi.org/https://doi.org/10.1002/j.1681-4835.2013.tb00419.x
- Mtebe, J. S., & Raisamo, R. (2014). A model for assessing learning management system success in higher education in sub-Saharan countries. Electronic Journal of Information Systems in Developing Countries, 61(7), 1–17. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00436.x
- Mthoko, H., & Khene, C. (2018). Building theory in ICT4D evaluation: A comprehensive approach to assessing outcome and impact. Information Technology for Development, 24(1), 138–164. https://doi.org/https://doi.org/10.1080/02681102.2017.1315359
- Mullany, J. M., & Peat, B. (2008). Process evaluation of a county drug court: An analysis of descriptors, compliance and outcome – answering some questions while raising others. Criminal Justice Policy Review, 19(4), 491–508. https://doi.org/https://doi.org/10.1177/0887403408317144
- Muthui, V. N., & Wasige, J. (2016). Strengthening climate information and early warning systems (SCIEWS) project – Uganda.
- Myers, M. (2005). Monitoring and evaluating information and communication for development (ICD) programmes: Guidelines.
- Ndiege, J. R. A., Wayi, N., & Herselman, M. E. (2012). Quality assessment of information systems in SMEs: A study of Eldoret, Kenya. Electronic Journal of Information Systems in Developing Countries, 51(2), 1–23. https://doi.org/https://doi.org/10.1002/j.1681-4835.2012.tb00359.x
- Negash, S. (2010). Learning assessment of a videoconference-based training: Lessons from medical training between USA and Ethiopia. Information Technology for Development, 16(3), 212–231. https://doi.org/https://doi.org/10.1080/02681102.2010.497274
- Neupane, A., Soar, J., & Vaidya, K. (2012). Evaluating the anti-corruption capabilities of public e-procurement in a developing country. Electronic Journal of Information Systems in Developing Countries, 55(2), 1–17. https://doi.org/https://doi.org/10.1002/j.1681-4835.2012.tb00390.x
- Ninson, E. A. (2018). Evaluating community development projects using the OECD evaluation criteria. Journal of MultiDisciplinary Evaluation, 14(30), 37–45.
- Niven, P. R. (2008). Balanced scorecard, step-by-step for government and nonprofit agencies (2nd ed.). John Wiley & Sons.
- Nolan, R. (1979). Managing the crises in data processing. Harvard Business Review, 57(2), 115–126. https://hbr.org/1979/03/managing-the-crises-in-data-processing
- Nyemba-Mudenda, M., & Chigona, W. (2018). Mhealth outcomes for pregnant mothers in Malawi: A capability perspective. Information Technology for Development, 24(2), 245–278. https://doi.org/https://doi.org/10.1080/02681102.2017.1397594
- Ochieng, D. M., Olugbara, O. O., & Marks, M. M. (2017). Exploring digital archive system to develop digitally resilient youths in marginalised communities in South Africa. Electronic Journal of Information Systems in Developing Countries, 80(4), 1–22. https://doi.org/https://doi.org/10.1002/j.1681-4835.2017.tb00588.x
- Odit, M. C. A., Rwashana, A. S., & Kituyi, G. M. (2014). Antecedents and dynamics for strategic alignment of health information systems in Uganda. Electronic Journal of Information Systems in Developing Countries, 64(6), 1–20. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00459.x
- OECD/DAC Network on Development Evaluation. (2019). Better criteria for better evaluation.
- Organisation for Economic Co-operation and Development (OECD). (1991). DAC principles for evaluation of development assistance. http://www.oecd.org/dac/evaluation/2755284.pdf
- Organisation for Economic Co-operation and Development (OECD). (2015). The DAC network on development evaluation: Evaluation evidence for better policies. http://www.oecd.org/dac/evaluation/EVALNET-flyer-2015.pdf
- Organisation for Economic Co-operation and Development (OECD). (2016). Evaluation systems in development co-operation: 2016 review.
- Organisation for Economic Co-operation and Development (OECD). (n.d.). DAC criteria for evaluating development assistance. http://www.oecd.org/dac/evaluation/49756382.pdf
- Orlikowski, W. J. (2000). Using technology and constituting structures: A practice lens for studying technology in organizations. Organization Science, 11(4), 404–428. https://doi.org/https://doi.org/10.1287/orsc.11.4.404.14600
- Osah, J. U., Pade-Khene, C., & Foster, G. (2014). Critical themes of process assessment in rural ICT4D projects: An analysis of assessment approaches. Electronic Journal of Information Systems in Developing Countries, 60(4), 1–22. https://doi.org/https://doi.org/10.1002/j.1681-4835.2014.tb00425.x
- Özkan, S., Baykal, N., & Sincan, M. (2006). Evaluation of a hospital information system in an international context: Towards implementing PB-ISM in Turkey. Electronic Journal of Information Systems in Developing Countries, 28(6), 1–10. https://doi.org/https://doi.org/10.1002/j.1681-4835.2006.tb00190.x
- Pade-Khene, C., & Sewry, D. (2012). The rural ICT comprehensive evaluation framework: Implementing the first domain, the baseline study process. Electronic Journal of Information Systems in Developing Countries, 51(8), 1–34. https://doi.org/https://doi.org/10.1002/j.1681-4835.2012.tb00365.x
- Pade, C., Mallinson, B., & Sewry, D. (2008). An elaboration of critical success factors for rural ICT project sustainability in developing countries: Exploring the DWESA case. Journal of Information Technology Case and Application Research, 10(4), 32–55. https://doi.org/https://doi.org/10.1080/15228053.2008.10856146
- Pandey, V., & Gupta, S. (2018). A comprehensive four-stage framework for evaluation of information communication technologies for development interventions. Information Technology for Development, 24(3), 511–531. https://doi.org/https://doi.org/10.1080/02681102.2017.1371108
- Patton, M. Q. (2008). Utilization-focused evaluation (4th ed.). Sage.
- Picciotto, R. (1995). Introduction: Evaluation and development. New Directions for Evaluation, 67(67), 13–23. https://doi.org/https://doi.org/10.1002/ev.1002
- Picciotto, R. (2012). Experimentalism and development evaluation: Will the bubble burst? Evaluation, 18(2), 213–229. https://doi.org/https://doi.org/10.1177/1356389012440915
- Picciotto, R. (2013). The logic of development effectiveness: Is it time for the broader evaluation community to take notice? Evaluation, 19(2), 155–170. https://doi.org/https://doi.org/10.1177/1356389013483715
- Plauché, M., De Waal, A., Grover, A. S., & Gumede, T. (2010). Morphological analysis: A method for selecting ICT applications in South African government service delivery. Information Technologies & International Development, 6(1), 1–20. https://doi.org/https://doi.org/10.4018/jiit.2010100901
- Pompi, K., Long, P., Lonh, S., & Stek, A. (2015). Mid-term performance evaluation of USAID/Cambodia’s development innovations (DI) project.
- Posavac, E. J., & Carey, R. G. (1997). Program evaluation: Methods and case studies (5th ed.). Prentice-Hall.
- Preece, J., Sharp, H., & Rogers, Y. (2015). Interaction design: Beyond human-computer interaction (4th ed.). John Wiley & Sons, Ltd.
- Prinsloo, T., & de Villiers, C. (2017). A framework to define the impact of sustainable ICT for agriculture projects: The Namibian livestock traceability system. Electronic Journal of Information Systems in Developing Countries, 82(6), 1–22. https://doi.org/https://doi.org/10.1002/j.1681-4835.2017.tb00606.x
- Qureshi, S. (2017). The forgotten awaken: ICT’s evolving role in the roots of mass discontent. Information Technology for Development, 23(1), 1–17. https://doi.org/https://doi.org/10.1080/02681102.2017.1293963
- Reichardt, C. S., & Rallis, S. F. (1994). Qualitative and quantitative inquiries are not incompatible: A call for a new partnership. In C. S. Reichardt & S. F. Rallis (Eds.), The qualitative-quantitative debate: New perspectives (Vol. 61, pp. 85–91). Jossey-Bass.
- Reilly, K., & Gómez, R. (2001). Comparing approaches: Telecentre evaluation experiences in Asia and Latin America. Electronic Journal of Information Systems in Developing Countries, 4(3), 1–17. https://doi.org/https://doi.org/10.1002/j.1681-4835.2001.tb00026.x
- Riddell, R. C. (2007). Does foreign aid really work? Oxford University Press.
- Rogers, E. M. (2003). Diffusion of innovations (5th ed.). Free Press.
- Rogers, P. (2014). Theory of change (No. 2; Methodological Briefs: Impact Evaluation).
- Ron, T. (2016). Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change – Zambia.
- Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach (7th ed.). Sage Publications.
- Royse, D., Thyer, B. A., Padgett, D. K., & Logan, T. K. (2001). Program evaluation: An introduction (3rd ed.). Wadsworth.
- Ruth, S. R. (2000). Measuring long term effects of technology transfer in developing nations: The case of Internet training at the Romanian academy of science. Information Technology for Development, 9(2), 105–121. https://doi.org/https://doi.org/10.1080/02681102.2000.9525325
- Sambo, P., & Alexander, P. (2018). A scheme of analysis for e-voting as a technological innovation system. Electronic Journal of Information Systems in Developing Countries, 84(2), e12020. https://doi.org/https://doi.org/10.1002/isd2.12020
- Sangmyung University. (2012). Ex-post evaluation report on the project for effective ICT education at the College of Engineering and Technology, University of Dar es Salaam, Tanzania.
- Schmidt, C., Gorman, T. J., Gary, M. S., & Bayor, A. A. (2012). Impact of low-cost, on-demand, information access in a remote Ghanaian Village. Information Technologies & International Development, 8(2), 85–100.
- Seddon, P. B., Graeser, V., & Willcocks, L. P. (2002). Measuring organizational IS effectiveness: An overview and update of senior management perspectives. The DATA BASE for Advances in Information Systems, 33(2), 11–28. https://doi.org/https://doi.org/10.1145/513264.513270
- Sein, M. K., & Harindranath, G. (2004). Conceptualizing the ICT artifact: Toward understanding the role of ICT in national development. Information Society, 20(1), 15–24. https://doi.org/https://doi.org/10.1080/01972240490269942
- Sen, A. (2000). Development as freedom. Anchor Books.
- Serafeimidis, V. (2002). A review of research issues in evaluation of information systems. In W. Van Grembergen (Ed.), Information systems evaluation management (pp. 167–194). IRM Press.
- Serafeimidis, V., & Smithson, S. (2000). Information systems evaluation in practice: A case study of organizational change. Journal of Information Technology, 15(2), 93–105. https://doi.org/https://doi.org/10.1177/026839620001500202
- Shadish, W. R., Cook, T. D., & Leviton, L. C. (1991). Foundations of program evaluation. Sage Publications.
- Shannon-Baker, P. (2016). Making paradigms meaningful in mixed methods research. Journal of Mixed Methods Research, 10(4), 319–334. https://doi.org/https://doi.org/10.1177/1558689815575861
- Sigwejo, A., & Pather, S. (2016). A citizen-centric framework for assessing e-government effectiveness. Electronic Journal of Information Systems in Developing Countries, 74(8), 1–27. https://doi.org/https://doi.org/10.1002/j.1681-4835.2016.tb00542.x
- Smithson, S., & Hirschheim, R. (1998). Analysing information systems evaluation: Another look at an old problem. European Journal of Information Systems, 7(3), 158–174. https://doi.org/https://doi.org/10.1057/palgrave.ejis.3000304
- Song, X., & Letch, N. (2012). Research on IT/IS evaluation: A 25 year review. Electronic Journal of Information Systems Evaluation, 15(3), 276–287.
- Southard, P. B., & Siau, K. (2004). A survey of online e-banking retail initiatives. Communications of the ACM, 47(10), 99–102. https://doi.org/https://doi.org/10.1145/1022594.1022601
- Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications (2nd ed.). Jossey-Bass.
- Symons, V. J. (1991). A review of information systems evaluation: Content, context and process. European Journal of Information Systems, 1(3), 205–212. https://doi.org/https://doi.org/10.1057/ejis.1991.35
- Symons, V., & Walsham, G. (1988). The evaluation of information systems: A critique. Journal of Applied Systems Analysis, 15, 119–132.
- Toyama, K. (2018). From needs to aspirations in information technology for development. Information Technology for Development, 24(1), 15–36. https://doi.org/https://doi.org/10.1080/02681102.2017.1310713
- Tully, M. (2015). Investigating the role of innovation attributes in the adoption, rejection, and discontinued use of open source software for development. Information Technologies & International Development, 11(3), 55–69.
- Uimonen, P. (2015). Beyond failure: Rethinking research and evaluation in ICT4D. In K. Andreasson (Ed.), Digital divides: The new challenges and opportunities of e-inclusion (pp. 247–263). CRC Press.
- United Nations Development Programme (UNDP). (1997). Governance for sustainable human development: A UNDP policy document.
- United Nations Development Programme (UNDP). (2019). The revised UNDP evaluation policy (DP/2019/29). http://web.undp.org/evaluation/documents/policy/2019/DP_2019_29_E.pdf
- United Nations Development Programme (UNDP) Evaluation Office. (2012). Project-level evaluation: Guidance for conducting terminal evaluations of UNDP-supported, GEF-financed projects. http://web.undp.org/evaluation/documents/guidance/GEF/UNDP-GEF-TE-Guide.pdf
- United Nations Office of the High Commissioner for Human Rights (UN OHCHR). (n.d.). Human rights and the 2030 agenda for sustainable development. Retrieved December 30, 2019, from https://www.ohchr.org/EN/Issues/SDGS/Pages/The2030Agenda.aspx
- United Nations (UN). (n.d.). Millennium Summit (6–8 September 2000). Retrieved January 10, 2018, from http://www.un.org/en/events/pastevents/millennium_summit.shtml
- Unwin, T. (Ed.). (2009). Introduction. In ICT4D: Information and communication technology for development (pp. 1–6). Cambridge University Press.
- van der Vyver, A. G., & Marais, M. (2015). Evaluating users’ perceptions of the digital doorway: A narrative analysis. Information Technology for Development, 21(1), 99–112. https://doi.org/https://doi.org/10.1080/02681102.2013.841629
- Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/https://doi.org/10.2307/30036540
- Verkijika, S. F., & De Wet, L. (2018). Quality assessment of e-government websites in sub-Saharan Africa: A public values perspective. Electronic Journal of Information Systems in Developing Countries, 84(2), e12015. https://doi.org/https://doi.org/10.1002/isd2.12015
- Villanueva-Mansilla, E., & Olivera, P. (2012). Institutional barriers to development innovation: Assessing the implementation of XO-1 computers in two peri-urban schools in Peru. Information Technologies & International Development, 8(4), 177–189.
- Vincent, K., & Cull, T. (2013). “Ten seeds”: How mobiles have contributed to development in women-led farming cooperatives in Lesotho. Information Technologies & International Development, 9(1), 37–48.
- Walsham, G. (2017). ICT4D research: Reflections on history and future agenda. Information Technology for Development, 23(1), 18–41. https://doi.org/https://doi.org/10.1080/02681102.2016.1246406
- Walton, M., & Heeks, R. (2011). Can a process approach improve ICT4D project success? (No. 47; Development Informatics Working Paper Series).
- Ward, J., & Peppard, J. (2002). Strategic planning for information systems (3rd ed.). John Wiley & Sons, Ltd.
- Ward, J., Taylor, P., & Bond, P. (1996). Evaluation and realisation of IS/IT benefits: An empirical study of current practice. European Journal of Information Systems, 4(4), 214–225. https://doi.org/https://doi.org/10.1057/ejis.1996.3
- Weiss, C. H. (1998). Evaluation (2nd ed.). Prentice-Hall.
- White, H. (2010). A contribution to current debates in impact evaluation. Evaluation, 16(2), 153–164. https://doi.org/https://doi.org/10.1177/1356389010361562
- Willcocks, L., & Lester, S. (1996). Beyond the IT productivity paradox. European Management Journal, 14(3), 279–290. https://doi.org/https://doi.org/10.1016/0263-2373(96)00007-2
- World Health Organization (WHO). (n.d.). Millennium Development Goals (MDGs). Retrieved December 30, 2019, from https://www.who.int/topics/millennium_development_goals/about/en/
- Yim, M. (2019). Information and communication technology for development (ICT4D) evaluation: Examining its foci, gaps, challenges, and associations with other areas to strengthen the field’s conceptual underpinnings [Doctoral dissertation]. University of Washington.
- Zheng, Y., Hatakka, M., Sahay, S., & Andersson, A. (2018). Conceptualizing development in information and communication technology for development (ICT4D). Information Technology for Development, 24(1), 1–14. https://doi.org/https://doi.org/10.1080/02681102.2017.1396020
- Zionts, S., & Wallenius, J. (1976). An interactive programming method for solving the multiple criteria problem. Management Science, 22(6), 652–663. https://doi.org/https://doi.org/10.1287/mnsc.22.6.652
- Zuboff, S. (1988). In the age of the smart machine: The future of work and power. Basic Books, Inc.