Supporting local institutions for inclusive green growth: Developing an Evidence Gap Map

Figures & data

Fig. 1 Theory of change.

Fig. 2 Summary of the structured search procedure.

Table A1 Keywords used in structured literature search.

Keywords used to identify the relevant interventions and outcome indicators:	Studies using either one of the following research methods:
Women Empowerment, Inclusive Growth, Natural Resource Management, Institutional Capacity Building, Participatory Technology Development, Co Management, Village Level Development, Farmer Cooperatives, Empowering the Marginalized, Localized Innovation Platforms, Enabling Environment, Infrastructure Development, Agricultural Service Delivery, Public Service Delivery, Resource Access, Decentralization, User Groups, Gender Equality, Technology Transfer, Joint Forestry Management, Participatory Irrigation Management, Micro Credit Groups, Farmer Field Schools, Propensity to Cooperate, Invest in Public goods	Randomized Controlled Trial,
Downward Accountability, Upward Accountability, Enhanced Representation, Equal Institutions, Elite Capture, Information Costs, Trust, Human Capital, Coordination Mechanisms, Property Rights, Legitimacy, Transparency, Democracy, Monitoring and Enforcement, Increased Yields, Deforestation, Soil fertility management, Technology Adoption, Poverty Alleviation, Food Security, Common Pool Resource Management, Agricultural Resilience, Land Restoration, Social Justice	Difference in Difference,
	Regression discontinuity designs,
	Propensity score matching

Table A1 lists the keywords and search terms used to identify the relevant studies. These include the keywords used (first column) and the relevant statistical research methods considered (second column).

Table A2 databases used in structured literature search.

Academic Databases	Working Paper Series
AgEcon, British Library for Development Studies, SCOPUS, Science Direct, Poverty Action Lab, JSTOR, IDEAS, JOLIS, Google Scholar and the 3IE Repository of Impact Evaluations.	NBER Working Papers, The World Bank (Policy Research Working Papers), Harvard Business School, Stanford University, Center for Global Development, European University Institute, Columbia University

Table A2 lists the academic databases (first column) and working paper series (second column) that were scanned to identify the relevant studies.

Table A3 Examples of search strings applied.

The search strings were based on the search terms included in Table A1. In principle, these search strings were applied individually, for all text bodies (not just title and abstract) and all given years. To avoid missing results due to misspelling, appropriate wild card and truncation operators were applied as well. Example are given below:

1. (“Institutional Capacity Building”)

2. (“Participatory Technology”)

3. (“Village Level Development”)

4. (“Micro?credit Groups”)

and so on

However, some academic databases (Table A2) are quite extensive (SCOPUS, Science Direct), therefore it was necessary to refine our results. In such cases, we narrowed down the time frame (1990 till present) and/or searched in specific sub-databases (Agricultural and Biological Sciences) Finally, we combined the keywords to identify the relevant interventions and outcome indicators (Table A1) resulting from specific methodological approaches. An example is provided below:

1. (“Inclusive Growth”) AND (“Random?ed Contro* Trial)

? stands for either s or z

* stands for either Control or Controlled

Table A4 Aggregation of interventions into eight distinct categories.

Build or improve local institutions	Establish or improve producer cooperatives	Enhance public service provision	Empower local marginalized groups	Cash or asset transfer	Provide access to financial services	Agricultural extension and skills	Incentives for efficient resource use
– Community Driven Development (CDD)	– Stimulate membership farmer cooperative	– Digitisation of public service provision	Stipulate participation vulnerable groups	– Cash or asset transfer program (including food aid)	– Group based financial services (microfinance etc.)	– Business & entrepreneurial training	– Commodity certification
– Enhanced participatory processes (deliberation, project selection, etc.)		– Stimulate competition in public procurement	Self-targeting disadvantaged groups		– Credit provision	– Agricultural extension: Farmer Field Schools	– Input vouchers
– Introduce democratic practices (of project or council selection)		– Address scale (of irrigation systems)			– Insurance provision	– Agricultural extension: telephone/computer etc.	– Subsidize input use
		– Public works program			– Bank account provision	– Agricultural extension (methods unspecified)	– Payment for Ecosystem Services (PES)
		– Decentralization of governance				– Agricultural marketing activities (e.g. High value crops)
		– Use social networks (for public service provision)

Table A5 Intermediate outcome indicators.

Enhanced local institutions and participation	Improved public service delivery	Better targeted public services	Improved use of financial services
– Trust (experimental measures)	– Public service provision	– Type and location of projects selected	– Use of and access to (in)formal financial services
– Willingness to contribute to public goods (experimental measures)	– Effective public spending: lower costs	– Effective public spending: greater reach
– Other social capital measures or indicators	– Greater security and safety	– Access to rural services
– Performance of local institution, changes in participation (groups) and time spent

Table A6 Final outcome indicators.

Inclusive Growth		Green Growth
Changes in poverty and vulnerability	Changes in household income	Productivity of agricultural land use	Reduced deforestation
– Vulnerability to income shocks	– Household income	– Agricultural productivity	– Forestry practices & (de)forestation
– Household income of vulnerable groups	– Household expenditures: consumption or investment	– Agricultural technology uptake or adoption
– Household expenditures of vulnerable groups	– Economic perception	– Knowledge on improved agricultural practices
– Poverty gap or poverty headcount	- commercialisation and income diversification	– Input use or uptake
- Food security (status)		– Input use, uptake or knowledge on pesticides
		– Environmental awareness

Fig. 3 Evidence Gap Map.

Fig. 4 Studies reporting final outcomes¹.

¹The total number of studies displayed in Fig. 4 exceeds fourteen since some studies evaluate multiple combinations of intermediate and final outcomes. The outcome indicators result from different interventions, information on which has been suppressed in this figure for clarity

Fig. 5 Distribution of interventions evaluated across continents¹.

¹The total number of studies displayed in Fig. 5 exceeds the overall number of 66 studies identified since some studies evaluate multiple interventions, or combinations thereof.

Table

Authors and Year	Title	Country	Appraisal	Intervention(s)	Intermediate outcome(s)	Final outcome(s) Inclusive Growth)	Final outcome(s) Green Growth
Abate et al. (2014)	Impact of Agricultural Cooperatives on Smallholders Technical Efficiency: Empirical Evidence from Ethiopia.	Ethiopia	Good confidence, with minor issues	Establish or improve producer cooperatives			More productive (agricultural) land use
Abebaw and Haile (2013)	The Impact of Cooperatives on Agricultural Technology Adoption. Evidence from Ethiopia	Ethiopia	Strong confidence	Establish or improve producer cooperatives	Enhanced local institutions and participation		More productive (agricultural) land use
Adimassu and Kessler (2015)	Impact of the Productive Safety Net Program on Farmers Investments in Sustainable Land Management in the Central Rift Valley in Ethiopia.	Ethiopia	Strong confidence	Enhance public service provision			More productive (agricultural) land use
Alatas et al. (2016)	Self Targeting: Evidence from a Field Experiment in Indonesia	Indonesia	Good confidence, with minor issues	Empower local marginalized groups	Improved public service delivery	Reduced poverty and vulnerability
				Cash or asset transfer	Better targeted public services
Ali and Abdulai (2010)	The Adoption of Genetically Modified Cotton and Poverty Reduction in Pakistan	Pakistan	Strong confidence	Provide access to financial services			More productive (agricultural) land use
Arcand and Wagner (2016)	Does CDD Improve Inclusiveness in Peasant Organizations? Evidence from Senegal	Senegal	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
Arriagada et al. (2012)	Do PES Reduce Deforestation? A Farm Level Evaluation from Costa Rica	Costa Rica	Good confidence, with minor issues	Incentives for efficient resource use			Reduced deforestation
Ashraf et al. (2009)	Finding Missing Markets (And a Disturbing Epilogue): Evidence from an Export Crop Adoption and Market Intervention in Kenya	Kenya	Strong confidence	Provide access to financial services			More productive (agricultural) land use
				Agricultural extension and skills
Avdeenko and Gilligan (2015)	International Interventions to Build social Capital. Evidence from a Field Experiment in Sudan	Sudan	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
Awotide et al. (2013)	The Impact of Seed Vouchers on Poverty Reduction Among Smallholder Rice Farmers in Nigeria	Nigeria	Strong confidence	Incentives for efficient resource use		Reduced poverty and vulnerability
						Improved household income
Banerjee et al. (2014)	Can E-Governance Reduce Capture of Public Programs? Experimental Evidence from a Financial Reform of India's Employment Guarantee	India	Strong confidence	Enhance public service provision	Improved public service delivery
Banerjee et al. (2015b)	Contracting out the Last Mile of Service Delivery: Subsidized Food distribution in Indonesia	Indonesia	Strong confidence	Enhance public service provision	Improved public service delivery
Banerjee et al. (2015b)	The power of transparency: information, identification cards and food subsidy programs in Indonesia	Indonesia	Strong confidence	Cash or asset transfer	Better targeted public services	Reduced poverty and vulnerability
Banerjee et al. (2015a)	A Multi-Faceted Program Causes Lasting Progress for the Very Poor. Evidence from 6 Countries.	Ethiopia	Strong confidence	Cash or asset transfer		Reduced poverty and vulnerability
		Ghana
		Honduras
		India
		Pakistan
		Peru
Beaman et al. (2014a)	Saving for a (not so) Rainy Day: A Randomized Evaluation of Savings Groups in Mali	Mali	Strong confidence	Provide access to financial services	Improved use of financial services	Reduced poverty and vulnerability
Beaman et al. (2015)	Can Network – Theory Based Targeting Increase Technology Adoption?	Malawi	Strong confidence	Enhance public service provision			More productive (agricultural) land use
				Agricultural extension and skills
Beaman et al. (2014b)	Selection into Credit Markets. Evidence from Agriculture in Mali	Mali	Strong confidence	Build or improve local institutions		Improved household income
				Provide access to financial services
Beath et al. (2012b)	Winning Hearts and Minds? Evidence from a Field Experiment in Afghanistan.	Afghanistan	Strong confidence	Build or improve local institutions	Better targeted public services
Beath et al. (2012a)	Direct Democracy and Resource Allocation. Experimental Evidence from Afghanistan	Afghanistan	Strong confidence	Build or improve local institutions	Better targeted public services	Improved household income
Beath et al. (2013a)	Do Elected Councils Improve Governance? Experimental Evidence on Local Institutions in Afghanistan.	Afghanistan	Strong confidence	Build or improve local institutions	Better targeted public services
				Cash or asset transfer
Beath et al. (2013b)	Empowering Women Through Development Aid: Evidence from a Field Experiment in Afghanistan	Afghanistan	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
				Empower local marginalized groups
BenYishay and Mobarak (2015)	Social Learning and Incentives for Experimentation and Communication	Malawi	Strong confidence	Enhance public service provision			More productive (agricultural) land use
				Agricultural extension and skills
Bernard et al. (2008)	Impact of Cooperatives in Smallholders Commercialization Behavior. Evidence from Ethiopia.	Ethiopia	Strong confidence	Establish or improve producer cooperatives		Improved household income
Bhamoriya and Gandhi (2010)	Adaptiveness in Water Management Institutions in India: Nature and Impact	India	Weak confidence, with multiple issues	Build or improve local institutions	Enhanced local institutions and participation
Brune et al. (2016b)	Savings Defaults and Payment Delays for Cash Transfers: Field Experimental Evidence from Malawi	Malawi	Strong confidence	Cash or asset transfer	Improved use of financial services
				Provide access to financial services
Brune et al. (2016a)	Facilitating Savings for Agriculture. Field Experimental Evidence from Malawi	Malawi	Strong confidence	Provide access to financial services	Improved use of financial services
Burke (2013)	Selling Low and Buying High: An Arbitrage Puzzle in Kenyan Villages	Kenya	Strong confidence	Provide access to financial services	Improved use of financial services
Carter et al. (2014)	Savings, Subsidies and the Persistence of Technology Adoption: Field Experimental Evidence from Mozambique	Mozambique	Strong confidence	Incentives for efficient resource use			More productive (agricultural) land use
Casey et al. (2012)	Reshaping Institutions: Evidence and Aid Impacts Using A Pre-Analysis Plan	Sierra Leone	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation	Improved household income
				Empower local marginalized groups
Cavatassi et al. (2011)	How do Agricultural Programmes Alter Crop Production? Evidence from Ecuador.	Ecuador	Strong confidence	Agricultural extension and skills		Improved household income	More productive (agricultural) land use
Chattopadhyay and Duflo (2004)	Women as Policy Makers: Evidence from a Randomized Experiment in India	India	Strong confidence	Empower local marginalized groups	Better targeted public services
Cole and Fernando (2012)	The Value of Advice: Evidence from Mobile Phone-Based Agricultural Extension	India	Strong confidence	Enhance public service provision	Improved public service delivery		More productive (agricultural) land use
				Agricultural extension and skills
Cole et al. (2013)	How does risk management Influence Production Decisions? Evidence from a Field Experiment	India	Strong confidence	Provide access to financial services		Improved household income
Cole et al. (2014)	Dynamics of Demand for Index Insurance. Evidence from a Long-Run Field Experiment	India	Strong confidence	Provide access to financial services	Improved use of financial services
Cunguara and Moder (2011)	Is Agricultural Extension Helping The Poor? Evidence from Rural Mozambique.	Mozambique	Strong confidence	Agricultural extension and skills		Improved household income
Dillon (2011)	Do Differences in the Scale of Irrigation Projects Generate Different Impacts on Poverty and Production	Mali	Good confidence, with minor issues	Enhance public service provision		Improved household income	More productive (agricultural) land use
Dupas et al. (2015)	The Effect of Savings Accounts on Interpersonal Financial Relationships. Evidence from a Field Experiment in Rural Kenya	Kenya	Strong confidence	Provide access to financial services	Improved use of financial services
Fearon et al. (2011)	Democratic Institutions and Collective Action Capacity: Results from a Field Experiment in Post-conflict Liberia	Liberia	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation	Improved household income
Fischer and Qaim (2012)	Linking Smallholders to Markets. Determinants and Impacts of Farmer Collective Action in Kenya	Kenya	Strong confidence	Establish or improve producer cooperatives	Enhanced local institutions and participation	Improved household income
				Agricultural extension and skills
Francesconi and Heerink (2011)	Ethiopian Agricultural Cooperatives in an Era of Global Commodity Exchange. Does Organizational form Matter?	Ethiopia	Weak confidence, with multiple issues	Establish or improve producer cooperatives		Improved household income
Giné and Yang (2009)	Insurance, Credit and Technology Adoption. Field Experiment Evidence from Malawi	Malawi	Strong confidence	Provide access to financial services	Improved use of financial services
Guo et al. (2015)	Farmer Field School and Farmer Knowledge Acquisition in rice Production. Experimental Evaluation in China	China	Strong confidence	Agricultural extension and skills		Improved household income	More productive (agricultural) land use
Hegde and Bull (2011)	Performance of Agro Forestry Based PES Project in Mozambique. A Household Level Analysis	Mozambique	Strong confidence	Incentives for efficient resource use	Enhanced local institutions and participation	Improved household income
Humphreys et al. (2015)	Social engineering in the Tropics: A Grassroots Democratization Experiment in the Congo	DR Congo	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
Cai et al. (2015)	Social Networks and the Decision to Insure	China	Strong confidence	Provide access to financial services	Improved use of financial services
Karlan et al. (2012)	Agricultural Decisions after Relaxing Credit and Risk Constraints	Ghana	Strong confidence	Provide access to financial services		Improved household income
Labonne and Chase (2011)	Do CDD projects enhance social capital? Evidence from the Philippines.	Philippines	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
Macours et al. (2012)	Transfers, Diversification and Household Risk Strategies: Experimental evidence with lessons for climate change adaptation	Nicaragua	Strong confidence	Cash or asset transfer		Improved household income
Madajewicz et al. (2014)	Community Participation in Decision – Making. Evidence from an Experiment in Providing Safe Drinking Water in Bangladesh	Bangladesh	Strong confidence	Build or improve local institutions Empower local marginalized groups	Better targeted public services
Matchaya and Perotin (2013)	The Impact of Cooperative Patronage. The Case of NASFAM in Kasungu District	Malawi	Good confidence, with minor issues	Establish or improve producer cooperatives	Enhanced local institutions and participation	Improved household income	More productive (agricultural) land use
				Agricultural extension and skills
Mazunda and Shively (2015)	Measuring the Forest and Income Impacts of Forest User Group Participation Under Malawi’s Forest Co-Management Program	Malawi	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation		Reduced deforestation
Mojo et al. (2015)	Social and Environmental Impacts of Agricultural Cooperatives. Evidence from Ethiopia	Ethiopia	Good confidence, with minor issues	Establish or improve producer cooperatives			More productive (agricultural) land use
Nagaraj et al. (2013)	Technological and Institutional Interventions in Enhancing Livelihood of Farmers in Semi-Arid Tropics Areas. Experience of ICRISAT HOPE Project	India	Strong confidence	Agricultural extension and skills			More productive (agricultural) land use
Nguyen and Rieger (2014)	Community Driven Development and Social Capital. Evidence from Morocco	Morocco	Strong confidence	Build or improve local institutions	Enhanced local institutions and participation
Nkonya et al. (2012)	Initial Impact of Integrated Agricultural Research for Development in East and Central Africa	DR Congo	Strong confidence	Build or improve local institutions	Better targeted public services	Improved household income
		Rwanda
		Uganda
Olken (2007)	Monitoring Corruption. Evidence from a Field Experiment in Indonesia	Indonesia	Strong confidence	Build or improve local institutions	Better targeted public services
Olken (2010)	Direct Democracy and Local Public Goods. Evidence from a Field Experiment in Indonesia	Indonesia	Strong confidence	Build or improve local institutions	Improved public service delivery
Schaner (2015)	The Persistent Power of Behavioral Change. Long Run Impacts of Temporary Savings Subsidies for the Poor	Kenya	Strong confidence	Provide access to financial services		Improved household income
Somanathan et al. (2009)	Decentralization for Cost – Effective Conservation	India	Strong confidence	Enhance public service provision	Improved public service delivery
Takahashi and Barrett (2013)	The System of Rice Intensification and Its Impacts on Household Income and Child Schooling. Evidence from Rural Indonesia	Indonesia	Strong confidence	Agricultural extension and skills		Improved household income	More productive (agricultural) land use
Tilahun et al. (2016)	Impact of Membership in Frankincense Cooperative Firms on Rural Income and Poverty in Tigray, Northern Ethiopia	Ethiopia	Strong confidence	Establish or improve producer cooperatives	Enhanced local institutions and participation	Improved household income
Togbé et al. (2015)	Effect of Participatory Research on Farmer's Knowledge and Practice of IPM. The Case of Cotton in Benin	Benin	Good confidence, with minor issues	Agricultural extension and skills			More productive (agricultural) land use
Van Rijsbergen et al. (2016)	The Ambivalent Impact of Coffee Certification on Farmers Welfare. A Matched Panel Approach For Cooperatives in Central Kenya	Kenya	Strong confidence	Incentives for efficient resource use		Improved household income
Verhofstadt and Maertens (2014)	Can Agricultural Cooperatives Reduce Poverty? Heterogeneous Impact of Cooperative Membership on Farmers' Welfare in Rwanda	Rwanda	Good confidence, with minor issues	Establish or improve producer cooperatives		Reduced poverty and vulnerability Improved household income
Voss (2008)	Impact evaluation of the Second Phase of the KDP in Indonesia	Indonesia	Strong confidence	Build or improve local institutions		Reduced poverty and vulnerability Improved household income
Wright et al. (2016)	Decentralization and Deforestation: The Local Politics of Environmental Policy	Bolivia	Strong confidence	Enhance public service provision			Reduced deforestation
		Peru