4,753
Views
10
CrossRef citations to date
0
Altmetric
Articles

Building Resilience through Social Protection: Evidence from Malawi

&
Pages 1958-1980 | Received 17 Jul 2020, Accepted 05 May 2022, Published online: 26 May 2022

Abstract

We apply a well-known resilience index developed by the FAO to data from a cash transfer evaluation in Malawi to address two key questions: Is the FAO index a valid measure of resilience? Can an unconditional cash transfer significantly boost household resilience? Our answer to both these questions is affirmative. The resilience index positively predicts future positive coping behaviour among households (predictive validity) and is a stronger predictor of future coping than consumption or assets. We then find that the unconditional cash transfer increased the resilience index by 12 points, or 30 per cent over the baseline mean index value. Results imply that small, regular, predictable cash transfer payments to ultra-poor households not only protect current consumption but can also build resilience and protect against future shocks.

JEL CLASSIFICATION CODES:

1. Introduction

The concept of Resilience has become increasingly popular within the international development community as a framework for profiling and ranking households in terms of their response capacity to shocks and stressors to livelihoods, particularly those that threaten food security. Though relatively new in development economics, the term has a long history of use in mental health studies where resilience is defined as ‘the ability to withstand and rebound from disruptive life challenges’ (Walsh, Citation2003). In the development literature, resilience is typically discussed in relation to threats to livelihoods and the ability to overcome these threats. The Resilience Alliance, for example, defines resilience as ‘The capacity of a system to absorb disturbance and reorganise while undergoing change’ (Resilience Alliance, Citation2002), while the Food Security Information Network’s Resilience Measurement Technical Working Group [FSIN-RMTWG] defines resilience as ‘…the capacity that ensures adverse stressors and shocks do not have long-lasting adverse development consequences’ (FSIN-RMTWG, Citation2014). Barrett and Constas (Citation2014) have proposed a theory of resilience for use in international development that builds on the concept of poverty traps and define resilience as ‘the capacity over time of a person, household or other aggregate unit to avoid poverty in the face of various stressors and in the wake of myriad shocks. If and only if that capacity is and remains high over time, then the unit is resilient’.

The common thread through these and other definitions is the notion that resiliency reflects an ability to successfully avoid poverty and food insecurity even in the event of negative shocks or stressors to an established pattern of livelihood. Resilience does not reflect the elimination of vulnerability to shock or stressors, but the capacity to bounce back when the shocks and stressors do occur. As such, unlike static measures of well-being, such as consumption or assets, behaviour is an important dimension of resilience that makes it unique from a measurement standpoint. Resilience has become particularly relevant in international development due to the increasing disruption in food supplies and agricultural productivity caused by climate change, soil quality depletion due to intensified land use, as well as sporadic incidence of civil unrest and armed conflict.

The empirical literature on resilience in economic development is still relatively recent, and there is not yet a consensus on the ideal approach to measuring resilience nor any validation of alternative measurement approaches (Bahadur, Ibrahim, & Tanner, Citation2013; Winderl, Citation2014). Some studies use an indicator of food security or diet diversity as the key outcome or result of higher resilience, and resilience itself is captured through a set of variables representing sources of livelihood and exposure to shocks (CRS, Citation2013; Frankenberger, Mueller, Spangler, & Alexander, Citation2013). Two theory based empirical approaches to resilience measurement have been developed to date which hold promise in terms of pushing the methodological frontier in this burgeoning field. Cisse and Barrett (Citation2018) apply the theory of poverty-traps to resilience and estimate a welfare function for pastoralist households in Northern Kenya based on the evolution of livestock holdings over a five-year period. Their method allows previous accumulation of livestock to affect future holdings in a non-linear way to generate the classic S-shaped welfare curve. Estimates of the first and second moments of the welfare distribution for each household are used to generate household specific distributions, which allows the calculation of the probability of the household ending up above a normative cut-off. This probability is the resilience measure, higher values indicating a higher probability of reaching the normative cut-off.

The second approach has been developed by the FAO through the FSIN-RMTWG (FSIN-RMTWG, Citation2014). In their Resilience Index Measurement and Analysis (RIMA) approach, resilience is conceptualized as a multidimensional latent variable with four key contributing pillars. Indicators within each pillar are combined using structural equations to create a single summary index of resilience capacity. This index can then be used to rank households from most to least resilient for targeting purposes (FAO, Citation2016). Determinants of resilience capacity at the household and community level can also be investigated to understand which factors contribute to improved resilience, although this is challenging because the obvious factors determining resilience are already used to build the capacity index (Alinovi, D’Errico, Main, & Romano, Citation2010). Nonetheless, the RIMA approach remains one of the most widely used methodological approaches to resilience measurement (D’Errico, Garbero, Letta, & Winters, Citation2020).

In this paper we make several new contributions to the literature on resilience using unique data from a randomized control trial (RCT) implemented to evaluate the Government of Malawi’s Social Cash Transfer Program (SCTP). First, we use these data and the RIMA approach to build a multidimensional resilience capacity index (RCI) for households in our sample, all of whom are ultra-poor. We then provide the first formal validation of the RIMA approach by exploiting the panel aspect of our data to see if households with higher resilience capacity at baseline are more likely to adopt positive coping strategies in the future in response to shocks. A valid index would have predictive ability in the sense that it would correctly predict resilient behaviour in the future. We find that the RCI developed based on RIMA approach does indeed have predictive power – 62 per cent of households scoring in the highest quintile of the capacity index at baseline adopted positive coping strategies when faced with a shock in the future, compared to just 25 per cent of households from the bottom quintile of the resiliency index. Future food security is also significantly higher among households in the top quintile of the resilience score at baseline, compared to those in the bottom quintile. These predictive effects are based on the panel of comparison households not exposed to the cash transfer intervention.

Having established the predictive validity of the RCI, we then evaluate the impact of the cash transfer program on resiliency using the RCI as the outcome and controlling for baseline levels of the RCI through a difference-in-difference estimation. We find that the unconditional cash transfer program has a large and statistically significant effect on resiliency, with an effect size in the full sample of 30 per cent of the baseline RCI value. These impacts are almost twice as large for the poorest households at baseline – who are also the least resilient. Key drivers for the increase in the RCI are increased income diversification, increased asset holdings (agricultural tools and livestock), and increased household food production. These results build on similar work that uses the RCI to show that the Lesotho Child Grant Program significantly increases resilience capacity (D’Errico et al., Citation2020).

Our results have two important implications for the literature on social protection and resilience. A recent position paper by the FAO argues that social protection can be a key programmatic strategy for building resilience in both fragile and stable settings (Winder Rossi, Spano, Sabates-Wheeler, & Kohnstamm, Citation2017) but the direct evidence of the impact of social protection interventions specifically on resiliency per se is essentially non-existent with the exception of D’Errico et al. (Citation2020). Many studies have looked at the effect of development interventions, including social protection interventions, such as cash transfers on outcomes that are related to or affected by resiliency, such as food security (Bhalla, Handa, Angeles, & Seidenfeld, Citation2016; Hjelm, Mathiassen, & Wadhhwa, Citation2016), coping strategies (CRS, Citation2013) and livelihoods (Handa, Natali, Seidenfeld, Tembo, & Davis, Citation2018). We provide just the second known rigorous assessment (after D’Errico et al., Citation2020) of the proposition that social protection can build resiliency, using the case of the Malawi SCTP, which is part of the government’s long-term poverty eradication policy, and using a theory-based approach to measure resilience.

Of particular interest is the fact that the social protection program is an unconditional cash transfer whose primary objective is food security, yet the program has large impacts on assets, livelihoods and other dimensions that strengthen the capacity to withstand a shock—an important component of resiliency. In other words, a program whose primary objective is protection strengthens resiliency by affecting longer-term features of the household that contribute to building resiliency – a potentially important spillover effect. Our paper is the first to provide a (predictive) validity check of the RIMA approach and the corresponding RCI. That the RCI is predictive of future resilient behaviour, at least in the context of this study, suggests that along with the measure developed by Cisse and Barrett (Citation2018) this is a potentially valid measurement tool for future empirical work on resiliency in low-income settings.

The remainder of the paper is organized as follows. Section 2 provides an overview of the Malawi SCTP programme and the evaluation design. Section 3 discusses the RIMA approach and the adaptations to the SCTP data, while Section 4 describes the SCTP data, balance and attrition. Section 5 presents the empirical results on the RCI estimation, predictive validity and programme impacts on the RCI. Section 6 provides a discussion and conclusions.

2. Overview of the Malawi SCTP programme and evaluation design

2.1. Program overview

The SCTP, locally known as the Mtukula Pakhomo, is an unconditional cash transfer programme targeted to ultra-poor, labour-constrained households. The programme began as a pilot in 2006 and has slowly expanded over the years and reaching all 28 districts in the country as off 2021. The objectives of the SCTP are to reduce poverty and hunger, and to increase school enrolment rates among children. The program is implemented by the Ministry of Gender, Children, Disability and Social Welfare (MoGCDSW) with additional policy oversight provided by the Ministry of Finance, Economic Planning and Development (MoFEPD).

Eligibility criteria are based on a household being ultra-poor (unable to meet the most basic urgent needs, including food and essential non-food items, such as soap and clothing) and labour-constrained (defined as having no member ‘fit to work’ or having the ratio of ‘not fit to work’ to ‘fit to work’ of more than three). Household members are defined as ‘unfit to work’ if they are below 19 or above 64 years of age, or if they are aged 19–64 but have a chronic illness or disability, or are otherwise unable to work (Ayala Consulting, Citation2012). Beneficiary selection is done through a community-based approach with oversight provided by the local District Commissioner’s (DC’s) Office and the District Social Welfare Office (DSWO). Community members are appointed to the Community Social Support Committee (CSSC), and the CSSC is responsible for identifying households that meet these criteria and creating a list. The ultra-poor eligibility condition is verified through a proxy means test (PMT) that is done centrally. Coverage is ∼10 per cent of the household population in each village cluster (VC).

The transfer amount varies based on household size and there is a ‘schooling bonus’ determined by the number of children in the household of primary- or secondary-school age. Transfer amounts remained fixed between 2013 and May 2015 and were adjusted after May 2015 to maintain the real value of the transfer (). The schooling bonus is not conditional on actual school enrolment but is rather intended to ‘motivate’ households to send children to school. To put these amounts in perspective, on average, the total annual transfer amount received by households was MWK25,622 (US$67) and the average monthly per capita value of the transfer was MWK 559 (US$1.50). Using baseline data, we estimate that the transfer represented 20 per cent of baseline consumption among all beneficiaries.

Table 1. Structure and level of transfers (current MWK)

Additional details of the implementation and operational performance of the SCTP can be found in the main impact evaluation report (CPC, Citation2016). In particular, there was high adherence in terms of disbursement with up to 99 per cent of target beneficiaries receiving payments as expected and the quantum of money received was also consistent with the schedule in . Overall impacts of the SCTP based on these data show significant impacts across a wide range of domains including food security and consumption, livestock holdings, and school enrolment of children (Handa, Otchere, & Sirma, Citation2022).

2.2. Evaluation study design

The impact evaluation for Malawi’s SCTP was a longitudinal, experimental study design with one baseline and two post-treatment follow-up surveys. The study districts, Salima and Mangochi, were selected for the study in order to integrate with the MoGCDSW’s plans to expand the SCTP to new districts beginning in 2012. The districts scheduled for scale-up in early 2013 were Salima and Mangochi, so the MoGCDSW took this opportunity to integrate an impact evaluation into the planned expansion activities. Subsequently, the research team worked with the Ministry to randomly select two study Traditional Authorities (TAs) in each district (Maganga and Ndindi TAs in Salima, and Jalasi and M’bwana Nyambi TAs in Mangochi) to enter into the study. Program targeting was conducted in these TAs and the final beneficiary lists for each VC, the primary sampling unit in the study, compiled. The study team visited these households in July 2013 to administer a household survey. After this baseline survey, VCs were randomly assigned to treatment or delayed-entry control status in a lottery that was held publicly at the District Commissioner’s Office. A midline longitudinal follow-up was conducted in November 2014 and the endline survey in November 2015. The final sample for the study was 3,531 SCTP-eligible households located in 29 VCs across the four TAs in the two districts at baseline, of which 14 VCs (1,678 households) were assigned to treatment (T) and 15 VCs (1,853 households) were assigned to the delayed-entry group (C).

All study protocols were reviewed for ethical considerations and approved by the UNC Institutional Review Board (IRB) and Malawi’s National Commission for Science and Technology (NCST), National Committee for Research in Social Sciences and Humanities (UNC IRB Study No. 14-1933; Malawi NCST Study No. RTT/2/20). All survey instruments, manuals, and the official evaluation reports are available online at: https://transfer.cpc.unc.edu/?page_id=196.

3. The RIMA approach to measuring resilience

In this study, we adopt the FAO RIMA approach to measuring resilience. Although a number of other measures have been developed and used to measure resilience in different contexts (Alfani, Dabalen, Fisker, & Molini, Citation2015; Cisse & Barrett, Citation2018; Kimetrica, Citation2015; Knippenberg, Jensen, & Constas, Citation2019; Signorelli, Azzarri, & Roberts, Citation2016; Smith & Frankenberger, Citation2018), The RIMA approach remains one of the most widely used, widely field tested, and increasingly peer-reviewed in scientific journals (D’Errico et al., Citation2020). The model was first used in 2008 and was later refined in 2016 to address the limitations identified in several practical applications.

The updated RIMA-II approach defines resilience as a latent construct, the RCI, with multiple predictors and multiple outcomes. The predictors are grouped into four categories (referred to as pillars), namely: (1) Access to basic services (ABS); (2) Ownership of assets (AST); (3) Access to social safety nets (SSN); and (4) Household adaptive capacity (AC). A description of these pillars is shown in . Each pillar is itself a latent variable determined by a number of observed household level indicators. The household is considered the unit of analysis because it is the unit of decision making for household production and consumption. The outcomes of resilience are per capita food consumption and the Simpson’s dietary diversity index (SI).

Table 2. RIMA resilience pillars

Empirically, the RCI is estimated using the Multiple Indicator and Multiple Outcome model (MIMIC) in a structural equation framework. The conceptual path diagram for the model is depicted in . Each pillar is separately estimated using factor analysis of the variables that make up the dimension. The predicted value of each of the components is standardized to range from 0 to 100 and in-turn used to construct the RCI in the MIMIC model. In the MIMIC estimation that we conduct below, several approaches are used to estimate the weights as check for robustness and to eliminate any bias on the weights due to the treatment. The weights represent the relative importance of each pillar to the RCI. In theory, there are four different samples that can be used to generate the weights: (1) only C households at baseline and endline; (2) baseline T and C households; (3) baseline T and C and endline C households; (4) using all the data. Similar to D’Errico et al. (Citation2020), we find that the results are consistent across the various specifications and we proceed with the model that makes use of all the data since this is the most efficient (FAO, Citation2016).

Figure 1. The MIMIC conceptual framework.

Figure 1. The MIMIC conceptual framework.

Given that the data used for the analysis was not designed to explicitly apply the RIMA model, a few adaptations were necessary before estimating the RCI. shows the indicators proposed by the FAO for each pillar and the corresponding indicators that we have available from the SCTP instrument. The outcome variables of per capita food expenditure and the Simpson’s index are identical to those proposed under RIMA, as are the AST indicators of asset ownership (agricultural and non-agricultural) and livestock. For SSN, we have total in-kind transfers, whether or not the household is credit constrained and self-reported perceived available support in times of need. Credit constraints and perceived available support capture a potential for support when shocks set in, and thus are very appropriate for capturing resilience. We recognize a potential downside to using the variable of in-kind assistance as a measure of resilience. Households that are better off by themselves may have little in-kind assistance, especially in ‘normal’ times, and so the indicator of whether support can be activated when needed is likely a more appropriate ex-ante measure.

Table 3. RIMA domain indicators by FAO and SCTP equivalents

On AC, we have an indicator on number of income sources (income diversity) and the ratio of fit-to-work (FTW) to non-fit-to-work (NFTW) to capture potential labor supply and the dependency ratio. Ideally, we would prefer to have the total income from each of these domains as a more direct measure of capacity and importance to household livelihood, but these were not collected in the survey instrument. We also have a binary variable of whether the household only engages in agriculture or if it combines agriculture with other income generating activities. While education is conceptually a part of AC, in our population there is hardly any variation in schooling of the recipient, over 90 per cent are not literate. ABS indicators consider the availability and quality of infrastructure and amenities—access to schools, hospitals and other health facilities, paved roads, markets, safe houses, water, and waste disposal systems. For the pillar of ABS, we do not have any direct measures to construct an index. While this will affect an individual household’s RCI level and the validity tests, it should not affect our estimates of program impact due to the randomization of households to study arm, provided that randomization worked (which we assess in the next section). Each measured variable is constructed to be positive such that more is better, and for binary variables, the better outcome is coded as one.

4. Data, balance, attrition, and descriptive statistics

4.1. Assessment of randomization

To assess the success of the randomization, we check for baseline balance between T and C households on several indicators. We present results of the balance tests on selected variables in . shows the balance test for characteristics of the household head including sex, age, marital status, education and disability status. shows the balance tests for household demographic characteristics, such as the age composition, household size, presence of orphans and disabled members, and dependency structure. shows the balance test for the analytic variables used for the resilience modelling (as outlined in ). The tables show the means for T and C, the mean difference, and a t-test of equality of the means. We find that T and C are balanced on all these indicators which gives assurance of successful randomization. Tests of balance for many more variables are provide in the publicly available evaluation reports and all evidence indicates that the randomization was successful at achieving the ideal counterfactual to estimate treatment effects.

Table 4. Test of balance in head characteristics between T and C households at BL

Table 5. Test of balance in household demographics between T and C households at BL

Table 6. Test of balance in resilience estimation indicators between T and C households at BL

4.2. Attrition

Attrition, when households from the baseline sample are missing in the follow-up surveys, occurs for various reasons, such as migration, death, separation, or the dissolution of households. Overall attrition, when the panel sample differs from the original sample, affects the representativeness of the evaluation results for the population of interest (the SCTP eligible) but remain internally valid. Differential attrition occurs when the treatment and control samples differ in the types of households or individuals who leave the sample, thus eliminating the balance between the T and C groups and leading to biased impact estimates. Ideally, both types of attrition should be null or small.

We investigated attrition at endline for the sample in two ways. First, to test for differential attrition, we checked for similarities at baseline between treatment and control groups for all households that remained in the panel of households, that is, for the households interviewed at baseline and in both follow-up surveys. We tested for overall attrition by comparing the characteristics of households in the panel and the households who were missing at the endline survey. We do not find evidence of differential attrition, meaning that we preserve the balance between the T and C groups found in the baseline survey. However, there is evidence of overall attrition as panel households differ from the lost households in about 8 per cent of the 125 indicators tested for balance in the program report. This is corrected by using inverse probability weighting to adjust the baseline sampling weights. Details of this procedure are available from the authors and are also presented in the publicly available online evaluation reports.

The attrition rates are shown in for the overall T and C groups, and also by district. Overall attrition was 6.5 per cent (6% in T and 6.8% in C). The attrition rate was higher in the Mangochi district than in the Salima district (7.1 vs. 5.8%), with the lowest attrition in the T group in Salima (4.9%). Summary attrition tables are given in for the same variables presented in the balance test in .

Table 7. Household ‘in the panel’ and attrition rates by T-C status and district

5. Empirical results

5.1. MIMIC results and the RCI

provides the results of the factor analysis used in constructing the three resilience pillars of AST, SSN and AC. The analysis uses the panel data for both C and T households. The first two factors for each pillar are reported, along with the uniqueness of each variable. However, only the first factor in each case had an eigenvalue greater than one (1). Furthermore, the first factor explains more than 70 per cent of the variance in each pillar (72% for AST, 76% for SSN, and 74% for AC). Estimation of each pillar therefore uses only the first factor loadings.

Table 8. Factor loading and uniqueness for individual indicators by pillar

The coefficients indicate the strength of the relationship between the variables and the latent pillar. For AST, the wealth index shows the greatest strength while value of social network shows the greatest association with the SSN pillar and livelihood diversification shows the greatest association with the AC pillar. The uniqueness describes the proportion of the variance that is unique to the variable and not shared with other variables. Uniqueness typically is inversely related to the factor loadings such that variables with higher uniqueness have lower association with the latent factor. Looking at the uniqueness column, we find that each variable has uniqueness of more than 70 per cent, which can be interpreted to mean that there is no single variable with high dominance in explaining the variance structure for each pillar.

Using the results in we generate the synthetic index for each pillar based on the first factor loading and estimate the MIMIC—we show these results in . All coefficients are statistically significant at 1 per cent level. The coefficient of per capita consumption is standardized to one to make the coefficient of the Simpson’s index interpretable. We find that a unit increase in the RCI results in a 0.13 increase in the standard deviation of the Simpson’s index. The summary model fit statistics indicate that the chi-square value is significant at the 1 per cent level (), and the root mean square estimate (RMSEA) is 0.0947 with a p-value of 0. The comparative fit index (CFI) is 0.93 which is >0.9, a threshold widely considered as being indicative of a good model fit. The Tuker-Lewis index (TLI) is also quite high at 0.76 although it falls below the threshold of 0.95 considered as threshold for a good fit. Taken together, having highly significant chi-square and RMSEA values, along with above threshold CFI and high value of TLI suggests a good model fit, an important result because as we mentioned earlier, the questionnaire was not explicitly designed to measure resilience but rather was a multi-topic household survey modelled after the Malawi Integrated Household Survey. This suggests that similar living conditions type surveys that are quite common in sub-Saharan Africa could be used to obtain reasonable estimates of resilience using the RIMA approach.

Figure 2. Schematic representation of RIMA II MIMIC model and results.

Figure 2. Schematic representation of RIMA II MIMIC model and results.

Table 9. Summary model fit statistics

5.2. Predictive validity of the RCI

Before estimating the impact of the SCTP on resilience, we assess the predictive validity of the RCI. An important feature of more resilient households is their ability to withstand and recover from shocks, which in part entails utilizing positive coping strategies, that is, strategies that do not permanently lead to a poverty trap or weaken future resiliency. Since coping mechanisms themselves are not used to build the RCI, they present a straightforward opportunity to assess the performance of the RCI in terms of its ability to predict positive shock response behaviour. More resilient households are expected to be more likely to use positive shock response strategies relative to less resilient households. For this analysis, we restrict the sample to the panel of C households only in order to eliminate the potential confounding effect of the cash transfer (the cash transfer itself will directly affect coping strategies). For an unambiguous intertemporal ordering, we relate the baseline RCI to the endline shock response.

In our data, we ask households whether they had experienced any one of 15 different shocks that affected their household negatively, and their most important coping strategy. lists the shocks that households were asked about, with an option to specify any shock not pre-listed. The shocks can be classified as covariate shocks, which affect the entire community or village (such as floods, drought, crop-destroying insects, etc.) or idiosyncratic shocks which are limited to the households (such as death of a breadwinner, catastrophic health expenditure, destruction of dwelling, theft of household goods, etc.). At baseline, about 94 per cent of households reported experiencing at least one of these shocks, and the typical household experienced about three of the shocks. At the endline, about 87 per cent of households reported experiencing at least one of the shocks in the prior 12 months with the typical household experience about two of the shocks. These figures show that these shocks constitute a regular feature of the daily lives of the households, and that resilience is a highly relevant concept in this population. Participation in the SCTP did reduce the share of households reporting at least one shock which suggests that the SCTP had some protective effect on the experience of shocks, or at least on the households’ interpretation of events that are shocks. The covariate shocks were more common than the idiosyncratic shocks ().

Table 10. List of shocks experienced by households

Coping with these shocks usually includes a mix of strategies, some negative (such as reducing consumption or sending children out to work), some positive (relying on own savings/SCTP payment, receiving unconditional help from social networks), and some ambiguous depending on the extent of the response relative to the initial conditions (e.g. labor intensification could be positive or negative depending on the initial level of labor supply). shows the schema used for the classification of coping mechanisms as positive, negative or ambiguous. Our classification is based on the literature on how credit-constrained rural households in Africa typically self-insure against risk (see the review by Mogues, Citation2011). The key idea is that credit-constrained households will engage in precautionary savings, typically holding cash or productive assets that are highly liquid and can be exchanged with little or no transaction costs. Small livestock of the type predominant among our study households would fall under this category, as well as grain stores; entering into liquid debt on the other hand is widely considered a negative response by households. For each household, we count the total number of different coping strategies used and then compute the shares for positive, negative and ambiguous strategies, and we also measure liquid debt directly.

Table 11. Classification of coping strategies to shocks

At baseline, the proportion of coping strategies that were positive was 0.4. In , we group households into quintiles according to the baseline RCI and report the average proportion of positive coping strategies in each quintile. The results show a high degree of agreement between the RCI and the share of positive responses to shocks that are adopted by households two years in the future and contemporaneously. Looking among the C households, we find that among the least resilient households (those in the bottom quintile of the RCI) at baseline, the average proportion of positive coping to shocks at the endline is 25 per cent compared to 62 per cent among households in the highest RCI quintile at baseline. The relationship is monotonic increasing with higher proportions of positive coping to shocks as households go from the lowest to highest quintile. This pattern is identical when we look at baseline (i.e. contemporaneous) shock responses.

Table 12. Share of positive coping responses to shocks by baseline resiliency quintiles

also shows results for the treatment group, and we see the same pattern of results, whereby the share of positive coping strategies adopted by households increases as we move from the lowest quintile (least resilient) to the highest quintile. Also of interest in this table is a comparison of the proportions of positive shock responses per household between T and C at baseline and endline. While the proportions are near identical for each quintile at baseline, the proportions of positive coping to shocks are significantly higher at each quintile among T households at endline. As we show in the next section, this is because the actual RCI is higher among T households at endline.

While indicates that the relationship between endline coping and the baseline RCI is monotonic, we examine this proposition more closely using a local linear regression relating the RCI score to positive coping—the resulting graph is depicted in . This shows that between RCI scores of 20 and 80 (which represents 84% of the sample), the relationship is quite linear, with each unit change in the RCI generating a similar constant increase in the probability of engaging in positive coping mechanisms two years in the future. looks at the number of coping responses adopted by households per shock, though our data is limited to two responses per shock. Here there appears to be little association except for a slight decline in the number of coping per shock among households with high RCI (just 0.10 change in the number of coping mechanisms from the lowest to the highest RCI). What is interesting is that those in the treatment group tend to report fewer number of coping strategies relative to the control group after a threshold of 20 on the resilience scale, suggesting that the cash transfer has allowed households to reduce the number of coping activities required per a given shock.

Figure 3. Future positive coping and baseline RCI among control households.

Figure 3. Future positive coping and baseline RCI among control households.

Figure 4. Future number of total coping mechanisms and baseline RCI among control and treatment households.

Figure 4. Future number of total coping mechanisms and baseline RCI among control and treatment households.

We also look at the correlation between the negative coping strategy of incurring more liquid debt and the baseline resilience scale. shows a very strong negative correlation between baseline resilience and future indebtedness, either measured by cash loans or purchases on credit, again suggesting that the resilience index using the RIMA approach has predictive ability.

Figure 5. Future loan and credit purchases and baseline RCI among control households.

Figure 5. Future loan and credit purchases and baseline RCI among control households.

Food security is the ultimate outcome in the RIMA approach, and indeed in almost all studies that examine resilience, so another obvious test of the validity of the RCI is to gauge its predictive ability with respect to future food security. As before, we show four food security indicators at endline by baseline RCI quintile among C households in . Food consumption and the Simpson’s Index were used to create the RCI, and we also report two other food security indicators—the proportion of households who were worried about food in the last seven days, and the food consumption score (FCS), which is a weighted measure of dietary diversity and nutritional importance of each category. For example, if one household consume food from only two broad categories (tubers and spices) and another household consumes food from only two broad categories (tubers and meat) then the two households would have the same dietary diversity score but different FCS because spices and meat have different weights. For each of the (future) food security indicators we again see a clear increasing monotonic relationship with the baseline quintile ranking on the RCI. These results further suggest that the RCI has predictive validity as a measure of resilience.

Table 13. Baseline resilience and endline food security among C households

5.3. Impact of the SCTP on resilience building

We now turn to the main objective of the paper, which is to estimate the impact of the SCTP on resilience. We begin by showing the distribution of the actual RCI scores by treatment status and baseline RCI quintile in . At baseline, given the randomized design of the study, we expect the scores to be balanced across the study arms and this is what we find in the first two columns of . We conducted t-tests for mean differences in the baseline RCI score across the two groups and found no statistically significant differences in the RCI score at BL but a statistically significant difference at endline.

Table 14. RCI score by treatment status and wave

We provide a more formal test of the impact of the SCTP on the RCI using a difference-in-difference (DID) model as follows: RCIijt=β0+β1Pj+β2Tt+β3Pj·Tt+β4Xij+εijt

In this framework, RCIijt is the outcome of interest for household i who lives in VC j at time t. Pj is a binary variable set to 1 if VC j is receiving the SCTP programme, and to 0 if it is not. Tt is a dummy (binary) variable for time of the observation, set to 1 if the observation is from the endline survey, and to 0 if it is from the baseline. Pj·Tt is the interaction term of the programme variable and the time dummy, Xijt represents a set of observed household characteristics, such as household size, household demographic composition, and household head characteristics, all measured at baseline, and, εijt is the usual error term. In this model, the coefficient of main interest is β3, the coefficient of the interaction term, which is the DID programme impact at endline. Its estimated value (β̂3) is interpreted as the additional change in the RCI value achieved between baseline and endline as a result of the households receiving the SCTP, relative to the change occurring in the comparison group, controlling for differences in the baseline values of the observed characteristics, Xijt.

We use cluster-robust standard errors to account for the lack of independence across observations due to clustering of households within VCs. We also use inverse probability weighting to adjust the sampling weights to account for the six per cent attrition in the follow-up sample. We present the impact for the full sample, for baseline bottom 50 per cent of households by expenditure (for whom the per capita transfer will be much large), baseline small households (household size <5), and baseline labour constrained households (for whom labor shortage might affect resilience capacity).

Estimation results of the DID model are shown in along with baseline and endline means for the two study groups for ease of interpreting effect sizes. We see that the SCTP has a statistically significant impact on the RCI score on all the samples shown in the table. For the full sample, the point estimate of 12.43 percentage points implies an effect size that is 30 per cent of the baseline mean value. For baseline poorest households, the effect size is almost double that at 51 per cent of the baseline mean score. A kernel density of the RCI by treatment status over time is shown in . We find a clear increase in the distribution of the resilience scores for the T group at endline compared to the near identical resilience distribution of C and T at baseline.

Figure 6. RCI by treatment status and time.

Figure 6. RCI by treatment status and time.

Table 15. Impacts on resilience capacity index (overall and heterogeneous)

To unpack the pathway through which the SCTP impacts on the RCI, we examine the program impacts on each of the resilience input variables as well as on the pillars. gives the results of the impacts. We see significant positive impacts on the AST pillar as a whole, driven by positive impacts on asset holdings and the TLU. We also find significant positive impact on AC, driven by increased income diversification. However, we do not find impacts on the pillar of SSN and the input variables. We estimated Lee Bounds (without covariates) for the treatment effect on RCI and its three components. For the three statistically significant effects (RCI, AST and AC), the Lee Bounds do not cross zero. The bound for RCI is 13.22–14.26, the bound for AST is 7.12–8.52 and the bound for AC is 5.32–6.90.

Table 16. Summary impacts on resilience pillars and input variables

5.4. Resilience vs. consumption vs. assets

An obvious competing hypothesis would be that baseline consumption or assets could be an equally good predictor of future coping to shocks. Richer households at baseline can be expected to have better coping to shocks in the future in much the same was as better resilience at baseline does. We examine this hypothesis by comparing the strength of the predictive power of resilience to that of consumption. As shown in , the association between baseline RCI and endline coping mechanisms to shock is monotonic increasing, while the relationship between baseline consumption and endline positive adaption to shocks is highly non-linear and actually decreases at higher levels of baseline consumption. At baseline the correlation between RCI and per capita consumption was 0.80, and this declined to 0.67 at the endline. The left panel of shows that in fact the relationship is highly non-linear, with substantial variability around the predicted line, indicating that these two measures, while clearly correlated (as theory would suggest they ought to be), are not perfect substitutes for each other. The right panel of shows the relationship between the asset index used in the RIMA model and the RCI. Again, we see that the relationship is highly non-linear, especially at lower levels of the asset index, with considerable variability of RCI at all levels of the asset index.

Figure 7. Endline positive coping to shocks by baseline RCI and baseline consumption.

Figure 7. Endline positive coping to shocks by baseline RCI and baseline consumption.

Figure 8. Per capita consumption and asset index vs. RCI—baseline only.

Figure 8. Per capita consumption and asset index vs. RCI—baseline only.

6. Discussion and conclusion

This paper has examined the impacts of Malawi’s SCTP program on development resilience. We find that the SCTP has positively impacted household production, asset ownership, income diversification and strengthening. The SCTP has also improved protective indicators, such as per capita food consumption, dietary diversity and food security. We use the FAO RIMA II model to build an index of development resilience from the data and examine the predictive validity of this index. Increases in the index value are predictive of future positive coping behaviours in the face of shocks and are also predictive of future food consumption and food security. We also compare the predictive power of baseline resilience and baseline consumption and asset holding to future positive coping responses to shocks, and find that resilience is a more consistent predictor of future positive coping to shocks than consumption or assets. Moreover, resilience and consumption are not perfectly correlated, the relationship is highly non-linear suggesting that the two contain different information. These validation results suggest that the RIMA II approach can be used to measure development resilience, for example for profiling and ranking tool for interventions, as well as early warning.

We then estimate the impact of the SCT on household resilience and find that although the SCTP was not explicitly designed with increasing resilience in mind, nonetheless, the SCTP has positively impacted resilience. This is an important result because it suggests that a large-scale government unconditional cash transfer, whose primary objective is short-term protection, can also strengthen household resiliency and thus the ability for ultra-poor households to withstand shocks. Our results are consistent with the one previous study examining the impact of a cash transfer program on resilience using the RIMA approach (D’Errico et al., Citation2020), who also find that the Lesotho Child Grant Program increases the RCI. However, unlike in Malawi, they do not find strong effects of the cash transfer on the individual components (pillars) of the RCI, while we find strong impacts on assets and adaptive capacity.

A key strength of our study is that it uses a well-designed RCT to estimate the impact of the SCTP on resilience. A weakness of the study is that we do not have the full range of indicators recommended by the RIMA approach. A further limitation is the external validity of the findings, though the Malawi SCTP has similar design parameters to other government cash transfer programs in Africa, which increases the potential for external validity. In terms of future research, with just two studies to date reporting on the resilience effects of national cash transfer programs, more evidence using the RIMA approach is necessary in this area to understand whether cash transfer programs in different contexts can deliver these results, and which specific components of the resilience index are driving the effects on household resilience.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The evaluation of the Malawi Social Cash Transfer Programme was funded by a consortium of donors including the European Union, UNICEF-Malawi, KfW, and 3IE. The evaluation was implemented by the University of North Carolina at Chapel Hill and the Center for Social Research under contract to UNICEF-Malawi. The evaluation would not have been possible without the dedicated work of a large team of collaborators, including technical staff of the implementing Ministry, Ayala Consulting, the Center for Social Research at the University of Malawi, and representatives from the key development partners in Malawi—they are recognized as part of the Evaluation Team. We dedicate this paper to the memory of Harry Mwamlima, a longstanding champion of social protection in the Ministry of Finance, Economic Planning and Development of the Government of Malawi.

References

  • Alfani, F., Dabalen, A., Fisker, P., & Molini, V. (2015). Can we measure resilience? A proposed method and evidence from countries in the Sahel. World Bank Policy Research Working Paper No. 7170.
  • Alinovi, L., D’Errico, M., Main, E., & Romano, D. (2010). Livelihoods strategies and households resilience to food security: An empirical analysis to Kenya.
  • Ayala Consulting (2012). Malawi social cash transfer inception report. Lilongwe: Ayala Consulting.
  • Bahadur, A., Ibrahim, M., & Tanner, T. (2013). Characterising resilience: unpacking the concept for tackling climate change and development. Climate and Development, 5(1), 55–65. doi:10.1080/17565529.2012.762334
  • Barrett, C., & Constas, M. A. (2014). Towards a theory of resilience for international development applications.
  • Bhalla, G., Handa, S., Angeles, G., & Seidenfeld, D. (2016). The effect of cash transfers and household vulnerability on food insecurity in Zimbabwe.
  • Carolina Population Center (2016). Malawi social cash transfer programme endline impact evaluation report. Retrieved from https://transfer.cpc.unc.edu/wp-content/uploads/2021/04/Malawi-SCTP-Endline-Report_Final.pdf
  • Catholic Relief Services (2013). Niger resilience study. Baltimore, MA: Catholic Relief Services.
  • Cisse, J., & Barrett, C. (2018). Estimating development resilience: A conditional moments-based approach. Journal of Development Economics, 135, 272–284. doi:10.1016/j.jdeveco.2018.04.002
  • D’Errico, M., Garbero, A., Letta, M., & Winters, P. (2020). Evaluating program impact on resilience: Evidence from Lesotho’s child grants programme. The Journal of Development Studies, 56(12), 2212–2234.
  • DFID 2011. Defining disaster resilience: A DFID approach paper. London. Retrieved from https://www.gov.uk/government/publications/defining-disaster-resilience-a-dfidapproach-paper
  • FAO 2016. Resilience index measurement and analysis II. Rome: Food and Agricultural Organization of the United Nations.
  • Food Security Information Network-Resilience Measurement Technical Working Group (2014, January). Resilience measurement principles. FSIN Technical Series No. 1.
  • Frankenberger, T., Mueller, M., Spangler, T., & Alexander, S. (2013). Community resilience: Conceptual framework and measurement feed the future learning agenda. Rockville, MD: Westat.
  • Handa, S., Natali, L., Seidenfeld, D., Tembo, G., & Davis, B. (2018). Can unconditional cash transfers raise long-term living standards? Evidence from Zambia. Journal of Development Economics, 133, 42–65. doi:10.1016/j.jdeveco.2018.01.008
  • Handa, S., Otchere, F., & Sirma, P. 2022. More evidence on the impact of government social protection in Sub-Saharan Africa: Ghana, Malawi and Zimbabwe. Development Policy Review, 40(3), 1–22. doi:10.1111/dpr.12576
  • Hjelm, L., Mathiassen, A., & Wadhhwa, A. (2016). Food and nutrition policy measuring poverty for food security analysis: Consumption-versus asset-based approaches. Food and Nutrition Bulletin, 37(3), 275–289.
  • Kimetrica  (2015). Measuring climate resilience and vulnerability: A case study from Ethiopia. In FEWSNet (Ed.), Famine early warning systems network. Washington, DC: United States Agency for International Development.
  • Knippenberg, E., Jensen, N., & Constas, M. (2019). Quantifying household resilience with high-frequency data: Temporal dynamics and methodological options. World Development, 121, 1–15.
  • Mogues, T. (2011). Shocks and asset dynamics in Ethiopia. Economic Development & Cultural Change, 60(1), 91–120. doi:10.1086/661221
  • OXFAM (2013). A multidimensional approach for measuring resilience. OXFAM GB Working Paper. Retrieved from http://policypractice.oxfam.org.uk/publications/a-multidimensional-approach-to-measuring-resilience-302641
  • Resilience Alliance 2002. Key concepts. Retrieved from http://www.resalliance.org/index.php/key_concepts
  • Signorelli, S., Azzarri, C., & Roberts, C. (2016). Malnutrition and climate patterns in the ASALs of Kenya: A resilience analysis based on a pseudo-panel dataset (Vol. 2). Washington, DC: International Food Policy Research Institute.
  • Smith, L. C., & Frankenberger, T. R. (2018). Does resilience capacity reduce the negative impact of shocks on household food security? Evidence from the 2014 floods in Northern Bangladesh. World Development, 102(C), 358–376. doi:10.1016/j.worlddev.2017.07.003
  • Walsh, F. (2003). Family resilience: a framework for clinical practice. Family Process, 42(1) 1–18. doi:10.1111/j.1545-5300.2003.00001.x
  • Winder Rossi, N., Spano, F., Sabates-Wheeler, R., & Kohnstamm, S. 2017. Social protection and resilience. Supporting livelihoods in protracted crises, fragile and humanitarian context. FAO Position Paper. Rome: Food and Agriculture Organization of the United Nations, Institute for Development Studies.
  • Winderl, T. (2014). Disaster resilience measurements: Stocktaking of ongoing efforts in developing systems for measuring resilience. United Nations Development Programme (UNDP). Retrieved from http://www.preventionweb.net/files/37916_disasterresiliencemeasurementsundpt.pdf

Appendix

Table A1. Tests for differential attrition on head characteristics

Table A2. Tests for differential attrition on household demographics

Table A3. Tests for differential attrition on resilience estimation indicators

Table A4. Tests for selective attrition on head characteristics

Table A5. Tests for differential attrition on household demographics

Table A6. Tests for selective attrition on resilience estimation indicators

Table A7. Impacts on shocks and coping