Publication Cover
Resilience
International Policies, Practices and Discourses
Volume 6, 2018 - Issue 1
1,680
Views
6
CrossRef citations to date
0
Altmetric
Original Articles

Probing the relationship between ecosystem perceptions and approaches to environmental governance: an exploratory content analysis of seven water dilemmas

, ORCID Icon, , &

Abstract

Addressing wicked ‘water dilemmas’ requires an understanding of the context within which they are embedded. This study explored perceptions of the ecosystem in terms of resilience and the governance approaches employed through a content analysis of documents from seven case studies across the globe. Analytical constructs developed for resilience and governance approaches guided the exploration. Multiple resilience types were present in documents for each case, but few patterns emerged across cases. Governance approaches were strongly focused on state approaches in most cases. A relationship between resilience type and governance approach was not clear; however, a pattern emerged between the presence of the social–ecological resilience type and non-state-centred governance forms. The type of author (government, non-government) or the type of document (research and advisory, descriptive) were not found to mediate the findings as resilience framings varied considerably and state governance approaches were emphasised throughout. As the findings stand in contrast to contemporary scholarship on understanding ecosystems and environmental governance they raise important issues to which individuals must be cognizant when accessing documents for guidance. They also open avenues for future investigation of water dilemmas at the nexus of theory, policy and practice.

Introduction

Water dilemmas are situations involving the biophysical world and humans where difficult choices are required among contested alternatives. These dilemmas are often described as wicked problems (e.g. FitzGibbon & Mensah, Citation2012; Head, Citation2010; Hearnshaw, Tompkins, & Cullen, Citation2011; Reed & Kasprzyk, Citation2009). While the definition of precisely what constitutes a wicked problem varies, it generally refers to a class of challenges characterised by extreme complexity (high risk, scientific uncertainty, ecological and social interdependencies, large scope and scale) and ‘the absence of a clear public consensus on value, the nature of the problem, or acceptable solutions’ (Balint, Stewart, Desai, & Walters, Citation2011, p. 9; see also Batie, Citation2008; Lazarus, Citation2009; Rittel & Webber, Citation1973).

Addressing water dilemmas is imperative and connected to how people see these wicked problems. Who should make decisions in water dilemmas and how should interventions occur? A vast discussion is underway about who should intervene in society and how it should take place; thus, governance has emerged as an integral concern in rethinking approaches to planning and managing water resources (de Loë & Kreutzwiser, Citation2007; Galaz, Citation2007; Pahl-Wostl et al., Citation2013; Plummer, de Grosbois, Velaniskis, & de Loë, Citation2011; Rogers & Hall, Citation2003).

As wicked problems are inherently embedded in a social context and involve multiple actors, attention is directed to diversity in terms of values, views/perceptions and problem framings (Balint et al., Citation2011; Batie, Citation2008; Rittel & Webber, Citation1973). Attention to diversity is necessary for understanding and navigating wicked problems as they are inherently embedded in a social context and involve multiple actors (Balint et al., Citation2011; Batie, Citation2008; Rittel & Webber, Citation1973). The question of how individuals perceive the environment has been explored in relation to geography, complex and synergistic causes, and complicated and contested solutions (Dunlap, Van Liere, Mertig, & Jones, Citation2000; Holling, Gunderson, & Ludwig, Citation2002; Stern, Citation1993). Stern, Dietz, and Guagnano (Citation1995, p. 740) argue that: ‘Given the ongoing debates about public understanding of science, and especially of risk, we need to understand the way values and worldview are implicated in the framing of public debate and the construction of public opinion … – how the general influences the specific.’ Exploring this connection has firmly taken hold within research examining the contingency of action for climate change (i.e. mitigation and adaptation) as related to endogenous societal factors such as perception and attitude of risk, knowledge, ethics and culture (e.g. Adger et al., Citation2009; Leiserowitz, Citation2007). It also extends into research on risk relating to water resources (e.g. Pahl-Wostl, Citation2007; Stenekes, Colebatch, Waite, & Ashbolt, Citation2006; Wolsink, Citation2006). Resilience has been an increasingly common framing in the context of wicked problems (e.g. Goldstein, Citation2011; Martin-Breen & Anderies, Citation2011; Powell, Larsen, & van Bommel, Citation2014; Termeer, Dewulf, & Breeman, Citation2013; Waddock, Citation2013).

This article explores the relationship between ecosystem perceptions in terms of resilience and the approaches to governance in a series of water dilemmas as described in documents arising from the cases. In line with the purpose of this research, the following four questions were explored:

(1)

How are ecosystems perceived in terms of resilience?

(2)

What governance approaches are taken to address the water dilemmas and how are they expressed?

(3)

Is there a relationship between perceptions of the ecosystem and governance approaches in these water dilemmas (and if yes, what is it)?

(4)

How does the relationship between ecosystem perceptions and governance approaches vary across document type?

Unpacking the constructs of resilience and environmental governance in the following section illuminates different ways of understanding the natural world and approaches for intervening. It also sets out important implications of resilience framing for environmental interventions that have been established with the scholarly evolution of these constructs. The main premise underpinning this study is that resilience framing relates to the approach for intervention in the seven water dilemmas from around the world.

Unpacking resilience and environmental governance: background and theory

The natural world is understood in many different ways and the historical assumptions underpinning the views people hold of it have implications for policy and action (Holling et al., Citation2002). Resilience entered the academic lexicon in the 1970s and developed rapidly in the disciplines of psychology and ecology along parallel tracks (Lundholm & Plummer, Citation2010). Several thorough reviews have traced the historical and conceptual development of the resilience construct in these disciplines as well as its more contemporary integrative usage (see Folke, Citation2006; Martin-Breen & Anderies, Citation2011; Masten, Citation2007). More recently, resilience is increasingly identified in association with understanding and responding to wicked problems in the scholarly literature (e.g. Goldstein, Citation2011; Martin-Breen & Anderies, Citation2011; Termeer et al., Citation2013; Waddock, Citation2013) and has been extended to popular news sources such as the New York Times (Zolli, Citation2012).

While several entry points are possible to consider how people perceive the environment, we draw upon the construct of resilience and employ it as a lens in this research for several reasons. First, types of resilience have been traced to differences in world views held by people (Holling et al., Citation2002) and these have important implications as set out in the introductory section of this paper. Second, notwithstanding duly noted difficult normative issues, resilience has spurred conversation about governance in relation to contemporary conditions of complexity and change (Brown, Citation2014; Duit, Galaz, Eckerberg, & Ebbesson, Citation2010; Nelson, Adger, & Brown, Citation2007). Third, recent approaches of using resilience as an optic to usefully explore different subjects with characteristics of wicked problems have been established, such as rural studies (Scott, Citation2013) and ecosystem services in cities (Barthel, Parker, & Ernstson, Citation2013). In developing a resilience lens to meet the needs of our inquiry we direct attention to a descriptive aspect by drawing upon work by Cumming et al. (Citation2005), as well as an interpretive aspect by developing a typology of resilience perspectives.

Resilience is thus understood in several ways and tensions are evident among interpretations (e.g. Brand & Jax, Citation2007; Brown, Citation2014; Hornborg, Citation2009, Citation2013; Leech, Citation2008; Strunz, Citation2012). Categorising types of resilience is essential to its use as a lens to illuminate how actors perceive the ecosystem in water dilemmas. A resilience typology, using four ‘types’ of resilience (engineering, ecological, social-ecological and epistemic) was developed in 2012 based on a thorough review of the literature (see Plummer, Baird, Dupont, & Renzetti, Citation2012). It was subsequently operationalised for use in content analysis by identifying corresponding word and phrase indicators for each type. Table provides an overview of the resilience typology and for each type sets out its boundaries, desirable attributes, relationships among system elements described and proxies/measures. While considerable efforts were made to clearly distinguish between the types, it is important to recognise that they are not mutually exclusive and a degree of overlap exists between some of the boundaries due to the nature of development of resilience types over time by diverse disciplinary perspectives (see e.g. Folke, Citation2006).

Table 1. A typology of ecosystem perception in terms of resilience.

Governance, in the broadest sense, is deliberate intervention in society that is goal oriented (Kooiman, Citation1993). As set forth by the Global Water Partnership, water governance refers to ‘the range of political, social, economic and administrative systems that are in place to develop and manage water resources, and the delivery of water services, at different levels of society’ (Rogers & Hall, Citation2003, p. 16). Water is one of many resources about which attendant concerns about governance are growing. For example, the World Water Assessment Programme (Citation2003) diagnoses the present dilemma concerning water as a crisis of governance, brought about by the mismanagement of water by humans. Ideas of environmental governance are being taken up in specific relation to water.

Questions of governance are often expressed or represented as models. These models reflect underlying positions about who should make decisions, the manner in which decisions should be made, and how societal change should occur (Glasbergen, Citation1998). A reconfiguration of environmental governance is underway in which the state or government is no longer seen as the sole decision-making authority (Armitage, de Loë, & Plummer, Citation2012; Bryant & Wilson, Citation1998). Attention is thus being directed to a broader array of governance models that highlight the particular roles of markets, civil society, self-regulation and co-operation (Glasbergen, Citation1998). Moreover, a growing emphasis is being placed on the way these models hybridise (see Armitage et al., Citation2012; Lemos & Agrawal, Citation2006) and combine to influence outcomes (Duit & Galaz, Citation2008) in light of the complex and multi-scale nature of contemporary environmental challenges. Table summarises four of the more common models of environmental governance and unpacks each in terms of who is involved, how decisions are made and the anticipated outcomes of change.

Table 2. Environmental governance models and key analytical considerations (Glasbergen, Citation1998; Lemos & Agrawal, Citation2006).

As set out in the introduction, the intent of this study is to explore the relationship between how a system of interest is understood in terms of resilience and the governance approach(es) to the water dilemma. Resilience framing has important implications for environmental interventions. An exclusive emphasis on engineering resilience is associated with the pervasive application of top-down command and control management (Folke et al., Citation2004; Holling & Gunderson, Citation2002; Holling & Meffe, Citation1996; Plummer, Citation2010). Government is the main entity in this model of intervention and control occurs through regulations (Glasbergen, Citation1998). The fundamental distinction in framing resilience away from an equilibrium steady state (i.e. ecological resilience) connotes the need for adaptive management (e.g. Gunderson, Citation2000; Holling & Meffe, Citation1996). The social–ecological framing of resilience broadens the context to linked systems of humans and nature (Folke, Citation2006) and correspondingly emphasises adaptive and collaborative approaches (e.g. Folke, Hahn, Olsson, & Norberg, Citation2005; Olsson, Folke, & Berkes, Citation2004; Walker, Holling, Carpenter, & Kinzig, Citation2004). Finally, the epistemic framing of resilience is rooted in social constructivism epistemology and draws attention to the contested boundaries defining systems with the implied requirement of participation in collective action with the hallmarks of agency, negotiation and co-dependence (Powell & Jiggins, Citation2003; Powell et al., Citation2014).

Methods

A multiple case study design was used to explore the relationship between ecosystem perceptions and the approaches to governance in a series of water dilemmas. In line with direction from Kuzel (Citation1999) and Shakir (Citation2002), the selection of cases fulfilled the objectives of appropriateness and adequacy. Specifically, each exhibited a water dilemma (the unit of analysis) and was located in a different geographic location, and the boundary of the location was defined by the water dilemma. The opportunity to engage with these cases was made possible through a broader research consortium, of which all the case studies were part, entitled ‘Climate Adaptation and Water Governance’ (CADWAGO). The locations of each case study and a brief description of the water dilemma are shown in Figure .

Figure 1. Geographic location of cases.

Figure 1. Geographic location of cases.

Analysis of documents is often undertaken in association with case study research (Stake, Citation1995; Yin, Citation2003) as well as policy relevant questions in the environmental domain (e.g. Berke & Conroy, Citation2000; Gupta et al., Citation2010; Plummer et al., Citation2011). A request was made via e-mail to each case study leader (a person in each case with extensive knowledge of the water dilemma and who had undertaken primary research in the case) for three key documents that addressed the water dilemma (e.g. management plans, research reports, policy documents). Each document was scrutinised to ensure it encompassed the elements of a water dilemma and that it was directly relevant to the case. Where a portion of a document was not directly relevant to the water dilemma or was clearly redundant it was excluded from the analysis.

The data collection protocol resulted in three documents for each case (21 documents in total) with an average length of 65 pages (see Appendix 1 for the list of documents). Content analysis was guided by analytical constructs in the literature – specifically, the resilience typology and governance approaches identified in Tables and . A comprehensive codebook was prepared which elaborates upon each aspect of these constructs by providing definitions, keywords, phrases and examples (as suggested by Creswell, Citation2009; Krippendorff, Citation2013). Coding was performed in two stages using NVivo 10 (QSR International). Text queries were initially used to identify all relevant passages related to ecosystems and/or governance. A subsequent round of deductive coding, using the codebook as a guide, assigned all relevant codes to passages identified via the text query (Creswell, Citation2009; Krippendorff, Citation2013).

In coding for the analytical construct of ‘resilience typology’, codes were assigned by resilience type (i.e. engineering, ecological, social–ecological and epistemic) and by consideration (i.e. system boundary, desirable system attributes, relationships and functions, and/or proxies/measures of resilience) that were exhibited in the passage. The proportion of all codes assigned for each consideration within each resilience type was calculated. From these data, a simple mean value for each resilience paradigm was calculated to identify relationships in the cross-case analysis. Codes for the analytical construct ‘governance approaches’ were assigned for: (1) the governance approach (i.e. state, market regulation, civil society and hybrid forms); (2) considerations for governance approaches (i.e. actors, processes and outcomes); (3) the tone of the language used within each passage (positive, negative or neutral); and, (4) the magnitude, or intent, of the language used within the passage. Tone and magnitude provide a means to gauge the governance approach and associated considerations in terms of the nature and strength of expression. Magnitude was assigned using three categories (i.e. explicit, implicit and empty) described in detail in Plummer et al. (Citation2011). The number of codes assigned to a single magnitude was divided by the total number of magnitude codes assigned and a proportion value was identified for each tone type for each document and combined for cases.

Cross-case analysis was subsequently undertaken to probe patterns among the water dilemmas that related to the four research questions guiding the study. ‘Fingerprints’ were created to visualise how resilience and governance was expressed across the cases by plotting the proportion of coded passages using a radar graph, where each axis represents a resilience consideration or governance dimension. All points on each axis sum to one (100% of codes assigned to that axis) and the resulting ‘shape’ shows how strongly it is expressed within each case (i.e. shapes with greater area indicate a stronger expression of the resilience type/governance approach). Relational patterns between how the ecosystem was perceived in terms of resilience and governance of the water dilemma were then explored through the use of scatterplots.

A limitation to the methods and study relates to the documents used for the analysis. Each case study leader was asked for three key documents that addressed the water dilemma. We relied upon the case study leaders to identify ‘key’ documents that address the water dilemma because it was beyond the scope of this research to investigate the extent to which the documents accurately reflected perspectives of actors in each case. While the wording of the request was intended to enable flexibility in the provision of documents based on a high degree of familiarity with the case, their selection has acknowledged implications. These include a different mix of document types between cases document as well as preparation by a variety of organisations (governmental and non-governmental) and the perceptions presented therein are reflective of author(s)/organisations. To explore the influence(s) of different types of documents, each document was classified into one of three categories: research and advisory documents authored by government agencies (n = 8); research and advisory documents written by non-governmental groups (n = 6); and descriptive documents authored by any source (n = 7). This categorisation was used to understand the differences between the two main types of documents provided by case study leaders, as well as potential differences between author types for research and advisory documents as this category was broad.

Findings

How are ecosystems perceived in terms of resilience?

A ‘resilience fingerprint’ using the resilience typology was generated for each case and is illustrated in Figure . Multiple resilience types were represented in each case (albeit to varying extents). The fingerprints highlighted the similarity of the UK, AUS coastal, AUS floods, Indonesia and Tunisian case in the dominance of ecological resilience framings of proxies/measures of resilience. It also showed a relatively similar ‘fingerprint’ for Niagara and Tunisian cases. The associated water dilemmas in these similar cases showed little similarity. For example, the Niagara and Indonesian cases focus on water quality and transboundary issues, the Tunisian case focuses on water quantity variability, the UK case deals with institutional constraints to integrated water resource management and the AUS coastal case deals with diverse development pressures on protection of marine ecosystems. In addition, the types of stakeholders and governance structures in these cases vary substantially. This supports the assertion that diverse actors from different places can still commonly frame issues because they are connected to a larger environmental discourse (‘resilience’ and ‘climate change’ being prime current examples) (Dryzek, Citation2005; Forsyth, Citation2003). As Forsyth (Citation2003, p. 226) observes: ‘all forms of environmental explanation reflect a wider social framing and solidarity such as a network or community…’.

Figure 2. Resilience fingerprints for each case. Notes: axes of the radar graph correspond to the four considerations of resilience paradigms: top = system boundary, right = system attributes, lower = relationships and functions, and left = proxies/measures of resilience. Line colours correspond to resilience types: blue = engineering, black = ecological, orange = social-ecological, and purple = epistemic.

Figure 2. Resilience fingerprints for each case. Notes: axes of the radar graph correspond to the four considerations of resilience paradigms: top = system boundary, right = system attributes, lower = relationships and functions, and left = proxies/measures of resilience. Line colours correspond to resilience types: blue = engineering, black = ecological, orange = social-ecological, and purple = epistemic.

Some discernible patterns appeared with regards to perception of the ecosystem across cases. First, multiple resilience framings occurred in each of the cases. Engineering and ecological resilience framings tended to occur most strongly in different axes in the resilience fingerprint (i.e. for different considerations) and often in isolation of other resilience framings (Figure ). Social–ecological resilience often co-occurred with other types and also tended to more frequently be oriented towards ‘system boundary’ and ‘relationships and functions’ considerations. Expressions of these multiple types may reflect evolution, uptake and overlapping boundaries associated with resilience as an analytical construct, which has evolved and been shaped by various disciplines in the social and natural sciences. Epistemic resilience was not identified in key documents in a proportion large enough to be exhibited in the fingerprints. This finding is unsurprising given the relatively recent advent of epistemic resilience and the formative nature associated with its scholarship.

What governance approaches are taken to address these water dilemmas and how are they expressed?

The second analytical construct concerned approaches to water governance and was unpacked using the fingerprint technique in terms of actors, processes and outcomes (Figure ). A clear pattern emerged across cases with state governance approaches most common across all governance considerations. State approaches were particularly strongly represented in the consideration of outcomes across cases, while non-state approaches (market regulation, civil society and hybrid forms) appeared more often for the considerations of actors and processes. This finding was unsurprising as government regulatory control forms the basis of environmental policy (Glasbergen, Citation1998; Kettl, Citation2002) and thus is likely to be closely aligned with governance outcomes.

Figure 3. Governance fingerprints for each case. Notes: axes of the radar graph correspond to the three considerations of governance approaches: top = actors, lower right = processes and lower left = outcomes. Line colours correspond to governance approaches: blue = state, black = market, orange = civil society and purple = hybrid forms.

Figure 3. Governance fingerprints for each case. Notes: axes of the radar graph correspond to the three considerations of governance approaches: top = actors, lower right = processes and lower left = outcomes. Line colours correspond to governance approaches: blue = state, black = market, orange = civil society and purple = hybrid forms.

Metrics of magnitude and tone were analysed to gauge strength and direction of the governance approaches to each water dilemma. Three distinguishable patterns emerged from the cross-case analysis. First, magnitude types were distributed among governance approaches and considerations, but passages mentioning state approaches tended to be explicit or empty, market approaches tended to be implicit or empty, and no clear patterns emerged for civil society and hybrid approaches. Second, as the proportion of state governance approaches increased, the proportion of passages with a neutral tone also increased, indicating a positive relationship between them. This is indicative of a descriptive tone (i.e. statements of what ‘is’) in reference to state governance approaches and is consistent with the findings about regarding the prevalence of this type of approach in most cases. Third, as the proportion of hybrid governance approaches increased, the proportion of passages with a positive tone increased, and those with a negative tone decreased, indicating that hybrid governance approaches are positively related to a positive tone and negatively related to a negative tone. While all magnitude types occur for all governance approaches, the proportions of passages mentioning market regulation, civil society and hybrid governance approaches are much lower than for state approaches. This highlights the explicit (directive) and empty (descriptive) nature of many of the passages that address state governance approaches and the implicit (advisory) and empty nature of passages for other governance approaches. This finding may be a signal of change in terms of water governance (while acknowledging the study limitation identified above), and coincides with growing emphasis for transformation of water governance beyond state approaches (e.g. Pahl-Wostl, Citation2009; Rogers & Hall, Citation2003; Tropp, Citation2007). A case study example of this can be drawn from the United Kingdom where non-governmental organisations legally challenged the existing approach to water management in the 1990s and fundamentally changed the way water resources were managed (Melo Zurita et al., Citation2013). The Department for Environment Food and Rural Affairs’ (Department for Environment Food & Rural Affairs (DEFRA), Citation2013, p. 3) most recent policy framework for an integrated catchment approach states: ‘We firmly believe that better coordinated action is desirable at the catchment level by all those who use water or influence land management and that this requires greater engagement and delivery by stakeholders’.

Is there a relationship between perceptions of the ecosystem and governance approaches in these water dilemmas (and if yes, what is it)?

This question brings together the previous analyses and informs the overarching intent of the research. The relationship(s) between perception of the ecosystem and governance approaches across cases were probed using a scatterplot to identify patterns (data not shown), however, a clear relational pattern did not appear from this exercise. The lack of clear patterns between resilience paradigms and governance approaches was surprising given the inherent associations in the literature, as set out in second section of the paper. Our findings stand in contrast to the literature (e.g. Folke et al., Citation2004; Holling & Gunderson, Citation2002; Holling & Meffe, Citation1996; Plummer, Citation2010) in which the engineering framing of resilience corresponds to intervention via government regulation. Specifically, resilience was framed in a variety of ways in the cases whereas an emphasis on intervention by government approaches was found consistently. The absence of relationship between resilience framing and governance intervention in the cases contradicts the main premise with which the research was undertaken. However, previous content analyses of discourse illustrate how contradictions and tensions can and do often exist both within and among framings of complex problems (Creed, Langstraat, & Scully, Citation2002). This may well be the situation in regard to the multiple framings of resilience and the implications for governance.

Two tendencies were observable in the relationship between resilience types and governance approaches. When social-ecological resilience was present in cases, the proportion of codes assigned for state governance approaches tended to decrease, indicating that state governance approaches were mentioned in a lesser proportion to other approaches when a social-ecological paradigm was expressed. This may indicate the possibility of an emphasis on non-state agents, processes and outcomes occurs in texts exhibiting this resilience type. Moreover, weak positive relationships between the social–ecological resilience type and market, civil society and hybrid governance approaches were also evident, indicating an increase in the presence of these approaches as the social–ecological resilience type was expressed. These findings are generally consistent with the transition underway in natural resources management and environmental governance scholarship where the limitations of command and control approaches are being acknowledged (e.g. Holling & Meffe, Citation1996; Ludwig, Citation2001) and novel governance arrangements are being explored (e.g. Armitage et al., Citation2012; Folke et al., Citation2005). Further, it appears that the social-ecological resilience perspective is most congruent with the promotion of this transition.

How does the type and source of document influence the findings?

Finding relatively few patterns among cases in the above question prompted further investigation into the influence(s) documents themselves may be having in mediating the findings. The presence of patterns within and across document types was explored spanning all cases in regard to each of the aforementioned queries. In terms of perceptions of the ecosystem, engineering resilience was more consistently present (in boundary and attributes considerations) in research and advisory documents authored by government agencies than for the non-government documents of the same type, or the descriptive documents. This may reflect the historically dominant role played by engineers and engineering consulting firms in water resource management. The perceptions of the ecosystem also were highly variable within each document type. Patterns within and across document type in reference to governance approach revealed that: state approaches were highly dominant in passages for all three document types for all considerations; for research and advisory documents authored by non-governmental groups, there was some mention of civil society actors and market outcomes; for research and advisory documents authored by government agencies and for descriptive documents, hybrid actors and processes were sometimes mentioned; and in terms of outcomes, research and advisory documents authored by government agencies were highly focused on state outcomes. While it was anticipated that documents authored by government would emphasise state governance approaches, the dominance of these approaches within and across document types was unexpected. Again, a clear relationship between resilience framing and governance approach was not evident. Moreover, the findings also suggest little uptake of non-state governance approaches as has been argued for in the scholarly literature over the past 15 years (e.g. Armitage et al., Citation2012; Folke et al., Citation2005; Glasbergen, Citation1998) and as required for second or next generation environmental policy (Durant, Chun, Kim, & Lee, Citation2004; Kettl, Citation2002). Thus, agents directly participating in these cases and drawing upon these texts for information and guidance may find that the documents reflect resilience perspectives not entirely congruent with their own or other agents participating in the same cases.

In considering magnitude, research and advisory documents authored by non-governmental groups exhibited mostly empty and implicit language for market, civil society and hybrid approaches, whereas state-based approaches were associated with a higher proportion of explicit passages (mean of 25% of all passages). Research and advisory documents authored by government agencies were written using mostly explicit and empty language for all governance types, and descriptive documents exhibited a mix of magnitude types for all governance approaches with no clear pattern. For all three document types, tone was most often neutral; however, a pattern was evident in tone between document types with research and advisory documents authored by both governments and non-governmental groups being more negative (approximately 30 and 20% of passages coded, respectively) as compared to descriptive documents (approximately 30% of passages coded were positive and only 10–16% negative). It is possible that certain document types could have been written to support a political position on an issue or set of issues or written by individuals that have a conceptual or professional stake in advancing the material and knowledge presented. As Bullock, Armitage, and Mitchell (Citation2012, p. 317) observe with respect to dominant framings of resilience and non-resilience in natural resource dilemmas:

Experts cannot and should not be viewed as neutral consultants and objectives technicians employed to advise their client social groups in situations of learning – because they bring their own disciplinary assumptions, tools and reputations to a problem domain, based on certain cultures of learning.

Robust relational patterns between ecosystem perceptions and governance approaches were not evident within document types; however, a trend emerged in government authored research in advisory reports and descriptive documents where a strong focus on state-based governance approaches was consistent despite the resilience perspectives expressed. This finding, again, stands in opposition to the anticipated relationship, informed by the literature, in which government regulatory intervention is associated with engineering framing of resilience. It also contradicts the tendencies outlined above between social–ecological resilience framing and governance approaches across the cases investigated. Consequently, evidence from the document analysis suggests relatively little reflection or uptake of the widespread calls for new and different approaches to intervening. For example, the need for new approaches for management and governance that correspond or ‘fit’ with complex adaptive systems perspective of resilience has been argued strongly (e.g. Boyd & Folke, Citation2012; Folke et al., Citation2004; Holling & Meffe, Citation1996). Attention to shifting paradigms and cultivating corresponding governance approaches is similarly present in water resource scholarship (e.g. Ison, Röling, & Watson, Citation2007; Pahl-Wostl, Citation2007; Scholz & Stifel, Citation2005). Inroads into wicked problems (e.g. water dilemmas) require processes and tools that are different from those contributing to their creation (Brown, Harris, & Russel, Citation2010; FitzGibbon & Mensah, Citation2012).

Conclusion

Ecosystem perceptions, governance approaches and the relationships among these were explored in a document analysis of seven water dilemmas across the globe. In drawing upon conceptual developments of resilience in relation to ecosystems and environmental governance, relationships were anticipated between resilience framing and approaches for intervening in the cases. However, these patterns did not clearly emerge from the analysis. In particular, the relationship between engineering framing of resilience and regulatory intervention via government was absent. A pattern across cases linked the presence of the social–ecological resilience framing and non-state-centred governance approaches. This trend appeared most strongly in references to governance actors and processes, and less so in governance outcomes which is consistent with a transition in governance from command and control to other forms (Armitage et al., Citation2012; Folke et al., Citation2005). However, the findings from these cases indicate that transition may be occurring slowly and in an incomplete way, and that a transfer of authority from state to non-state actors may not have accompanied this shift. The persistent expression of state governance approaches found in documents authored by governments, regardless of the resilience perspective taken, raises important questions about the limited uptake as called for above as well as the entrenchment pathology within resource agencies (cf. Holling & Meffe, Citation1996).

While this research was initiated with expectations of finding congruence between resilience framings and governance approaches, the discordance found reveals important cautions when considering documents as well as opens directions for future research. Reflections on the process of using documents in this research highlight the influence of author type and messaging (language and tone) in the analysis. Results indicating the occurrence of negative content emanating from government and non-government authors serve as a reminder that while documents are stable sources of data, they must not be viewed as apolitical or neutral data sources. Instead, they are imbued with the political meanings of their authors, explicit and implicit, whether intentional and unintentional. This is a noteworthy challenge for actors who are addressing local water issues and perhaps participating in governance that in their efforts to gain information and guidance from available texts, may confront resilience perspectives in these texts that do not reflect the most recent conceptualisations of the wicked water dilemmas being addressed.

The findings from this study also highlight several important directions for future research. The (mis)alignment of perceptions and beliefs about ecosystems and governance by stakeholders in the water dilemmas with the anticipated relationships from the literature is extremely perplexing and requires further investigation. Grounded speculation from this research suggests that resilience may be a challenging lens to capture framing because of the multi-faceted nature of the construct, incremental manner in which it has evolved and issues of mutual exclusivity. The pervasiveness of the government regulatory approach to address the water dilemmas studied requires concerted investigation. Why is the transition underway in water scholarship and policy regarding the inclusion of non-state actors in contemporary water governance not reflected in documents associated with water dilemmas? Is the emphasis on government regulation manifest in documents reflective of how water dilemmas are being addressed in practice? Another question called up by this study is how individuals (stakeholders) in water dilemmas perceive ecosystems and prefer governance to be approached. Comparisons could then be made among those conceptually advanced by scholars, manifest in documents and held by individuals. These future avenues of research are essential next steps to sort out inconsistencies in addressing water dilemmas among theory, policy and practice.

Notes on contributors

Ryan Plummer holds a PhD in Rural Studies (University of Guelph). He is a professor in the Environmental Sustainability Research Centre at Brock University where he held a Chancellor’s Chair for Research Excellence from 2008–2011. He is also a senior research Fellow at the Stockholm Resilience Centre (Sweden) and a faculty investigator with Water Policy and Governance Group (Canada). His multi-faceted programme of research broadly concerns resilience and governance of social–ecological systems. Water resources are the context in which his research mainly occurs.

Julia Baird holds a PhD in Environment and Sustainability and a MSc in Soil Science (University of Saskatchewan). At present, she is a research associate at Brock University. Her current research focuses on collaborative and adaptive environmental governance within the contexts of water resources and climate change. Within this area, she has a strong interest in resilience, learning and social networks.

Ryan Bullock holds a PhD in Geography and Environmental Management (Waterloo). He is an assistant professor with The University of Winnipeg’s Department of Environmental Studies and Sciences and he is the director of the Centre for Forest Interdisciplinary Research (C-FIR). His research addresses the human dimensions of environmental resource management, northern governance and development, and community-based research approaches.

Diane Dupont holds a PhD in Economics (University of British Columbia). She is a professor in the Economics Department and associate dean, Graduate Studies and Research, Faculty of Social Sciences at Brock University. Her current research programme concentrates upon examining ways to encourage more efficient and sustainable use of water resources both on the supply and demand side. On the supply side, she is looking at factors that help to identify which water utilities operate most efficiently and sustainably. On the demand side, she has undertaken a number of non-market valuation studies to determine the value of good quality water as it relates to individuals’ perceptions of the health effects of tap water.

Steven Renzetti holds a PhD in Economics (University of British Columbia). He is a professor in the Department of Economics and associate vice president, Research for Humanities and Social Sciences at Brock University. His current research interest is in the economics of water resources. He is particularly interested in understanding the factors influence households’ and businesses’ water use and employing that information to design incentives (such as water prices) that will promote efficient and sustainable water use.

Disclosure statement

No potential conflict of interest was reported by the authors.

Funding

Funding for this work, as part of the CADWAGO project, was provided by Riksbankens Jubileumsfond, the Volkswagen Stiftung and Compagnia di San Paolo through the Europe and Global Challenges programme.

Acknowledgements

We wish to thank Samantha Morris, Katrina Krievins and Julia Lawler for their research assistance. Our appreciation is also extended to the case study leaders in the CADWAGO project for their generous assistance in identifying and providing key documents.

References

  • Adger, N. W., Dessai, S., Goulden, M., Hulme, M., Lorenzoni, I., Nelson, L., … Wreford, A. (2009). Are there social limits to adaptation to climate change? Climatic Change, 93, 335–354. doi:10.1007/s10584-008-9520-z
  • Armitage, D., de Loë, R., & Plummer, R. (2012). Environmental governance and its implications for conservation practice. Conservation Letters, 5, 245–255. doi:10.1111/j.1755-263X.2012.00238.x
  • Balint, P. J., Stewart, R. E., Desai, A., & Walters, L. W. (2011). Wicked environmental problems. Washington, DC: Island Press.10.5822/978-1-61091-047-7
  • Barthel, S., Parker, J., & Ernstson, H. (2013). Food and green space in cities: A resilience lens on gardens and urban environmental movements. Urban Studies, 52(7), 1–18. doi:10.1177/0042098012472744
  • Batie, S. S. (2008). Wicked problems and applied economics. American Journal of Agricultural Economics, 90, 1176–1191. doi:10.1111/j.1467-8276.2008.01202.x
  • Berke, P., & Conroy, M. M. (2000). Are we planning for sustainable development?. Journal of the American Planning Association, 66, 21–33. doi:10.1080/01944360008976081
  • Boyd, E., & Folke, C. (2012). Adapting institutions, adaptive governance and complexity: An introduction. In E. Boyd & C. Folke (Eds.), Adapting institutions: Governance, complexity and social-ecological resilience (pp. 1–8). Cambridge: Cambridge University Press. doi:10.1017/CBO9781139017237.003
  • Brand, F. S., & Jax, K. (2007). Focusing the meaning(s) of resilience: Resilience as a descriptive concept and a boundary object. Ecology and Society, 12, 23. Retrieved from http://www.ecologyandsociety.org/vol12/iss1/art23/
  • Brown, K. (2014). Global environmental change I: A social turn for resilience? Progress in Human Geography, 38, 107–117. doi:10.1177/0309132513498837
  • Brown, V. A., Harris, J. A., & Russel, J. (2010). Tackling wicked problems: Through the transdisciplinary imagination. New York, NY: Earthscan.
  • Bryant, R., & Wilson, G. (1998). Rethinking environmental management. Progress in Human Geography, 22, 321–343. doi:10.1191/030913298672031592
  • Bullock, R., Armitage, D., & Mitchell, B. (2012). Shadow networks, social learning, and collaborating through crisis: Building resilient forest-based communities in northern Ontario, Canada. In B. Goldstein (Ed.), Collaborative resilience: Moving through crisis to opportunity (pp. 309–337). Boston, MA: The MIT Press.
  • Creed, W., Langstraat, J., & Scully, M. (2002). A picture of the frame: Frame analysis as technique and as politics. Organizational Research Methods, 5, 34–55. doi:10.1177/1094428102051004
  • Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches. Thousand Oaks, CA: Sage.
  • Cumming, G. S., Barnes, G., Perz, S., Schmink, M., Sieving, K. E., Southworth, J., … Van Holt, T. (2005). An exploratory framework for the empirical measurement of resilience. Ecosystems, 8, 975–987. doi:10.1007/s10021-005-0129-z
  • de Loë, R., & Kreutzwiser, R. (2007). Challenging the status quo: The evolution of water governance in Canada. In K. Bakker (Ed.), Eau Canada: The future of Canada’s water (pp. 85–103). Vancouver: UBC Press.
  • Department for Environment Food and Rural Affairs (DEFRA). (2013). Catchment based approach: Improving the quality of our water environment – A policy framework to encourage the wider adoption of an integrated catchment based approach to improving the quality of our water environment. London: Author. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/204231/pb13934-water-environment-catchment-based-approach.pdf
  • Dryzek, J. (2005). The politics of the earth: Environmental discourses (3rd ed.). New York, NY: Oxford University Press.
  • Duit, A., & Galaz, V. (2008). Governance and complexityemerging issues for governance theory. Governance, 21, 311–335. doi:10.1111/j.1468-0491.2008.00402.x
  • Duit, A., Galaz, V., Eckerberg, K., & Ebbesson, J. (2010). Governance, complexity, and resilience. Global Environmental Change, 20, 363–368. doi:10.1016/j.gloenvcha.2009.01.004
  • Dunlap, R. E., Van Liere, K. D., Mertig, A. G., & Jones, R. E. (2000). New trends in measuring environmental attitudes: Measuring endorsement of the new ecological paradigm: A revised NEP scale. Journal of Social Issues, 56, 425–442. doi:10.1111/0022-4537.00176.
  • Durant, R. F., Chun, Y.-P., Kim, B., & Lee, S. (2004). Toward a new governance paradigm for environmental and natural resources management in the 21st century? Administration and Society, 35, 643–682. doi:10.1177/0095399703256968
  • FitzGibbon, J., & Mensah, K. O. (2012). Climate change as a wicked problem: An evaluation of the institutional context for rural water management in Ghana. Sage Open, 1–14. doi:10.1177/2158244012448487
  • Folke, C. (2006). Resilience: The emergence of a perspective for social–ecological systems analyses. Global Environmental Change, 16, 253–267. doi:10.1016/j.gloenvcha.2006.04.002.
  • Folke, C., Carpenter, S., Walker, B., Scheffer, M., Elmqvist, T., Gunderson, L., & Holling, C. S. (2004). Regime shifts, resilience, and biodiversity in ecosystem management. Annual Review of Ecology, Evolution, and Systematics, 35, 557–581. doi:10.1146/annurev.ecolsys.35.021103.105711
  • Folke, C., Hahn, T., Olsson, P., & Norberg, J. (2005). Adaptive governance of social-ecological systems. Annual Review of Environment and Resources, 30, 441–473. doi:10.1146/annurev.energy.30.050504.144511
  • Forsyth, T. (2003). Critical political ecology: The politics of environmental science. New York, NY: Routledge.
  • Galaz, V. (2007). Water governance, resilience and global environmental change – A reassessment of integrated water resources management (IWRM). Water Science & Technology, 56(4), 1–9. doi:10.2166/wst.2007.530
  • Glasbergen, P. (1998). The question of environmental governance. In P. Glasbergen (Ed.), Co-operative environmental governance: Public-private agreements as a policy strategy (pp. 1–18). Dordrecht: Kluwer Academic. doi:10.1007/978-94-011-5143-6_1
  • Goldstein, B. E. (2011). Collaborative resilience: Moving through crisis to opportunity. Boston, MA: MIT Press.
  • Gunderson, L. H. (2000). Ecological resilience – In theory and application. Annual Review of Ecology and Systematics, 31, 425–439. doi:10.1146/annurev.ecolsys.31.1.425
  • Gupta, J., Termeer, C., Klostermann, J., Meijerink, S., van de Brink, M., Jong, P., … Bergsma, E. (2010). The adaptive capacity wheel: A method to assess the inherent characteristics of institutions to enable the adaptive capacity of society. Environmental Science and Policy, 13, 459–471. doi:10.1016/j.envsci.2010.05.006
  • Head, B. W. (2010). Water policy: Evidence, learning and the governance of uncertainty. Policy and Society, 29, 171–180. doi:10.1016/j.polsoc.2010.03.007
  • Hearnshaw, E. J., Tompkins, J. M., & Cullen, R. (2011, February). Addressing the wicked problem of water resource management: An ecosystem services approach. Paper presented at Australian Agricultural and Resource Economics Society 2011 Conference (55th), Melbourne, Australia. Retrieved from http://ageconsearch.umn.edu/handle/100556
  • Holling, C. S., & Gunderson, L. H. (2002). Resilience and adaptive cycles. In L. H. Gunderson & C. S. Holling (Eds.), Panarchy: Understanding transformations in human and natural systems (pp. 25–62). Washington, DC: Island Press.
  • Holling, C. S., Gunderson, L. H., & Ludwig, D. (2002). In quest of a theory of adaptive change. In L. H. Gunderson & C. S. Holling (Eds.), Panarchy: Understanding transformations in human and natural systems (pp. 3–24). Washington, DC: Island Press.
  • Holling, C. S., & Meffe, G. K. (1996). Command and control and the pathology of natural resource management. Conservation Biology, 10, 328–337. doi:10.1046/j.1523-1739.1996.10020328.x
  • Hornborg, A. (2009). Zero-sum world: Challenges in conceptualizing environmental load displacement and ecologically unequal exchange in the world-system. International Journal of Comparative Sociology, 50, 237–262. doi:10.1177/0020715209105141
  • Hornborg, A. (2013). Revelations of resilience: From the ideological disarmament of disaster to the revolutionary implications of (p)anarchy. Resilience, 1, 116–129. doi:10.1080/21693293.2013.797661
  • Ison, R., Röling, N., & Watson, D. (2007). Challenges to science and society in the sustainable management and use of water: Investigating the role of social learning. Environmental Science and Policy, 10, 499–511. doi:10.1016/j.envsci.2007.02.008
  • Kettl, D. F. (2002). Environmental governance: A report on the next generation of environmental policy. Harrisonburg: Brookings Institution Press.
  • Kooiman, J. (Ed.). (1993). Modern governance: New government–society interactions. Thousand Oaks, CA: Sage.
  • Krippendorff, K. H. (2013). Content analysis: An introduction to its methodology. Thousand Oaks, CA: Sage.
  • Kuzel, A. J. (1999). Sampling in qualitative inquiry. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research (pp. 33–45). Thousand Oaks, CA: Sage.
  • Lazarus, R. (2009). Super wicked problems and climate change: Restraining the present to liberate the future. Cornell Law Review, 94, 1153–1234. Retrieved from http://cornelllawreview.org/files/2013/02/LazarusSuperWickedProblems.pdf
  • Leech, M. (Ed.). (2008). Re-framing resilience: A symposium report (STEPS Working Paper 14). Brighton: STEPS Centre. Retrieved from http://opendocs.ids.ac.uk/opendocs/bitstream/handle/123456789/2315/Re-framing%20Resilience.pdf?sequence=1
  • Leiserowitz, A. (2007). International public opinion, perception, and understanding of global climate change. New York, NY: UNDP. Retrieved from http://environment.yale.edu/climate-communication/article/international-public-opinion-perception-and-understanding-of-global-cl
  • Lemos, M. C., & Agrawal, A. (2006). Environmental governance. Annual Review of Environment and Resources, 31, 297–325. doi:10.1146/annurev.energy.31.042605.135621
  • Ludwig, D. (2001). The era of management is over. Ecosystems, 4, 758–764. doi:10.1007/s10021-001-0044-x
  • Lundholm, C., & Plummer, R. (2010). Resilience and learning: A conspectus for environmental education. Environmental Education Research, 16, 475–491. doi:10.1080/13504622.2010.505421
  • Martin-Breen, P., & Anderies, J. M. (2011). Resilience: A literature review. New York, NY: The Rockefeller Foundation.
  • Masten, A. S. (2007). Resilience in developing systems: Progress and promise as the fourth wave rises. Development and Psychopathology, 19(3), 921–930. doi:10.1017/S0954579407000442
  • Melo Zurita, M. L., Smith, T., Thomsen, D., Lyth, A., Baum, S., & Preston, B. (2013). CADWAGO work package two: First phase case study report (Climate Adaptation and Water Governance (CADWAGO) Project Report). Sippy Downs: University of the Sunshine Coast.
  • Nelson, D. R., Adger, W. N., & Brown, K. (2007). Adaptation to environmental change: Contributions of a resilience framework. Annual Review of Environment and Resources, 32, 395–419. doi:10.1146/annurev.energy.32.051807.090348
  • Olsson, P., Folke, C., & Berkes, F. (2004). Adaptive comanagement for building resilience in social-ecological systems. Environmental Management, 34, 75–90. doi:10.1007/s00267-003-0101-7
  • Pahl-Wostl, C. (2007). Transition towards adaptive management of water facing climate and global change. Water Resources Management, 21, 49–62. doi:10.1007/978-1-4020-5591-1_4
  • Pahl-Wostl, C. (2009). A conceptual framework for analysing adaptive capacity and multi-level learning processes in resource governance regimes. Global Environmental Change, 19, 354–365. doi:10.1016/j.gloenvcha.2009.06.001
  • Pahl-Wostl, C., Arthington, A., Bogardi, J., Bunn, S. E., Hoff, H., Lebel, L., … Tsegai, D. (2013). Environmental flows and water governance: Managing sustainable water uses. Current Opinion in Environmental Sustainability, 5, 341–351. doi:10.1016/j.cosust.2013.06.009
  • Plummer, R. (2010). Social-ecological resilience and environmental education: Synopsis, application, implications. Environmental Education Research, 16, 493–509. doi:10.1080/13504622.2010.505423
  • Plummer, R., Baird, J., Dupont, D., & Renzetti, S. (2012). Work package one: Ecological components of ecosystems (Climate Adaptation and Water Governance (CADWAGO) Project Meeting Presentation). Sippy Downs: University of the Sunshine Coast.
  • Plummer, R., de Grosbois, D., Velaniskis, J., & de Loë, R. (2011). Probing the integration of land use and watershed planning in a shifting governance regime. Water Resources Research, 47, W09502. doi:10.1029/2010WR010213
  • Powell, N., & Jiggins, J. (2003). Learning from participatory land management. In H. A. Becker & F. Vanclay (Eds.), The international handbook of social impact assessment: Conceptual and methodological advances (pp. 42–55). Cheltenham: Edward Elgar Press.
  • Powell, N. S., Larsen, R. K., & van Bommel, S. (2014). Meeting the ‘Anthropocene’ in the context of intractability and complexity: Infusing resilience narratives with intersubjectivity. Resilience, 2, 135–150. doi:10.1080/21693293.2014.948324.
  • Reed, P. M., & Kasprzyk, J. R. (2009). Water resources management: The myth, the wicked, and the future. Journal of Water Resources Planning and Management, 135, 411–413. doi:10.1061/(ASCE)WR.1943-5452.0000047
  • Rittel, H. W. J., & Webber, M. M. (1973). Dilemmas in a general theory of planning. Policy Sciences, 4(2), 155–169. doi:10.1007/BF01405730
  • Rogers, P., & Hall, A. W. (2003). Effective water governance (TEC Background Papers 7). Stockholm: Global Water Partnership. Retrieved from http://www.gwp.org/Global/GWP-CACENA_Files/en/pdf/tec04.pdf
  • Scholz, J. T., & Stifel, B. (2005). Adaptive governance and water conflict: New institutions for collaborative planning. Washington, DC: Resources for the Future Press.
  • Scott, M. (2013). Resilience: A conceptual lens for rural studies? Geography Compass, 7, 597–610. doi:10.1111/gec3.12066
  • Shakir, M. (2002). The selection of case studies: Strategies and their applications to IS implementation cases studies. Research Letters in the Information and Mathematical Sciences, 3, 191–198. Retrieved from http://mro.massey.ac.nz/handle/10179/4332
  • Stake, R. (1995). The art of case research. Newbury Park, CA: Sage.
  • Stenekes, N., Colebatch, H. K., Waite, T. D., & Ashbolt, N. J. (2006). Risk and governance in water recycling: Public acceptance revisited. Science, Technology and Human Values, 31, 107–134. doi:10.1177/0162243905283636
  • Stern, P. C. (1993). A second environmental science: Human–environment interactions. Science, 260, 1897–1899. doi:10.1126/science.260.5116.1897
  • Stern, P. C., Dietz, T., & Guagnano, G. A. (1995). The new ecological paradigm in social-psychological context. Environment and Behavior, 27, 723–743. doi:10.1177/0013916595276001
  • Strunz, S. (2012). Is conceptual vagueness an asset? Arguments from philosophy of science applied to the concept of resilience. Ecological Economics, 76, 112–118. doi:10.1016/j.ecolecon.2012.02.012
  • Termeer, C., Dewulf, A., & Breeman, G. (2013). Governance of wicked climate adaptation problems. In J. Knieling & W. Leal Filho (Eds.), Climate change governance (pp. 27–39). New York, NY: Springer.10.1007/978-3-642-29831-8
  • Tropp, H. (2007). Water governance: Trends and needs for new capacity development. Water Policy, 9, 19–30. doi:10.2166/wp.2007.137.
  • Waddock, S. (2013). The wicked problems of global sustainability need wicked (good) leaders and wicked (good) collaborative solutions. Journal of Management for Global Sustainability, 1, 91–111. doi:10.13185/JM2013.01106.
  • Walker, B. H., Holling, C. S., Carpenter, S. R., & Kinzig, A. (2004). Resilience, adaptability and transformability in social–ecological systems. Ecology and Society, 9, 5. Retrieved from http://www.ecologyandsociety.org/vol9/iss2/art5/
  • Wolsink, M. (2006). River basin approach and integrated water management: Governance pitfalls for the Dutch Space-Water-Adjustment Management Principle. Geoforum, 37, 473–487. doi:10.1016/j.geoforum.2005.07.001
  • World Water Assessment Programme. (2003). Water for people water for life (The United Nations World Water Development Report). UNESCO. Retrieved from http://unesdoc.unesco.org/images/0012/001295/129556e.pdf
  • Yin, R. K. (2003). Case study research (Vol. 5). Thousand Oaks, CA: Sage.
  • Zolli, A. (2012, November 2). Learning to bounce back. The New York Times. Retrieved from http://www.nytimes.com/2012/11/03/opinion/forget-sustainability-its-about-resilience.html?pagewanted=all&_r=2

Appendix 1

Table A1. Documents used for content analysis of water dilemmas.