563
Views
0
CrossRef citations to date
0
Altmetric
Research Article

The role of science in resilience planning for military-civilian domains in the U.S. and NATO

ORCID Icon, ORCID Icon, ORCID Icon, & ORCID Icon
Received 15 Mar 2024, Accepted 04 Jun 2024, Published online: 21 Jun 2024

ABSTRACT

In recent years, the NATO member nations have committed to a coordinated approach to strengthening resilience among the Allies, including the development of National Resilience Plans (NRPs). The Allies outlined the extent to which the robustness of their respective military capacities requires the designed resilience of systems that bridge civilian and military domains. This article outlines the role that resilience plays in supporting tactical and strategic measures of national security and defense within military and civilian domains. This exploration provides an outline of how resilience is currently applied in practice by the U.S. Department of Defense (DOD) and NATO. Building on this diversity of applications, various categorical forms of resilience drawn from the empirical science of resilience are positioned within NATO’s emerging frame for ‘layered’ resilience. This article reinforces the scientific debate that an optimal orientation to resilience leaves open the door for the transformative adaptation of function and identity when the single-equilibrium processes of resilience reach their limits. This article concludes with a normative perspective on how military and civilian resilience planning could support the development of NRPs that would amplify the Allies’ collective capacity to face shared security threats.

Introduction

As the geopolitical landscape grows increasingly complex and interconnected across state boundaries, intense domestic disruptions from acute shocks and chronic stresses in any given state are capable of leading to global disruptions across a variety of meta-scales (Vina and Liu Citation2023). At the 2016 Warsaw Summit of the North Atlantic Treaty Organization (NATO), the member nations (or “Allies”) committed to adopting a more integrated and better-coordinated approach to strengthening resilience among NATO members (NATO Citation2016a). During that summit, the Allies released a Commitment to Enhance Resilience that defined baseline civil preparedness principles to ensure NATO military forces can always be adequately supported with civilian resources (Id.). At the Vilnius Summit in 2023, the Allies agreed to each develop a National Resilience Plan (NRP) to meet a new range of civil preparedness requirements (NATO Citation2023a). Here, the Allies outlined the extent to which the robustness of their respective military capacities requires the designed resilience of systems that bridge civilian and military domains.

This article outlines the complex relationship between military and civilian domains and the role that resilience plays and has played in supporting tactical and strategic measures of national security and defense. This exploration continues with an outline of how resilience is currently defined and applied in practice by the U.S. Department of Defense (DOD) and NATO. Building on this diversity of applications and perspectives, various categorical forms of resilience drawn from the empirical science of resilience are positioned within NATO Allied Command for Transformation’s (ACT) emerging frame for “layered” resilience that seeks to cut across military and civilian domains. This article argues that a more comprehensive utilization of resilience science requires greater epistemic precision of the various forms of resilience. These various forms of resilience offer a range of analytical models and measurements that may support a more robust quantification of performance within sectors and across military-civilian domains (Davidson et al. Citation2016; Wied, Oehmen, and Welo Citation2020).

This type of precision is important for not only guiding strategic design, but also stress testing and validating investments in resilience that address a wide range of shocks and stresses that may impair the defense capabilities of the Allies – associated with everything from climate change to artificial intelligence (AI) in cyberwarfare (Milburn Citation2023; Thornton and Miron Citation2020). With its often-invisible hand and ambiguous political goals, the meta-landscape of hybrid warfare extends from the psychological conditioning of labor and military force members to the systems of systems that drive the delivery of critical infrastructure services (Mumford and Carlucci Citation2023). Given the vast and deep uncertainty resident in global change and hybrid landscapes, this article reinforces the scientific debate that an optimal orientation to resilience leaves open the door for the transformative adaptation of function and identity when the single-equilibrium processes of resilience reach their limits (Folke et al. Citation2010; Yu et al. Citation2020). Finally, this article concludes with a normative perspective on how military and civilian resilience planning could be initiated in order to achieve a coordinated development of NRPs that would amplify allies’ collective capacity to face shared security threats.

National security, cross-domain deterrence and resilience

The primary purpose of the military in NATO nations is to protect and ensure the continuity and integrity of civilian institutions, assets, and infrastructure, as well as the welfare of the general population. Such civilian resources reciprocally provide support for and enable the operations and readiness of the military. The intensive convergent integration and interdependence of civilian and military domains raises several key issues concerning the state of democracy, the constitutional role of the civilian governance of the military (Brooks Citation2019) and the role of the state in an open society (Hartmann Citation2017; Popper Citation2020). Military and civilian domains have long been entwined with each other, manifesting in different ways – whether that is over the course of western social history (Karsten Citation2013) or contemporary economic discourses on the role of public military spending in the era of fair trade regulation and globalization (Meunier Citation2019).

The magnitude of this relationship has intensified as the world’s infrastructure and technology have grown in complexity, particularly as it relates to information technology (Lindsay Citation2020) and AI (Ams Citation2023). This technological integration has accelerated the proliferation of hybrid warfare (also referred to in literature as “hybrid threats”), which is a rapidly emerging vector by which interstate hostility is conducted (Linkov et al. Citation2019). Hybrid threats embody a complex blend of conventional and unconventional tactics, orchestrated by state or non-state actors to exploit vulnerabilities across a wide spectrum of domains, including military, economic, social, and cyber (Hartmann Citation2017). These multifaceted threats are characterized by their covert nature, strategic ambiguity, and the deliberate blurring of lines between peace and conflict, which aim to undermine societal cohesion, erode trust in institutions and destabilize targeted nations without triggering a conventional military response. For NATO, addressing hybrid threats is paramount, as they directly challenge the alliance’s mission of collective defense and security through non-conventional means, particularly where adversaries can leverage vulnerabilities in NATO member critical infrastructure while maintaining plausible deniability (Jacuch Citation2020). The sophisticated nature of these threats benefits from a resilience-oriented approach, emphasizing the need for agile, adaptive strategies that can respond to the dynamic and often indistinct contours of hybrid warfare.

Military-civilian cyberspace and cyber-physical integration has created a new landscape for both low-scale conflict and the potential for mass destruction within civilian systems and economies that serve as a multi-lateral deterrent to classical forms of warfare (Gartzke and Lindsay Citation2019). Indeed, cross-domain deterrence (CDD) has arisen as an important dimension of strategic motivation and capability. “When an opponent has no incentive to initiate or escalate conflict at any given intervention or escalation threshold in any given domain of warfare – both vertically and horizontally within that domain and laterally into one or more additional domains of warfare – successful cross-domain deterrence can be said to be in effect” (Mallory Citation2018, 1).

There are two dimensions to CDD relevant in the context of resilience. First, low-scale indirect cyber warfare presents an alternative to classical forms of military aggression wherein the geopolitical stakes may be lower for forms of aggression that do not present visceral forms of destruction and loss of human life. They may simply be deniable and hence avoid clear punitive consequences. For instance, the People’s Liberation Army of China deems “financial warfare” as something that can be just as destructive through “man-made stock market crashes, attacks on financial instruments, and cyber-attacks on the financial systems” (Reinike Citation2020, 8). In the context of the global marketplace, attacks associated with financial warfare may be plausibly deniable, as any number of unregulated market-based and/or criminal actors may be at work. This level of anonymity and plausible deniability makes hybrid warfare attractive, as the consequences are lower. It is difficult for the target nation to attribute the attack to a specific actor or nation. To this end, some scholars have sought to frame proactive “economic” resilience measures in the financial system that seek to detect and manage responses to malfeasance in everything from currencies to portfolios (Constantinescu Citation2023; Smalenberger Citation2015).

Second, by extension, one could argue that the greater the robustness in resilience within civilian infrastructure and populations, the less valuable the target. In such cases, the aggressor is limited in their offensive capacity to classical forms of military assault within a military domain which may be geopolitically and technologically limited. In this sense, resilience itself may be a form of CDD. As Sweijs, et al. note, “[r]esilience is directed at dissuading hostile measures by presenting the adversary with the futility of his attacks through recovery” (Sweijs et al. Citation2021, 16–17). In this light, Hartmann notes that resilience is “a constant process of adaptation [that is] potentially able to undermine the effectiveness of hybrid warfare, and, thus, deter opponents” (Hartmann Citation2017, 8). Some commentators among the Allies have viewed resilience as key element of deterrence (Roepke and Thankey Citation2019). They have argued that countries with greater measures of resilience, usually characterized by comprehensive preparedness planning involving government, public, and private sectors, possess fewer vulnerabilities susceptible to exploitation or targeting by adversaries (Id.). Thus, resilience becomes a critical component of CDD through denial, thereby aiming to dissuade adversaries from attacking by demonstrating that such actions would fail to accomplish their objectives while at the same time risking the consequences of the identification of proxy actors and methods.

Resilience performance through military and civilian integration may manifest, not just as a form of CDD, but also as a very practical prerequisite for military mobilization and tactical execution. NATO’s use of the concept of “enablement” refers to the overarching capacity to mobilize extensive military forces and allocate resources across the NATO area of responsibility seamlessly, encompassing periods of peace, crisis, and conflict (Lindley-French Citation2021). This capability is deemed essential for establishing a credible deterrence posture. In times of direct military conflict, militaries utilize much of the same infrastructure that civilians rely on. The relationship becomes more complicated when one considers the prospects of transnational defense and mobilization wherein NATO forces operate across multiple physical and cyber infrastructural systems across state-borders (Frizzelle, Garey, and Kulalic Citation2022). Hence the challenge is not just cross-jurisdictional interoperability standards, but also the management of vulnerabilities such as foreign direct investment and control of critical infrastructure (Id.).

Military and civilian integration exists not just between the military and civilian infrastructure, but such integration also extends to the general civilian population. Some commentators have noted that “whole-of-government and “whole-of-society” resilience strategies that have framed recent integration efforts discussed herein are “top-down” and not sufficiently invested in bottom-up civilian institutional capacities for threat-perception, detection and mitigation (Manwaring and Holloway Citation2023; Kott et al. Citation2024). As such, civilian institutions and assets (e.g. infrastructure) should be distinguished from the broad range of capacities at a population-level. For instance, some have argued that Ukraine did not fall during the Russian invasion due in large part to civilian resilience (Goodwin et al. Citation2023). Kudlenko attributes Ukraine’s resilience to numerous factors including a history of decentralization and self-organization that allowed for a continuity of institutions and systems when national and federal systems were impaired during physical and cyber assaults (Kudlenko Citation2023).

To this end, cultural, historical and legal qualities of the general population are understood to be an important element of military and civilian integration and resilience. In recent years, NATO has focused on citizen-level resilience that is centered on societal processes (Christie and Berzina Citation2022; NATO Citation2022a). The COVID-19 pandemic and potential future crises that deeply impair the mobilization of the general population emphasize the significance of civil societies in national preparedness and responses. This includes roles in facilitating effective public communications and ensuring access to transparent, timely, and accurate information to combat disinformation (Reding and Wells Citation2022).

Defining resilience from DOD to NATO

The United Nations (UN) has 129 English-language entries for resilience in its official terminology database (UN Citation2023). The U.S. government has at least eight (8) different formal definitions of resilience (DOD Citation2019). Some of these definitions across the U.S. government are defined in congressional legislation that relate to particular policy goals. For instance, the U.S. Department of State (DOS) utilizes a statutorily definition that defines resilience, in the context of foreign food aid, as “the ability of people, households, communities, countries, and agriculture and food systems to mitigate, adapt to, and recover from shocks and stresses to food security, including global food catastrophes, in a manner that reduces chronic vulnerability and facilitates inclusive growth”(22 U.S.C. § 9303(9)).

On the other hand, the U.S. Department of Defense (DOD) does not have a single overarching definition of resilience despite prior proposals for developing such a definition (Herrera Citation2021). Nonetheless, within DOD, resilience planning appears in three core focus areas, including force readiness, cyber security, and military installations. Often these focus areas are shaped by congressional legislation and appropriations. For instance, “military installation resilience” is defined as:

[t]he capability of a military installation to avoid, prepare for, minimize the effect of, adapt to, and recover from extreme weather events, or from anticipated or unanticipated changes in environmental conditions, that do, or have the potential to, adversely affect the military installation or essential transportation, logistical, or other necessary resources outside of the military installation that are necessary in order to maintain, improve, or rapidly reestablish installation mission assurance and mission-essential functions (10 U.S.C § 101(e) (8)).

Engineering resilience concepts for military installations have also been extended to the Production-based Resilience Program (PRP) and the Industrial Base Resilience (IBR) policies for weapons, advanced technology and other critical supply chains within the defense industrial base (DOD Citation2024; Nicastro Citation2023). On a tactical level utilizing the aforementioned statutory authority for military installation resilience, the DOD created the Readiness and Environmental Protection Integration Program (REPI) as a means to understand how engineering resilience and ecological resilience efforts may shape force readiness capacities and capabilities through an integration of relevant military and non-military public, private and civic stakeholders (REPI Citation2023). In the closely related context of climate and global change, the DOD defines resilience as “[t]he ability to anticipate, prepare for, and adapt to changing conditions and withstand, respond to, and recover rapidly from disruptions” (DOD Citation2018). Resilience is also thematically applied at a strategic level, as highlighted by the creation of the office of the Deputy Assistant Secretary for Defense for Arctic and Global Resilience. This office is charged with ensuring the DOD’s competitive advantage as it relates to sociotechnical and political changes relating to the energy transition, among other aspects of national security relating to environmental change (DOD Citation2023b).

Different forms of resilience are broadly utilized in everything from climate change planning to force readiness. Across the services of the U.S. military, there is an application of the concepts of resilience originating from the fields of psychology and psychiatry to support everything from mental and physical health to force readiness of personnel (McInerney, Waldrep, and Benight Citation2022). For instance, the U.S. Army, within the Office of the Deputy Chief of Staff, has a Directorate of Prevention, Resilience and Readiness that defines resilience as “the ability to persevere, adapt, [and] grow in dynamic or stressful environments” (U.S. Army Citation2023). In this case, the stress is on the individual. More broadly, the Office of Force Resiliency (OFR) within the Undersecretary of Defense for Personnel and Readiness focuses on a wider variety of issues including, “diversity management and equal opportunity, personnel risk reduction, suicide prevention, [and] sexual assault prevention and response” (OFR Citation2023).

Beyond force readiness and climate change applications driving resilience planning at the DOD, cyber resilience is increasingly a focus of policy and planning at DOD (DOD Citation2023a; Linkov and Kott Citation2019). Early work in cyber resilience defined resilience as an “ability to provide acceptable operations despite disruption: natural or man-made, inadvertent or deliberate” (DOD Citation2013). Yet, performance and operations standards for resilience at the time, a decade ago, did not exist, with the Defense Science Board warning that “[p]oorly defined and improperly used metrics may prove as harmful as no metrics at all (DOD Citation2013, 15). MITRE would later go on to develop resilience metrics that focused on performance before and after a detected or detectable event with a focus on the “time between disruption, detection, response and recovery” (Bodeau et al. Citation2018).

DOD would later build on the work of the National Institute of Standards and Technology (NIST) at the U.S. Department of Commerce who has led work on cyber security across the U.S. government. NIST has two different definitions for “cyber resiliency,” including “[t]he ability to anticipate, withstand, recover from, and adapt to adverse conditions, stresses, attacks, or compromises on systems that use or are enabled by cyber resources” (NIST Citation2020). The second definition builds on the first definition by noting that “[c]yber resiliency is intended to enable mission or business objectives that depend on cyber resources to be achieved in a contested cyber environment” (NIST Citation2021). Cyber resilience activities for both internal networks and external contractors has been extended in defensive posture at units such as the Department of Defense Cyber Crime Center and more broadly at DOD’s Under Secretary of Defense for Research and Engineering. At the current stage of development, cyber security, with its risk management orientation, and “operational resilience” were programmatically segregated, with operational resilience being defined as “the ability of systems to resist, absorb, and recover from or adapt to an adverse occurrence during operation that may cause harm, destruction, or loss of ability to perform mission-related functions” (DoDI 8500.001(DOD Citation2019)). In this context, cyber resilience has been largely relegated to a principled goal or objective and less of a quantification of designed processes. This finding is reinforced by the National Academies of Sciences, Engineering and Medicine’s (NASEM) publications published by the Forum on Cyber Resilience, which do not define resilience and offer little to no direct methodological advancement in the forum’s publications (NASEM Citation2023).

Across many aspects of the U.S. government, resilience is largely relegated to a qualifiable objective, yet it is viewed by DOD as a critical element of its defense strategy. The 2022 National Defense Strategy (NDS) defines resilience as “the ability to withstand, fight through, and recover quickly from disruption” (DOD Citation2022, 8). The NDS explicitly reinforces the proposition that resilience planning is an effective mechanism for CDD by noting in a section entitled “Deterrence by Resilience” that “the Department will reduce adversary incentives for early attack by fielding diverse, resilient, and redundant [assets]. We will bolster our ability to fight through disruption by improving defensive capabilities and increasing options for reconstitution. We will assist Allies and partners in doing the same” (DOD Citation2024, 8). Indeed, building on domestic interagency resilience practices, the Defense Security Cooperation Agency within DOD has an active program in training partner nations (DSCA Citation2021). Indeed, the NDS specifically cites the intent to support NATO Allies through “promoting resilience, including against hybrid and cyber actions” (DOD Citation2022, 15).

While the U.S. government and DOD have approached resilience from a variety of bottom-up thematic areas focused on strategic objectives, NATO has approached resilience planning from a largely top-down central planning orientation that starts with a meta-system perspective. NATO formally defines resilience in two contexts. In the context of information technology, which is critical for hybrid warfare applications, resilience is defined as “[t]he ability of a functional unit to continue to perform a required function in the presence of faults or errors” (NATO Citation2005). In the general terminology of NATO, resilience is officially defined as “[t]he ability of an entity to continue to perform specified functions during and after an attack or an incident” (NATO Citation2022b). Here, resilience is oriented towards episodes, shocks and known or potentially detectable phenomena.

Following the 2016 Warsaw summit, NATO shifted its focus further towards a broader orientation of resilience by positioning resilience within the related-concept of non-military preparedness (NATO Citation2016a). As a designed capability, resilience is rooted in Article 3 of the North Atlantic Treaty, which states, “[i]n order to more effectively achieve the objectives of this Treaty, the Parties, separately and jointly, by means of continuous and effective self-help and mutual aid, will maintain and develop their individual and collective capacity to resist armed attack” (NATO Citation1949). For NATO, civil preparedness has been the focus of this historically implied and current requirement for resilience planning, also reiterated in Vilnius in 2023 as “resilience through civil preparedness” (NATO Citation2016b, Citation2023a).

However, in recent decades, there has been a corresponding decline in investments in civil preparedness (H. Larsen Citation2022) and an increased reliance on private sector actors to provide critical services and infrastructure (Newlove-Eriksson, Giacomello, and Eriksson Citation2018; Radvanovsky and McDougall Citation2018). In the Cold War era, essential infrastructure like railways, ports, airfields, grids, and airspace were predominantly under state control in Europe, which facilitated their transfer to NATO authority in times of crisis or conflict. By contrast, approximately “90% of NATO’s supplies and logistics are moved [today] by private companies and 75% of the host nation support for NATO forces forward deployed on the territory of the eastern Allies comes from private sector contracts” (Shea Citation2016). Against this institutional backdrop, there have been emerging threats such as hybrid warfare, climate change (Rico Citation2022), the COVID-19 pandemic (Missiroli and Rühle Citation2021) and the emergence of AI capabilities (Porkoláb Citation2020) that have added additional prolonged stress that undermine conventional shock-oriented recovery and response mechanisms of civil preparedness.

It is at this juncture that resilience is thought to fill a strategic void. As some scholars have noted, there is arguably a “need for much broader political, economic, technological and societal resilience in the face of hostile acts below the threshold of war” (Hall and Sandeman Citation2022, 5). Indeed, it is the interaction between chronic multivalent stresses that exist below the threshold of war and actual direct military confrontation, capabilities and deterrence that is at the heart of a resilience strategy. In this sense, resilience is both the “first and last line of defense” (Hall and Sandeman Citation2022, 1). It is the first line of defense insofar as it serves as a CDD and it is the last line of defense in the face of shocks – and shocks whose systemic and asset sensitivity is amplified by regular and prolonged multivalent stresses.

How science can support ‘layered resilience’

While the applications of resilience policies at national and international levels are gaining prominence, the formulation of policies and processes across sectors has not fully availed itself of the science of resilience. The science of resilience suggests that there is no one single or universal definition or conceptual framing of resilience. Rather there are a variety of major categories that have emerged over time in core disciplinary areas of science and each of these categorical forms of resilience possesses its own conceptual and analytical autonomy, empirical application and external validity (Davidson et al. Citation2016; Joseph Citation2018; Mentges et al. Citation2023). Key categorical forms of resilience are applied in physical, informational, cognitive, and social domains (Wells et al. Citation2022).

Across these domains, many different forms of resilience are programmatically applied across the U.S. government policy, including engineering resilience, cyber resilience, operational resilience, ecological resilience and community resilience (Kang et al. Citation2023; Keenan Citation2018a, Citation2018b). Even within civil engineering and critical infrastructure systems design and management, these different types of resilience serve different functions, metrics, and assessments (Field et al. Citation2022). This conceptual plurality within material systems of the built environment and across economic sectors is also widely observed in European policy (Capraru Citation2022; Baravikova, Coppola, and Terenzi Citation2021).

Appendix provides a non-exhaustive overview of key categorical forms of resilience found in American and European policies and programs. This table provides a heuristic reference to each categories’ properties, attributes and performance criteria. Some forms of resilience, such as engineering resilience and disaster resilience, are primarily concerned with an elastic and reversionary process that reverts to the pre-perturbation state (Wied, Oehmen, and Welo Citation2020). This is often referenced as a single equilibrium process (Zampieri Citation2021). These forms of resilience are focused on designed processes within the context of engineered systems and systems-of-systems (SoSs) wherein fixed levels of performance have been optimized to a robust range for purposes of reliability, safety, efficiency and other limiting factors (Martello et al. Citation2021; Park et al. Citation2013). Conversely, within the context of multi-equilibrium processes, other forms of engineering resilience may provide an underlying capacity for adaptation wherein the designed resilience performance may result in a superior level of performance across its lifecycle in a post-perturbation state (Ungar Citation2021; Woods Citation2015). In either case, scholars have noted the value of utilizing different forms of resilience across systems within SOSs as a means to decomposing and managing case-specific complexities, as Uday and Marais note:

Although there are advantages to using a single calculated value to define resilience, it is also important to recognize the potential issues associated with doing so [Haimes Citation2009]. In particular, an overall metric provides little, if any, information regarding specific areas within the SoS that need attention. Also, in the context of SoSs, the uncertainties associated with network operations, evolution, and management are quite large and hence one metric may not be able to capture all the unknowns. To address these concerns, some studies focus on capturing or disentangling the various dimensions of resilience. (Uday and Marais Citation2015, 502)

In a different context of complex adaptive systems, ecological resilience is also a multi-equilibrium phenomena that is concerned with the degree of external impact that an ecological unit may endure while still maintaining its key identify and performance measures in what might otherwise be shifting responsive structures (Dakos and Kéfi Citation2022). Other forms of resilience, such as community resilience, are focused on people and social behavior and may be explicitly multi-equilibrium phenomena due to the social learning and the modification of behavior that leads to forms of adaptation (Koliou et al. Citation2020). Social dimensions of resilience have also found specialized forms across scales – from individuals (i.e. psychological resilience)(Denckla et al. Citation2020), organizations (i.e. organizational resilience, operational resilience) (Essuman, Boso, and Annan Citation2020; S. E. Galaitsi et al. Citation2023), and institutions (i.e. economic resilience, financial system resilience) (Hynes et al. Citation2022; Keenan et al. Citation2021).

Social aspects of resilience – often referenced as “community resilience” – specifically addresses the capacity of communities and societies to effectively confront, adapt to, and recover from external perturbations (Koliou et al. Citation2020), including the complex impacts of hybrid and conventional warfare (Zekulić, Godwin, and Cole Citation2017). This form of resilience is pivotal in safeguarding societal coherence, morale, and the continuity of social functions amidst the psychological, informational, and physical disruptions posed by such conflicts (Hadji-Janev Citation2018; Lee et al. Citation2022). The essence of community resilience in this milieu involves the strategic cultivation of societal attributes such as informed awareness, communal solidarity, and adaptive governance structures. These elements are crucial for mitigating the divisive and destabilizing tactics employed in hybrid warfare, which often targets the social fabric through disinformation campaigns, cyber-attacks, and other forms of indirect aggression (Apostol, Cristache, and Năstase Citation2022).

Furthermore, the resilience of social systems against conventional warfare demands a comprehensive approach that spans the psychological preparedness of civilians, the maintenance of critical societal functions, and the preservation of cultural heritage (Nikolov Citation2018). Mechanisms for fostering social resilience include community-based education and training programs that enhance disaster readiness, the development of infrastructure, particularly communications infrastructure, capable of withstanding physical and cyber-attacks, and policies that support economic and social recovery post-conflict. Such strategies not only aim to preserve the immediate welfare and security of the population but they also ensure the long-term viability and cohesion of the social structure, thereby reinforcing the overall resilience performance of the state against the multifarious challenges of modern warfare (Wigell, Mikkola, and Juntunen Citation2021).

Wherein some forms of resilience (i.e. engineering resilience, disaster resilience) are explicitly designed as endogenous processes that may be directly indicated, other forms of resilience may be defined by innate characteristics (i.e. psychological resilience) or normative outcomes (i.e. community resilience). Because some forms of resilience may be defined by objectives (e.g. engineering) and others may be defined by characteristics (e.g. ecological resilience, psychological resilience), it “becomes imperative to understand and establish interlinkages between the objectives and characteristics,” as there may be a misalignment and/or direct conflict of objectives across scales (Kolte et al. Citation2023, 11). For this reason, it is often necessary to draw analytical distinction between the various forms of resilience across scales in order to “disentangle” objectives and characteristics and processes and outcomes.

This diverse application of different forms of resilience across sectors has not been widely internalized within national security policies, which has tended to utilize a singular form of engineering resilience in general and non-specific terms. Unfortunately, early applications of resilience in American national security policy development lacked scientific specificity and therefore were viewed by some scholars as “an exercise in ‘occupying’ them with ideologically loaded meanings, which can be interpreted as the actualisation of … ‘political keywords’”(Selchow Citation2017, 36). In Europe, the incorporation of resilience into national security raised a more fundamental critique that “resilience [is] a way to ‘act on the cheap’ removing responsibility from the international community, as local actors become the main protagonists – and in case of failure, the main culprit – of conflict management, also potentially leading to an indirect legitimization of dysfunctional local practices for conflict and security management” (Baldaro and Costantini Citation2021, 309).

Yet, other scholars have noted that resilience in the context of security policy represents a fundamental shift in a theory of governance. Chandler notes, “[t]he area where resilience-thinking has gone furthest is in the rejection of modernist or liberal approaches to governance, based upon linear or deterministic knowledge assumptions of causality. For liberal universalist approaches, policymaking is constructed in ‘top-down’ ways, determined by the ‘known knowns’ of established knowledge and generalisable assumptions of cause and effect” (Chandler Citation2014, 62). In rejecting a linear and deterministic orientation to external shocks and stresses, an extension of this position would suggest that resilience policy is or should be – at its best – grounded in a bottom-up orientation that acknowledges unknowns and deep uncertainty in a world that is shaped by increasing interdependencies and rapid rates of global change manifested across scales and sectors.

In 2021, the Allies endorsed the NATO Warfighting Capstone Concept that introduced “layered resilience” as one of five development imperatives necessary for current and future security challenges (NATO Citation2022c, Citation2023c). In broad terms, layered resilience relies on different sectors across military-civilian domains to each demonstrate their own resilience performance measures and thus enable NATO to sustain, if necessary, long and protracted campaigns (van Mill Citation2023). NATO’s layered resilience model largely imagines the Alliance, its constituent militaries, and the civilian sectors of those countries as components of multiple layers of interaction and dependencies that define security capacities and resilience processes. outlines the various frames and definitions for each of the respective layers within this conceptualization of layered resilience.

Table 1. Resilience definitions within NATO’s layered resilience framework.

NATO’s framing of layered resilience with Alliance Resilience (AR), Military Resilience (MR), Military-Civilian Resilience (MCR) and Civilian Resilience (CR) has a very close conceptual orientation to applications of engineering resilience previously utilized in transatlantic security policies. In this limited context, provides an alternative orientation to layered resilience that highlights various scientific applications across select categorical forms of resilience. These examples largely represent ongoing activities across units of military and civilian governance that may be overlooked for their interactive and cross-scale relationships. For instance, national climate adaptation planning within the context of ecological resilience and AR may significantly shape and support MR and MCR processes that are managing and adapting to environmental and climate risk in physical facilities, installations, and industrial networks. In an entirely different realm of risk and uncertainty, applications drawn from psychological resilience may support everything from the countering of malicious misinformation within the AR and CR domains to force readiness and mobilization within MR and MCR domains. Similar benefits may arise from investments in community resilience in terms of force readiness, labor training, and civilian transition management from the MR, MRCR and CR domains and may even offer the opportunity for reductions in social vulnerability within the AR domain.

Table 2. Example applications of scientific categories of resilience across nato’s layered resilience model.

outlines a variety of potential linkages across domains within the various categorical forms of resilience. Some of these forms of resilience may allow for and support an adaptive capacity for transformation, not necessarily available or inherent in linear top-down policy making as shown in . While some forms of resilience may reinforce reliability and safety dimensions of critical infrastructure systems in a single equilibrium context, other forms acknowledge the potential value and capacity for transformation (i.e. adaptation) when thresholds for single equilibrium recovery are either undesirable, infeasible or otherwise not possible. For instance, adaptation plays a central role in ecological resilience – vertically – across domains from AR to CR, as multiple domains and sectors will need to prepare for and respond to climate change impacts. There are also horizontal connections within a single domain. For example, ongoing advancements at DOD in climate adaptation planning within installations, facilities and force readiness is a prime example of the interaction between engineering resilience (i.e. often but not always single equilibrium) and ecological resilience (i.e. multi-equilibrium) within the MR domain wherein environmental conditions are expected to far exceed current steady state operational parameters (Garfin et al. Citation2021).

Carrying forward this example, these horizontal connections between different forms of resilience within the MR domain share a convergent scenario where installations must be secured (engineering resilience); people must be secured and protected (disaster resilience); assets must adapt (ecological resilience); forces must take on new operating conditions and health precautions (community resilience); and, force personnel must be prepared to improvise in the face of the stress of change and disasters (psychological resilience). Yet, this example represents a singular and unilateral risk vector that may impact military capabilities. When hostile acts compound simultaneously with natural disasters and climate impacts, for example, then the value of resilience is the capacity to execute planned recovery and “to improvise” beyond the limits of resilience in order to change structures to transform to a new operational state (Pursiainen and Kytömaa Citation2023, 10). For instance, redundant communications hardware and infrastructure designed for post-disaster coordination may serve as a critical lifeline during a cyberattack, which may also, by extension, increase the cyber resilience of dual-use command, control and communications supporting military capabilities (Afina, Inverarity, and Unal Citation2020).

This is not a far-out hypothetical scenario, as cyber-attacks have been observed to increase in number following natural disasters (Lallie et al. Citation2021). Years before the Russian military invasion of Ukraine, hackers, widely believed to be associated with Russian state-sponsored groups, launched a sophisticated attack in December 2015 that resulted in power outages for several hours in parts of western Ukraine. The attackers used malware to gain access to the control systems of energy distribution companies, manipulating and disrupting the operation of critical infrastructure and highlighting the vulnerabilities inherent in critical infrastructure sectors (Condliffe Citation2016).

Resilience may support transformative adaptation

Transformative adaptation may take over when the limits of resilience have been reached. Resilience narrowly viewed through traditional risk management strategies often focuses on specific, known threats, creating targeted solutions that may become inadequate or obsolete as new challenges emerge (Linkov, Trump, and Fox-Lent Citation2017). Risk is inherently uncertain. It is often impossible to predict the threats that will emerge, their magnitude, or the likelihood or existence of a specific threat scenario (Hynes et al. Citation2022). Planners attempting to mitigate all known risks will face prohibitive costs due to the sheer number of possible disruptions – most of which will never emerge as actual disruptions (S. Galaitsi et al. Citation2022). In contrast, resilience is often threat-agnostic because it processes system performance regardless of the nature or origin of the disruption (Pescaroli et al. Citation2023). A continuing challenge of investing in resilience is the fact that, in many cases outside of designed single equilibrium forms of engineering resilience, it is not easy to measure. Measurement is often clouded by the uncertainty of the timing of an event and the extent to which resilience performance may be self-executing. Therefore, probabilistic expected values and net present value optimizations originating from risk management processes are less useful for quantifying resource trade-offs supporting resilience investments than other forms of robust decision-making. This measurement challenge may result in an underinvestment in resilience. As a backstop, investments in forms of resilience that support the adaptive capacity of a system are the preferred pathway when total and complete system failure increases the likelihood of military defeat.

One challenge with existing frames of NATO ACT’s preliminary resilience model is that it often represents stability features as a baseline for resilience performance, which is consistent with early applications of single equilibrium forms of engineering resilience utilized in national security policies. The various forms of resilience shown in highlight that adaptation largely falls outside of the conceptualization of NATO ACT’s layered resilience framework. In this context, there is little defined room for multi-equilibrium outcomes – or multiple stable states – that may address the inevitability or uncertainty of the dynamics and thresholds of systems and SOSs. The pursuit of resilience in military and deterrence policy is arguably most effective when it prioritizes both the capacity to recover and the capacity to adapt (formerly, adaptive capacity) within a designed multi-equilibrium resilience context.

Adaptation is critical, particularly in the context of when frontline defense and resistance to acute shocks fails. Under one common scenario, a defense may simply fail because the acute shock or attack was either unknown or undetectable. For instance, in the NATO description of MR, the deterrence operation to adapt occurs in a linear condition only under circumstances of known and anticipated risks. By the same token, defense may manifest to known or unknown (but detectable) phenomena, but the ultimate outcome under this emergent layered resilience framework is presumed to be the recovery to the pre-event baseline. It does not conceptualize a potentially superior alternative state achievable through transformative adaptation defined by new structures and processes. Both known and, particularly, unknown phenomena may cross thresholds from which pre-event baseline conditions are either impossible or undesirable. Resilience is only useful if military commanders and NATO decision makers can understand and operate from the knowledge that systems can and will eventually fail, and that resilience is largely the capability or pathway to flexibly recover and/or adaptively execute new structures that support core functions and performance measures in the eventual case that such systems fail.

Equally, effective adaptation to conventional and hybrid threats requires an understanding and integration of societal systems into NATO doctrine, preparedness, and best practices. Particularly for hybrid threats, it is incumbent upon policymakers to ensure that societal systems and collective human intelligence is able to adapt to the shifting nature of hybrid threats, particularly in the emerging era of generative artificial intelligence (Terziyan et al. Citation2021). This necessitates a resilience framework that not only anticipates and withstands attacks but also evolves in response to unknown or anticipated threats, ensuring societal structures can dynamically adjust and maintain critical functions. Emphasizing societal aspects of resilience policy within NATO’s strategy involves reinforcing public awareness (Lillemäe, Talves, and Wagner Citation2023), enhancing digital literacy, and fostering a culture of adaptability and innovation (J. A. Larsen Citation2023). By doing so, NATO can create a more robust defense ecosystem, one that leverages the collective resilience of its member states to navigate and overcome the multifaceted challenges posed by both known and unforeseen threats.

highlights the extent to which a narrow focus on single equilibrium forms of engineering resilience in national security policies may contribute to maladaptation. As the intensity of single and multi-vector hostile acts increases, so too may the corresponding measure of consequences. This is because the resilience performance is reliant on a set of fixed design parameters and resources that may not scale with the increased intensity (or novelty) of hostile action or the convergence of multiple acute extreme events. At some point, the resilience threshold may be reached and the traditional “V” curve of resilience – where the post-perturbation state equals the pre-perturbation state – is degraded to the extent to that the post-perturbation performance is inferior to the level of pre-perturbation. To this end, an inferior performance of resilience at this stage may also be defined by a longer execution time and at a greater cost. Such an outcome defined by the stress and strain on the elastic performance of resilience would suggest that there is a greater capacity for maladaptation as the intensity (or novelty) of hostile acts increases. This may simply be because any attempt at transformation at the edge of a resilience threshold may be based on the same limited assumptions and resources of pre-perturbation designed resilience. As such, processes and policies that are “too rigid pose any obstacle to improvisation”(Pursiainen and Kytömaa Citation2023, 10). Indeed, if the resilience function collapses entirely without any subsequent adaptation, then total failure or worse (maladaptation) may be the result.

Figure 1. Maladaptive implications for utilizing single equilibrium forms of engineering resilience.

Figure 1. Maladaptive implications for utilizing single equilibrium forms of engineering resilience.

By contrast, highlights the value of the utilization of forms of resilience that support the adaptive capacity of a system. Very often adaptation happens as a function of social learning wherein experience is translated into an alternative range of practice. This is in contrast with designed single equilibrium resilience in an engineered system, which, in many cases, is based on an entirely endogenous utilization of intelligence in the initial exercise of the design of the resilience performance. Therefore, the design and management of resilience processes that supports the adaptive capacity of the system and/or object is primarily centered on the capacity to internalize social and machine learning. But, adaptive capacity may also be supported by flexible governance, semi-autonomous chains of command, redundant communications pathways, readily available material and technological substitutions, and training and simulations that force responses to failure scenarios. All of these attributes may support the transformation to a new identity and function that is more likely to be adaptive than maladaptive.

Figure 2. Adaptive forms of resilience in response to novel and adverse events.

Figure 2. Adaptive forms of resilience in response to novel and adverse events.

As represented in , the intensification of hostile acts (and other non-malicious circumstantial shocks and stresses) results in the greater measure of more severe consequences. In both and , the intensification of hostile acts may also be substituted for the sheer novelty of such acts. In either case, there is a near 1:1 conceptual scaling as resilience operates in a default modulation. However, at some point in time, when there is sufficient social learning, external intelligence and/or machine learning the subject system may begin to reduce the measure of consequence as it adapts to the intensity and/or novelty of hostile acts. Indeed, with greater exposure and experience, the adaptive capacity may significantly increase proportionate to the intelligence. Of course, this assumes on some level that the adverse action has been detected.

In both and , there is no fixed measure associated with maladaptation or adaptation, respectively. Rather, these are measures of capacity for such outcomes. However, with greater degrees of social and machine learning and intelligence, there is a greater capacity for flexibility and for alternative pathways and structures that alter the identity of a system but otherwise maintain desirable processes and/or conditions.

This raises the challenging paradox of resilience in convergent cyber-physical critical infrastructure systems. On one level, the cyber domain offers a greater range of novelty for malicious acts, while, at the same time, there is a great capacity for the utilization of machine learning and artificial intelligence to create new structures and pathways that represent transformative adaptation to such novelties (Colabianchi et al. Citation2021). Yet, paradoxically, machine learning algorithms – and perhaps the agents of social learning – themselves must deploy a measure of resilience in order to keep up with rapid advances in computation, agent structure, and novel counterintelligence acts (Olowononi, Rawat, and Liu Citation2020). This raises the prospects that alternating states of resilience and adaptation may reach an absolute frontier (e.g. supercomputing) from which total and absolute failure is the only outcome in a zero-sum game.

Conclusions for guiding national resilience plans

This article has highlighted the extent to which resilience represents a strategic policy goal that provides both a front and last line of defense. It is a front-line defense by virtue of its presumed ability to serve as a CDD, and it serves as a last line of defense when dependent systems and SOSs are stressed by convergent and novel shocks and stresses. As a strategic policy goal, resilience represents a fundamental shift in a theory of national security that acknowledges the limitations of deterministic threat mitigation and conventional models of risk management. For NATO and the Allies, it also represents a critical stop-gap deterrence building measure when the rates and degrees of change (e.g. in the European theatre) are moving faster than many institutions and political processes have historically been able to keep up with. Yet, there are significant co-benefits that arise from these policies that extend beyond the military domain and well into domestic affairs.

A resilience strategy tailored to emerging threats is essential for national security and reducing vulnerabilities to acute shocks and chronic stressors alike. Such an integrated approach encourages collaboration among military, civilian, and private sectors, enhancing the collective ability to detect, respond to, and recover from threats. By adopting a comprehensive resilience framework, the Allies can enhance their adaptive capacities, ensuring they remain robust in the face of evolving challenges stemming from hybrid threats and other emerging vectors of conflict and disruption. This approach enables the identification and mitigation of vulnerabilities across critical infrastructure and minimizes the potential impact of disruptions. Furthermore, resilience planning fosters a culture of preparedness and agility within governmental and societal structures, ensuring that when disruptions occur, recovery processes are swift and effective. This strategic focus on resilience not only protects the integrity of national will but also promotes a rapid return to normalcy, thereby maintaining public confidence and societal stability.

The DOD has a great deal of experience in applying resilience across multiple sectors and domains. What it lacks is a fundamental and overarching deployment of resilience. Having such a strategic plan or policy would be arguably critical for horizontal and vertical integration across sectors and domains. In this sense, the crossover by and between military and civilian domains is intrinsically limited to a narrow area of interest. It would also be important for social learning and the integration of intelligence systems for understanding emerging and unknown phenomena and threats. By contrast, NATO has a strong strategic orientation to resilience with its emerging layered resilience framework. It simply lacks the specificity of scientific application of resilience within and across the domains. By working together, the U.S. and its NATO allies can merge bottom-up experience with top-down planning toward a more comprehensive deployment of resilience for strategic goals.

Each of the Allies has committed to developing a NRP that connects domestic and international processes, capabilities and capacities. NRPs are aligned with established Alliance resilience development priorities and an agreed-upon level of ambition for enhancing deterrence. In developing a comprehensive NRP, it is crucial to recognize the geographic factors for enablement and each nation’s risk profile, as well as the complex interdependencies that exist across various sectors and governance structures. From transportation to energy and healthcare to defense, each sector faces unique challenges, yet shares some structural underlying similarities and interconnected vulnerabilities. To craft an integrated NRP that capitalizes on these commonalities, one should align efforts in significant areas where collaborations and information can be exchanged and sustained. Given the dynamic nature of change, ongoing networks for people and information are going to need to be built alongside the NRP process. This is an important element of promoting an adaptive capacity that supports resilience.

Resilience planning requires acknowledging that SOSs, systems, and non-systems are interconnected across sectors and domains in ways that are often non-linear, unintuitive and counter to prevailing institutional wisdom. Resilience does not always lead in absolute or universal terms to advances in economic, social, or environmental welfare. It is a dynamic and adaptive process that requires resources and trade-offs that offer a pathway for a sustainable response, recovery and maybe even transformative adaptation. As noted by Adlakha-Hutcheon (Citation2022), discovering cognition at indivudal and collective levels and forming interconnections among these elements with resilience measures–layer-upon-layer–will be key to achieving adaptive layered resilience. As the governments of NATO member nations prepare their NRPs they have the opportunity to incorporate adaptive processes that lean towards bolstering resilience in the deployment of limited and precious resources that seek to guard against a very unpredictable future.

Acknowledgments

The views and opinions expressed in this article are those of the individual authors and not those of the U.S. Army, or other sponsor or affiliate organizations of the authors.

Disclosure statement

No potential conflict of interests were reported by the author(s).

Additional information

Funding

This paper is based upon work supported by the U.S. Department of Defense Operational Resilience International Cooperation Program (DORIC) and U.S. Army Engineer Research and Development Center FLEX Project on Compounding Threats. The views and opinions expressed in this article are those of the individual authors and not those of the U.S. Army, or other sponsor organizations.

Notes on contributors

Jesse M. Keenan

Jesse M. Keenan is a Senior Economist at the U.S. Army Corps of Engineers’ Engineer Research and Development Center and the Favrot II Associate Professor at Tulane University where he conducts research in resilience and critical infrastructure systems.

Benjamin Trump

Benjamin Trump is a Senior Research Social Scientist at the U.S. Army Corps of Engineers’ Engineer Research and Development Center where he researches the intersection of resilience, engineered systems, and public health.

Eero Kytömaa

Eero Kytömaa serves as the Ministerial Adviser at the National Security Unit of the Finnish Ministry of the Interior. He has a worked extensively on countering hybrid threats and resilience policy planning in Finland and within the EU and NATO.

Gitanjali Adlakha-Hutcheon

Gitanjali Adlakha-Hutcheon serves as the Acting Chief Scientist of the Centre for Security Science and Central Offices at the Defence Research and Development Canada within the Canadian Department of Defence.

Igor Linkov

Igor Linkov is a Senior Science and Technology Manager with the U.S. Army Corps of Engineers’ Engineer Research and Development Center and Adjunct Professor at Carnegie Mellon University. He is responsible for ERDC’s project portfolio in the areas of crises management and resilience.

References

  • Adlakha-Hutcheon, G. 2022. “The Importance of Cognition in Achieving Resilience.” In: Proceedings of the 17th NATO Operational Research & Analysis Conference, 17-18 October 2022, Copenhagen, Denmark. NATO Science and Technology Organization.
  • Afina, Y., C. Inverarity, and B. Unal. 2020. “Ensuring Cyber Resilience in NATO’s Command, Control and Communications Systems.” Research Paper, International Security Programme. London, U.K: The Royal Institute of International Affairs, Chatham House. https://www.chathamhouse.org/sites/default/files/2020-07-17-cyber-resilience-nato-command-control-communication-afina-inverarity-unal.pdf.
  • Alderson, D. L., G. G. Brown, and W. M. Carlyle. 2015. “Operational Models of Infrastructure Resilience.” Risk Analysis 35 (4): 562–586. https://doi.org/10.1111/risa.12333.
  • Ams, S. 2023. “Blurred Lines: The Convergence of Military and Civilian Uses of AI & Data Use and Its Impact on Liberal Democracy.” International Politics 60 (4): 879–896. https://doi.org/10.1057/s41311-021-00351-y.
  • Apostol, A. C., N. Cristache, and M. Năstase. 2022. “Societal Resilience, a Key Factor in Combating Hybrid Threats.” International Conference: The Knowledge-Based Organization 28 (2): 107–115. https://doi.org/10.2478/kbo-2022-0057.
  • Baldaro, E., and I. Costantini. 2021. “Fragility and Resilience in the European Union’s Security Strategy: Comparing Policy Paradigms.” Italian political science review/Rivista italiana di scienza politica 51 (3): 305–320. https://doi.org/10.1017/ipo.2020.22.
  • Baravikova, A., A. Coppola, and A. Terenzi. 2021. “Operationalizing Urban Resilience: Insights from the Science-Policy Interface in the European Union.” European Planning Studies 29 (2): 241–258. https://doi.org/10.1080/09654313.2020.1729346.
  • Bodeau, D. J., R. D. Graubart, R. M. McQuaid, and J. Woodill. 2018. “Cyber Resiliency Metrics, Measures of Effectiveness and Score.” Bedford, MA: MITRE Corporation. https://apps.dtic.mil/sti/citations/trecms/AD1108054.
  • Bonnevie, E., J. Sittig, and J. Smyser. 2021. “The Case for Tracking Misinformation the Way We Track Disease.” Big Data & Society 8 (1): 20539517211013867. https://doi.org/10.1177/20539517211013867.
  • Brooks, R. A. 2019. “Integrating the Civil–Military Relations Subfield.” Annual Review of Political Science 22 (1): 379–398. https://doi.org/10.1146/annurev-polisci-060518-025407.
  • Capraru, M. R. 2022. “A New Era for Resilience in the Euro-Atlantic Region.” Aspenia Online. June 14th. https://aspeniaonline.it/a-new-era-for-resilience-in-the-euro-atlantic-region/.
  • Chandler, D. 2014. “Beyond Neoliberalism: Resilience, the New Art of Governing Complexity.” Resilience 2 (1): 47–63. https://doi.org/10.1080/21693293.2013.878544.
  • Chandra, A., J. Acosta, L. S. Meredith, K. Sanches, S. Stern, L. Uscher-Pines, and D. Yeung. 2010. Understanding Community Resilience in the Context of National Health Security, In Santa Monica, CA: RAND Corporation. https://www.rand.org/content/dam/rand/pubs/working_papers/2010/RAND_WR737.pdf.
  • Christie, E. H., and K. Berzina. 2022. “NATO and Societal Resilience: All Hands on Deck in the Age of War.” Policy Brief, Washington, D.C: The German Marshall Fund of the United States. https://www.gmfus.org/sites/default/files/2022-07/NATO%20and%20Societal%20Resilience%20All%20Hands%20on%20Deck%20in%20an%20Age%20of%20War.pdf.
  • Claverie, B., and F. du Cluzel. 2022. “The Cognitive Warfare Concept.” Innovation Hub Working Paper. Norfolk, VA: NATO Allied Command Transformation. https://innovationhub-act.org/wp-content/uploads/2023/12/CW-article-Claverie-du-Cluzel-final_0.pdf.
  • Colabianchi, S., F. Costantino, G. Di Gravio, F. Nonino, and R. Patriarca. 2021. “Discussing Resilience in the Context of Cyber Physical Systems.” Computers & Industrial Engineering 160:107534. https://doi.org/10.1016/j.cie.2021.107534.
  • Condliffe, J. 2016. “Ukraine’s Power Grid Gets Hacked Again, a Worrying Sign for Infrastructure Attacks.” MIT Technology Review. December 22nd. https://www.technologyreview.com/2016/12/22/5969/ukraines-power-grid-gets-hacked-again-a-worrying-sign-for-infrastructure-attacks/.
  • Constantinescu, M. 2023. “Measuring Economic Resilience for the CEE and Black Sea Countries in the Framework of Comprehensive Defence.” Security and Defence Quarterly 44 (4): 55–83. https://doi.org/10.35467/sdq/175379.
  • Cusumano, E. 2018. “Resilience for Hire? NATO Contractor Support in Afghanistan Examined.” In: E. Cusumano and M. Corbe, eds. A Civil-Military Response to Hybrid Threats. Cham, CH: Palgrave Macmillan. https://doi.org/10.1007/978-3-319-60798-6_6.
  • Cutter, S. L. 2016. “The Landscape of Disaster Resilience Indicators in the USA.” Natural Hazards 80 (2): 741–758. https://doi.org/10.1007/s11069-015-1993-2.
  • Cutter, S. L., and S. Derakhshan. 2019. “Implementing Disaster Policy: Exploring Scale and Measurement Schemes for Disaster Resilience.” Journal of Homeland Security and Emergency Management 16 (3): 20180029. https://doi.org/10.1515/jhsem-2018-0029.
  • Dakos, V., and S. Kéfi. 2022. “Ecological Resilience: What to Measure and How.” Environmental Research Letters 17 (4): 043003. https://doi.org/10.1088/1748-9326/ac5767.
  • Davidson, J. L., C. Jacobson, A. Lyth, A. Dedekorkut-Howes, C. L. Baldwin, J. C. Ellison, and T. F. Smith. 2016. “Interrogating Resilience: Toward a Typology to Improve Its Operationalization.” Ecology and Society 21 (2). https://doi.org/10.5751/ES-08450-210227.
  • Denckla, C. A., D. Cicchetti, L. D. Kubzansky, S. Seedat, M. H. Teicher, D. R. Williams, and K. C. Koenen. 2020. “Psychological Resilience: An Update on Definitions, a Critical Appraisal, and Research Recommendations.” European Journal of Psychotraumatology 11 (1): 1822064. https://doi.org/10.1080/20008198.2020.1822064.
  • Den Hartigh, R. J., and Y. Hill. 2022. “Conceptualizing and Measuring Psychological Resilience: What Can We Learn from Physics?” New Ideas in Psychology 66:100934. https://doi.org/10.1016/j.newideapsych.2022.100934.
  • DesJardine, M., P. Bansal, and Y. Yang. 2019. “Bouncing Back: Building Resilience Through Social and Environmental Practices in the Context of the 2008 Global Financial Crisis.” Journal of Management 45 (4): 1434–1460. https://doi.org/10.1177/0149206317708854.
  • Djalante, R., C. Holley, F. Thomalla, and M. Carnegie. 2013. “Pathways for Adaptive and Integrated Disaster Resilience.” Natural Hazards 69 (3): 2105–2135. https://doi.org/10.1007/s11069-013-0797-5.
  • DOD (U.S. Department of Defence). 2024. Industrial Base Policy: DASD Industrial Base Resilience. Washington, D.C: Office of the Deputy Assistant Secretary of Defense for Industrial Base Resilience. https://www.businessdefense.gov/ibr/.
  • DOD (U.S. Department of Defense). 2013. Task Force Report: Resilient Military Systems and the Advanced Cyber Threat. Washington, D.C: Office of the Under Secretary of Defense for Acquisition, Technology and Logistics. https://apps.dtic.mil/sti/pdfs/ADA569975.pdf.
  • DOD (U.S. Department of Defense). 2018. DOD Directive 4715.21: Climate Change Adaptation and Resilience, Washington, D.C: Office of the Under Secretary of Defense for Acquisition and Sustainment. https://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodd/471521p.pdf.
  • DOD (U.S. Department of Defense). 2019. United State Government Compendium of Interagency and Associated Terms, Washington, D.C: Joint Chiefs of Staff, U.S. Department of Defense. https://www.jcs.mil/Portals/36/Documents/Doctrine/dictionary/repository/usg_compendium.pdf?ver=2019-11-04-174229-423.
  • DOD (U.S. Department of Defense). 2022. National Defense Strategy of the United States of America. Washington, D.C: U.S. Department of Defense. https://media.defense.gov/2022/Oct/27/2003103845/-1/-1/1/2022-NATIONAL-DEFENSE-STRATEGY-NPR-MDR.PDF.
  • DOD (U.S. Department of Defense). 2023a. 2023 Cyber Strategy of the Department of Defense, Washington, D.C: Department of Defense. https://media.defense.gov/2023/Sep/12/2003299076/-1/-1/1/2023_DOD_Cyber_Strategy_Summary.PDF.
  • DOD (U.S. Department of Defense). 2023b. Deputy Assistant Secretary of Defense for Arctic and Global Resilience. https://policy.defense.gov/OUSDP-Offices/ASD-for-Homeland-Defense-and-Hemispheric-Affairs/Arctic-and-Global-Resilience/.
  • DSCA (Defense Security Cooperation Agency). 2021. Building Resilience for National Defense, Monterey, CA: Institute for Security Governance. https://nps.edu/documents/113018911/125185574/ISG+Resilience.pdf/bbbe0227-207d-873a-3864-c4d19d7bdc14?t=1622747034982.
  • Essuman, D., N. Boso, and J. Annan. 2020. “Operational Resilience, Disruption, and Efficiency: Conceptual and Empirical Analyses.” International Journal of Production Economics 229:107762. https://doi.org/10.1016/j.ijpe.2020.107762.
  • Field, C., E. Sutley, N. Naderpajouh, J. W. van de Lindt, D. Butry, J. M. Keenan, and M. Koliou. 2022. “Incorporating Socioeconomic Metrics in Civil Engineering Projects: The Resilience Perspective.” Natural Hazards Review 23 (1): 04021064. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000537.
  • Folke, C., S. R. Carpenter, B. Walker, M. Scheffer, T. Chapin, and J. Rockström. 2010. “Resilience Thinking: Integrating Resilience, Adaptability and Transformability.” Ecology and Society 15 (4). https://doi.org/10.5751/ES-03610-150420.
  • Fraccascia, L., I. Giannoccaro, and V. Albino. 2017. “Rethinking Resilience in Industrial Symbiosis: Conceptualization and Measurements.” Ecological Economics 137:148–162. https://doi.org/10.1016/j.ecolecon.2017.02.026.
  • Frizzelle, B., J. Garey, and I. Kulalic. 2022. “NATO’s National Resilience Mandate: Challenges and Opportunities.” Defence Studies 22 (3): 525–532. https://doi.org/10.1080/14702436.2022.2082954.
  • Galaitsi, S., M. Kurth, S. Fries, and I. Linkov. 2022. “Mainstreaming Resilience Analytics: 10 Years After the Fukushima Disaster.” Integrated Environmental Assessment and Management 18 (6): 1551–1554. https://doi.org/10.1002/ieam.4623.
  • Galaitsi, S. E., E. Pinigina, J. M. Keisler, G. Pescaroli, J. M. Keenan, and I. Linkov. 2023. “Business Continuity Management, Operational Resilience, and Organizational Resilience: Commonalities, Distinctions, and Synthesis.” International Journal of Disaster Risk Science 14 (5): 713–721. https://doi.org/10.1007/s13753-023-00494-x.
  • Garfin, G., D. A. Falk, C. D. O’Connor, K. Jacobs, R. D. Sagarin, A. C. Haverland, and A. A. Zuniga-Teran. 2021. “A New Mission: Mainstreaming Climate Adaptation in the US Department of Defense.” Climate Services 22:100230. https://doi.org/10.1016/j.cliser.2021.100230.
  • Gartzke, E., and J. R. Lindsay, eds. 2019. Cross-Domain Deterrence: Strategy in an Era of Complexity. New York, NY: Oxford University Press.
  • Goodwin, R., Y. Hamama-Raz, E. Leshem, and M. Ben-Ezra. 2023. “National Resilience in Ukraine Following the 2022 Russian Invasion.” International Journal of Disaster Risk Reduction 85:103487. https://doi.org/10.1016/j.ijdrr.2022.103487.
  • Grade, A. M., A. R. Crimmins, S. Basile, M. R. Essig, L. Goldsmith, A. R. Lustig, T. K. Maycock, A. McCarrick, and A. Scheetz. 2023. “Appendix 5. Glossary.” In: A.R. Crimmins, C.W. Avery, D.R. Easterling, K.E. Kunkel, B. C. Stewart and T.K. Maycock, eds. Fifth National Climate Assessment. Washington, D.C: U.S. Global Change Research Program. https://doi.org/10.7930/NCA5.2023.A5.
  • Hadji-Janev, M. 2018. “Toward Community Resilience Against Disinformation & Propaganda with a Focus.” Journal of Communication 68 (6): 1007–1028.
  • Haimes, Y. Y. 2009. “On the Definition of Resilience in Systems.” Risk Analysis: An International Journal 29 (4): 498–501. https://doi.org/10.1111/j.1539-6924.2009.01216.x.
  • Hallegatte, S. 2014. “Economic Resilience: Definition and Measurement.” World Bank Policy Research Working Paper 6852. Washington, D.C: World Bank. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2432352.
  • Hall, J., and H. Sandeman. 2022. Nato’s Resilience: The First and Last Line of Defence. Strategic Update. London, U.K: The London School of Economics and Political Science. https://www.lse.ac.uk/ideas/Assets/Documents/updates/2022-SU-NATO-HallSandeman.pdf.
  • Hartmann, U. 2017. “The Evolution of the Hybrid Threat, and Resilience As a Countermeasure.” Research Paper 139. Rome, IT: NATO Defense College, Research Division. https://www.ndc.nato.int/news/news.php?icode=1083.
  • Hepfer, M., and T. B. Lawrence. 2022. “The Heterogeneity of Organizational Resilience: Exploring Functional, Operational and Strategic Resilience.” Organization Theory 3 (1): 26317877221074701. https://doi.org/10.1177/26317877221074701.
  • Herrera, J. G. 2021. Military Installation Resilience: What Does it Mean?, Washington, D.C: Congressional Research Service. https://apps.dtic.mil/sti/pdfs/AD1147490.pdf.
  • Hodicky, J., G. Özkan, H. Özdemir, P. Stodola, J. Drozd, and W. Buck. 2020. “Dynamic modeling for resilience measurement: NATO resilience decision support model.” Applied Sciences 10 (8): 2639. https://doi.org/10.3390/app10082639.
  • Holling, C. S. 1996. “Engineering Resilience versus Ecological Resilience.” In Engineering within Ecological Constraints, edited by Schulze, E. Washington, D.C: National Academy of Engineering, 31–44.
  • Houston, J. B., M. L. Spialek, J. Cox, M. M. Greenwood, and J. First. 2015. “The Centrality of Communication and Media in Fostering Community Resilience: A Framework for Assessment and Intervention.” American Behavioral Scientist 59 (2): 270–283. https://doi.org/10.1177/0002764214548563.
  • Hynes, W., B. D. Trump, A. Kirman, A. Haldane, and I. Linkov. 2022. “Systemic Resilience in Economics.” Nature Physics 18 (4): 381–384. https://doi.org/10.1038/s41567-022-01581-4.
  • Jacuch, A. 2020. “Countering Hybrid Threats: Resilience in the EU and NATO’s Strategies.” The Copernicus Journal of Political Studies 1 (1): 5–26. https://doi.org/10.12775/CJPS.2020.001.
  • Johnson, M. F., T. Ide, and J. G. Cruz. 2023. “Conceptualizing Resilience within Environmental Peacebuilding.” Current Opinion in Environmental Sustainability 65:101362. https://doi.org/10.1016/j.cosust.2023.101362.
  • Joseph, J. 2018. Varieties of Resilience: Studies in Governmentality. Cambridge, UK: Cambridge University Press.
  • Kahn, W. A., M. A. Barton, C. M. Fisher, E. D. Heaphy, E. M. Reid, and E. D. Rouse. 2018. “The Geography of Strain: Organizational Resilience as a Function of Intergroup Relations.” Academy of Management Review 43 (3): 509–529. https://doi.org/10.5465/amr.2016.0004.
  • Kang, K. E., A. O. M. Bowman, B. Hannibal, S. Woodruff, and K. Portney. 2023. “Ecological, Engineering and Community Resilience Policy Adoption in Large US Cities.” Urban Affairs Review 59 (6): 1973–2004. https://doi.org/10.1177/10780874221150793.
  • Karsten, P., ed. 2013. The Military-State-Society Symbiosis. New York, NY: Routledge.
  • Keating, A., K. Campbell, R. Mechler, P. Magnuszewski, J. Mochizuki, W. Liu, M. Szoenyi, and C. McQuistan. 2017. “Disaster Resilience: What it Is and How it Can Engender a Meaningful Change in Development Policy.” Development Policy Review 35 (1): 65–91. https://doi.org/10.1111/dpr.12201.
  • Keenan, J. M. 2018a. “From Climate Change to National Security: Analysis of the Obama administration’s Federal Resilience Mandates and Measures.” Natural Hazards Review 19 (1): 04017022. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000273.
  • Keenan, J. M. 2018b. “Types and Forms of Resilience in Local Planning in the US: Who Does What?” Environmental Science & Policy 88:116–123. https://doi.org/10.1016/j.envsci.2018.06.015.
  • Keenan, J. M. 2019. Climate Adaptation Finance and Investment in California. London, U.K: Routledge.
  • Keenan, J. M., B. D. Trump, W. Hynes, and I. Linkov. 2021. “Exploring the Convergence of Resilience Processes and Sustainable Outcomes in Post-Covid, Post-Glasgow Economies.” Sustainability 13 (23): 13415. https://doi.org/10.3390/su132313415.
  • Koliou, M., J. W. van de Lindt, T. P. McAllister, B. R. Ellingwood, M. Dillard, and H. Cutler. 2020. “State of the Research in Community Resilience: Progress and Challenges.” Sustainable and Resilient Infrastructure 5 (3): 131–151. https://doi.org/10.1080/23789689.2017.1418547.
  • Kolte, R., S. Goswami, A. Kumar, and S. Pipralia. 2023. “Challenges in Practical Implementation of the Concept of Urban Resilience in Cities.” International Journal of Disaster Risk Reduction 99:104142. https://doi.org/10.1016/j.ijdrr.2023.104142.
  • Kott, A., G. Dubynskyi, A. Paziuk, S. E. Galaitsi, B. D. Trump, and I. Linkov. 2024. “Russian Cyber Onslaught Was Blunted by Ukrainian Cyber Resilience, Not Merely Security.” IEEE Computer. [in press].
  • Kudlenko, A. 2023. “Roots of Ukrainian Resilience and the Agency of Ukrainian Society Before and After Russia’s Full-Scale Invasion.” Contemporary Security Policy 44 (4): 513–529. https://doi.org/10.1080/13523260.2023.2258620.
  • Lallie, H. S., L. A. Shepherd, J. R. Nurse, A. Erola, G. Epiphaniou, C. Maple, and X. Bellekens. 2021. “Cyber Security in the Age of COVID-19: A Timeline and Analysis of Cyber-Crime and Cyber-Attacks During the Pandemic.” Computers & Security 105:102248. https://doi.org/10.1016/j.cose.2021.102248.
  • Larsen, H. 2022. “Adapting NATO to Great-Power Competition.” The Washington Quarterly 45 (4): 7–26. https://doi.org/10.1080/0163660X.2022.2148507.
  • Larsen, J. A. 2023. “The United States and NATO: Is There a Western Strategic Culture?“ In: K. Kartchner, B. Bowen and J. Johnson, eds. Routledge Handbook of Strategic Culture, 91–105. New York, NY: Routledge.
  • Lee, J. H., N. Santero, A. Bhattacharya, E. May, and E. S. Spiro. 2022. “Community-Based Strategies for Combating Misinformation: Learning from a Popular Culture Fandom.” Harvard Kennedy School Misinformation Review. https://misinforeview.hks.harvard.edu/article/community-based-strategies-for-combating-misinformation-learning-from-a-popular-culture-fandom/.
  • Lillemäe, E., K. Talves, and W. Wagner. 2023. “Public Perception of Military AI in the Context of Techno-Optimistic Society.” AI & Society 1–15. https://doi.org/10.1007/s00146-023-01785-z.
  • Lindley-French, J. 2021. “After You, Please? Enablement and Deterrence.” Atlantisch Perspectief 45 (4): 11–15. https://www.jstor.org/stable/48638251.
  • Lindsay, J. R. 2020. Information Technology and Military Power. Ithaca, NY: Cornell University Press.
  • Linkov, I., F. Baiardi, M. V. Florin, S. Greer, J. H. Lambert, M. Pollock, and B. D. Trump. 2019. “Applying Resilience to Hybrid Threats.” IEEE Security & Privacy 17 (5): 78–83. https://doi.org/10.1109/MSEC.2019.2922866.
  • Linkov, I., and A. Kott. 2019. “Fundamental Concepts of Cyber Resilience: Introduction and Overview.” In: A. Kott, and I. Linkov, eds. Cyber Resilience of Systems and Networks. Cham, CH: Springer International Publishing, 1–25. https://doi.org/10.1007/978-3-319-77492-3_1.
  • Linkov, I., B. D. Trump, and C. Fox-Lent. 2017. “Resilience: Approaches to Risk Analysis and Governance.” In: M.V. Florin and I. Linkov, eds. Resource Guide on Resilience. CH: EPFL International Risk Governance Center (IRGC), 1–12.
  • Liu, W., and Z. Song. 2020. “Review of Studies on the Resilience of Urban Critical Infrastructure Networks.” Reliability Engineering & System Safety 193:106617. https://doi.org/10.1016/j.ress.2019.106617.
  • MacLeish, K. 2020. “Churn: Mobilization–Demobilization and the Fungibility of American Military Life.” Security Dialogue 51 (2–3): 194–210. https://doi.org/10.1177/0967010619889469.
  • Mallory, K. 2018. “New Challenges in Cross-Domain Deterrence.” Perspective, Santa Monica, CA: RAND Corporation. https://www.jstor.org/stable/pdf/resrep17639.pdf.
  • Manwaring, R., and J. Holloway. 2023. “Resilience to Cyber-Enabled Foreign Interference: Citizen Understanding and Threat Perceptions.” Defence Studies 23 (2): 334–357. https://doi.org/10.1080/14702436.2022.2138349.
  • Maronkova, B. 2021. “NATO Amidst Hybrid Warfare Threats: Effective Strategic Communications As a Tool Against Disinformation and Propaganda.” In: S. Jayakumar, B. Ang and N.D. Anwar, eds. Disinformation and Fake News. Singapore: Palgrave Macmillan. https://doi.org/10.1007/978-981-15-5876-4_9.
  • Martello, M. V., A. J. Whittle, J. M. Keenan, and F. P. Salvucci. 2021. “Evaluation of Climate Change Resilience for Boston’s Rail Rapid Transit Network.” Transportation Research Part D: Transport & Environment 97:102908. https://doi.org/10.1016/j.trd.2021.102908.
  • McInerney, S. A., E. Waldrep, and C. C. Benight. 2022. “Resilience Enhancing Programs in the US Military: An Exploration of Theory and Applied Practice.” Military Psychology 36 (3): 1–12. https://doi.org/10.1080/08995605.2022.2086418.
  • Mentges, A., L. Halekotte, M. Schneider, T. Demmer, and D. Lichte. 2023. “A Resilience Glossary Shaped by Context: Reviewing Resilience-Related Terms for Critical Infrastructures.” International Journal of Disaster Risk Reduction 103893:103893. https://doi.org/10.1016/j.ijdrr.2023.103893.
  • Meunier, F. X. 2019. “Construction of an Operational Concept of Technological Military/Civilian Duality.” Journal of Innovation Economics and Management n° 29 (2): 159–182. https://doi.org/10.3917/jie.029.0159.
  • Milburn, R. 2023. “Carbon Warriors: Enhancing NATO’s Response to Climate Change.” The RUSI Journal 168 (4): 30–39. https://doi.org/10.1080/03071847.2023.2235152.
  • Missiroli, A., and M. Rühle. 2021. “The Pandemic and the Military: EU and NATO Between Resilience and Total Defence.” European Foreign Affairs Review 26 (2): 203–218. https://doi.org/10.54648/eerr2021016.
  • Mumford, A., and P. Carlucci. 2023. “Hybrid Warfare: The Continuation of Ambiguity by Other Means.” European Journal of International Security 8 (2): 192–206. https://doi.org/10.1017/eis.2022.19.
  • NASEM (National Academies of Sciences, Engineering and Medicine’s). 2023. “Forum on Cyber Resilience. https://www.nationalacademies.org/our-work/forum-on-cyber-resilience.
  • NATO. 1949. “The North Atlantic Treaty.” Washington, D.C: The North Atlantic Treaty Organization. https://www.nato.int/cps/en/natolive/official_texts_17120.htm.
  • NATO. 2005. “Science & Technology: Information Technology: Resilience.” NATO Term: The Official NATO Terminology Database. https://nso.nato.int/natoterm/Web.mvc/.
  • NATO. 2016a. “July 8th Commitment to Enhance Resilience.” Press Release #116.https://www.nato.int/cps/en/natohq/official_texts_133180.htm.
  • NATO. 2016b. “July 9th Warsaw Summit Communiqué.” Press Release #100. https://www.nato.int/cps/en/natohq/official_texts_133169.htm.
  • NATO. 2022a. “Call for Proposals: “Increasing Societal Resilience: Innovative Ways to Counter Disinformation and Hostile Activities.” Brussels, BE: NATO Headquarters. https://www.nato.int/structur/pdd/2022/220411-ResilienceContentGuidelines.pdf.
  • NATO. 2022b. “General Terminology: Resilience.” NATO Term: The Official NATO Terminology Database. https://nso.nato.int/natoterm/Web.mvc.
  • NATO. 2022c. “NATO Standard AJP-01 Allied Joint Doctrine.” Edited F Version 1 with UK National Elements. Brussels, B.E: NATO Standardization Office.
  • NATO. 2023a. “July 11th Vilnius Summit Communiqué.” Press Release #001. https://www.nato.int/cps/en/natohq/official_texts_217320.htm.
  • NATO. 2023b. “Layered Resilience Interdependencies Between the Civil and Military Layers.” Layered Resilience Team Working Paper. Norfolk, VA: NATO HQ Supreme Allied Commander Transformation.
  • NATO. 2023c. “NWCC: NATO Warfighting Capstone Concept.” Norfolk, VA: Allied Command Transformation, North Atlantic Treaty Organization. https://www.act.nato.int/wp-content/uploads/2023/06/NWCC-Glossy-18-MAY.pdf.
  • NATO. 2023d. “What Is Military Resilience (MR)? Layered Resilience Team Working Paper.” Norfolk, VA: NATO HQ Supreme Allied Commander Transformation.
  • Newlove-Eriksson, L., G. Giacomello, and J. Eriksson. 2018. “The Invisible Hand? Critical Information Infrastructures, Commercialisation and National Security.” The International Spectator 53 (2): 124–140. https://doi.org/10.1080/03932729.2018.1458445.
  • Nicastro, L. A. 2023. The U.S. Defense Industrial Base: Background and Issues for Congress. R47751. Washington, D.C: Congressional Research Service. October 12th. https://crsreports.congress.gov/product/pdf/R/R47751.
  • Nikolov, O. 2018. “Building Societal Resilience Against Hybrid Threat.” Information & Security 39 (1): 91–109. https://doi.org/10.11610/isij.3908.
  • NIST (National Institute of Standards and Technology). 2020. “Protecting Controlled Unclassified Information in Nonfederal Systems and Organizations.” NIST Special Publication 800-171, Revision 2, Gaithersburg, MD: National Institute of Standards and Technology, U.S. Department of Commerce. https://doi.org/10.6028/NIST.SP.800-171r2.
  • NIST (National Institute of Standards and Technology). 2021. “Developing Cyber-Resilient Systems: A Systems Security Engineering Approach.” NIST Special Publication 800-160, Revision 1, Gaithersburg, MD: National Institute of Standards and Technology, U.S. Department of Commerce. https://doi.org/10.6028/NIST.SP.800-160v2r1.
  • OFR (Office of Force Resiliency). 2023. “Office of the Under Secretary of Defense for Personnel & Readiness.” Office of Force Resiliency: Overview. https://prhome.defense.gov/Home/Organization/OFR/.
  • Olowononi, F. O., D. B. Rawat, and C. Liu. 2020. “Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPS.” IEEE Communications Surveys & Tutorials 23 (1): 524–552. https://doi.org/10.1109/COMST.2020.3036778.
  • Oprins, E. A., K. V. D. Bosch, and W. Venrooij. 2018. “Measuring Adaptability Demands of Jobs and the Adaptability of Military and Civilians.” Military Psychology 30 (6): 576–589. https://doi.org/10.1080/08995605.2018.1521689.
  • Ortiz‐de‐Mandojana, N., and P. Bansal. 2016. “The Long‐Term Benefits of Organizational Resilience Through Sustainable Business Practices.” Strategic Management Journal 37 (8): 1615–1631. https://doi.org/10.1002/smj.2410.
  • Ostadtaghizadeh, A., A. Ardalan, D. Paton, H. Jabbari, and H. R. Khankeh. 2015. “Community Disaster Resilience: A Systematic Review on Assessment Models and Tools.” PLOS Currents Disasters 7. https://doi.org/10.1371/currents.dis.f224ef8efbdfcf1d508dd0de4d8210ed.
  • Park, J., T. P. Seager, P. S. C. Rao, M. Convertino, and I. Linkov. 2013. ““Integrating Risk and Resilience Approaches to Catastrophe Management in Engineering Systems.” Risk Analysis 33 (3): 356–367. https://doi.org/10.1111/j.1539-6924.2012.01885.x.
  • Patel, S. S., M. B. Rogers, R. Amlôt, and G. J. Rubin. 2017. “What Do We Mean by ‘Community resilience’? A Systematic Literature Review of How it Is Defined in the Literature.” PloS Currents 9. https://doi.org/10.1371/currents.dis.db775aff25efc5ac4f0660ad9c9f7db2.
  • Pennington, C. 2020. Strengthening Our Resilience to Environmental Change Is a National Security Imperative, McLean, VA: MITRE Center for Data-Driven Policy. https://apps.dtic.mil/sti/trecms/pdf/AD1137491.pdf.
  • Pescaroli, G., K. Guida, J. Reynolds, R. S. Pulwarty, I. Linkov, and D. E. Alexander. 2023. “Managing Systemic Risk in Emergency Management, Organizational Resilience and Climate Change Adaptation.” Disaster Prevention & Management: An International Journal 32 (1): 234–251. https://doi.org/10.1108/DPM-08-2022-0179.
  • Popper, K. R. 2020. The Open Society and Its Enemies. Princeton, NJ: Princeton University Press.
  • Porkoláb, I. 2020. “An AI Enabled NATO Strategic Vision for Twenty-First-Century Complex Challenges.” In Artificial Intelligence and Global Security, 153–165. Lees, U.K: Emerald Publishing Limited. https://doi.org/10.1108/978-1-78973-811-720201009.
  • Poudel, S., A. Dubey, and A. Bose. 2019. “Risk-Based Probabilistic Quantification of Power Distribution System Operational Resilience.” IEEE Systems Journal 14 (3): 3506–3517. https://doi.org/10.1109/JSYST.2019.2940939.
  • Puckett, L. M. 2021. “Civil-Military Coordination in Disaster Preparedness and Response.” Natural Hazards Review 22 (2): 04021005. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000446.
  • Pursiainen, C., and E. Kytömaa. 2023. “From European Critical Infrastructure Protection to the Resilience of European Critical Entities: What Does it Mean?” Sustainable and Resilient Infrastructure 8 (sup1): 85–101. https://doi.org/10.1080/23789689.2022.2128562.
  • Radvanovsky, R. S., and A. McDougall. 2018. Critical Infrastructure: Homeland Security and Emergency Preparedness. Boca Raton, FL: CRC Press.
  • Reding, D. F., and B. Wells. 2022. “Cognitive Warfare: NATO, COVID-19 and the Impact of Emerging and Disruptive Technologies.” In: COVID-19 Disinformation: A Multi-National, Whole of Society Perspective. Cham, CH: Springer International Publishing, 25–45. https://doi.org/10.1007/978-3-030-94825-2_2.
  • Reinike, W. J. 2020. The U.S. Financial System As a Network: Insight and Implications for Hybrid Warfare. Master’s Thesis, Monterey, CA: Naval Postgraduate School. https://apps.dtic.mil/sti/citations/AD1114705.
  • REPI (Readiness and Environmental Protection Integration Program). 2023. Using 10 U.S.C. §2684a and the Sikes Act (16 U.S.C. §670c-1) to Maintain or Improve Military Installation Resilience, Washington, D.C: U.S. Department of Defense. https://www.repi.mil/Portals/44/Documents/Resilience/ResilienceAuthorities_OCT2020.pdf.
  • Rico, L. G. 2022. NATO and Climate Change: A Climatized Perspective on Security. Report. Cambridge, MA: Belfer Center for Science and International Affairs, Kennedy School of Government, Harvard University. https://www.belfercenter.org/sites/default/files/files/publication/Belfer%20Nato_Climate%20Change_VF_1.pdf.
  • Roepke, W., and H. Thankey. 2019. “Resilience: The First Line of Defense.” NATO Review. https://www.nato.int/docu/review/articles/2019/02/27/resilience-the-first-line-of-defence/index.html.
  • Rose, A. 2004. “Defining and Measuring Economic Resilience to Disasters.” Disaster Prevention & Management: An International Journal 13 (4): 307–314. https://doi.org/10.1108/09653560410556528.
  • Schilling, J., S. L. Nash, T. Ide, J. Scheffran, R. Froese, and P. Von Prondzinski. 2017. “Resilience and Environmental Security: Towards Joint Application in Peacebuilding.” Global Change, Peace & Security 29 (2): 107–127. https://doi.org/10.1080/14781158.2017.1305347.
  • Selchow, S. 2017. “Resilience and Resilient in Obama’s National Security Strategy 2010: Enter Two ‘Political keywords’.” Politics 37 (1): 36–51. https://doi.org/10.1177/0263395715614847.
  • Sharifi, A. 2016. “A Critical Review of Selected Tools for Assessing Community Resilience.” Ecological Indicators 69:629–647. https://doi.org/10.1016/j.ecolind.2016.05.023.
  • Shea, J. 2016. “Resilience: A Core Element of Collective Defense.” NATO Review. https://www.nato.int/docu/review/articles/2016/03/30/resilience-a-core-element-of-collective-defence/index.html.
  • Sisto, A., F. Vicinanza, L. L. Campanozzi, G. Ricci, D. Tartaglini, and V. Tambone. 2019. “Towards a Transversal Definition of Psychological Resilience: A Literature Review.” Medicina 55 (11): 745. https://doi.org/10.3390/medicina55110745.
  • Smalenberger, D. M. 2015. On Pecuniary Resiliency, Early Warning, and Market Imitation Under Unrestricted Warfare. Doctoral Dissertation, Wright-Patterson Air Force Base, OH: Air Force Institute of Technology. https://scholar.afit.edu/etd/227/.
  • Small, C., G. Parnell, E. Pohl, S. Goerger, B. Cottam, E. Specking, and Z. Wade. 2018. “Engineering Resilience for Complex Systems.” In: Madni, A. M., B. Boehm, R. G. Ghanem, D. Erwin, and M. J. edited by Disciplinary Convergence in Systems Engineering Research, 3–15. Springer International Publishing. https://doi.org/10.1007/978-3-319-62217-0_1.
  • Smith, S. 2023. “Towards a Scientific Definition of Cyber Resilience.” Proceedings of the International Conference on Cyber Warfare and Security 18 (1): 379–386. https://doi.org/10.34190/iccws.18.1.960.
  • Stette, M., K. Porath, and S. Muehlich. 2023. “Civil-Military Cooperation for the Countering of Threats: Protection of Civilians During the Development of a Threat.” In K. Balomenos, P., A. Fytopoulos, and P.M. Pardalos. eds. Handbook for Management of Threats. Springer Optimization and Its Applications, Cham, CH: Springer. https://doi.org/10.1007/978-3-031-39542-0_23.
  • Sweijs, T., S. Zilincik, F. Bekkers, and R. Meessen. 2021. A Framework for Cross-Domain Strategies Against Hybrid Threats, Den Haag, NL: Hague Centre for Strategic Studies. https://euhybnet.eu/wp-content/uploads/2021/01/Framework-for-Cross-Domain-Strategies-against-Hybrid-Threats.pdf.
  • Terziyan, V., M. Gavriushenko, A. Girka, A. Gontarenko, and O. Kaikova. 2021. “Cloning and Training Collective Intelligence with Generative Adversarial Networks.” IET Collaborative Intelligent Manufacturing 3 (1): 64–74. https://doi.org/10.1049/cim2.12008.
  • Thornton, R., and M. Miron. 2020. “Towards the ‘Third Revolution in Military affairs’ the Russian military’s Use of AI-Enabled Cyber Warfare.” The RUSI Journal 165 (3): 12–21. https://doi.org/10.1080/03071847.2020.1765514.
  • Uday, P., and K. Marais. 2015. “Designing Resilient Systems‐Of‐Systems: A Survey of Metrics, Methods, and Challenges.” Systems Engineering 18 (5): 491–510. https://doi.org/10.1002/sys.21325.
  • Ungar, M., ed. 2021. Multisystemic Resilience: Adaptation and Transformation in Contexts of Change. New York, NY: Oxford University Press.
  • UN (United Nations). 2023. Resilience. UNTERM: The United Nations Terminology Database. https://unterm.un.org/unterm2/en/search?searchTerm=resilience.
  • U.S. Army. 2023. “Office of the Deputy Chief of Staff, Directorate of Prevent, Resilience and Readiness.” About the Directorate of Prevent, Resilience and Readiness. https://www.armyresilience.army.mil/ard/about-ARD.html.
  • van Mill, J. 2023. The Future of NATO’s Resilience Concepts and Wargaming. The Three Swords, Stavanger, NO: Concepts, Capability Integration and Experimentation Branch, NATO Joint Warfare Centre. https://www.jwc.nato.int/application/files/9616/9804/8578/RESILIENCE.pdf.
  • Vina, A., and J. Liu. 2023. “Effects of Global Shocks on the Evolution of an Interconnected World.” AMBIO: A Journal of the Human Environment 52 (1): 95–106. https://doi.org/10.1007/s13280-022-01778-0.
  • Vogler, A. 2023. “Tracking Climate Securitization: Framings of Climate Security by Civil and Defense Ministries.” International Studies Review 25 (2): viad010. https://doi.org/10.1093/isr/viad010.
  • Wells, E. M., M. Boden, I. Tseytlin, and I. Linkov. 2022. “Modeling Critical Infrastructure Resilience Under Compounding Threats: A Systematic Literature Review.” Progress in Disaster Science 15:100244. https://doi.org/10.1016/j.pdisas.2022.100244.
  • Wied, M., J. Oehmen, and T. Welo. 2020. “Conceptualizing Resilience in Engineering Systems: An Analysis of the Literature.” Systems Engineering 23 (1): 3–13. https://doi.org/10.1002/sys.21491.
  • Wigell, M., H. Mikkola, and T. Juntunen. 2021. “Best Practices in the Whole-Of-Society Approach in Countering Hybrid Threats.” Study for European Parliament, Brussels, BE: Directorate General for External Policies of the European Union. https://doi.org/10.2861/702047.
  • Woods, D. D. 2015. “Four Concepts for Resilience and the Implications for the Future of Resilience Engineering.” Reliability Engineering & System Safety 141:5–9. https://doi.org/10.1016/j.ress.2015.03.018.
  • Yodo, N., and P. Wang. 2016. “Engineering Resilience Quantification and System Design Implications: A Literature Survey.” Journal of Mechanical Design 138 (11): 111408. https://doi.org/10.1115/1.4034223.
  • Yu, D. J., M. L. Schoon, J. K. Hawes, S. Lee, J. Park, P. S. C. Rao, and S. V. Ukkusuri. 2020. “Toward General Principles for Resilience Engineering.” Risk Analysis 40 (8): 1509–1537. https://doi.org/10.1111/risa.13494.
  • Zampieri, M. 2021. “Reconciling the Ecological and Engineering Definitions of Resilience.” Ecosphere 12 (2): e03375. https://doi.org/10.1002/ecs2.3375.
  • Zekulić, V., C. Godwin, and J. Cole. 2017. “Reinvigorating Civil–Military Relationships in Building National Resilience.” The RUSI Journal 162 (4): 30–38. https://doi.org/10.1080/03071847.2017.1380376.

Appendix

Table A1. Example, non-exhaustive list of categorical forms of resilience in science.