Table of Contents Author Guidelines Submit a Manuscript
Volume 2018, Article ID 3074791, 16 pages
Research Article

Integrating “Hard” and “Soft” Infrastructural Resilience Assessment for Water Distribution Systems

1Water Research Institute-National Research Council (IRSA-CNR), viale F. de Blasio 5, 70132 Bari, Italy
2LAMSADE-CNRS, Paris Dauphine University, PSL University, Place du Maréchal de Lattre de Tassigny, 75016 Paris, France
3DICATECh, Politecnico di Bari, Via Orabona 4, 70125 Bari, Italy

Correspondence should be addressed to Alessandro Pagano; ti.rnc.asri.ab@onagap.ordnassela

Received 25 October 2017; Revised 23 April 2018; Accepted 12 May 2018; Published 14 June 2018

Academic Editor: Anand Nair

Copyright © 2018 Alessandro Pagano et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Cities are highly dynamic systems, whose resilience is affected by the interconnectedness between “hard” and “soft” infrastructures. “Hard infrastructures” are the functional networks with physical elements providing goods or services. “Soft infrastructures” (culture, governance, and social patterns) encompass the social networks, make the hard infrastructures work, and are vital for understanding the consequences of disasters and the effectiveness of emergency management. Although the dynamic interactions between such infrastructures are highly complex in the case of the occurrence of hazardous events, it is fundamental to analyze them. The reliability of hard infrastructures during emergency management contributes to keep alive the social capital, while the community, its networks, and its own resilience influence the service provided by infrastructural systems. Resilience-thinking frameworks overcome the limits of the traditional engineering-oriented approaches, accounting for complexity of socio-technical-organizational networks, bridging the static and dynamic components of disasters across pre- and postevent contexts. The present work develops an integrated approach to operatively assess resilience for the hard and soft infrastructural systems, aiming at modeling the complexity of their interaction by adopting a graph theory-based approach and social network analysis. The developed approach has been experimentally implemented for assessing the integrated resilience of the hard/soft infrastructures during the L’Aquila 2009 earthquake.

1. Introduction

Critical infrastructures (CIs) have an increasingly pivotal role for modern societies, providing services which are paramount for the welfare of citizens [1, 2]. They are vital systems, services, and assets, whose disruption or destruction may have severe impacts on the health, security, safety, or economic well-being of a community. Both human actions and natural disasters threaten the proper functioning of CIs, increasing the concerns about their reliability and safety level and making their improvement a key requirement in the field of crisis management [1]. Among the CIs, water supply infrastructures are crucial for both public health and economic reasons, and the assessment of water distribution network performance in case of disruptive events is thus a relevant research topic [3].

The analysis of CIs shows extraordinary complexity, mainly due to the interdependence inherited from their technological, social, and economic properties [4]. Particularly, the occurrence of disasters is characterized by interdependent and systemic risks that can trigger hardly predictable effects. Both risk identification and risk management tools are limited because they rely upon foreseeable factor analyses of steady-state systems with predictable hazard frequencies and severities ([5, 6]). These approaches are unsuitable to cope with unpredictable risks. Therefore, a shift from risk management toward resilience management is crucial, since a resilient system is capable of coping with not-expected/not-forecasted risks [2, 6, 7].

Resilience-based approaches have gained increasing recognition particularly in the field of infrastructural systems, given that infrastructure assets represent significant financial investments and provide essential societal value [8, 9], considering their increasing complexity and interdependency [4] and the importance of “black swan” (i.e., unanticipated or unpredictable) events [7]. Although multiple definitions of disaster resilience exist (see, e.g., [10]), a broad one identifies resilience as the property of a system impacted by a hazard to (i) resist the stresses, by withstanding hazards and limiting damage, and (ii) recover or be strengthened, thus returning within a given period time into acceptable levels of use and serviceability [8, 10]. Specifically referring to infrastructural systems, resilience accounts for resistive and adaptive capacities that support infrastructure functionality in times of crisis or stress, such as natural hazards [9, 11], even in the case where the stress is uncertain or not defined.

During a crisis, emergency management of CIs is even more complex due to the presence of different decision-makers (e.g., government, first responders, and community members), characterized by a dense network of interactions among them and with the system of infrastructures [1, 4]. The analysis of past disasters led researchers to investigate and model the connections between physical (“hard”) infrastructures (e.g., buildings, infrastructures, and utilities) and social (“soft”) infrastructures (e.g., social bonds between citizens and emergency management systems) (e.g., [1215]). The importance of integrating social and physical components to properly model resilience attributes of infrastructural systems, using a human-centric perspective, is crucial to understand and describe system performances [16, 17]. The need for integrated approaches has been introduced by Checkland’s framework [15] and also echoed by the Hyogo Framework for Action of the United Nations [18].

Among the available approaches for resilience assessment, the TOSE approach, stemmed from the activities carried out at the Multidisciplinary Center for Earthquake Engineering Research (MCEER), seems to be suitable for analyzing the hard/soft infrastructure interaction. According to this framework, resilience should be conceptualized as the joint ability of both physical and social systems to withstand external stresses and to cope with impacts through situation assessment, rapid response, and effective recovery strategies [19]. The TOSE approach is based on the integration of four dimensions: technical, organizational, social, and economic [19, 20]. Examples of the TOSE implementation in actual cases are available in [1, 21].

Although the need to address resilience through a multidimensional and integrated approach is widely accepted (e.g., [17, 22]), it is still challenging to develop quantitative measures and indicators in complex systems such as urban environments [17]. Most of the resilience-building principles defined in the literature do not cover all the dimensions that make up resilience, and there is still a gap between theory and practice in integrated resilience [1].

Starting from such premises, this work aims at operationalizing the TOSE approach to resilience, with specific reference to water distribution systems (WDS), proposing a quantitative framework to measure its dimensions. The basic assumption is that the urban system can be modeled as a set of interrelated networks (i.e., the “hard” infrastructural system and the “soft” one), which is capable of generating a collective behavior through the combination of simple local mechanisms, resulting in a complex behavior [22, 23]. The hard infrastructure is represented by the urban WDS, whereas the soft infrastructure is the social network for emergency management. A graph theory- (GT-) based approach is implemented in this work to assess the properties influencing the integrated resilience of CIs. The methodology is developed with specific reference to the well-known case of the 2009 L’Aquila earthquake, one of the most severe in the recent history of disasters.

2. Resilience Dimensions and Attributes

The present section aims at providing an overview of the main concepts related to resilience, according to the scientific literature, mainly focusing on its key properties, dimensions, and attributes. Particularly, based on the available literature, a conceptualization of resilience is proposed and used to build a framework to develop an integrated model to assess the resilience of CIs.

Several definitions of resilience currently exist. The National Academy of Sciences [24, 25] defines resilience as “the intrinsic ability of a system to prepare and plan for, absorb, recover from, and more successfully adapt to adverse events.” This definition becomes more articulated if a set of system properties is considered (e.g., [26, 27]): (i) absorptive capacity, that is, the resistance to shocks; (ii) adaptive capacities, connected to the possibility of meeting different demand/service levels; and (iii) restorative capacities, that is, the capability to return to, or beyond, equilibrium [9].

Resilience literature often highlights the need to understand and consider multiple contributing dimensions (e.g., [9, 20, 27]). For what concerns the resilience of complex networked systems, four dimensions should be particularly considered, that is, technical, organizational, social, and economic (TOSE approach, [19, 22]), which help describe both physical and nonphysical aspects. The four dimensions are described in detail: (i)The “technical” dimension of resilience focuses on the ability of the built environment to withstand and recover from disruptive events [19, 26]. It describes the capability of a system to perform adequately.(ii)The “organizational” dimension of resilience pertains to the function of organizations in managing facilities and postdisaster response activities [19]. It refers to the capacity of crisis managers to make decisions and take actions that lead to the avoidance of a crisis or at least to a reduction of its impact [1]. It typically encompasses measures of organizational capacity, planning, training, leadership, experience, and information management that improve disaster-related organizational performance and problem solving.(iii)The “social” dimension of resilience emphasizes the capacity of social ties and networks in limiting negative impacts from hazards [19, 28, 29]. It explains the response of society to disasters.(iv)The “economic” dimension of resilience refers to the capacity of systems to minimize, and rebound from, direct or indirect economic losses.

Opdyke et al. [9] underlined that among these dimensions, the most prevalently analyzed in literature are organizational, technical, and economic. A smaller number of works refer to social indicators. Several authors also argue that these dimensions are often studied separately without taking into account their interrelationship. An analysis of independent resilience dimensions could indeed be satisfactory, but crisis could also originate due to the lack of integration of these dimensions—for example, a valve could be the right one but operators might not have the required training for its proper use [1].

Given the multidimensionality of resilience, and the need for integrated approaches, system performances may be quantified in a number of ways, depending on the type of system under investigation. MCEER’s resilience framework consists of a set of attributes (“4R”) such as robustness, redundancy, resourcefulness, and rapidity and enables the characterization of system functionality (performance level) of the system at a particular time (e.g., [19, 20, 22]). Specifically: (i)Robustness is the “strength or the ability of elements, systems, or other units of analysis to withstand a given level of stress or demand without suffering degradation or loss of function” [19], that is, the inherent resistance of a system.(ii)Redundancy is “the extent to which elements, systems, or other units of analysis exist that are substitutable, i.e. capable of satisfying functional requirements in the event of disruption, degradation, or loss of functionality” [19]. It describes the availability of alternative resources.(iii)Resourcefulness is “the capacity to identify problems, establish priorities, and mobilize resources when conditions exist that threaten to disrupt some element, system, or other unit of analysis” [19]. It mainly depends on human skills and improvisation during the event.(iv)Rapidity is the “capacity to meet priorities and achieve goals in a timely manner in order to contain losses and avoid future disruption” [19], that is, the speed of the recovery phase.

Referring specifically to CI resilience assessment, a broad overview of the available tools and methods includes, for example, probabilistic methods, graph theory methods, fuzzy methods, and analytical methods [30]. However, such models have limitations in their implementation [1]. Because of the theoretical nature of current resilience frameworks, crisis managers have difficulties determining which activities or policies should be carried out to improve the resilience level of CIs [1]. In addition, most of the current sets of principles underestimate the role of external agents and their influence on improving the CIs’ resilience. Furthermore, most of the frameworks only define principles for improving organizational aspects without taking into account economic or social aspects, which are also influential in the resilience-building process [1]. Although there are several promising trends in resilience analysis, the landscape of resilience indicators is confusing and increasingly hard to navigate [22, 27]. A comprehensive and widely accepted model to quantify resilience is thus still missing, due to the complexity of the issue [30], and there is no single or widely accepted method to measure it. The challenge is to adopt a comprehensive methodology mixing both qualitative and quantitative resilience metrics or indicators, capable of describing multiple dimensions [9]. Among the available methods, the use of GT-based approaches is particularly relevant with the aim of providing an integrated and multidimensional insight into resilience. As detailed in Section 3, it is a flexible methodology, capable of being used both in hard and soft infrastructure analysis, with strongly quantitative roots and an explicit focus on topological and connectivity aspects of systems.

Starting from the available scientific literature and the widely acknowledged gaps in it, the present work aims at operationalizing resilience for CIs according to the following assumptions: (i) from a theoretical perspective, the TOSE framework is used to describe the multidimensionality of resilience; (ii) the “4R” set of attributes is used to characterize the main features of all such dimensions; (iii) an integrated approach is used to jointly assess resilience for the hard infrastructural system (i.e., the physical infrastructure, focusing specifically on drinking water supply) and the soft infrastructural system (i.e., the social network of agents, resources, tasks, and knowledge available during emergency); and (iv) GT is used to operationalize all the dimensions and attributes of resilience, and specific metrics are used to characterize hard and soft systems.

3. Methods: Graph Theory Metrics to Operationalize the TOSE Approach to Resilience

Complex systems can be interpreted and analyzed as networks, that is, abstract mathematical structures consisting of objects and their connections, and by the associated attributes. The analysis of the topology of networks is crucial since it is well known that the structure affects function [31, 32]. Network science therefore has important implications for understanding complex sociotechnical systems because, as discussed by several scholars (e.g., [31, 33]), complex systems’ properties and behavior are strongly affected by the network of connections among the different system elements [34].

Following the conceptual framework provided by the TOSE approach [19], resilience is conceptualized according to four dimensions (i.e., technical, operational, social, and economic), each one described through four key attributes, namely, robustness, redundancy, resourcefulness, and rapidity. Globally, 16 performance criteria are used to characterize the resilience of CIs, which are described in detail in Table 1.

Table 1: Performance criteria according to the TOSE approach (adapted from [19]).

Selected metrics of graph theory (GT) are used in the present work to operationalize the TOSE framework: (i) referring to the hard infrastructural system, a set of metrics capable of modeling the key aspects of resilience of WDS is identified; (ii) referring to the soft infrastructural system, social network analysis (SNA) is used to map and analyze the network of interactions among the different emergency responders, both institutional and noninstitutional.

The analysis of the hard infrastructural system mainly originates from the existing scientific knowledge, since some GT metrics were already associated to specific resilience dimensions/attributes for WDS (further details in Section 3.1). Results obtained in other systems (both benchmarks and real networks) were used for the purpose of comparison with the L’Aquila case. Starting from these evidence, the local water utility technicians supported identifying the most significant subset of metrics. As far as the soft infrastructure is concerned, the process of model building and validation was performed integrating SA (storytelling approach) and PSM (problem-structuring methods), to structure and analyze salient knowledge (as in [29]). Both expert (i.e., policymakers and first responders) and local community member knowledge was elicited, mainly concerning (i) the emergency management procedures, (ii) the role of information exchange, and (iii) the interactions taking place during a crisis. Focusing on the metrics, a broad set of suitable measures was identified by the authors among those available in ORA© software. Among the different available SNA methods, we referred to organizational risk analysis because it allows detecting the central elements in the network but also identifying and analyzing the main elements affecting the vulnerability of the network, that is, those elements whose failure could drastically reduce the effectiveness of the emergency management network, as discussed in [29]. The comparison among the resilience dimensions’ definition and the ORA measures’ definition allowed identifying the most suitable GT measure (see Sections 3.2 and 3.3 for further details).

3.1. Technical Dimension: Water Distribution System Modeling Based on the Graph Theory

Referring to CIs, resilience is the degree to which the system minimizes the level of service failure magnitude and duration over its design life when subject to exceptional conditions. This definition is particularly suitable for water distribution systems (WDS) [35].

Several research projects underlined the role of GT to provide a framework for the assessment of water infrastructure system performances, through the analysis of subsystem connections, topological redundancy, and identification of critical components [36]. Indeed, WDS can be basically represented as networks of nodes connected by links (e.g., [37]). Physical and hydraulic attributes (e.g., diameter, pressure, and flow rate) may be added to better characterize system components. GT-based approaches for water distribution systems are particularly important in the reliability field, supporting the identification of topologies minimizing service disruptions (e.g., [3639]) and the analysis of operation and failure conditions [36, 40].

In general, topology-based approaches to WDS pipe network analysis are less data-dependent and more computationally efficient to support initial assessments of WDS performance and reliability [38]. Referring to the wide set of GT metrics that are suggested in the scientific literature to describe the behavior of WDS, a direct connection with resilience dimension was already identified for the ones included in Table 2. A short description of such metrics is also provided, mainly in order to underline the specific relevance for WDS analysis. Starting from the measures included in Table 2, and referring also to literature evidence for both real and benchmark networks, the experts from the water utility supported in the selection of the most significant measures (highlighted in light grey in Table 2). Specifically, the technical robustness can be described referring to the density of bridges (), which estimates the percentage of the links/pipes whose failure may potentially disrupt water delivery by isolating a part of the network. The redundancy can be expressed using the meshedness coefficient (), which is typically a measure of network connectivity. The rapidity is described using the network efficiency , under the assumption that a more efficient network is also capable of recovering more rapidly from disruption. The technical resourcefulness, following the definition by [19], is considered either 0 or 1 according, respectively, to the absence or availability of monitoring and assessment systems.

Table 2: GT metrics used for the analysis of the technical dimension of resilience. The number of WDS nodes and links is denoted by and , respectively.

It is worth remarking that the selected metrics can provide a global description of network properties and a general assessment of the expected response to extreme events regardless of local aspects and of the specific hydraulic operation of the system. Detailed hydraulic simulations and modeling activities (see, e.g., [4143]) should be implemented in order to better investigate system performances.

3.2. Organizational and Social Dimensions: Social Network Analysis for Emergency Management

Evidence demonstrates the need for a coordinated involvement of experts and organizations from several fields for effective response to disasters [29, 47]. Nevertheless, understanding and managing the complex network of interactions involving the different responders—both formal and informal—is not a trivial task.

Emergency management networks are more emergent than planned [48]. Moreover, organizational structures, procedures, and responders’ roles could be altered in order to meet the demands of an exceptional event, such as an emergency situation [49]. Finally, interactions are activated, with noninstitutional actors (e.g., the society) playing crucial roles in responding to the emergency [29]. Therefore, the analysis of emergency management network cannot be based exclusively on existing and formalized relationships. Keeping track of the interactions taking place during an emergency management is difficult, hampering the capabilities of analysts and researchers to implement quantitative methods for the analysis [48].

Following Giordano et al. [29], quantitative social network analysis (SNA) and problem structuring methods were integrated in order to collect responders’ narratives and to structure them in a graphical map of interactions. Among the different methods available in the scientific literature for modeling and analyzing social networks (e.g., [5052]), the organizational risk analysis (ORA) approach was implemented in this work [53].

The underlying assumption is that an organization could be conceived as a set of interlocked networks connecting entities such agents, knowledge, tasks, and resources [54]. The interlocked networks can be represented using the metamatrix conceptual framework, which accounts for the role of knowledge and tasks and of the interconnections among the key elements (i.e., agents A, knowledge K, tasks T, and resources R) considering their specific weight/importance. Additional details on the methodology are available in Giordano et al. [29]. Following Carley [54] and Giordano et al. [29], the following metamatrix was used (Table 3).

Table 3: Metamatrix framework showing the connections among the key entities of social network (adapted from [54]).

The map was developed using the ORA© software [54], developed by the Centre for Computational Analysis of Social and Organizational Systems of the Carnegie Mellon University. According also to GT, the strength of edges is analyzed considering the weights for the links. In this work, the metamatrix approach was used to unravel the complexity of interactions in the soft infrastructural system, particularly identifying the key properties affecting resilience according to the cited approach.

Among the different GT measures available for analyzing social networks (e.g., [55, 56]), we referred to the measures described in Tables 4 and 5. The organizational criteria of the TOSE approach refer to the water utility characteristics (Table 4), whereas the social criteria refer to the local community characteristics in the network of interactions (Table 5).

Table 4: GT measures for the analysis of the organizational dimension of resilience.
Table 5: GT measures for the analysis of the social dimension of resilience.

With specific reference to the water utility, the assumption is that its position in the map of interactions affects its capability to mobilize resources, both economic and informational, needed to cope with an emergency. The social dimension of the resilience accounts, instead, for the capability of the local community to access important information and to interact with important responders.

The robustness of the water utility (organization) relies on the organization’s capability to access important information for carrying out the required tasks, even in case of failures of part of the interaction network (e.g., some connections could not be available in a critical situation). Therefore, referring to Table 4, the agent-knowledge congruence measure was adopted. Similarly, we considered the water utility as organizationally redundant if it has access to multiple sources of knowledge to perform its tasks (out-degree centrality in the agent × knowledge network). The water utility could be considered as a resourceful actor if it could be listed among the emergent leaders in the social network, that is, if it is capable of mobilizing critical resources during a crisis (cognitive demand). Finally, the water utility could rapidly react (rapidity) to a crisis if it has fast access to information and resources (closeness centrality).

Concerning the social dimension of the resilience framework, GT measures were selected in order to assess the capability of local communities to change behaviors—as water users—and to affect positively the infrastructure resilience. We assume here that the community behavior is influenced by the interaction with the other agents and thus if it could activate alternative connections in order to gather useful information to cope with the emergency (capability). A community could be considered redundant in the resilience framework if it has a high degree of hub centrality. This means that it receives information from different sources and shares information with well-connected nodes. The community is a resourceful agent if it has a high degree of cognitive demand. Finally, the community could rapidly react to a crisis if it has a high closeness centrality.

3.3. Economic Dimension of Resilience

Following [19], the economic resilience measures can be defined referring to the ability of the system to limit losses and recover quickly performances after disasters. The economic impacts concern both the hard and the soft infrastructural systems, thus requiring the adoption of a hybrid set of GT metrics, which are summarized in Tables 6 and 7. Particularly, the economic resilience takes into account features of the system that either guarantee a limitation of damages or increase the accessibility to resources that are useful in supporting emergency management operations.

Table 6: Economic dimension of resilience: GT measures related to the hard infrastructural system.
Table 7: Economic dimension of resilience: GT measures related to the soft infrastructural system.

4. Overview of the Case Study: The 2009 L’Aquila Earthquake

L’Aquila province (central Italy) was struck by a severe earthquake on the 6th of April 2009. The magnitude was relatively moderate (6.3), but it revealed the very high vulnerability of lives, livelihoods, building stock, and institutions [57, 58]. The L’Aquila old city was declared unsafe and made off-limits with military control, and the community was moved out of destroyed and damaged buildings. A complex recovery phase characterized the whole area [59, 60].

Focusing on the infrastructural systems, the emergency management of CIs guaranteed a rapid and effective response to the earthquake [61, 62]. With specific reference to the water supply systems, an important water pipe within the “Gran Sasso Aqueduct” failed due to the presence of a fault activated during the earthquake [61, 62]. Furthermore, some minor damage on the supply system (slippage/breakage of the joints and breaking of cast iron pipes) was also observed [63]. Individual interviews with the technicians working for the local water utility (Gran Sasso Acqua SpA) confirmed that one of the most critical points in supporting the operation of the whole system was the distribution of several local breaks (e.g., in pipes serving single buildings), which caused severe functionality issues [21]. The urban WDS showed only a partial flexibility and limited adaptation capacity to provide the required service to citizens, considering the change in population distribution (e.g., people moved to temporary shelters or to other cities) and the need to close entire districts of the network (due to high ratio of volume lost). It is worth mentioning that, as a consequence of the high level of damage that occurred and of the changes in urban asset, the WDS was completely redesigned and is currently being rebuilt, after the earthquake.

The L’Aquila earthquake got a great interest worldwide also due to a series of scandals and controversies that are still ongoing. One of the most controversial issues related to the earthquake was the trial and prosecution of seven functionaries of the Italian National Department of Civil Protection (DPC), mainly due to the kind of information on the event shared with the community. Some citizens had acted on that information and consequently had lost their lives [58]. In general, in the aftermath of the disaster, the centralized emergency management has been debated [60].

The analysis of the L’Aquila earthquake thus represents an interesting opportunity to analyze in detail the interconnectedness of hard and soft infrastructural systems and to prove the importance of jointly assessing their resilience.

5. Results

According to the methodology description proposed in Section 3, Table 8 summarizes the GT measures used in the present work in order to characterize the dimensions of resilience according to the TOSE approach. The measures refer either to the hard (GT(h)) or to the soft (GT(s)) infrastructural system. Particularly, referring to the soft system, it also made explicit reference to the agent/resource or the specific matrix the measures are computed for. All the measures included vary between 0 and 1, denoting increasing values of resilience. Full details on the results and the values obtained for the case study are included in the following subsections. More specifically, Sections 5.1, 5.2, and 5.3 provide a detailed analysis of the results of the methodology in the “baseline” condition, that is, with specific reference to the earthquake in 2009, whereas a scenario analysis is proposed in Section 5.4.

Table 8: GT measures used to assess the performance criteria according to the TOSE approach.
5.1. “Hard” Infrastructural System: L’Aquila WDS

The following Figure 1(a) represents the urban WDS of L’Aquila, as it was before the earthquake. Figure 1(b) is the representation of the same system according to GT convention. The key characteristics of the system, along with the selected metrics, are summarized in Table 9. According to the definitions of the metrics proposed in Section 3.1 and considering for the purpose of comparison the values available for other networks in the cited literature, the high density of bridges , along with the low value of the critical breakdown ratio , contributes to suggest a low resilience of the network. The value of the meshedness coefficient assimilates the network to a tree-like structure, which is in general easier to control but also characterized by lower adaptation capacity and flexibility.

Figure 1: (a) Representation of L’Aquila WDS. The elements in red represent the main pipes of the system, whereas the elements in black are part of the distribution network. (b) Representation of L’Aquila WDS according to GT metrics.
Table 9: Summary of a selected subset of characteristics of the WDS of L’Aquila according to GT.
5.2. “Soft” Infrastructural System: L’Aquila Emergency Management Network

This section describes the implementation of SNA to unravel the complexity of the emergency management interaction network. The methodology used for knowledge elicitation and structuring, and for mapping the network of interactions according to the metamatrix approach, is the same as discussed by [29].

Particularly, the integration of SA and PSM allowed reconstruction of the emergency management interaction network, according to the perception of both institutional and noninstitutional agents. Two main steps were performed: (a) semistructured individual interviews were performed to elicit individual knowledge and (b) participatory modeling exercises were designed and implemented, in two different moments, for collecting additional knowledge. The first participatory modeling exercise was focused on the retrospective analysis of the 2009 L’Aquila earthquake (“baseline” scenario). The second one oriented to the identification of the main criticalities of the system and on potential changes/strategies. For the purpose of the SNA, participants described their role in emergency management and the tasks they have to carry out. They also identified the information and the resources needed to perform their activities and other actors providing/owning information and resources. They thus built the list of elements proposed in Table 10 and then suggested the connections represented in Figure 2, based on the understanding of roles, interdependencies, tasks, resources, and information flows. The participatory modeling exercises (Section 3) were used for validating the map in Figure 2 and the lists of Table 10, which reflects the metamatrix approach detailed in Section 3.2.

Table 10: List of the agents, tasks, knowledge, and resources suggested by the stakeholders and included in the metamatrix approach.
Figure 2: Representation of the emergency management network in L’Aquila. Agents are identified in red, information in green, tasks in blue, and resources in pale blue.

The result of the SNA was the map of interactions for emergency management proposed in Figure 2. This map was used for analyzing the actual role of two key important responders in the integrated resilience assessment framework, that is, the water utility and the local community.

5.3. Integrated Resilience Analysis

The GT measures described in Table 8 were implemented to assess the integrated resilience for the water distribution system in L’Aquila. The results obtained for both the hard and soft infrastructural systems are proposed in Table 11 and Figure 3.

Table 11: Summary of the resilience measures in the L’Aquila case study.
Figure 3: Spider graphs showing the values of specific components of resilience according to the metrics defined in Table 11.

The representation proposed in Figure 3 is highly relevant in order to have an overview of the specific role of single dimensions of resilience. This could help to identify weak points negatively contributing to the resilience of the whole system (e.g., lack of organizational skills/capabilities or physical limits for the CI) and, consequently, to select the most suitable and effective strategies to increase resilience. Such representation could be used with the aim of both assessing the current state of the system and quantifying the impact of the introduction of specific resilience-enhancing strategies or measures.

The results of this analysis allowed us to draw some hints concerning the main reasons of the infrastructure failures during the earthquake crisis. Although the network is quite robust, it is worth noticing that the density of bridges is high, and this may result in the possibility of easily isolating portions of the network. The redundancy is low, since the connectivity of the network is limited, the WDS being more similar to a tree-like system than a grid-like one. The network has a very low efficiency, which may result in the impossibility of rapidly adapting to new operating conditions. The resourcefulness is set to 0, since no effective monitoring or control systems were available at the time of the earthquake.

Figure 3 shows also the very limited contribution of the organizational and social dimensions to the integrated resilience of the water distribution network. This was mainly due to the limited capability of the water utility (organization) to have access to information needed to cope with the emergency. Although it demonstrated the capability to activate resources, it had only few short connections with the other responders, reducing the rapidity index. Moreover, the organization’s robustness was low because of the lack of pieces of knowledge needed for dealing with the emergency. The lack of a geographical information system for systematizing the knowledge of the existing network negatively affected this index.

Similarly, the social components of the network—that is, local community—did not have a positive impact on the integrated resilience. As shown in Figure 3, the local community has a relatively high robustness degree, because of the dense network of interactions within the community and with the other agents. Nevertheless, the limited accessibility of important information kept low the values of the redundancy and robustness indexes. Finally, the low level of closeness centrality (long connection paths) had a negative impact on the rapidity of reaction.

Referring to the economic dimension, the low critical breakdown ratio suggests a limited robustness of the old WDS, due to the high amount of damages (and repairs required) and limitations to service. Economic resources to perform the tasks required in emergency management had limited availability, due to scarce preparedness of institutional agents and to other phenomena that conditioned the aftermath of the disaster (e.g., people not able to pay taxes and fees), limiting the economic resilience of the system.

5.4. Scenario Analysis

The developed methodology for integrated resilience assessment was implemented with a twofold objective: firstly, as detailed in Section 5.3, to estimate the resilience level with specific reference to the 2009 L’Aquila earthquake, accounting for both the hard and soft infrastructural components, and secondly, as described in the present section, to analyze the impact of specific resilience-enhancing strategies, selected taking into account both components and their multiple dimensions. Particularly, the scenario analysis aims at showing that, although the performances of hard infrastructures are crucial to cope with severe disruption and thus directly contributing to resilience, the role of soft infrastructures is relevant as well to deal with crisis. Enhancing resilience thus requires both improving the physical system (e.g., through maintenance, adaptation, and reconstruction) and acting on soft infrastructures (e.g., on organizational culture, awareness raising, and preparedness/emergency planning), usefully comprising a portfolio of interventions [64, 65]. The integration of these options may suggest investments into systemic interventions, which may bring large benefits in building resilience, showing also a remarkably better cost/benefit ratio (despite some difficulties in correctly estimating economic efficiency of soft measures) [65].

More specifically, two scenarios are discussed for the L’Aquila case study: (i)Scenario (1) considers a change in the hard infrastructural system, that is, the reconstruction of the water supply infrastructure with an improvement in its technical performances.(ii)Scenario (2) analyzes a combined change in the hard and soft infrastructural system, that is, an improvement of system resilience acting both on the water supply system and on the effectiveness of the emergency management network.

Going further into details, scenario (1) is defined considering that the water supply system was redesigned (and is currently being built) after the earthquake. In fact, due to the high ratio of breaks in the urban WDS, to the dramatic changes in the distribution of population (and thus in demand pattern), and to the need of restoring/rebuilding several infrastructural systems at the same time, the hard infrastructure was completely restructured, based on innovative design criteria (e.g., the identification of districts for water supply and the improvement of the systems for network control). The metrics related to the hard infrastructural system were thus computed referring to the “new” WDS. Scenario (2) is built, instead, considering the joint impact of specific improvements in the emergency management network. The relevance of this scenario stems from the identification and analysis, during the participatory exercises, of some significant changes that occurred in the “soft” infrastructural system after the earthquake. Specifically, the connections between the community (C) and the water utility (WU) were significantly strengthened, as well as the connection between the WU and the other key agents involved in emergency management, due to an improved effectiveness of the emergency management plan and an increased experience in emergency management operations. From the SNA point of view, the main improvements of the emergency management network are (i) an increase in the number and strength of connections between agents, particularly referring to both incoming and outgoing connections between C and WU and the emergency managers (A × A matrix), (ii) an improved access to procedural information for both agents (A × K matrix, IP1, IP2, IP3, and IP4), and (iii) an improved access to resources to perform the required tasks, particularly for the WU (increased human and economic resources). The GT measures described in Table 8 allowed us to assess the benefits due to the changes in the interaction network. As expected, the robustness of both the organizational and social dimensions increased. This is mainly due to the increase in the number and strength of the connections. The results of this analysis have been used as basis for the debate aiming at improving the protocol for emergency management. The main institutional actors were involved in this ongoing process. Some important decisions were already taken—that is, involvement of the water utility in the protocol for intervention—but the process is still in its early phases.

Table 12 summarizes the results of scenarios (1) and (2), while Figures 4 and 5 include a comparison between both scenarios and the reference condition described in Figure 3. It can be easily argued that multiple actions may contribute to changes on different dimensions of resilience, globally concurring to an increase in resilience levels. The resilience-enhancing strategies merely oriented to improve the hard infrastructural system are definitely effective (scenario (1)), but it should be considered that acting on multiple dimensions of resilience of both hard and soft infrastructural systems might have a better effect (see, e.g., social and economic dimensions) on system response to disasters (scenario (2)).

Table 12: Summary of the resilience assessment model in the L’Aquila case study, referring to scenarios (1) and (2).
Figure 4: Spider graph showing the values of specific components of resilience according to the metrics defined in Table 12, referring to scenario (1).
Figure 5: Spider graph showing the values of specific components of resilience according to the metrics defined in Table 12, referring to scenario (2).

6. Conclusions

The present work aims at operationalizing the resilience concept for CIs. The results of the L’Aquila case study demonstrates that dealing with complexity—for example, managing emergency situation in complex systems—claims for integrated approaches based on the interaction between hard and soft infrastructural systems. The TOSE approach is used as a conceptual framework to model the multidimensionality of resilience, along with the 4Rs’ set of attributes (robustness, redundancy, resourcefulness, and rapidity). Selected GT metrics are used to identify a set of properties which may be used to characterize the dimensions of CIs. The methodology was developed with specific reference to the well-known case of the L’Aquila earthquake. The hints from the case study allow us to state that the method described in this work, due to its capability to address the multidimensional nature of the system resilience, facilitates decision-makers in identifying the main criticalities in both soft and hard infrastructural systems and in suggesting effective resilience-enhancing strategies.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this manuscript.


The research activities described in this work have been financially supported by the EDUCEN Project (EC contract no. 653874) within the H2020. The authors would like to thank the institutional and noninstitutional stakeholders that provided their knowledge and expertise as the basis of this work.


  1. L. Labaka, J. Hernantes, and J. M. Sarriegi, “Resilience framework for critical infrastructures: an empirical study in a nuclear plant,” Reliability Engineering & System Safety, vol. 141, pp. 92–105, 2015. View at Publisher · View at Google Scholar · View at Scopus
  2. A. A. Ganin, E. Massaro, A. Gutfraind et al., “Operational resilience: concepts, design and analysis,” Scientific Reports, vol. 6, no. 1, article 19540, 2016. View at Publisher · View at Google Scholar · View at Scopus
  3. F. Cubillo and Á. Martínez-Codina, “A metric approach to measure resilience in water supply systems,” Journal of Applied Water Engineering and Research, pp. 1–12, 2017. View at Publisher · View at Google Scholar · View at Scopus
  4. I. Linkov and J. M. Palma-Oliveira, Resilience and Risk: Methods and Application in Environment, Cyber and Social Domains, NATO Scien. Springer, 2017. View at Publisher · View at Google Scholar
  5. C. Folke, “Resilience: the emergence of a perspective for social-ecological systems analyses,” Global Environmental Change, vol. 16, no. 3, pp. 253–267, 2006. View at Publisher · View at Google Scholar · View at Scopus
  6. A. Cavallo and V. Ireland, “Preparing for complex interdependent risks: a system of systems approach to building disaster resilience,” International Journal of Disaster Risk Reduction, vol. 9, pp. 181–193, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. N. R. Sikula, J. W. Mancillas, I. Linkov, and J. A. McDonagh, “Risk management is not enough: a conceptual model for resilience and adaptation-based vulnerability assessments,” Environment Systems and Decisions, vol. 35, no. 2, pp. 219–228, 2015. View at Publisher · View at Google Scholar · View at Scopus
  8. A. Mebarki, “Resilience : theory and metrics—a metal structure as demonstrator,” Engineering Structures, vol. 138, pp. 425–433, 2017. View at Publisher · View at Google Scholar · View at Scopus
  9. A. Opdyke, A. Javernick-will, and M. Koschmann, “Infrastructure hazard resilience trends: an analysis of 25 years of research,” Natural Hazards, vol. 87, no. 2, pp. 773–789, 2017. View at Publisher · View at Google Scholar · View at Scopus
  10. D. E. Alexander, “Resilience and disaster risk reduction: an etymological journey,” Natural Hazards and Earth System Sciences, vol. 13, no. 11, pp. 2707–2716, 2013. View at Publisher · View at Google Scholar · View at Scopus
  11. A. Pagano, R. Giordano, I. Portoghese, U. Fratino, and M. Vurro, “A Bayesian vulnerability assessment tool for drinking water mains under extreme events,” Natural Hazards, vol. 74, no. 3, pp. 2193–2227, 2014. View at Publisher · View at Google Scholar · View at Scopus
  12. E. Booth, “Dealing with earthquakes: the practice of seismic engineering ‘as if people mattered,’,” Bulletin of Earthquake Engineering, vol. 16, no. 4, pp. 1661–1724, 2018. View at Publisher · View at Google Scholar · View at Scopus
  13. S. Baez Ullberg and J. Warner, “The relevance of soft infrastructure in disaster management and risk reduction,” UN Chronicle, vol. 53, no. 3, pp. 23–26, 2016. View at Publisher · View at Google Scholar
  14. A. Wesselink, J. Warner, M. A. Syed et al., “Trends in flood risk management in deltas around the world: are we going ‘soft’?” International Journal of Water Governance, vol. 3, no. 4, pp. 25–46, 2016. View at Publisher · View at Google Scholar
  15. P. Checkland, “Soft systems methodology : a thirty year retrospective,” Systems Research and Behavioral Science, vol. 17, no. S1, pp. S11–S58, 2000. View at Publisher · View at Google Scholar
  16. E. Arneson, D. Deniz, A. Javernick-Will, A. Liel, and S. Dashti, “Information deficits and community disaster resilience,” Natural Hazards Review, vol. 18, no. 4, article 04017010, 2017. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Bozza, D. Asprone, and G. Manfredi, “Developing an integrated framework to quantify resilience of urban systems against disasters,” Natural Hazards, vol. 78, no. 3, pp. 1729–1748, 2015. View at Publisher · View at Google Scholar · View at Scopus
  18. UNISDR, Hyogo Framework for Action 2005–2015: Building the Resilience of Nations and Communities to Disasters, United Nations, Geneva, 2005.
  19. M. Bruneau, S. E. Chang, R. T. Eguchi et al., “A framework to quantitatively assess and enhance the seismic resilience of communities,” Earthquake Spectra, vol. 19, no. 4, pp. 733–752, 2003. View at Publisher · View at Google Scholar · View at Scopus
  20. K. Tierney and M. Bruneau, “Conceptualizing and measuring resilience: a key to disaster loss reduction,” Transportation Research Board, vol. 250, pp. 14–18, 2007. View at Google Scholar
  21. A. Pagano, I. Pluchinotta, R. Giordano, and M. Vurro, “Drinking water supply in resilient cities: notes from L’Aquila earthquake case study,” Sustainable Cities and Society, vol. 28, pp. 435–449, 2017. View at Publisher · View at Google Scholar · View at Scopus
  22. G. P. Cimellaro, C. Renschler, A. M. Reinhorn, and L. Arendt, “PEOPLES: a framework for evaluating resilience,” Journal of Structural Engineering, vol. 142, no. 10, article 04016063, 2016. View at Publisher · View at Google Scholar · View at Scopus
  23. T. D. O’Rourke, “Critical infrastructures, interdependencies and resilience,” BRIDGE-Washington-National Academy of Engineering, vol. 37, no. 1, pp. 22–29, 2007. View at Google Scholar
  24. National Research Council, Disaster Resilience: a National Imperative, The National Academies Press, Washington DC, 2012.
  25. E. B. Connelly, C. R. Allen, K. Hatfield, J. M. Palma-Oliveira, D. D. Woods, and I. Linkov, “Features of resilience,” Environment Systems and Decisionss, vol. 37, no. 1, pp. 46–50, 2017. View at Publisher · View at Google Scholar · View at Scopus
  26. E. D. Vugrin, D. E. Warren, M. A. Ehlen, and R. C. Camphouse, “A framework for assessing the resilience of infrastructure and economic systems,” in Sustainable and Resilient Critical Infrastructure Systems: Simulation, Modeling, and Intelligent Engineering, K. Gopalakrishnan and S. Peeta, Eds., pp. 77–116, Springer Berlin Heidelberg, Berlin, Heidelberg, 2010. View at Google Scholar
  27. R. Francis and B. Bekera, “A metric and frameworks for resilience analysis of engineered and infrastructure systems,” Reliability Engineering & System Safety, vol. 121, pp. 90–103, 2014. View at Publisher · View at Google Scholar · View at Scopus
  28. D. P. Aldrich and M. A. Meyer, “Social capital and community resilience,” American Behavioral Scientist, vol. 59, no. 2, pp. 254–269, 2014. View at Publisher · View at Google Scholar · View at Scopus
  29. R. Giordano, A. Pagano, I. Pluchinotta, R. O. del Amo, S. M. Hernandez, and E. S. Lafuente, “Modelling the complexity of the network of interactions in flood emergency management: the Lorca flash flood case,” Environmental Modelling & Software, vol. 95, pp. 180–195, 2017. View at Publisher · View at Google Scholar · View at Scopus
  30. G. P. Cimellaro, Urban Resilience for Emergency Response and Recovery, Springer International Publishing, Switzerland, 2016.
  31. S. H. Strogatz, “Exploring complex networks,” Nature, vol. 410, no. 6825, pp. 268–276, 2001. View at Publisher · View at Google Scholar · View at Scopus
  32. J. W. Wang, “Universal robustness of scale-free networks against cascading edge failures,” Complexity, vol. 17, no. 6, 23 pages, 2012. View at Publisher · View at Google Scholar · View at Scopus
  33. A.-L. Barabási, Network Science, Cambridge university press, Cambridge, 2015.
  34. M. Tran, “Modeling sustainability transitions on complex networks,” Complexity, vol. 19, no. 5, 22 pages, 2014. View at Publisher · View at Google Scholar · View at Scopus
  35. K. Diao, C. Sweetapple, R. Farmani, G. Fu, S. Ward, and D. Butler, “Global resilience analysis of water distribution systems,” Water Research, vol. 106, pp. 383–393, 2016. View at Publisher · View at Google Scholar · View at Scopus
  36. A. Yazdani and P. Jeffrey, “Complex network analysis of water distribution systems,” Chaos, vol. 21, no. 1, article 016111, 2011. View at Publisher · View at Google Scholar · View at Scopus
  37. A. Yazdani and P. Jeffrey, “Water distribution system vulnerability analysis using weighted and directed network models,” Water Resources Research, vol. 48, no. 6, 2012. View at Publisher · View at Google Scholar · View at Scopus
  38. J. M. Torres, L. Duenas-Osorio, Q. Li, and A. Yazdani, “Exploring topological effects on water distribution system performance using graph theory and statistical models,” Journal of Water Resources Planning and Management, vol. 143, no. 1, article 04016068, 2017. View at Publisher · View at Google Scholar · View at Scopus
  39. L. Perelman and A. Ostfeld, “Topological clustering for water distribution systems analysis,” Environmental Modelling & Software, vol. 26, no. 7, pp. 969–972, 2011. View at Publisher · View at Google Scholar · View at Scopus
  40. A. Ostfeld, “Water distribution systems connectivity analysis,” Journal of Water Resources Planning and Management, vol. 131, no. 1, pp. 58–66, 2005. View at Publisher · View at Google Scholar · View at Scopus
  41. S. Atkinson, R. Farmani, F. A. Memon, and D. Butler, “Reliability indicators for water distribution system design: comparison,” Journal of Water Resources Planning and Management, vol. 140, no. 2, pp. 160–168, 2014. View at Publisher · View at Google Scholar · View at Scopus
  42. S. N. Mugume, D. E. Gomez, G. Fu, R. Farmani, and D. Butler, “A global analysis approach for investigating structural resilience in urban drainage systems,” Water Research, vol. 81, pp. 15–26, 2015. View at Publisher · View at Google Scholar · View at Scopus
  43. D. Butler, S. Ward, C. Sweetapple et al., “Reliable, resilient and sustainable water management: the Safe & SuRe approach,” Global Challenges, vol. 1, no. 1, pp. 63–77, 2017. View at Publisher · View at Google Scholar
  44. A. Yazdani, R. A. Otoo, and P. Jeffrey, “Resilience enhancing expansion strategies for water distribution systems: a network theory approach,” Environmental Modelling & Software, vol. 26, no. 12, pp. 1574–1582, 2011. View at Publisher · View at Google Scholar · View at Scopus
  45. A. Yazdani, L. Dueñas-Osorio, and Q. Li, “A scoring mechanism for the rank aggregation of network robustness,” Communications in Nonlinear Science and Numerical Simulation, vol. 18, no. 10, pp. 2722–2732, 2013. View at Publisher · View at Google Scholar · View at Scopus
  46. E. Porse and J. Lund, “Network analysis and visualizations of water resources infrastructure in California: linking connectivity and resilience,” Journal of Water Resources Planning and Management, vol. 142, no. 1, article 04015041, 2016. View at Publisher · View at Google Scholar · View at Scopus
  47. K. Hardy and L. K. Comfort, “Dynamic decision processes in complex, high-risk operations: the Yarnell Hill Fire, June 30, 2013,” Safety Science, vol. 71, pp. 39–47, 2015. View at Publisher · View at Google Scholar · View at Scopus
  48. N. Kapucu and F. Demiroz, “The soma mine accident case, Turkey,” in The Routledge Handbook of Global Public Policy and Administration, p. 207, Routledge, 2016. View at Google Scholar
  49. R. McMaster and C. Baber, “Multi-agency operations: cooperation during flooding,” Applied Ergonomics, vol. 43, no. 1, pp. 38–47, 2012. View at Publisher · View at Google Scholar · View at Scopus
  50. S. P. Borgatti, “Identifying sets of key players in a social network,” Computational and Mathematical Organization Theory, vol. 12, no. 1, pp. 21–34, 2006. View at Publisher · View at Google Scholar · View at Scopus
  51. K. Ingold, “Network structures within policy processes: coalitions, power, and brokerage in Swiss climate policy,” Policy Studies Journal, vol. 39, no. 3, pp. 435–459, 2011. View at Publisher · View at Google Scholar · View at Scopus
  52. J. Lienert, F. Schnetzer, and K. Ingold, “Stakeholder analysis combined with social network analysis provides fine-grained insights into water infrastructure planning processes,” Journal of Environmental Management, vol. 125, pp. 134–148, 2013. View at Publisher · View at Google Scholar · View at Scopus
  53. K. M. Carley, “Computational organizational science and organizational engineering,” Simulation Modelling Practice and Theory, vol. 10, no. 5–7, pp. 253–269, 2002. View at Publisher · View at Google Scholar
  54. K. M. Carley, “Organizational design and assessment in cyber-space,” in Organizational Simulation, pp. 389–423, John Wiley & Sons, Inc., Hoboken, NJ, USA, 2005. View at Publisher · View at Google Scholar · View at Scopus
  55. L. C. Freeman, “Centrality in social networks conceptual clarification,” Social Networks, vol. 1, no. 3, pp. 215–239, 1978. View at Publisher · View at Google Scholar · View at Scopus
  56. K. M. Carley, J. Diesner, J. Reminga, and M. Tsvetovat, “Toward an interoperable dynamic network analysis toolkit,” Decision Support Systems, vol. 43, no. 4, pp. 1324–1347, 2007. View at Publisher · View at Google Scholar · View at Scopus
  57. D. E. Alexander, “The L’Aquila earthquake of 6 April 2009 and Italian government policy on disaster response,” Journal of Natural Resources Policy Research, vol. 2, no. 4, pp. 325–342, 2010. View at Publisher · View at Google Scholar · View at Scopus
  58. D. E. Alexander, “Communicating earthquake risk to the public: the trial of the “L’Aquila Seven”,” Natural Hazards, vol. 72, no. 2, pp. 1159–1173, 2014. View at Publisher · View at Google Scholar · View at Scopus
  59. G. M. Calvi and V. Spaziante, “La ricostruzione tra provvisorio e definitivo: Il Progetto C. A. S. E. [The reconstruction between temporary and definitive: the C. A. S. E. Project] in Italian,” Progettazione Sismica, vol. 3, pp. 227–252, 2009. View at Google Scholar
  60. G. Forino, “Disaster recovery: narrating the resilience process in the reconstruction of L’Aquila (Italy),” Geografisk Tidsskrift-Danish Journal of Geography, vol. 115, no. 1, pp. 1–13, 2014. View at Publisher · View at Google Scholar · View at Scopus
  61. A. Pagano, I. Pluchinotta, R. Giordano, A. B. Petrangeli, U. Fratino, and M. Vurro, “Dealing with uncertainty in decision-making for drinking water supply systems exposed to extreme events,” Water Resources Management, vol. 32, no. 6, pp. 2131–2145, 2018. View at Publisher · View at Google Scholar · View at Scopus
  62. M. Dolce and D. Di Bucci, “Comparing recent Italian earthquakes,” Bulletin of Earthquake Engineering, vol. 15, no. 2, pp. 497–533, 2017. View at Publisher · View at Google Scholar · View at Scopus
  63. I. Kongar, S. Esposito, and S. Giovinazzi, “Post-earthquake assessment and management for infrastructure systems: learning from the Canterbury (New Zealand) and L’Aquila (Italy) earthquakes,” Bulletin of Earthquake Engineering, vol. 15, no. 2, pp. 589–620, 2017. View at Publisher · View at Google Scholar · View at Scopus
  64. M. Omer, A. Mostashari, and U. Lindemann, “Resilience analysis of soft infrastructure systems,” Procedia Computer Science, vol. 28, pp. 565–574, 2014. View at Publisher · View at Google Scholar · View at Scopus
  65. R. Mechler, “Reviewing estimates of the economic efficiency of disaster risk management: opportunities and limitations of using risk-based cost–benefit analysis,” Natural Hazards, vol. 81, no. 3, pp. 2121–2147, 2016. View at Publisher · View at Google Scholar · View at Scopus