Research Article | Open Access
Viviane M. Gomes, Joao R. B. Paiva, Marcio R. C. Reis, Gabriel A. Wainer, Wesley P. Calixto, "Mechanism for Measuring System Complexity Applying Sensitivity Analysis", Complexity, vol. 2019, Article ID 1303241, 12 pages, 2019. https://doi.org/10.1155/2019/1303241
Mechanism for Measuring System Complexity Applying Sensitivity Analysis
This work proposes a complexity metric which maps internal connections of the system and its relationship with the environment through the application of sensitivity analysis. The proposed methodology presents (i) system complexity metric, (ii) system sensitivity metric, and (iii) two models as case studies. Based on the system dynamics, the complexity metric maps the internal connections through the states of the system and the metric of sensitivity evaluates the contribution of each parameter to the output variability. The models are simulated in order to quantify the complexity and the sensitivity and to analyze the behavior of the systems leading to the assumption that the system complexity is closely linked to the most sensitive parameters. As findings from results, it may be observed that systems may exhibit high performance as a result of optimized configurations given by their natural complexity.
The scientific and technological advances of the second half of the twentieth century have generated significant changes in the dynamics of human civilization. The creation of electronic systems and their network structure revolutionized communication systems, modifying the social and economic relations in the world. The systems became more integrated and interdependent, consequently, more complex; since the network structure was not restricted to the computational systems, it is embedded in the human relationships.
Bar-Yam  argues that this increase in complexity is directly related to the increasing interdependence of the global economic and social systems, as well as political instabilities. According to Bar-Yam , the interdependence is characterized by the network control structure, which considers lateral interactions and transfers decision making to teams due to the high complexity of collective behavior.
The network structure assigns a prominent role to the interactions that, in turn, are responsible for the holistic approach in the study of systems [2–4]. For centuries, scientists tried to explain the whole by its parts, making successive divisions in search of the smallest structure that characterized each system and, ultimately, all systems. According to Bak , physicists have been reductionist in considering that the world could be understood in terms of the properties of simple building blocks. Although they have been successful in some cases, the complexity of the systems requires a global analysis instead.
Likewise, in engineering studies, researchers have realized that subdividing systems to analyze them may cause significant losses in the internal structure of the original system . Considering the use of computational tools, it is preferable to carry out the study throughout the system, modeling it in terms of inputs and outputs to simulate its behavior. Another relevant aspect is the number of parameters with their respective variabilities, which may constitute a bottleneck in understanding the systems. In order to reduce the number of variables, several studies use sensitivity analysis for fixing nonessential parameters, since they generate low impact on the output of the system [7, 8].
This holistic approach to systems is based on a philosophical assertion that the whole is more than the sum of the parts. According to Simon , in complex systems, this statement means that the properties of the whole cannot be easily inferred from the properties of the parts and their interaction laws. For this reason, complexity has arisen as a unifying feature of our world, regardless of the scale and of the kind of system in analysis [1, 10].
According to Holland , the term complexity has assumed such importance that now designates a scientific field with many branches. Some authors consider that the science of the 21st Century is the science of complexity . However, there is no consensus on the quantitative definition of complexity. None of the various measures of complexity is universally accepted by scientists, nor they are practical .
Lloyd  argues that the measures of complexity are developed to respond to questions about the system with respect to (i) difficulty of description, (ii) difficulty of creation, or (iii) degree of organization. In these categories, the complexity has been approached in different ways, such as entropy [15, 16], statistics [17, 18], fractal dimension [19, 20], algorithmic information content [21, 22], dynamic depth , tracking performance , and connections , among many other forms.
Based on the fractal dimension as measure for self-similar objects, Balaban et al.  proposes a metric for quantifying emergence and self-organisation extending fractal dimension to a function, since most of the fractal-like objects have multiple scaling rates. Thus the multifractal analysis investigates the statistical scaling laws of complex fragmented geometrical objects as bacteria aggregates. Balaban et al.  observe the evolution of the spatial arrangement of Enterobacter cloacae aggregates and apply multifractal analysis to calculate dynamics changes in emergence and self-organisation within the bacterial population. As experimental results, the emergence degree decreases as aggregates populate the plate while the self-organisation degree increases.
Given the relevance of geometrical and computational frameworks, Joosten et al.  define the space-time diagrams using small Turing machines with a one-way infinite tape as a computational model and translate these diagrams to fractal dimension. The results from this work have shown that there is a strong relation between the fractal dimension of the Turing machine used and its runtime complexity.
Among the complexity metrics, fractal dimension is frequently applied to the analysis of textures, shapes, and network structures [20, 28, 29]. However, when the detailed system dynamics is available, other metrics may be more effective, such as those based on interactions, for instance, the metrics proposed by Koorehdavoudi and Bogdan  for quantifying complexity from spatiotemporal interactions, which estimates the free energy landscape of the states and distinguishes between stable and transition states. This framework was applied to three natural groups: swimming bacteria, flying pigeons, and ants. The analysis has shown that the collective group has had lower energy level and higher degree of complexity at stable states compared to transition ones.
Regarding the connections, the complexity may be measured from the evolution of the system over time, considering the active connections in each state. The connections depend mainly on (i) the transition from one state to another due to the occurrence of events and (ii) the change of the input parameters that lead to variation in the system output [25, 30]. Through sensitivity analysis, the effect of a given input is measured on the output, assessing how the uncertainties in the parameters affect the uncertainty in the system response .
Sensitivity analysis is relevant to the study of complexity because certain variables may eventually emerge and have a significant impact on the system. Even if the variables are hidden, the relevance of each one may be defined previously by means of its sensitivity and so anticipate strategies if such variables emerge. According to Holland , emergence characterizes complex systems and helps distinguish these systems from others; however this characteristic has no sharp demarcation. To define the system as complex is still a subjective effort.
Here, we focus on the degree of system complexity as a measure that comprises mechanisms related to internal and external interactions of the system. Thus considering (i) the increase in complexity, (ii) the holistic approach to systems, (iii) complexity as a unifying variable, and (iv) the absence of a practical and representative quantitative definition of complexity, we propose a complexity metric based on connections, which may be weighted according to the relevance of each one. This metric is applicable to any system that may be modeled and simulated from its input parameters and output variables.
The proposed metric covers a wide range of systems in the physical world. Using this metric, it is possible (i) to say how complex a particular system is or how much more complex one system is than another, (ii) to use the complexity in the objective function of optimization process, in order to minimize it, or as a constraint, in order not to exceed the value defined as a reference, and (iii) to support decision making.
In order to apply the proposed metrics, Section 2 presents complexity metric developed by adapting the Second Law of Thermodynamics. Our proposed methodology is presented in Section 3, where the connection-based complexity and sensitivity metrics are defined and two systems are modelled as case study. The complexity and sensitivity of different models are analyzed in Section 4, leading to the proposal to include the sensitivity index in the systems complexity metric as a factor of relevance of each connection (Section 5). By including this factor, the complexity metric will consider the descriptive and organizational aspects of the systems, verified by the number of connections and the relevance of each connection, respectively.
2. Metric of System Complexity
Several metrics to calculate the complexity have been developed based on the size of the system, entropy, information, cost, hierarchy, organization, and other criteria . The complexity measures are used to compare systems or different configurations of the same system [13, 32]. In some cases, these measures are dimensionless, allowing to compare one value to another one measured in the same system or in different systems, as long as the nature of them allows comparison [32, 33].
Some complexity metrics are proposed based on the information entropy [32, 34–37]. Considering the system connections, Paiva  presents the modeling of Shannon  adapted by Lemes  to measure the system complexity usingwhere is the complexity of the system connections equivalent to the entropy in information exchange, is the set of connections between elements of the system, is the total number of connections, , is the frequency with which the connections between elements and occur, where is given by , in which is the number of connections between the elements and .
3.1. Proposed Metric of System Complexity
Based on the Paiva’s  modeling, the proposed method measures the complexity of real systems using expression (2). This metric considers the connections regardless of information exchange, observing their probabilities according to expression (3).where is the system complexity based on connections, is the probability of occurrence of the connection between two elements, and is the number of active connections at the instant , expressed by (4). The variables , , and correspond to the number of entities, resources, and queues at the instant , respectively. These variables are components of the system according to the discrete-event modeling, which is applied to the systems investigated in the case studies. In this kind of model, the dynamics of the system is known with respect to the interaction between its components, which enables its modeling in terms of connections.where is the number of entities states, is the number of active connections per entity in each state, and is the number of entities in each state.
In (3), may be generalized to the function , seeing that some constraints may rule out the connection between entities and resources or queues. In this function, corresponds to the constraints, which lead to the decrease in the number of relationship possibilities. The function may assume values in the interval .
Expressions (3) and (4) are useful in the context of discrete event systems, which consist of a class of dynamic systems that depend on the occurrence of events to the state change, i.e., new set of values of the attributes at a given instant . The concept of queue is commonly used in discrete-event modeling, since the entities often need to share the system resources. In these cases, the entities have to wait in queue in order to use certain resources, which provide them some service or something they need .
The proposed metric maps the active connections related to entities, resources, and queues at any given time , expressed through the relationship matrix . Figure 1 shows a system configuration with the entities to (in orange) and the resources , , , , , , and (in gray).
In Figure 1, there are 8 active connections in the system: (i) and , (ii) and , (iii) and , (iv) and , (v) and , (vi) the queue and , (vii) and , and (viii) and . No entity is connected to the resources and ; hence they are idle.
3.2. Proposed Metric of Sensitivity Analysis
In this work, a quantitative analysis is proposed of the curves that express the impact generated by the changes of the input parameters. These changes are carried out from the base values of the parameters, which may be defined as optimized solution or as the best bet for parameters. While one parameter is changed, the others are held at their base values and the output is measured. This approach is known as one-at-a-time measures.
The system output is given by the function . When is the output corresponding to the base values of the parameters, . A base axis is defined parallel to the axis of the abscissa in the graph, presenting constant value in the ordinate corresponding to the output , as represented by the dashed line in Figure 2.
The proposed method based on Saraiva  calculates the area of the polygons formed by the base axis and the curves related to the one-at-a-time measures in order to determine the system sensitivity to variations in the parameters. The coordinates in the graph represent the relation between the inputs and output, enabling the computation of the absolute difference given by the output value obtained and the value (for the base case).
This sensitivity metric has mathematical properties of entropy related to the lack of information about system behavior. Likewise the fact that the entropy is maximum when the most uncertain situation is expressed in terms of probabilities , the most sensitive parameter is the one that generates greater variability in the model output for the same conditions of analysis. Besides that, similarly to classical mechanics in which the experimenter controls the microstate by manipulating parameters from usual macroscopic ones , the sensitivity analysis addresses the internal mechanisms of the system through the manipulation of its inputs and outputs.
In order to determine the parameters sensitivity, the proposed metric requires few one-at-a-time measures (set of parameters values and the respective output value), which may be obtained either by experiments performed in the real system or by simulations performed in the model. In both cases, the system is observed as a whole, leading us to believe this may be an appropriate mechanism to measure complexity. Some researches have showed the relationship between complexity and sensitivity [42–44]; however none of them proposes to measure complexity using sensitivity analysis.
The parameters influence on the model output may be quantified by the sensitivity indices. Here, we define sensitivity index as the contribution of the area concerning the parameter in relation to the total area, where is the number of parameters, given by
Figure 2 presents the polygons used to calculate the sensitivity index for the interval from to of parameter change from base values. This interval represents an example of area delimitation for applying the proposed metric. One may choose any interval comprising between and of parameter change. The area (in orange) is defined by the base axis and the curve in red given by variation in parameter while is held in its base value . The area (in gray) is defined by the base axis and the curve in blue given by variation in parameter while is held in its base value . The number of polygons for each parameter is defined by the intersections of the base axis with the curve of the parameter that is varying for interval of interest, as expressed bywhere is the number of polygons and is the number of intersections of the curve with base axis in the analysed interval.
3.3. Model for the Distribution Center Problem
The distribution center of a company consists of the logistics of products delivery. After separating the products, an order of delivery is generated. During the center operation, the following steps are performed: (1) the distribution center generates the orders of delivery; (2) the orders are kept in queue until the resources are available; (3) the truck stays on the dock while the loading process is performed; (4) the truck leaves for delivery, releasing the dock and the group of workers for new loading; (5) the products are transported to their destinations; (6) the truck comes back to the distribution center for new deliveries. In the model, the duration at each stage corresponds to values given by probability distributions.
As typical discrete event system, the distribution center is modelled in terms of entities, queues, and resources. The entities are the orders of delivery, which are waiting in line for the availability of the resources: docks, trucks, and group of workers. The set of discrete states concerning the orders are (i) waiting in the queue, (ii) being loaded, and (iii) being transported. Based on the states, how many resources are being used at every instant of time is determined.
The distribution center works like an open system, in which new entities may be integrated at any moment; hence the number of entities (orders of delivery) and the demand for resources (docks, trucks, and groups of workers) vary over time. Different performance measures may be chosen for the problem of the distribution center, e.g., the average waiting time in queue, the average time for transportation, or the percentage of use of the system resources.
At this work, the delivery time of orders is considered as performance measure, which is the time spent between the moment that the order is generated and the delivery to the customers is performed. The variable is composed of the sum of the times of (i) waiting in queue, (ii) loading the products into the truck, and (iii) transporting the products from the distribution center to the customers. That system is represented by .
The measure for complexity is calculated by (2), in which the active connections are mapped based on the states of the orders. The number of active connections is determined by (4), in which the order in state waiting in the queue adds one connection to the system (with the order ahead of it), the order in state being loaded adds three connections (one with the dock, one with the truck, and another with the group of workers), and the order in state being transported contributes with one connection to the system (with the truck).
The probability of connection occurrence in the distribution center problem is given by (3), in which the number of entities is equal to the total number of orders in the system at the instant , considering that each entity (order) may be attended by any system resource or be kept in queue. In this model, there is only one queue and the number of resources is equal to the sum of the number of docks, trucks, and groups of workers. The queue modeling applies the FIFO (first-in-first-out) policy, in which the first entity that arrives in the queue is the first one to be attended and, consequently, to leave the queue.
Considering that there are 2 docks, 3 trucks, and 2 groups of workers into the distribution center, the system configuration may occur at any instant according to Figure 1. This configuration is expressed by relationship matrix in (7), in which the columns represent the entities to and the rows represent the queue , docks and , trucks to , and group of workers and , in this sequence.
In (7), the orders and are being transported in trucks and , respectively, the order is being carried by the group of workers into the truck parked in the dock , and the orders , , and are waiting in line. The resources dock and group of workers are idle; no entity is connected to them. The number of active connections is computed from the matrix .
3.4. Model for Medical Center Problem
The medical center consists of the processes of medical care and basic procedures. The flow at medical center is as follows: (1) the patients arrive at the medical center; (2) the patients wait in queue for medical assistance; (3) the patients get the medical appointment; (4) after the appointment, some of the patients are released and others are forwarded to (5) perform basic procedures (receiving medication or doing medical exams); (6) after medication or exams, some of the patients are released and others perform new exams or take more medication, returning to step 5, and some of them wait in queue to come back to the physician; (7) after a new medical appointment, some of the patients are directed to further exams or medication, returning to step 5, and the others leave the center.
During the care process, queues of people may be generated in order to wait for (i) medical appointment, (ii) medication, and (iii) medical exams. The set of discrete states concerning patients are (i) waiting in queue, (ii) having medical appointment, (iii) receiving medication, and (iv) doing exams. The resources are used according to the demand.
The medical center is also an open system. It means that the number of entities (patients) and the demand for resources (physicians, nurses, and technicians) vary over time. In this model, the time between arrival and leaving of patients is adopted as the performance measure. The medical center system is represented by .
The complexity measure is calculated by expression (2), in which the active connections of medical center are mapped based on states. The number of active connections is determined by (4), in which each patient adds one connection, no matter which state he or she is in.
The connection probability in the medical center is given by expression (3), where the number of entities is equal to the total number of patients in the system at the moment , considering that each patient may be attended by any system resource or be waiting in any queue. The resources are computed by the sum of the number of physicians, nurses, and technicians. There are four queues in the system: (i) queue for medical appointment on arrival, (ii) queue for medication, (iii) queue for examination, and (iv) queue for appointment on medical return after basic procedures. The queues , , , and are defined according to the FIFO (first-in-first-out) policy, which states that each entity waiting for resource availability is added to the end of the respective queue.
Considering the medical center have 2 physicians, 2 nurses, and 1 technician in its staff, the configuration presented in matrix (8) may occur at any instant. Each column represents the patients to and the rows represent the queues to and the resources: physicians and , nurses and , and technician , in this sequence.
In (8), the patient is doing exam with the technician , patients and are receiving medication by nurses and , respectively, patient is waiting in queue to be examined, and are consulting with physicians and , respectively, and is waiting in queue to get an appointment.
4.1. Case Study 1: Distribution Center
The simulation of the distribution center model presented in Section 3.3 generated orders of delivery with probability distribution , the groups of workers loaded the products in the truck during time , and the truck spent time for transporting the products to customers and for returning to the distribution center.
The number of resources used in the simulation ranged from 1 to 10 for docks, 1 to 15 for trucks, and 1 to 10 for groups of workers, compounding scenarios. The simulation was performed for 180 days by scenario, considering 24 daily hours of operation and that each order of delivery corresponds to the truckload. In the simulated scenarios, complexity and delivery time were calculated.
The normalized values of and for all scenarios are presented in Figure 3. As the simulation is the combination of resources docks, trucks, and groups of workers, in this order, in Figure 3, the peaks of (in blue) correspond to the combinations in which there was only one truck. At every change in the number of docks, one truck was used during 10 scenarios, leading to the highest values of and (in red). Furthermore the oscillations that occur between values and of are derived from changes in the number of trucks, indicating greater sensitivity in this system parameter.
Figure 3 shows that whenever the number of truck is , values of approach . In the scenarios, the lowest complexity is , which corresponds to lowest delivery time and to scenario with the greatest number of available resources, as shown in Table 1. The highest delivery time is bigger than the lowest time and it corresponds to the greatest complexity and lowest number of resources.
The complexity measure is a way of seeing the system as a whole. The connections mapping concerning the states expresses the system configuration. Thus the relation between performance measure and complexity expressed by (9) may lead to some findings.
The lowest (in bold) and greatest (in italic) values of , and normalized are shown in Table 2. The lowest value of refers to , only the lowest , whereas the number of resources was approximately lower than the scenario of lowest . The system performance was greater than the worst case and only lower than in the best case. This shows that the use of resources was optimized, since the ratio value indicates the lowest cost in terms of complexity for each minute of permanence of the entities in the system.
4.2. Case Study 2: Medical Center
The model of the medical center presented in Section 3.4 was simulated following the flow in which the patients (1) arrive at the medical center in time with probability distribution ; (2) wait in queue for medical appointment; (3) are attended by physician for a time ; (4) after the appointment, of patients are released and are forwarded to (5) perform basic procedures, wherein (5a) of them wait in queue in order to receive medication and (5b) of them wait in queue for doing medical exams; (6) after medication or exams, of patients are released, , perform new exams or take more medication, returning to step 5, and wait in queue to return to the physician; (7) after a new appointment, of patients are directed to further exams or medication, returning to step 5, and the other leave the medical center. The medication time lasts , the duration of exams is , and the return to the physician in new appointment lasts .
The number of physicians, technicians, and nurses used in the simulation ranged from 3 to 8, 2 to 10, and 5 to 15, respectively, compounding 594 different scenarios. The simulation was performed for 180 days by scenario, considering 24 daily hours of operation. The medical care time in minutes spent within the medical center by patient and complexity of the system was calculated for all scenarios.
The lowest complexity obtained from all scenarios occurred when the greatest number of resources were used, i.e., 8 physicians, 10 technicians, and 15 nurses. The greatest complexity occurred when there was the lowest number of resources, i.e., 3 physicians, 2 technicians, and 5 nurses, therefore lengthy waiting times.
Figure 4 presents the percentage values of resource utilization and the measure of normalized complexity for all scenarios. It may be observed that in the 200 initial scenarios, where there were less than 5 physicians, the utilization of this resource got values between and 1. The peaks of complexity occurred whenever the number of physicians was increased but the number of nurses and the number of technicians were minimum for analyzed scenarios, causing increase in the size of the queues and .
In the scenario with the lowest complexity, the time that patients were in medical center was approximately , , , and minutes for those who left (1) without examination or medication, (2) after doing exams and/or taking medication, (3) after a new medical appointment, and (4) after all procedures, respectively. For the scenario with the greatest complexity, the times were , , and, minutes, respectively, due to the time in queues.
Considering the relation between performance and complexity measures for medical center, expressed by (10), the lowest (in bold) and greatest (in italic) values of , and normalized are shown in Table 2.
In Table 2, the lowest value of equal to represents reduced number of resources compared to other scenarios with lowest values of and . Even with fewer resources, the system achieved near-peak performance values when . The greatest values of all variables were found when the number of physician was lowest, indicating this parameter as the most sensitive in the system.
4.3. Case Study 3: Sensitivity Analysis
The complexity of the distribution center and medical center was analyzed in Section 4.1 and Section 4.2, respectively. As analysis findings, some parameters were pointed out as more sensitive due to the significant impact generated by their scarcity. In order to check how sensitive each parameter is, the metric proposed in the Section 3.2 was applied to the models.
In order to obtain the one-at-a-time measures, the configuration given by the lowest value of was assumed as the optimized solution and the base for the local sensitivity analysis, as presented in Table 3. The parameter influence on model output was calculated according to the variability of the parameters. The range chosen for variation expresses values between and from base value of each parameter, shown in Table 3. In both case studies, the complexity was considered as model output for calculating the sensitivity index.
The results obtained by the sensitivity analysis are presented in the following sections. The metric proposed in Section 3.2 was used to calculate the sensitivity indices, which measures how much the area between curve of the parameter variation and base axis represents in relation to the sum of the areas of all parameters. Before applying that method, two intervals were chosen for analysis. The first interval consists of the variation of the parameters between and and the second one refers to the interval in which all parameters have been changed according to their range presented in Table 3.
4.3.1. Sensitivity Analysis of Distribution Center
The one-at-a-time measures for the distribution center are presented in Figure 5 related to the complexity as model output. As observed in the graphs, the lower the number of the resource truck, the greater the impact on the complexity, especially between and .
According to the values presented in Table 4, the resource truck presented highest sensitivity index, equal to for the interval and for the interval , where all parameters may be changed. Values change of that parameter inferior to from base value led to significant impact on the system, corresponding to the scenarios in which there were less than five trucks at the distribution center.
The resources dock and group of workers presented the same values for sensitivity indices, equal to for the interval and for the interval . As it may be observed, these resources have low impact on model output because the dynamics of distribution center depends mostly on the resource truck.
The optimized solution for distribution center, i.e., 2 docks, 6 trucks, and 2 groups of workers, may be regarded robust for parameter change between and . In this range, the complexity presented low variation, , which means that the increase or decrease of resources in one unit has not significantly affected the system.
4.3.2. Sensitivity Analysis of Medical Center
Based on the medical center simulation, Figure 6 presents one-at-a-time measures for the complexity as model output. By analysing the graphs, it may be seen that all curves have similar behavior; i.e., as the number of resources increased, the values of decreased.
The resource physician obtained the higher sensitivity indices as presented in Table 5, equal to related to the interval and related to , concerning the region in which all parameters have variation from base values. Regarding these intervals, the resource technician presented sensitivity indices equal to and , respectively, while the resource nurse was the least sensitive parameter, with indices lower than . The lowest indices for resource nurse may be explained by the fact that the range was begun from the base value, which is the optimized value for this resource. So the situation of scarcity of that parameter was not evaluated. In the opposite way, the resource technician presented the worst case of scarcity, which explains its higher sensitivity index related to the interval .
Between and of parameter change, low impact on the output was observed, , indicating robustness around of the configuration given by the lowest , i.e., 7 physicians, 7 technicians, and 5 nurses. However when the number of physicians and the number of technicians were minimum for analyzed scenarios, the complexity was almost twice the value .
The system complexity measure contributes to the knowledge of the system as a whole. The simulated scenarios for the distribution center and the medical center have shown that the system becomes less complex as the number of resources increases. However, complexity saturates from a certain number of resources, indicating idleness in the system.
As the complexity is based on the connections, complexity measures may reflect (i) configurations with idle resources, (ii) optimized configurations, in which the system exhibits high performance, or (iii) configurations with scarce resources, hence expressive size of queues. The type of configurations may be distinguished one from another by applying the relation , expressed by
The lowest value of has indicated the suitable number of resources for the system. In this configuration, there is a measure that expresses the level of complexity in which the system achieves its goal with high performance. We denote this measure as natural complexity of the system, i.e., the proper level of system complexity. By using natural complexity as reference, the complexity decrease may mean that resources are becoming idle and the complexity increase may indicate that the system is overloaded and underperforming, as expressed by
In addition to the system overload, the complexity peaks have indicated the most sensitive parameters. The sensitivity analysis has been performed and has confirmed this point. In this paper, the sensitivity analysis contributed to (i) quantifying the influence of the parameters, (ii) understanding relationships between input and output variables, and (iii) checking the robustness of optimized solution. Besides that we here propose that the sensitivity indices are used to quantify the coupling between components of a system, since its inner structure reveals the system relationship with its environment.
So far we have measured the complexity based only on system connections regardless of their relevance. In order to make a complexity metric more comprehensive, this work proposes the use of sensitivity analysis in the metric of system complexity by the inclusion of relevance factor of connection . The sensitivity indices associated with each connection allows the measure of complexity to become greater expressive, regarding different strengths of coupling in the system.
Thus, we propose updating expression (2) to (13), given bywhere is the complexity of the system based on weighted connections, is the number of active connections, is the probability of occurrence of the connection , and is the relevance factor of connection , defined based on the sensitivity indices of the parameters. The results obtained from sensitivity analysis have used complexity measures as model output; however future works must use another measure in order to apply the metric . We recommend that sensitivity indices are calculated based on system performance as model output.
In this paper, we presented a local sensitivity metric, called method of the area. However the local approach may make the complexity analysis unstable if the parameters base values are in a region of system instability. In order to overcome this problem, the global sensitivity analysis should be performed to comprise regions of instability and stability of the analyzed system. In this way, the impact of the nonlinearity in every region of operation of the system will be considered.
The proposed complexity metric abstracts aspects related to the spatial arrangement of the system, taking into account spatiotemporal interactions, as an alternative to Koorehdavoudi and Bogdan  approach. While the complexity metric proposed by Koorehdavoudi and Bogdan  is defined as the product between emergence and self-organization, both characteristics build on the missing information definition according to Shannon , the metric proposed here captures the spatial arrangement in terms of connections and uses the entropy conception to quantify the influence of the uncertainty inside the system added to the influence of the uncertainty generated by external elements, applying sensitivity analysis.
The sensitivity analysis was chosen because even parameters considered as less important by the uncertainty analysis (i.e., with low variability) may lead to significant changes on the output model due their sensitivity . Thus we consider that the metric using connections weighted by sensitivity indices is able to capture the degree of system complexity as the combination between order and disorder, regularity and randomness, as discussed by Deacon and Koutroufinis  and Kurths et al. .
For instance, if we apply the proposed metric to a control system of DC motor, whose model presents continuous variables and continuous time, we could observe that when the motor is running, all connections are active and the probabilities of occurrence of all connections are equal to 1; thus the second part of the expression (13) is because the uncertainty related to the connections does not exist in this case. If any connection is broken, the system does not work. Thus, the uncertainty in the system is attributed to the parameters change (field voltage, control variables, etc.), which may be evaluated through the sensitivity analysis. In addition to operational aspects, the application of the metric based on weighted connections may show observable characteristics in structural terms and in relation with the environment, given by the local or global sensitivity analysis.
This example of control system of DC motor shows that some metrics such as fractal dimension could not be used due the absence of geometrical patterns described in phase space. Even for other types of systems, such as those analysed in the case studies (distribution center and medical center), the fractal dimension would be not effective, since the arrangements observable during simulation are abstractions made from system operation, besides the fact that they would not probably have self-similarity. Therefore the proposed metric is able to quantify complexity related to system dynamics in several contexts.
The complexity metric considers both the difficulty of describing systems and their degree of organization. The configuration of the system in terms of the connections between its parts is the modeling used to describe it. The degree of organization, on the other hand, may be observed by the relevance of each connection, given by the sensitivity measures.
In future works, we intend to apply the proposed complexity metric to wide range of systems, both human-made and natural ones. Another issue is to investigate how complexity measures behave for different probabilities distributions used in the models. When we applied the complexity metric based on connections , we observed that low complexity was related to scenarios of greater number of resources, since the queue size decreased and the probabilities of occurrence of connections were lower than ones when there were few resources. However the probability distribution of arrival of entities in the systems was modeled as exponential distribution. Further researches could apply other distributions and observe the results.
In this paper, the main contribution is the proposal of integrating several system characteristics (configuration, arrangement, performance, and workload) into the complexity metric . The use of sensitivity indices as weights for the connections enables combining features of external and internal dynamics of the system. Another important contribution is the conception of natural complexity of systems: a new concept that could be investigated in future work in order to make it a reasonable reference to evaluate the systems, since the concept comprises both effectiveness and efficiency.
This paper has proposed sensitivity and complexity metrics based on one-at-a-time values and system connections, respectively. It has been observed that complexity may indicate (i) most sensitive parameter, (ii) idleness or overload in the system, and (iii) lowest or greatest number of resources. The relation between performance and complexity has led to scenarios with optimized configuration for meeting the demand. Considering these cases, the paper has established that systems have their proper level of complexity, denoted natural complexity. Regarding the different types of couplings in the system, the use of sensitivity analysis has been proposed in order to determine the relevance factor of connection, contributing to more accurate measurement of the system complexity.
The CSV file with data used to support the findings of this study are available from the corresponding author upon request. The data are results from the simulation of the models.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
The authors would like to thank the National Council for Scientific and Technological Development (CNPq), the Foundation for Research Support of the State of Goias (FAPEG), and the Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES). This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001.
- Y. Bar-Yam, “Complexity rising: from human beings to human civilization, a complexity profile,” in Encyclopedia of Life Support Systems (EOLSS), EOLSS Publ, Oxford, UK, 2002.
- H. Koorehdavoudi and P. Bogdan, “A Statistical physics characterization of the complex systems dynamics: quantifying complexity from spatio-temporal interactions,” Scientific Reports, vol. 6, Article ID 27602, 2016.
- M. W. Maier, “Architecting Principles for Systems-of-Systems,” INCOSE International Symposium, vol. 6, no. 1, pp. 565–573, 1996.
- K. Wang and Ø. Bjørket, “A general efficient approach to dynamic analysis of interconnected mechanical systems using the theory of connections,” International Journal of Systems Science, vol. 25, pp. 1157–1178, 1994.
- P. Bak, How Nature Works: The Science of Self-Organized Criticality, Copernicus Books, New York, NY, USA, 1st edition, 1996.
- T. Nohara, S. Hosoe, and M. Ito, “Approximation of linear systems with internal connections,” International Journal of Systems Science, vol. 20, pp. 649–662, 1989.
- N. H. Kim, H. Wang, and N. V. Queipo, “Adaptive reduction of random variables using global sensitivity in reliability-based optimisation,” International Journal of Reliability and Safety, vol. 1, pp. 102–119, 2006.
- S. Tarantola, D. Gatelli, S. Kucherenko et al., “Estimating the approximation error when fixing unessential factors in global sensitivity analysis,” Reliability Engineering & System Safety, vol. 92, pp. 957–960, 2007.
- H. A. Simon, “The architecture of complexity,” Proceedings of the American Philosophical Society, vol. 106, pp. 467–482, 1962.
- W. Meed, “Complexity science and the social world,” in Encyclopedia of Social Measurement, K. Kempf-Leonard, Ed., pp. 399–403, Elsevier, Greater Manchester, UK, 2005.
- J. H. Holland, Complexity: A Very Short Introduction, Oxford University Press, Oxford, UK, 1st edition, 2014.
- K. Mainzer and L. Chua, The Universe as Automaton: from Simplicity And Symmetry to Complexity, Springer Science & Business Media, Berkeley, Calif, USA, 1st edition, 2011.
- M. Mitchell, Complexity: A Guided Tour, Oxford University Press, Oxford, UK, 1st edition, 2009.
- S. Lloyd, “Measures of complexity: a nonexhaustive list,” IEEE Control Systems Magazine, vol. 21, no. 4, pp. 7-8, 2001.
- M. Batty, R. Morphet, P. Masucci, and K. Stanilov, “Entropy, complexity, and spatial information,” Journal of Geographical Systems, vol. 16, pp. 363–385, 2014.
- O. A. Rosso, L. C. Carpi, P. M. Saco, M. Gómez Ravetti, A. Plastino, and H. A. Larrondo, “Causality and the entropy–complexity plane: robustness and missing ordinal patterns,” Physica A: Statistical Mechanics and its Applications, vol. 391, no. 1-2, pp. 42–55, 2012.
- S. A. Abdallah and M. D. Plumbley, “A measure of statistical complexity based on predictive information with application to finite spin systems,” Physics Letters A, vol. 376, pp. 275–281, 2012.
- D. P. Feldman and J. P. Crutchfield, “Measures of statistical complexity: why?” Physics Letters A, vol. 238, pp. 244–252, 1998.
- U. K. Basak and A. Datta, “Fractal dimension and complexity in the long-term dynamics of a monomolecular layer,” Chaos, Solitons & Fractals, vol. 81, pp. 534–541, 2015.
- J. D. Corbit and D. J. Garbary, “Fractal dimension as a quantitative measure of complexity in plant development,” Proceedings of the Royal Society of London. Series B, Biological sciences, vol. 262, pp. 1–6, 1995.
- N. Ay, M. Muller, and A. Szkola, “Effective complexity and its relation to logical depth,” IEEE Transactions on Information Theory, vol. 56, pp. 4593–4607, 2010.
- M. Gell-Mann and S. Lloyd, “Information measures, effective complexity, and total information,” Complexity, vol. 2, no. 1, pp. 44–52, 1996.
- T. Deacon and S. Koutroufinis, “Complexity and dynamical depth,” Information, vol. 5, no. 3, pp. 404–423, 2014.
- J. Liu, C. Cui, Q. Meng, Y. Shen, and F. Fang, “IAE performance based signal complexity measure,” Measurement, vol. 75, pp. 255–262, 2015.
- J. Paiva, V. Gomes, S. Oliveira et al., “Calculation of system complexity based on the connections: methodology and applications,” in Proceedings of the 16 IEEE International Conference on Environment and Electrical Engineering, pp. 1145–1150, 2016.
- V. Balaban, S. Lim, G. Gupta, J. Boedicker, and P. Bogdan, “Quantifying emergence and self-organisation of Enterobacter cloacae microbial communities,” Scientific Reports, vol. 8, Article ID 12416, 2018.
- J. J. Joosten, F. Soler-Toscano, and H. Zenil, “Fractal dimension versus process complexity,” Advances in Mathematical Physics, vol. 2016, Article ID 5030593, 21 pages, 2016.
- J. Li, Q. Du, and C. Sun, “An improved box-counting method for image fractal dimension estimation,” Pattern Recognition, vol. 42, no. 11, pp. 2460–2469, 2009.
- Y. Xue and P. Bogdan, “Reliable multi-fractal characterization of weighted complex networks: algorithms and implications,” Scientific Reports, vol. 7, p. 7487, 2017.
- G. A. Wainer, Discrete-Event Modeling And Simulation: A Practitioner’s Approach, Chichester, UK, CRC press, 1st edition, 2009.
- A. Saltelli, S. Tarantola, F. Campolongo, and M. Ratto, Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models, John Wiley & Sons, Chichester, UK, 1st edition, 2004.
- D. W. Repperger, R. G. Roberts, and C. G. Koepke, “Quantitative measurements of system complexity,” US Patent 8,244,503 B1, 2012.
- J. R. B. Paiva, V. M. Gomes, B. A. Rodrigues et al., “Metric for calculation of system complexity based on its connections,” Transactions on Environment and Electrical Engineering, vol. 2, pp. 67–73, 2017.
- C. Gershenson and N. Fernández, “Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales,” Complexity, vol. 18, pp. 29–44, 2012.
- M. J. R. Lemes, Complexity, coupling and criticality (C 2A) as risk factors in system design [Ph.D. thesis], University of Sao Paulo, 2012.
- C. E. Maldonado, G. Cruz, and A. Nelson, “Biological hypercomputation: a new research problem in complexity theory,” Complexity, vol. 20, pp. 8–18, 2015.
- L. Santos, C. Silva, J. Paiva et al., “A methodology for calculation of complexity in systems: case study,” in Proceedings of the IEEE Congreso Chileno de Ingeniería Eléctrica, Electrônica, Tecnologías de la Información y Comunicaciones, pp. 213–218, 2015.
- C. E. Shannon, “A mathematical theory of communication,” Bell Labs Technical Journal, vol. 27, pp. 379–423, 1948.
- C. G. Cassandras and S. Lafortune, Introduction to Discrete Event Systems, Springer Science & Business Media, 2009.
- J. P. Saraiva, B. S. Lima, V. M. Gomes et al., “Calculation of sensitivity index using one-at-a-time measures based on graphical analysis,” in Proceedings of the 18th International Scientific Conference on Electric Power Engineering, EPE 2017, Czech Republic, May 2017.
- E. T. Jaynes, “Gibbs vs Boltzmann entropies,” American Journal of Physics, vol. 33, pp. 391–398, 1965.
- K. Lindenschmidt, “The effect of complexity on parameter sensitivity and model uncertainty in river water quality modelling,” Ecological Modelling, vol. 190, no. 1-2, pp. 72–86, 2006.
- L. A. Bastidas, T. S. Hogue, S. Sorooshian, H. V. Gupta, and W. J. Shuttleworth, “Parameter sensitivity analysis for different complexity land surface models using multicriteria methods,” Journal of Geophysical Research: Atmospheres, vol. 111, no. 20, 2006.
- J. Sobieszczanski-Sobieski, “Sensitivity of complex, internally coupled systems,” AIAA Journal, vol. 28, no. 1, pp. 153–160, 1990.
- D. M. Hamby, “A review of techniques for parameter sensitivity analysis of environmental models,” Environmental Modeling & Assessment, vol. 32, no. 2, pp. 135–154, 1994.
- J. Kurths, A. Witt, H. Atmanspacher, F. Feudel, H. Scheingraber, and R. Wackerbauer, “General remarks on complexity,” in Inside Versus Outside, pp. 219–234, Springer, Berlin, Germany, 1994.
Copyright © 2019 Viviane M. Gomes et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.