Research Article | Open Access
Wen Li, Yicheng Ye, Nanyan Hu, Xianhua Wang, Qihu Wang, "Real-Time Warning and Risk Assessment of Tailings Dam Disaster Status Based on Dynamic Hierarchy-Grey Relation Analysis", Complexity, vol. 2019, Article ID 5873420, 14 pages, 2019. https://doi.org/10.1155/2019/5873420
Real-Time Warning and Risk Assessment of Tailings Dam Disaster Status Based on Dynamic Hierarchy-Grey Relation Analysis
The consequences of tailings dam breaks are disastrous; although various factors can often result in tailings dam damage, the main cause is poor management. To reduce human supervision errors and ensure that real-time early warnings alerts are sent for any risks, 22 evaluation indexes that affect dam breaks were set up based on inherent and frequency risk. To efficiently predict an early dam break signal for a tailings dam, 12 key evaluation indexes of a dynamic early warning system were screened and a comprehensive consideration of the risk trend was undertaken. The current and future states of the 12 indexes were analyzed based on a borda count and dynamic analytic hierarchy process (AHP) methods and early warning grades for tailings dam damage were evaluated using the dynamic grey relation analysis method. The dynamic AHP method, which avoids the tedious testing and risks of static early warning states, was compared to the traditional method. This research provides a useful basis upon which mining enterprises can select reasonable and effective prediction indexes for risk assessment, fully implement and promote intelligent management of major risks, and conduct accurate and authentic supervision at all levels.
Breakages are the most common accident faced by tailings dams . The consequences of tailings dam failures are often catastrophic ; they can cause huge environmental and human losses, are a serious threat to the life and property of downstream residents and are a major source of environmental pollution that cause secondary disasters [3, 4]. Therefore, it is necessary to research the early warning signs of tailings dam failure to improve safety conditions. Furthermore, given that humans sometimes intervene in warning systems and that supervision errors can sometimes occur, avoiding accidents is difficult on a fundamental level . In addition, improvements in management systems and supervision have been found to have been needed in investigations of accidents [6–8]. This is why the role of enterprise leader is a very important position; their management ability determines how the enterprise develops.
Risk decision-making is uncertain because risks are themselves uncertain and dynamic [9, 10]. The analytic hierarchy process (AHP) is a widely used quantitative and qualitative analysis method suitable for situations in which the results of decisions are difficult to measure directly and accurately (Table 1) [11–14]. However, the variables used in the AHP method are not always easily acquired. For example, verifying the consistency of AHP results requires recalculation when there are inconsistencies, as this indicates that there is not only one result relevant to the inconsistency and thus that one variable is ambiguous [15, 16]. Although the use of the AHP in various fields has improved greatly, modifications can still be made in the following areas:(i)The comparison of two elements; the definition of categories such as “slightly important,” “more important,” “very important,” and “significant” are still ambiguous and lead to time-consuming verifications of the cycle.(ii)The scales that remain for the two elements when the scale value is selected, once the relationship between two elements has been determined, and the remaining fuzzy uncertainties in the selection process.(iii)Risk trends which are not considered in the assessment and thus tend to be static. Therefore, if the outcome of the risk assessment result is positive, it represents only the current status and not the trend for future developments.
Nevertheless, the early warning status of tailings dam breaks cannot be fully interpreted using the AHP method alone. In the past few years, a variety of evaluation methods have been proposed for use in combination with AHP; the typical methods are shown in Table 1. However, these methods have their own advantages and disadvantages and not all of them can be applied well to risk assessment. For example, the first six methods to evaluate the early warning status of tailings dam are limited or static; however, grey relational analysis (GRA) can solve this problem effectively. The GRA method can use mathematics to effectively solve the lack of theoretical uncertainty information. GRA method uses less data modelling than the first six methods and has a goal of establishing differential equations, characterized by dynamic time series used for prediction and decision-making . Applying the GRA method combined with the AHP can effectively overcome the problem of high correlation ambiguity. Samvedi et al. , Xia et al. , and Mathivathanan et al.  used GRA and AHP to enhance the reliability of predictions and overcome ambiguities in data. Most scholars select early warning indicators from human and machine inputs, the environment, and management methods. However, although these can result in good early warnings [20, 21], the evaluation indicators are static in the models used by researchers while a real-life risk status is dynamic. Therefore, characterizing the risk of uncertainty requires a consideration of the risk of bias so that the evaluation results achieve the effect of avoiding human interference in forecasting the alarm status. This provides a new direction for traditional AHP and GRA research.
In summary, combining AHP and GRA methods is a relatively widespread technique; however, there are comparatively few studies on using these to study early warnings for tailings dam hazards. Moreover, there is very little research employing dynamic state-of-the-art correlation analysis methods for tailings dam collapses. Most traditional risk analysis methods are static and fail to capture the states of risk evolution . However, the consequences of tailings dam breaks are dynamic events and circumstances beyond control. Thus, it is very necessary to ensure intelligent risk management and control of the mine system as obtaining characteristic data on tailings and making use of them reduces risks of tailings dam disasters. This is similar to how violations of highway rules are managed and controlled using an information network; by obtaining data on vehicles and roads, we can judge whether a particular vehicle is legal or not. These methods could also be employed to improve the systemic risk management and control of mines and resolve risks through safe developments. This would have far-reaching implications for the reduction of major accidents.
2.1. Preliminary Construction of the Evaluation System
2.1.1. Dynamic Risk Assessment Process
To prevent the tailings dam breaks and solve for the intervention of humans in early warning systems, an evaluation process is constructed as shown in Figure 1. An initial evaluation index set is established based on the theory of risk management. The early warning level for tailings dams is systematically evaluated using Spearman’s correlation coefficient, a borda count, and the dynamic AHP and GRA methods. The evaluation method is introduced in Section 2.2.
2.1.2. Evaluation Indicators
Identifying the risk of tailings dam failures requires a multilevel, fuzzy, and complex system. This research characterizes the state of risks to tailings dam to help supervisors obtain information to use during inspections. According to the definitions of risk [30, 31], identifying risks to tailings dams can be divided into inherent risk indicators and frequency indicators. Inherent risk indicators refer mostly to material loss caused, which determines the severity of the consequences of the disaster; they generally refer to the source of the risk. Frequency indicators, which mainly monitor the characteristics of the dams, show the probability that an accident might occur. To choose the most reasonable assessment indicators, this study counted many typical large-scale tailings dam accidents in China and other countries and identified an initial system of indicators, including 22 kinds of dam breakage hazards, as shown in Table 2.
2.1.3. Divide Evaluation Warning Level
The relevant departments of the State Council of the People’s Republic of China have drafted an “Emergency Plan for Emergency National Public Emergencies”, which standardizes the warning level for emergencies according to their severity and urgency; the risk levels for the safe production of tailings are divided into five levels from high to low. The comment set is described by V = “I warning”; “II warning”; “III warning”; “IV warning”; “V No warning” (of which “I warning” is the highest risk level), corresponding risk warning colors in the order red, orange, yellow, blue, and green, and a critical point. These details are shown in Table 3.
The relevant departments of the State Council of the People’s Republic of China have drafted an “Emergency Plan for Emergency National Public Emergencies,” which standardizes the warning level for emergencies according to their severity and urgency. The risk levels for the safe production of tailings are divided into five levels from high to low. The comment set is described as follows: V = “I warning”; “II warning”; “III warning”; “IV warning”; “V No warning” (of which “I warning” is the highest risk level); corresponding risk warning colors in the order red, orange, yellow, blue, and green; and a critical point. The details are shown in Table 3.
2.2. Calculation of Indicators
2.2.1. Spearman’s Rank Correlation Coefficient
Mining enterprises should use economical, safe, and efficient methods to select the most practical and meaningful early warning identification index from Table 1. This study selects indicators based on Spearman’s rank correlation coefficient [32, 33], using the following calculation steps.
Step 1. Spearman’s rank correlation coefficient is used to estimate the correlation between two variables and , where the correlation between them can be described using a monotonous function. The between the two variables can be +1 or -1. If the number of elements in the variables and is , the ith value of two random variables is denoted by , . Sorting the two variables yields two ordered sets of elements , , where elements , are the order of in and the order of in . Spearman’s rank correlation coefficient between the random variables , can be calculated from the following:where , .
Step 2. The correlation value is selected based on the relevance of the range of results. > 0.95 shows a particularly high correlation; ≥ 0.8 shows a high correlation; 0.5 ≤ < 0.8 indicates a moderate relationship; 0.3 ≤ < 0.5 indicates a weak relationship; and < 0.3 refers to an extremely weak or irrelevant correlation.
2.2.2. Borda Count
The borda count, also called the borda ordinal method, is used to quantify evaluation elements based on importance [34, 35]. The basic method is as follows: Let be the total number of risk factors and be a certain risk, where represents a guideline. If represents the level of risk under criterion , the borda number of can be calculated as
2.2.3. Risk Assessment of the Dynamic Hierarchy-Grey Relation Analysis Method
The traditional AHP is not enough to evaluate the risk development trend. For example, if the evaluation results of the two tailings dams indicate a state of no warning, it is impossible to further compare which of the two tailings dams is better. This is because the tailings dams can develop in either a benign or a malignant way with the passage of time. Thus, if the current and future state of two tailings dams can be predicted, it will be easy to judge which is safer. For example, if the two risk warning levels of mine No. 1 are “V” and “IV,” respectively, while those of mine No. 2 are “V” and “V”, respectively, it can be concluded that the latter is safer than the former. Psychology shows that expert evaluators cannot help considering the trend in a mine’s warning levels over a certain period of time in the future when making their evaluations. If one expert thinks that mine No. 1 will develop negative way while mine No. 2 will develop in a positive way, it means that mine No. 2 is safer. In other words, traditional evaluation results only represent the present evaluation status, not the future trend . Here, the future state is not meant to be infinite; it is a prediction of the future state for a short period of time and represents the accompanying trend. Therefore, a dynamic analytic hierarchy process (DAHP) would be a more effective way to measure trends in risk. Assessments using DAHP are as follows.
Step 1. Develop the structural hierarchy model, as shown in Table 2. Tailings dam construction evaluation indicators are divided into layers for goals, guidelines, and indicators. There should be a direct link between each target level, the one before, and one after.
Step 2. Construct the dynamic judgment matrix which shows that, for a certain factor in the previous level, like in the traditional AHP, the classic Saaty 1 to 9 scale is still used [36, 37]. Then, compare the relative importance of the factors related to this level. In the DAHP, the two-factor judgment table is established based on the relationship between in layer and in layer . “←” represents the current state of the indicator and “→” represents its future trend after the risk trend is considered. Then create matrix table as shown in the example below:in which ; .
Step 3. Use the square root method to calculate the weight vector values of the required evaluation factors because this facilitates the calculation and determination of its accuracy. The relationship is as follows:
After the normalization process in (4), use the following equation to find the evaluation factor weight vector :
The weight value obtained from (5) using the DAHP is
Step 4 (perform the judgment matrix consistency test). Using (5), the maximum eigenvalue can be obtained as
Then, check the consistency of the judgment matrix as follows:
Saaty  proposed a method by which to amend the using the mean random coherence index as shown in Table 4, if ; that is, when < 0.10, is an acceptable judgment matrix. On the contrary, the initially established matrix is unsatisfactory and needs to be recalculated.
Note: n is the matrix order.
Step 5 (determine the grey relational degree). The GRA determines the desired target for a given state. By analyzing and determining each indicator set, a matrix is formed according to a certain sequence, the grey correlation coefficient can be obtained through a normalization process, and the result can be calculated by combining the determined weight values . Thus, the GRA is used to analyze early warning data for a tailings dam break disaster. The grey correlation coefficient of the tailings dam fault warning, the weight value judged by AHP, and the dynamic alert warning of the degree of the risk of a tailings dam disaster are obtained. Combining a DAHP and GRA is an effective way to measure the alertness of a disaster risk warning system.
First, to make the calculation reasonable based on the average value of the original warning data for the dimensionless treatment, the following matrix is used:where ; .
Next, the difference sequence between each row is calculated according to (10) below, where is the optimal evaluation sample sequence constructed.
The maximum difference between the poles and minimum difference is found:
The degree of the correlation coefficient is sought:
Given this, the degree of relevance of the sample is as follows:
where is the resolution coefficient and ; here , is the normalized weight of the metric set .
3. Case Study
3.1. Introduction to the Case Study
The mine used as a case study was originally developed in 1998. The valley-type upstream tailings dam was an impermeable brick dam with an initial elevation of 458.5 m and a height of 22 m. The tailings yield for a catchment area 1.26 km2 is 80%, and the total dam height designed was 33.5 m with a total storage capacity of 1.5 106 m3. There were no residential buildings within 2 km downstream of the dam.
To evaluate the trend in the early warning status, it is necessary to use the expert scoring method to score the evaluation indicators to obtain weight information. However, using a small number of experts would lead to lack of information while too many would lead to information redundancy. Some researchers have analyzed this and verified that it would be optimal to select around 10 people to participate in the evaluation. While evaluating the same subject, different experts have different opinions and give different scores  because of their differing levels of education and cultural backgrounds. Experts are also usually of different ages and have different profession positions, work experience, and educational backgrounds; all of this leads to differences in the evaluations [40–42]. Therefore, we invited 10 experts with similar backgrounds to assess the scores of the tailings dam indicators in Table 2. The score results are given in Appendix A.
3.2. Determining the Key Indicators
The 22 categories of indicators are correlated using Spearman’s rank correlation coefficient. Taking as an example, the third and fourth columns in Table 5 are the rankings of the scores and the mean values of each factor of , and a correlation coefficient of 0.76 is obtained from (1). The correlation is high; the correlation coefficient results of the other indicators were calculated in a similar manner. For further details, see Appendix B.
Based on the results in Appendix B, the following 12 indicators for early warning evaluation based on their high relevance (a correlation coefficient greater than 0.60) are observed: , , , , , , , , , , , and .
3.3. Finding the Index Weight
Step 1. Rename the selected inherent risk indicator and frequency indicator in sequence, as shown in Table 6.
Notes: is the weight of the original indicator layer to the criteria layer; is the weight of the original indicator layer to the target layer; is the weight of the new indicator layer on the criteria layer; isthe weight of the new indicator layer on the target layer.
Step 2. To solve the ambiguity of the results of the comparison between AHP indicator elements, the borda count was used here to quantify the judgments among the indicator elements, and the 12 elements were ranked according to 10 expert scores. Taking the element in the inherent risk indicator as an example and using (2), where N = 12 and k = 10, its borda ordinal value is obtained as follows:
Similarly, the borda ordinal values of other elements can be found as shown in Appendix C. The six categories of the inherent risk indicators are 75, 74, 73, 66, 58, and 50. The six ordinal numbers of the frequency indicators are 93, 78, 65, 60, 81, and 75, and their logarithms are taken in order. The logarithms of the six categories of the inherent risk indicators are 0, 1, 2, 3, 4, and 5, respectively, while the logarithms of the six categories of the frequency indicators are 0, 2, 4, 5, 1, and 3, respectively. In this matrix, the rows are sorted and added to or subtracted from. The judgment matrix A can be constructed directly and a two-factor judgment matrix can be established.
The degree of disaster risk is not equal and policy makers tended to distinguish between them based on risk appetite. Here, the experts scored the risk appetite for the 12 indicator categories using a 10-point score that showed possible future status. The proportion of each factor obtained is shown in Table 7.
The 12 key index scores in Appendix A are multiplied by their respective weights in Table 7 to obtain the reordered matrix as shown in Appendix D. The steps above are repeated, in order, to find the logarithm of the borda ordinal value after considering the risk appetite. The logarithms of the six ordinal numbers for the new inherent risk indicators are 0, 3, 1, 4, 2, and 5, respectively, while the logarithms of the six categories of the new frequency indicators are 0, 1, 5, 2, 3, and 4, respectively. Furthermore, there is a row-by-level increase or decrease in the matrix. The judgment matrix can be constructed directly and a two-factor judgment matrix can be established.
The matrix of the inherent risk indicators of the current and possible future states is as follows:
Similarly, the matrix of frequency risk indicators is as follows:
Step 3. Equations (4) and (5) are used to obtain the weights of the two matrices. The maximum eigenvalues are obtained using (7) and verified one at a time using (8), indicating that they are acceptable judgment matrices and satisfactory results. This proves that this method is highly efficient. The final results are shown in Table 6.
3.4. Result Analysis
A correlation assessment matrix is constructed based on the critical early warning points for each element in Table 3 in combination with the selected optimal evaluation reference data. Taking the six “inherent risks” categories as an example, the matrix obtained after dimensionless processing is as follows:
The difference between rows and rows are calculated according to (10), and the matrix is reobtained as follows:
is a Level V warning and shows a green alert; is a Level IV warning and shows a blue alert. The “frequency risk” degree of relevance is obtained by repeating the above steps in the same way.
This shows that “frequency risk” is in the blue alert state.
Using the same method, the overall disaster identification associated with the tailings dam can be obtained as follows:
This result shows that, based on the optimal reference assessment, both warnings and are in the blue alert state; however, when the risk bias degree was not considered, almost approached the “No warning” state. Thus, it is obviously more accurate after the risk degree is considered.
Figure 2 shows clearly that there are two columns for every correlation coefficient. Figure 2 also indicates that the early warning of the two states is almost identical; this is related to the management of the mine. An investigation showed that the mine has a perfect monitoring system for safety development that and no accident occurred in five years.
4. Results and Discussion
4.1. Method Comparison Analysis
The analysis of the borda ordinal number results, the characteristic symmetry of AHP, and scale of the latter on the diagonal all have a value of 1 for the purposes of weighing the importance ranking of other indicators. To facilitate a better understanding of this, the advantages of the method are explained in detail by taking the new “inherent risk” using the order in the section on “Finding the index weight” as an example. The relative indicators of the index –, after sorting by borda ordinals given in the latter section, are 0, 3, 1, 4, 2, and 5. These are turned into a matrix of diagonal 1 based on the 1–9 scale method and are analyzed as follows.
For the first row of matrix data sources, the index of the first column of the first row of the matrix is scaled to 1. The other values are then added in order of the principle of diagonal 1 and the scale obtained for the first row of the matrix is 1, 4, 2, 5, 3, and 6.
For the second row of matrix data sources, the index scale of the first row and second column is now 4, while the scale of the second row and second column of the matrix is still 1. The difference between them is 3 and the scale after the first row will be those values subtracted by 3. This results in values of -1, 2, 0, and 3; however, according to the order of the scale method, there should be no values equal to 0 or negative numbers. Therefore, these values are converted into 1/3 and 1/2, based on the order of the reciprocal of the scale of 1 to 9 and are finally included on the scale of each element of the second line as follows: 1, 1/3, 2, 1/2, and 3.
An inverted trapezoid with a step edge of 1 is finally obtained using other index scales as analogies. According to the principle of symmetry, the reciprocal of each scale constitutes a positive trapezoid with a step edge of 1 in the other half and finally forms a complete conformity with each element. The indicator matrix is as follows:
This borda method, combined with the AHP consistency verification, passes the verification process once; this avoids the trouble of improperly reselected scales.
Using the traditional AHP method results in a high uncertainty. This is because more than one matrix can be established to rank the same importance indexes, as shown in the following two examples:
After the traditional subjective judgment method was verified, the two types of consistencies noted above did not meet the requirements. Finding the matrix suitable for this evaluation index using this method was very time-consuming as each possible alternative had to be examined, and even if one passed the verification process it might not have been the only possibility. The method given in this research avoids this problem and achieves a highly efficient, precise, and unique result.
4.2. Comparison of Correlation Coefficients
When the trend of the risk state is not considered, the weight has a great influence on GRA method, which determines the size of the correlation coefficient. For comparison, the traditional AHP-GRA method is applied to this case. As with the DAHP-GRA method, all evaluation procedures are the same except that the indicators are static. Only the main steps are shown here. Similarly, the inherent risk weight set is calculated and frequency risk weight set is obtained, after which the corresponding degrees of relevance and are calculated. Therefore, the correlation degree of the early warning status of tailings dams can be obtained as follows:
Figure 3 provides a comparison of correlation coefficients for the early warning status of tailings dams. A comparison of Figures 2 and 3 shows that DAHP-GRA method not only avoids the tedious verifications of consistency but also gives the results of future risk trends. The latter can help mine supervisors effectively predict risk trends and find weak links in a timely manner.
4.3. Comparison of Warning Levels
Based on the early warning level set point range for the indicators and given in Table 3, we invited 79 experts to score the element table of the risk of tailings dam breakage. The recovery rate was 100% and we obtained 79 sets of data as the initial testing sample because the scope of our study was limited and the data group no longer listed. In addition, the results of scoring the 12 key elements selected in Appendix A were listed as test samples (see Table 8). The PNN method was used for early warning analysis  and the “newpnn” comprehensive early warning training and test samples were formed. The PNN in the MATLAB neural network toolbox was used to design the function, “wpnn” was used to create the training network, and the sim function was used to simulate the PNN. The parameter spread, with different spread values of 1, 6, and 12, was divided into three groups of data from which the “for” loops were selected and used to test the performance of the model. The early warning rates were 80% and above. One of these was selected and the group’s early warning classification results are shown in Table 8. These are almost the same as the warning results assessed by the experts, but the results from the latter were closer to the actual results.
To identify hazards to tailings dams and prevent human error from affecting the early warning status of these, experiments using the definition of risk were constructed using aspects of intrinsic and frequency risk with which to characterize the safety of the tailing dams. Spearman’s rank correlation coefficient method of 22 groups of initial indicators was calculated and 12 key dynamic early warning evaluation indicators were selected. Taking a tailings pond in China as an example, a comprehensive consideration of the risk bias and a study of the DAHP based on borda ordinal number resulted in an improved judgment of fuzzy importance. Those results were also compared with those from the traditional AHP method; it was found that the former avoids a cumbersome verification process and efficiently finding the weight ratios of 12 indicators in combinations of the current and possible future states. It then uses the early warning level and dynamic hierarchical association analysis to predict the “blue” state of early warnings of tailings dam disasters; this allows a better assessment of the state of the tailings dam breach. The method used in this study selects reasonable and effective forecasting indicators for use in mining risk assessments, intelligently updates risk statuses in real time, and establishes a data control and management model based on modern information technology. It would be of great significance in preventing and reducing the occurrence of serious accidents and would also provide a good basis for management inspectors to carry out accurate and realistic monitoring at all levels. We believe that the methods used in this study can also be applied in fields apart from mining safety. However, the early warning assessment data used here were collected from an expert database; other expert databases would need to be updated in real time for this method to be effective. We will also study the sensitivity of tailings dam disaster statuses if the many indicators used in this method that show that the early warning results are on the boundary between safety and danger but have been not studied because of space limits.
A. Expert Rating Results
See Table 9.
B. Spearman’s Rank Correlation Coefficient Results
See Table 10.
C. Key Element Original Borda Ordinal
See Table 11.
D. Key Elements New Borda Ordinal
See Table 12.
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare no conflicts of interest.
This work was supported by the National Key Technology Project of Prevention and Control of Major Accidents in Safety Production (Grant no. 149hubei-0002-2017AQ).
- F. Hooshyaripor, A. Tahershamsi, and S. Razi, “Dam break flood wave under different reservoir’s capacities and lengths,” Sādhanā, vol. 42, no. 9, pp. 1557–1569, 2017.
- A. B. Fourie, G. E. Blight, and G. Papageorgiou, “Static liquefaction as a possible explanation for the merriespruit tailings dam failure,” Canadian Geotechnical Journal, vol. 38, no. 4, pp. 707–719, 2001.
- B. Wang, C. Wu, L. Huang, L. Zhang, L. Kang, and K. Gao, “Prevention and control of major accidents (MAs) and particularly serious accidents (PSAs) in the industrial domain in China: current status, recent efforts and future prospects,” Process Safety and Environmental Protection, vol. 117, pp. 254–266, 2018.
- R. J. J. Beerens and H. Tehler, “Scoping the field of disaster exercise evaluation - a literature overview and analysis,” International Journal of Disaster Risk Reduction, vol. 19, pp. 413–446, 2016.
- Y. Sui, R. Ding, and H. Wang, “An integrated management system for occupational health and safety and environment in an operating nuclear power plant in East China and its management information system,” Journal of Cleaner Production, vol. 183, pp. 261–271, 2018.
- P. Baybutt, “Issues for security risk assessment in the process industries,” Journal of Loss Prevention in the Process Industries, vol. 49, pp. 509–518, 2017.
- O. Uduma, M. Galligan, H. Mollel, H. Masanja, S. Bradley, and E. McAuliffe, “The impact of a human resource management intervention on the capacity of supervisors to support and supervise their staff at health facility level,” Human Resources for Health, vol. 15, p. 57, 2017.
- Z. Z. Wu and G. D. Mei, “Statistical analysis of tailings pond accidents and cause analysis of dam failure,” China Safety Science Journal, vol. 24, no. 9, pp. 71–76, 2014 (Chinese).
- N. Khakzad, F. Khan, P. Amyotte, and V. Cozzani, “Risk management of domino effects considering dynamic consequence analysis,” Risk Analysis, vol. 34, no. 6, pp. 1128–1138, 2014.
- K. Wernstedt and P. Murray-Tuite, “The dynamic nature of risk perceptions after a fatal transit accident,” Risk Analysis, vol. 35, no. 3, pp. 536–552, 2015.
- S. Di Zio and M. Maretti, “Acceptability of energy sources using an integration of the Delphi method and the analytic hierarchy process,” Quality & Quantity, vol. 48, no. 6, pp. 2973–2991, 2014.
- S. Xu, T. Wang, and S. Hu, “Dynamic assessment of water quality based on a variable fuzzy pattern recognition model,” International Journal of Environmental Research and Public Health, vol. 12, no. 2, pp. 2230–2248, 2015.
- D. Güler and T. Yomralıoğlu, “Alternative suitable landfill site selection using analytic hierarchy process and geographic information systems: a case study in Istanbul,” Environmental Earth Sciences, vol. 76, no. 20, pp. 1866–6280, 2017.
- E. Thanassoulis, P. K. Dey, K. Petridis, I. Goniadis, and A. C. Georgiou, “Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis,” Journal of the Operational Research Society, vol. 68, no. 4, pp. 431–445, 2017.
- H. Wei, M. Wang, B. Song, X. Wang, and D. Chen, “Study on the magnitude of reservoir-triggered earthquake based on support vector machines,” Complexity, vol. 2018, Article ID 2830690, 10 pages, 2018.
- K. Hou, X. Li, J. Wang, and J. Zhang, “Evaluating ecological vulnerability using the GIS and analytic hierarchy process (AHP) method in Yan’an, China,” Polish Journal of Environmental Studies, vol. 25, no. 2, pp. 599–605, 2016.
- A. Samvedi, V. Jain, and F. T. Chan, “An integrated approach for machine tool selection using fuzzy analytical hierarchy process and grey relational analysis,” International Journal of Production Research, vol. 50, no. 12, pp. 3211–3221, 2012.
- X. Xia, Y. Sun, K. Wu, and Q. Jiang, “Optimization of a straw ring-die briquetting process combined analytic hierarchy process and grey correlation analysis method,” Fuel Processing Technology, vol. 152, pp. 303–309, 2016.
- D. Mathivathanan, K. Govindan, and A. N. Haq, “Exploring the impact of dynamic capabilities on sustainable supply chain firm's performance using grey-analytical hierarchy process,” Journal of Cleaner Production, vol. 147, pp. 637–653, 2017.
- Q. F. Nian, S. L. Shi, R. Q. Li, and W. K. Luo, “Research on risk early warning of safety production based on PNN in coal mines,” Journal of Safety Science and Technology, vol. 20, no. 7, pp. 1345–1359, 2013.
- D.-X. Zhao, B.-J. He, C. Johnson, and B. Mou, “Social problems of green buildings: from the humanistic needs to social acceptance,” Renewable & Sustainable Energy Reviews, vol. 51, pp. 1594–1609, 2015.
- A. T. Ubando, J. L. Cuello, M. M. El-Halwagi, A. B. Culaba, M. A. B. Promentilla, and R. R. Tan, “Application of stochastic analytic hierarchy process for evaluating algal cultivation systems for sustainable biofuel production,” Clean Technologies and Environmental Policy, vol. 18, no. 5, pp. 1281–1294, 2016.
- R. Biloslavo and A. Grebenc, “Integrating group Delphi, analytic hierarchy process and dynamic fuzzy cognitive maps for a climate warning scenario,” Kybernetes, vol. 41, no. 3-4, pp. 414–428, 2012.
- M. Hadzikadic, T. Carmichael, and C. Curtin, “Complex adaptive systems and game theory: an unlikely union,” Complexity, vol. 16, no. 1, pp. 34–42, 2010.
- Y. Gu, Z. Bao, and Z. Rui, “Complex lithofacies identification using improved probabilistic neural networks,” Petrophysics, vol. 59, no. 2, pp. 245–267, 2018.
- D. E. Goldberg, K. Sastry, and X. Llora, “Toward routine billion-variable optimization using genetic algorithms,” Complexity, vol. 12, no. 3, pp. 27–29, 2007.
- D. Lin, C. K. M. Lee, and Z. Wu, “Integrating analytical hierarchy process to genetic algorithm for re-entrant flow shop scheduling problem,” International Journal of Production Research, vol. 50, no. 7, pp. 1813–1824, 2012.
- R. G. van der Vegt, “Risk assessment and risk governance of liquefied natural gas development in gladstone, Australia,” Risk Analysis, vol. 38, no. 9, pp. 1830–1846, 2018.
- M. Abimbola and F. Khan, “Dynamic blowout risk analysis using loss functions,” Risk Analysis, vol. 38, no. 2, pp. 255–271, 2018.
- B. He, D. Zhao, J. Zhu, A. Darko, and Z. Gou, “Promoting and implementing urban sustainability in China: an integration of sustainable initiatives at different urban scales,” Habitat International, vol. 82, pp. 83–93, 2018.
- A. Meel and W. D. Seider, “Real-time risk analysis of safety systems,” Computers & Chemical Engineering, vol. 32, no. 4-5, pp. 827–840, 2008.
- C. Spearman, “The proof and measurement of association between two things,” International Journal of Epidemiology, vol. 39, no. 5, pp. 1137–1150, 2010.
- L. Yan, L. Zhang, W. Liang, W. Li, and M. Du, “Key factors identification and dynamic fuzzy assessment of health, safety and environment performance in petroleum enterprises,” Safety Science, vol. 94, pp. 77–84, 2017.
- P. Emerson, “The original Borda count and partial voting,” Social Choice and Welfare, vol. 40, no. 2, pp. 353–358, 2013.
- C. John, H. Hsiao, and P. David, “A Borda count for partially ordered ballots,” Social Choice and Welfare, vol. 42, no. 4, pp. 913–926, 2014.
- T. L. Saaty, “A scaling method for priorities in hierarchical structures,” Journal of Mathematical Psychology, vol. 15, no. 3, pp. 234–281, 1977.
- E. Kazuva, J. Zhang, Z. Tong, A. Si, and L. Na, “The DPSIR model for environmental risk assessment of municipal solid waste in Dar es Salaam city, Tanzania,” International Journal of Environmental Research and Public Health, vol. 15, no. 8, pp. 1660–4601, 2018.
- G. Zeng, R. Jiang, G. Huang, M. Xu, and J. Li, “Optimization of wastewater treatment alternative selection by hierarchy grey relational analysis,” Journal of Environmental Management, vol. 82, no. 2, pp. 250–259, 2007.
- W. Li, W. Liang, L. Zhang, and Q. Tang, “Performance assessment system of health, safety and environment based on experts' weights and fuzzy comprehensive evaluation,” Journal of Loss Prevention in the Process Industries, vol. 35, pp. 95–103, 2015.
- M. Yazdi, F. Nikfar, and M. Nasrabadi, “Failure probability analysis by employing fuzzy fault tree analysis,” International Journal of Systems Assurance Engineering and Management, vol. 8, pp. 1177–1193, 2017.
- A. Mottahedi and M. Ataei, “Fuzzy fault tree analysis for coal burst occurrence probability in underground coal mining,” Tunnelling and Underground Space Technology, vol. 83, pp. 165–174, 2019.
- S. M. Lavasani, N. Ramzali, F. Sabzalipour, and E. Akyuz, “Utilisation of fuzzy fault tree analysis (FFTA) for quantified risk analysis of leakage in abandoned oil and natural-gas wells,” Ocean Engineering, vol. 108, pp. 729–737, 2015.
Copyright © 2019 Wen Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.