Research on the Evaluation Model for Wireless Sensor Network Performance Based on Mixed Multiattribute Decision-Making

Song, Jiekun; Zhang, Yemeng; Zhao, Zhihao; Chen, Rui

doi:https://doi.org/10.1155/2021/8885009

Journal of Sensors

On this page

Abstract Introduction Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Recent Advances in Security and Privacy for Wireless Sensor Networks 2020

View this Special Issue

Research Article | Open Access

Volume 2021 | Article ID 8885009 | https://doi.org/10.1155/2021/8885009

Research on the Evaluation Model for Wireless Sensor Network Performance Based on Mixed Multiattribute Decision-Making

Jiekun Song,¹Yemeng Zhang,¹Zhihao Zhao,¹and Rui Chen¹

Academic Editor: Iftikhar Ahmad

Received21 Mar 2020

Revised28 Jan 2021

Accepted20 May 2021

Published03 Jun 2021

Abstract

Many application fields initiate using wireless sensor network (WSN), and the evaluation for its performance becomes an important topic, which can help the decision-maker to find the deficiency of the current WSN or seek the best WSN. There exist mixed multiple attributes in the WSN performance evaluation process, for example, some evaluation indicators can be expressed as interval numbers, while others can be expressed as linguistic variables, so it is necessary to explore the evaluation model based on mixed multiattribute decision-making (MADM). Considering the specific evaluation purpose and requirements for different enterprises, this paper puts forward an indicator selection method and a subjective weighting method based on the rough set theory. After that, based on the transformation of mixed attributes into the unified intuitionistic fuzzy numbers (IFNs), an objective weighting method based on intuitionistic fuzzy entropy is proposed. Meanwhile, the combined weights of indicators are obtained by synthesizing the subjective and objective weights. Subsequently, in order to evaluate WSN performance objectively, an integrated comprehensive evaluation framework is proposed, which includes single evaluation, compatibility test, combination evaluation, and consistency test. The paper gives specific models and calculation steps in detail. Finally, it provides a case study to explain the application of the proposed indicator selection method and the evaluation models, which provide new ideas and references for WSN performance evaluation.

1. Introduction

WSN is a combination of multiple sensor nodes, which play a role in real-time sensing, collecting, processing, and transmitting the sensing object information. In recent years, WSN has become more and more popular in many fields, such as environmental monitoring, Internet of Things, factory maintenance, and target tracking on battlefields. In particular, enterprise production and people’s life more and more rely on WSN, and how to evaluate the performance of WSN becomes more and more vital. Scientific evaluation can help decision-makers objectively compare the performance of different WSNs, so as to get the objective comparison result, improve the performance of existing WSN, or provide decision support for the selection of the best WSN. Many scholars have focused on the performance evaluation of WSN. According to the evaluation object, it mainly includes link quality [1–3], protocol performance [4–7], quality of service (QoS) [8–11], reliability [12–15], robustness [16–18], and overall performance [19–23]. Gomes et al. [1] used the received signal strength indication and data packet information as indicators to test the link quality of industrial WSN. Jayasri and Hemalatha [2] put forward the link quality parameters and used Kalman filter method to evaluate the link quality. Shu et al. [3] established a link quality estimation model in terms of a support vector machine with a decision tree. Chen et al. [4] evaluated protocol performance according to coverage awareness and energy saving. Souil et al. [5] analyzed the performance of media access control (MAC) protocol using transmission probability and data delivery ratio. Mokdad et al. [6] used loss probabilities, average delay, and average delivery ratio as performance indicators to evaluate the protocol. Ketshabetswe et al. [7] compared the property of different routing protocols based on latency, success rate, energy consumption, and energy efficiency. Arora et al. [8] used throughput, end-to-end delay, network load, and other indicators to evaluate the QoS of WSN. Long et al. [9] constructed a network layer QoS evaluation indicator system including throughput, the success rate of communication, packet loss rate, and energy efficiency. Wu et al. [10] proposed a QoS evaluation model in the basis of ideal points of vague sets. Kumar et al. [11] reviewed the machine learning techniques in QoS evaluation of WSN, including artificial neural network and reinforcement learning. He et al. [12] evaluated WSN reliability in terms of hierarchical trust rules, which combined fault evaluation with security evaluation. Zhu et al. [13] established the transmission reliability evaluation models for WSNs. Sun and Willmann [14] proposed a dependability evaluation method of industrial WSN based on deep learning. Yue and He [15] summarized the research progress of mobile WSN reliability and qualitatively analyzed different reliability schemes from packet loss rate, throughput, connectivity, and other aspects. Hu and Li [16] proposed the measurement metrics of WSN robustness, including betweenness, node degree, and connectivity coverage. Acharya and Tripathy [17] proposed four WSN cluster deployment models and compared their robustness from the first node dies, network lifetime, energy cost, and other indicators. Wang et al. [18] proposed robustness performance indicators such as power consumption, cost, and message delay and established an evaluation model based on the extension cloud theory. Jiang et al. [19] used gain-cost to represent the performance of the entire network and combined the three evaluation indicators of network efficiency, network reliability, and network connection energy cost into a function of net revenue. Zhou and Li [20] selected time delay, packet loss rate, and throughout as evaluation indicators and adopted the linear weighting method for comprehensive evaluation. Anwar et al. [21] compared trust-based security WSN and key-based security WSN from two aspects of time delay and throughput. Li et al. [22] proposed a hierarchy model from three aspects of availability, dependability, and capability and established a weighted comprehensive evaluation model for WSN performance. Luan et al. [23] summarized the performance evaluation indicators of WSN in the network layer, survivability, monitoring performance, and positioning technology and introduced a linear weighted comprehensive evaluation method. Literature review shows that the performance evaluation of WSN is actually a comprehensive process of multiple indicators. Among the evaluation methods in the existing literature, the performance indicators of WSN are mostly expressed by precise real numbers. In fact, due to the passage of time and the instability of the external environment, the values of indicators such as time delay and packet loss rate are often uncertain. In addition, the values of qualitative indicators can be expressed as linguistic variables. Therefore, based on the mixed MADM method, the establishment of a comprehensive evaluation model of WSN performance is more realistic, and the conclusion will be more scientific.

There are many ways to express the attributes of evaluation objects, which can be divided into deterministic attributes and uncertain attributes [24]. Due to the uncertainty and variability of the environment, the research on the expression and decision-making of uncertain attributes is increasingly in-depth. Zadeh [25] first proposed the concept of the fuzzy set (FS). On the basis of FS, Atanassov [26] and Torra and Narukawa [27], respectively, introduced the intuitionistic fuzzy set (IFS) and hesitant fuzzy set (HFS) for further describing the uncertain characteristics. To associate the occurring probability of hesitant fuzzy numbers, Xu and Zhou [28] presented the probabilistic HFS. Zhu et al. [29] introduced the dual HFS as an extension of FS. Yager [30] developed the Pythagorean fuzzy set (PyFS). Cuong [31] and Smarandache [32], respectively, proposed the picture fuzzy set (PFS) and neutrosophic set as the general forms of FS and IFS. Considering that fuzzy language terms were often used for qualitative description, Zadeh [33] proposed the linguistic variable (LV) characterized by a fuzzy compatibility function. Wang and Li [34] and Rodriguez et al. [35], respectively, introduced the intuitionistic LV and the hesitant fuzzy LV. Xu [36] proposed the uncertain LV with the lower and upper limits. For comparing multiple evaluation objects, a lot of MADM methods have been developed to accommodate different attribute types. Xu and Zhao [37] reviewed the aggregation operators of IFS and proposed that some operators have ideal properties. Beliakov et al. [38] introduced the definition of the generalized aggregation of IFS, which can deal with the failure caused by the extreme value. Liu and Jin [39] developed a hybrid geometric operator of the intuitionistic uncertain LV. Besides the aggregation operator methods, some traditional methods in MADM are widely used, including distance measure [37, 39], TOPSIS (technique for order preference by similarity to ideal solution) [40], GRA (grey relational analysis) [41, 42], VIKOR (Vlse Kriterijumska Optimizacija I Kompromisno Resenje) [43–45], and ER (evidence reasoning) methods [45, 46]. For the mixed MADM problem, scholars mainly put forward the distance-based methods [47–49] and the transformation technique-based methods [46, 50–55]. Lourenzutti and Krohling [48] and Pan and Geng [49], respectively, proposed a group modular random TOPSIS method and a modular random VIKOR method, which can break heterogeneous information into independent attribute modules and process information in a straight forward way without unifying. Wang and Li [50] determined the ideal alternatives and developed an interactive MADM method. Herrera et al. [51] and Liu [52] transformed the heterogeneous information into the 2-tuple LV and ranked the alternatives by dominance degree and 2-tuple linguistic weighting arithmetic average values, respectively. Bao et al. [46] aggregated the heterogeneous information into IFNs and applied integrating prospect theory and ER to rank the alternatives. Xu et al. [53] proposed an approach that aggregates the heterogeneous information into IFNs by group evaluation in rating system and TOPSIS and applied intuitionistic weighted arithmetic mean operator for ranking the alternatives. Wan et al. [54, 55] proposed an aggregation method for fusing heterogeneous information into interval-valued IFNs and applied a weighted averaging operator for ranking the alternatives. Because the transformation technique-based methods can avoid information loss to a certain extent, the research on them in mixed MADM is more extensive in recent years.

To sum up, scholars have established various WSN performance evaluation indicator systems and proposed various comprehensive evaluation models. However, the current research needs to be deepened in the following two aspects: (1) Different evaluation subjects have different goals and requirements, so how to select evaluation indicators according to their actual situation? (2) There are both deterministic attributes and uncertain attributes in the evaluation indicator system. How to establish a more scientific comprehensive evaluation model based on the mixed MADM method? This study mainly focuses on the above two aspects, and its contributions are as follows: (1) A rough set method for WSN performance evaluation indicator selection is proposed, which can make full use of the experience of the field experts and provide relatively complete indicators that meet the needs of decision-makers. (2) An indicator weighting method based on subjective and objective synthesis is proposed, in which the subjective and objective weights of each indicator are obtained by the rough set method and by entropy technique, respectively. (3) An evaluation model based on intuitionistic fuzzy MADM is proposed, which integrates single evaluation, compatibility test, combination evaluation, and consistency test.

This article is organized as follows: Section 2 presents the indicator selection method on the basis of the rough set. Section 3 presents the indicator weighting method based on rough set and intuitionistic fuzzy entropy. Section 4 presents the evaluation model based on intuitionistic fuzzy MADM. Section 5 illustrates an example of the evaluation and selection of the WSN partner to demonstrate how to apply the proposed model. Section 6 concludes the study.

2. Indicator Selection Based on Rough Set

Due to the different evaluation purposes and requirements of WSN performance, it is difficult to establish a consistent indicator system. We design an indicator selection method based on the rough set theory to solve this problem [56, 57]. It is assumed that a comprehensive evaluation indicator system containing two levels of indicators has been preliminarily established by referring to relevant literature. The evaluation organizers investigate experts with rich practical experience in the WSN field and invite each expert to judge the importance of primary indicators and the corresponding secondary indicators according to the Likert’s five-level scale method. The numbers from 1 to 5 represent unimportant, general, important, very important, and especially important, respectively. With each primary indicator as the decision attribute and all the corresponding secondary indicators as the condition attributes, we can get decision tables. It shows the decision table form in Table 1, where and are Likert values given by the th expert for the importance of and relative to WSN performance evaluation.

The steps of indicator selection based on a rough set are as follows:

Step 1. According to the decision attribute , divide the argument domains into equivalent classes: .

Step 2. Calculate the lower approximation of the th equivalence class regarding the conditional attribute set as follows: The positive domain of is as follows:

Step 3. Remove the attribute from and calculate . If ), it means that is a redundant attribute and can be deleted from . Then, we can get the reduced conditional attribute set.

Step 4. According to step 2 and step 3, continue to test whether there are redundant attributes in the reduced condition attribute set until all of the attributes are nonredundant. Then, we can get the reduced secondary indicator set .

3. Indicator Weighting Based on Rough Set and Intuitionistic Fuzzy Entropy

The indicator weight has an important influence on the results of WSN performance evaluation. The subjective weight of the indicator is calculated by using the concept of relativity of rough set, so as to reflect the experts’ cognition of the importance of each indicator. At the same time, the objective weight can be obtained by the intuitionistic fuzzy entropy, which can reflect the difference between the indicator values in the actual evaluation.

3.1. Indicator Weighting Based on Rough Set

Based on the reduced secondary indicators , we calculate the dependence of on as follows: , where ∣•∣ represents the cardinality of the set. Then, we calculate the dependence of on the condition attribute in : . By standardizing as follows: we can get the subjective weight of each secondary indicator relative to the primary indicator.

For a small number of primary indicators, experts can jointly determine weights based on their experience. By multiplying the weight of the secondary indicator by its corresponding weight of the primary indicator, we can obtain the composite weight of each secondary indicator. Suppose there are secondary indicators after reduction, and their subjective weights are denoted as .

3.2. Indicator Weighting Based on Intuitionistic Fuzzy Entropy

Because IFS take the information of membership degree, nonmembership degree, and hesitation degree into consideration at the same time, it can more accurately reflect the objective reality, and it is more reasonable for decision-makers to understand and apply. Therefore, different types of evaluation information can be uniformly transformed into IFNs, and on this basis, the weight of each attribute can be determined and the MADM can be made. references [46, 53] provided different methods to aggregate heterogeneous information into IFNs. The former is applicable to the case containing both qualitative and quantitative attributes, and the values of qualitative attributes are jointly given by group members. The latter is applicable to the case that all the attributes are qualitative, and multiple decision-makers, respectively, give the value of some attribute in the same rating system. Here, we suppose that all the attribute values of each alternative are known and refer to the former method to aggregate precise numbers, interval numbers, and linguistic variables into IFNs. Since the normalization method in [46] may produce the extreme (1, 0), making the comparison of different alternatives less objective, we suggest replacing the normalization method with vector normalization. For the triangular fuzzy numbers (TFNs) or trapezoidal fuzzy numbers (TrFNs), we can extract their cut sets and convert them to interval numbers [58]. The values of secondary indicators of WSNs comprise the evaluation matrix .

Case 1. If the value of the th indicator of each WSN is a positive precise real number, , we can use the formula (4) to get dimensionless value and then convert to the intuitionistic fuzzy number . where and represent the benefit attribute set and the cost attribute set, respectively.

Case 2. If is an interval number , , we can convert it to a dimensionless interval number by using the formula (5).

The corresponding intuitionistic fuzzy number is . Among them, the precise real number of can be first converted to an interval number .

Case 3. If is a triangular fuzzy number or a trapezoidal fuzzy number , we can convert it to an interval number or by extracting its α-cut set and then convert the interval number to the intuitionistic fuzzy number according to the Case 2.

Case 4. If is an uncertain linguistic variable . , , we can quantify it to an interval number by the two-level proportion method (see Table 2) and convert it to the intuitionistic fuzzy number which is according to the Case 2. Among them, a certain linguistic variable can be first converted to an uncertain language variable .

Entropy can reflect the degree of numerical dispersion, and the entropy method is often used for objective weighting of indicators. There are many discussions on intuitionistic fuzzy entropy [47, 59, 60]. According to the scientific axiomatic definition in reference [59], we conduct traversal simulation of various measurement formulas on the set of an intuitionistic fuzzy number and choose the formula in reference [47]. Based on the matrix , the intuitionistic fuzzy entropy of the th indicator is as follows: where is the score of : and is the accuracy of : .

The objective weight of the th indicator is as follows:

Let the weight of subjective weights be and that of objective weights 1-α, and we can get the comprehensive weight of each indicator: .

4. Evaluation Model Based on Intuitionistic Fuzzy MADM

When all the values of attributes are uniformly transformed into IFNs, WSN performance evaluation becomes an intuitionistic fuzzy MADM problem. As mentioned in the literature review, there are many intuitionistic fuzzy MADM methods. For the intuitionistic fuzzy MADM problems with known weights, the researched models mainly include aggregation operator, TOPSIS, VIKOR, GRA, and ER models. Different models have their own based-techniques and basic principles, which are summarized in Table 3. It is difficult to determine which model is most suitable for WSN performance evaluation. Each of these models is theoretically applicable. In order to fully utilize the results of various models, we put forward a combination evaluation framework that includes a single evaluation, Kendall compatibility test, combination evaluation, and Spearman consistency test.

4.1. Single Evaluation Models

Combined with the research progress of aggregation operator, TOPSIS, VIKOR, GRA, and ER models, we provide the following single performance evaluation models for WSN.

4.1.1. Aggregation Operator Model

There are a variety of forms of aggregation operators [37]. Because the HWA (hybrid weighted averaging) operator considers both the importance and the position of attributes and has such ideal properties as idempotency, boundedness, and monotony, we select HWA operator for WSN performance evaluation. The calculation steps are as follows:

Step 1. Calculate the weighted matrix: , where

Step 2. Calculate the score and accuracy of . In terms of the sorting rule of IFNs: (1) the higher score, the greater value; (2) when the scores are the same, the higher accuracy, the greater value, and we reorder the values of indicators of each WSN from large to small. Let be the th intuitionistic fuzzy number, , and we can get the corresponding value before weighted and the indicator weight .

Step 3. Calculate the position weight vector by the normal distribution method. Let be the weight of the th position; then, the comprehensive value of the th WSN is as follows:

Step 4. Calculate the score and accuracy of and sort WSNs according to the sorting rule of IFNs.

4.1.2. TOPSIS Model

The basic principle of the TOPSIS model is to compare each object by its relative proximity to the ideal points. The calculation steps are as follows:

Step 1. Determine the positive and negative ideal points of evaluation matrix : where and .

Step 2. Calculate the distance between the th object and the positive and negative ideal points:

Because the distance measure in reference [47] can consider the characteristics of fluctuation and nonconcreteness of intuitionistic fuzzy information, we apply it to calculate the distance between two IFNs and , and the formula is as follows:

In the formula (12), and are the score and accuracy of , respectively, .

Step 3. Calculate the proximity of the th WSN:

Sort all the WSNs according to their proximities from large to small.

4.1.3. VIKOR Model

VIKOR model takes both group utility and individual regret into account, and it can reflect the preference of decision-makers by the trade-off coefficient. Firstly, calculate the group utility value and the individual regret value of the th WSN:

Secondly, calculate the benefit ratio value : where is the trade-off coefficient between the group utility and individual regret, .

Finally, sort all the WSNs according to their benefit ratio values from small to large.

4.1.4. GRA Model

The principle of GRA is to evaluate each object according to its relation degree with the reference sequence (usually positive ideal point). Firstly, calculate the relation coefficient between the th indicator of the th WSN and the positive ideal point: where is the distinguishing coefficient, .

Secondly, calculate the relation degree of the th WSN:

Finally, sort all the WSNs according to their relation degrees from large to small.

4.1.5. ER Model

Each indicator of the evaluation object in the ER model is regarded as proof. Based on the identification framework composed of multiple evaluation grades, we can evaluate each proof and get the belief degree that it belongs to each grade. By combining the weight of each indicator, we can use the evidence of reasoning algorithm to get the belief degree of the evaluation object. In this paper, we use the IDS software for the evidence of reasoning of WSN performance [61], and the steps are as follows:

Step 1. Build an indicator hierarchy comprising a top attribute and bottom attributes. The top attribute has the best and the worst grade, and the utility values are 1 and 0, respectively. The bottom attributes also have the best and the worst grade, and the belief degree vectors of them for the combination (best, worst) are (1, 0) and (0, 1), respectively. Input the weights of bottom attributes into the IDS software.

Step 2. Insert alternatives and input the belief degree that the th indicator of the th alternative belongs to the best and worst grades, that is, the value expressed in the form of an intuitionistic fuzzy number .

Step 3. Evaluate the th alternative and get the belief degree vector of the top attribute for the combination (best, worst), namely, the intuitionistic fuzzy number .

Step 4. Calculate the score and accuracy of and sort all the WSNs according to the sorting rule of an intuitionistic fuzzy number.

4.2. Kendall Compatibility Test

Since the evaluation results of the above single models may differ greatly, we need to obtain less divergent evaluation results through compatibility test, so as to conduct further combination evaluation [62]. Let be the rank of the th WSN in the th single model, ; . When , we can calculate Kendall’s coefficient of concordance as follows:

Given the significance level , if the value is no less than the critical value , then the models are compatible.

When , we calculate the statistical indicator: , where

Given the significance level , if the value is no less than the critical value , then the models are compatible.

For the case of incompatibility, we can calculate the statistical indicator of the remaining models by eliminating a single model and obtain the set of compatible models with the largest statistical value.

4.3. Combination Evaluation Models

The evaluation values of each WSN in the above single models are all in the range [-1, 1], and their meanings are clear. In order to fully utilize of the evaluation information, we further carry out the combination evaluation according to the numerical value rather than ranking. To eliminate the influence of actual value range difference between models and keep the correlation of the previous results unchanged, we firstly apply the extremum transformational method to convert the original results into the range [0, 1]. Among them, the benefit ratio value in the VIKOR model is converted according to the conversion method of the cost indicator, and the results of the other four models are converted according to the conversion method of the benefit indicator. Let be the result from the th WSN in the th compatible model after the extremum transformation, , . The widely used combination evaluation models based on the numerical value mainly include averaging, principal component analysis (PCA), MSE- (mean square error-) based weighted, optimization, drift, and cooperative game models [63, 64]. Since the PCA model requires a large number of samples, we apply the other five models for combination evaluation.

4.3.1. Averaging Model

All the single evaluation models have the same status in this combination model, and the average value of the results in compatible models for each WSN is its combination evaluation result.

4.3.2. MSE-Based Weighted Model

This model is an objective weighted method. By calculating the MSE of the th compatible model and taking its proportion to the MSEs’ sum of all the models as the weight , we can calculate the combination evaluation result of each WSN as follows:

4.3.3. Optimization Model

The objective function is to minimize the sum of the error squares between the weighted combination results and the single evaluation results of all WSNs. We can get the optimal weights of all the compatible models by solving the optimization model and can calculate the combination evaluation result by substituting them into formula (20).

4.3.4. Drift Model

Assuming there exists an objective model, the weight of each model can be calculated based on the drift of its result relative to the result of the objective model. The further the drift, the greater the weight. In this paper, we assume that the averaging model, MSE-weighted model, or optimization model is the objective model and record its evaluation result as the reference . Calculate the correlation coefficient between the result of the th single evaluation model and the reference [65], then the drift is , and the weight is as follows:

Substitute the weights of all the single evaluation models into the formula (20), and we can get the combination evaluation result.

4.3.5. Cooperative Game Model

Assuming there exists an objective model, we calculate the average absolute error between the result of the th single evaluation model and that of the objective model as the characteristic function of the alliance :

Similarly, we can calculate the characteristic functions of the alliances. Let be the contribution of the th model to alliance , and then, we can get the Shapley value of the th model as its average contribution to the whole alliance :

The weight of the th model is as follows:

Substitute the weights of all the single evaluation models into the formula (20), and then, we can get the combination evaluation result.

4.4. Spearman Consistency Test

The method of Spearman rank correlation coefficient can be used to test the consistency between each combination evaluation model and all the compatible model set [63, 64]. The Spearman rank correlation coefficient between the th combination model and the th single evaluation model is as follows: where and are the ranks of the th WSN in the th combination evaluation model and the th single evaluation model, respectively, ; ; .

When , we calculate the average correlation coefficient as follows:

Then, we output the ranking result in the combination model with the maximum average correlation coefficient as the ultimate evaluation result.

When , we can calculate the statistical indicator as follows:

Given the significance level , if the value is no less than the critical value , it means that the th combination evaluation model is consistent with the compatible model set. Then, we output the ranking result of the combination model with the largest statistical value and passed the consistency test as the final evaluation result.

5. A Case Study

The decision-makers of company H, a manufacturer of cold chain products, plan to choose the best WSN partner for the Internet of Things from five WSNs: . The preliminary evaluation indicator system is shown in Figure 1.

Considering the possibility of redundancy between indicators, we use the proposed rough set method to select indicators. Taking the network layer QoS as an example, we get the decision table by consulting ten experts in Table 4. For example, the first expert thinks that the packet loss rate is especially important for the network layer QoS, and network layer QoS is important for the WSN performance evaluation, so the Likert value for the importance of the packet loss rate is 5, and that of the network layer QoS is 3. Following the reduction steps, we get five reduction sets of conditional attributes that include {energy consumption balance, time delay}, {energy consumption balance, time delay jitter}, {packet loss rate, energy consumption balance, time delay jitter}, {energy efficiency, energy consumption balance, time delay jitter}, and {packet loss rate, throughout, energy efficiency, time delay}. Through further consultation with experts, we select the four elements in the fifth reduction set as the secondary indicators.

Similarly, we get the secondary indicators of reliability including security, survivability, and anti-interference capability and those of monitoring performance including network coverage, self-organizing ability, and sensor node capability. According to formula (3), we calculate the weight of each secondary indicator relative to the primary indicator. The experts consider that each primary indicator has the same weight 1/3; then, we can get the weight of each indicator for WSN performance evaluation in Table 5.

Through expert interviews and data monitoring, we get the original evaluation data of five alternative WSN partners in Table 6. The indicators , , , and are expressed as interval numbers, is expressed as a precise real number, and the other five indicators are expressed linguistic variables from the seven-level linguistic term set {highest, very high, high, average, low, very low, lowest}.

After vector normalization of the above evaluation matrix elements and the unified conversion to IFNs, we get the intuitionistic fuzzy decision-making matrix as follows:

According to formulas (6) and (7), the intuitionistic fuzzy entropy weights of ten indicators are 0.0811, 0.0839, 0.0979, 0.0990, 0.0964, 0.0962, 0.1047, 0.1335, 0.1047, and 0.1025 in sequence. Suppose the weights of the subjective and objective weights are both 0.5, the combination weights of ten indicators are 0.0644, 0.0896, 0.0966, 0.0971, 0.0853, 0.1222, 0.1079, 0.1052, 0.1036, and 0.1282 in sequence. By using the aggregation operator, TOPSIS, VIKOR, GRA, and ER models, we get their evaluation results as shown in Table 7.

The results of these five single models are not consistent. In particular, the result of the VIKOR model is significantly different from those of the other four models, which may be caused by the fact that the VIKOR model considers individual regret factor at the same time. Kendall’s coefficient of concordance equals 110, which is less than the critical value , so the five single evaluation models are not compatible. By removing a single model at a time, we get the statistical value of the remaining models as shown in Table 8.

Remove the VIKOR model, and Kendall’s coefficient of concordance of the other four models equals 106, greater than the critical value , so the remaining four models are compatible. By applying the extremum transformation method, we convert the results of four single evaluation models into the range [0, 1]. By substituting the normalized values into the averaging, MSE-based weighted, and optimization combination models, we find that the optimal weights of four compatible models are all 0.25, indicating that the result of the optimization model is the same as that of the averaging model. Taking the averaging and MES-based weighted models as the objective model, we get the results of the drift and cooperative game models. The results of six combination evaluation models are summarized in Table 9.

The ranking results of six combination evaluation models are identical, i.e., . The average correlation coefficient is 0.775, indicating that the results of the combination evaluation models have great consistency with the single evaluation models. It can be seen that the combination evaluation can make full use of the evaluation information, overcome the shortcomings, and retain the advantages of each method, so as to realize the consistent fusion of different single evaluation models. According to the above ranking results, company H can give priority to as the WSN partner.

6. Conclusions

In this research, considering that the purposes and requirements of different enterprises for WSN performance evaluation are not the same, we propose a method of indicator selection based on the rough set. By consulting experts with Likert’s five-level scale and using the attribute reduction method of the rough set, we can obtain a relatively small-scale WSN performance evaluation indicator system that reflects the individual experience and judgment of experts. In addition, based on the decision tables, we also calculate the subjective weights of indicators by using the concept of dependence.

Considering the mixed multiattribute characteristics of the indicators, we first transform the precise real numbers, interval numbers, linguistic variables, TFNs, and TrFNs into the unified form of IFNs. Then, we calculate the objective weights of indicators on the basis of intuitionistic fuzzy entropy. By the linear combination of subjective and objective weights, we get the comprehensive weights.

Based on the research progress of intuitionistic fuzzy MADM methods, we put forward five single evaluation models for WSN performance, including aggregation operator, TOPSIS, VIKOR, GRA, and ER models. In order to make full use of their results, we propose the thought and framework of combination evaluation. First, we perform the Kendall compatibility test to get the compatible model set. Second, we apply the averaging, MSE-based weighted, optimization, drift, and cooperative game models to perform the combination evaluation. Third, we carry out the Spearman consistency test to get the best combination evaluation result.

The case study proves that the proposed indicator selection method and the evaluation models are feasible and efficient. In practice, decision-makers can apply the thought and method in this paper for performance evaluation or optimal selection of WSN.

Even though this study considers the mingle multiple attributes in the WSN performance evaluation process, there still exist other expression forms of evaluation indicators that should be taken into consideration. For instance, the values of indicators may contain the other forms, such as hesitant fuzzy number, Pythagorean fuzzy number, picture fuzzy number, and spherical fuzzy number simultaneously, so finding the way of unifying them into a consistent form with little information distortion is necessary for the future. The rough set method is used for subjective weight determination in this study. Actually, in addition to this method, there exist other methods suitable for subjective indicator weighting. For instance, the analytic network process (ANP) can take the correlations among indicators at the same level into consideration. Therefore, integrating the rough set method and other subjective weighting methods to improve indicator weighting may also be another future research direction.

Data Availability

The gathered data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work is supported by the National Natural Science Foundation of China (71871222).

References

R. D. Gomes, D. V. Queiroz, A. C. Lima Filho, I. E. Fonseca, and M. S. Alencar, “Real-time link quality estimation for industrial wireless sensor networks using dedicated nodes,” Ad Hoc Networks, vol. 59, pp. 116–133, 2017.
View at: Publisher Site | Google Scholar
T. Jayasri and M. Hemalatha, “Link quality estimation for adaptive data streaming in WSN,” Wireless Pers Commun, vol. 94, no. 3, pp. 1543–1562, 2017.
View at: Publisher Site | Google Scholar
J. Shu, S. Liu, L. Liu, L. Zhan, and G. Hu, “Research on link quality estimation mechanism for wireless sensor networks based on support vector machine,” Chinese Journal of Electronics, vol. 26, no. 2, pp. 377–384, 2017.
View at: Publisher Site | Google Scholar
D. Chen, L. Chen, M. Chen, and M. Y. Hsu, “A coverage-aware and energy-efficient protocol for the distributed wireless sensor networks,” Computer Communications, vol. 137, pp. 15–31, 2019.
View at: Publisher Site | Google Scholar
M. Souil, A. Bouabdallah, and A. E. Kamal, “Efficient QoS provisioning at the MAC layer in heterogeneous wireless sensor networks,” Computer Communications, vol. 43, pp. 16–30, 2014.
View at: Publisher Site | Google Scholar
L. Mokdad, J. Ben-Othman, B. Yahya, and S. Niagne, “Performance evaluation tools for QoS MAC protocol for wireless sensor networks,” Ad Hoc Networks, vol. 12, pp. 86–99, 2014.
View at: Publisher Site | Google Scholar
L. K. Ketshabetswe, A. U. M. Zungeru, M. Mangwala, J. M. Chuma, and B. Sigweni, “Communication protocols for wireless sensor networks: a survey and comparison,” Heliyon, vol. 5, no. 5, article e01591, 2019.
View at: Publisher Site | Google Scholar
V. K. Arora, V. Sharma, and M. Sachdeva, “On QoS evaluation for ZigBee incorporated wireless sensor network (IEEE 802.15.4) using mobile sensor nodes,” Journal of King Saud University – Computer and Information Sciences, 2018.
View at: Publisher Site | Google Scholar
Y. Long, Y. Wu, X. Wang, R. Feng, and J. Wan, “Research on evaluation method for network layer QoS in wireless sensor networks,” Chinese Journal of Sensors and Actuators, vol. 23, no. 12, pp. 1766–1771, 2010.
View at: Google Scholar
J. Wu, L. Wang, and H. Shi, “Method to evaluate WNS QoS,” Journal of Hainan Tropical Ocean University, vol. 25, no. 5, pp. 80–85, 2018.
View at: Google Scholar
D. Praveen Kumar, T. Amgoth, and C. S. R. Annavarapu, “Machine learning algorithms for wireless sensor networks: a survey,” Information Fusion, vol. 49, pp. 1–25, 2019.
View at: Publisher Site | Google Scholar
W. He, G. Hu, Z. Zhou et al., “A new hierarchical belief-rule-based method for reliability evaluation of wireless sensor network,” Microelectronics Reliability, vol. 87, pp. 33–51, 2018.
View at: Publisher Site | Google Scholar
X. Zhu, Y. Lu, J. Han, and L. Shi, “Transmission reliability evaluation for wireless sensor networks,” International Journal of Distributed Sensor Networks, vol. 12, no. 2.
View at: Publisher Site | Google Scholar
D. Sun and S. Willmann, “Deep learning-based dependability assessment method for industrial wireless network,” IFAC PapersOnLine, vol. 52, pp. 219–224, 2019.
View at: Publisher Site | Google Scholar
Y. Yue and P. He, “A comprehensive survey on the reliability of mobile wireless sensor networks: taxonomy, challenges, and future directions,” Information Fusion, vol. 44, pp. 188–204, 2018.
View at: Publisher Site | Google Scholar
S. Hu and J. Li, “TMSE: a topology modification strategy to enhance the robustness of scale-free wireless sensor networks,” Computer Communications, vol. 157, pp. 53–63, 2020.
View at: Publisher Site | Google Scholar
S. Acharya and C. R. Tripathy, “A reliable fault-tolerant ANFIS model based data aggregation scheme for Wireless Sensor Networks,” Journal of King Saud University –Computer and Information Sciences, vol. 32, no. 6, pp. 741–753, 2020.
View at: Publisher Site | Google Scholar
Z. Wang, D. Wang, Q. Zhang, and Z. Zhang, “Robustness evaluation of WSN based on extension cloud theory,” Software Guide, vol. 16, no. 7, pp. 1–4, 2017.
View at: Google Scholar
N. Jiang, B. Li, P. Pan, T. Wan, and L. Liu, “C-POEM: comprehensive performance optimization evaluation model for wireless sensor networks,” Soft Computing, vol. 21, no. 12, pp. 3377–3385, 2017.
View at: Publisher Site | Google Scholar
C. Zhou and X. Li, “Research on comprehensive evaluation of industrial wireless sensor network performance,” Computer Engineering, vol. 36, no. 16, pp. 82–84, 2010.
View at: Google Scholar
R. W. Anwar, A. Zainal, F. Outay, A. Yasar, and S. Iqbal, “BTEM: belief based trust evaluation mechanism for wireless sensor networks,” Future Generation Computer Systems, vol. 96, pp. 605–616, 2019.
View at: Publisher Site | Google Scholar
G. Li, W. Jiang, and J. Tao, “Effectiveness evaluation of wireless sensor networks based on AHP,” Informatization Research, vol. 43, no. 6, pp. 74–78, 2017.
View at: Google Scholar
J. Luan, Q. Wang, X. He et al., “Analysis of wireless sensor network performance evaluation,” Machine Building Automation, vol. 44, no. 3, pp. 165–167, 2015.
View at: Google Scholar
J. F. Pang and J. Y. Liang, “Evaluation of the results of multi-attribute group decision-making with linguistic information,” Omega, vol. 40, no. 3, pp. 294–301, 2012.
View at: Publisher Site | Google Scholar
L. A. Zadeh, “Fuzzy sets,” Information and Control, vol. 8, no. 3, pp. 338–353, 1965.
View at: Publisher Site | Google Scholar
K. Atanassov, “Intuitionistic fuzzy sets,” Fuzzy Sets and Systems, vol. 20, no. 1, pp. 87–96, 1986.
View at: Publisher Site | Google Scholar
V. Torra and Y. Narukawa, “On hesitant fuzzy sets and decision,” in 2009 IEEE International Conference on Fuzzy Systems, pp. 1378–1382, Jeju Island, Korea, August 2009.
View at: Publisher Site | Google Scholar
Z. Xu and W. Zhou, “Consensus building with a group of decision makers under the hesitant probabilistic fuzzy environment,” Fuzzy Optimization and Decision Making, vol. 16, no. 4, pp. 481–503, 2017.
View at: Publisher Site | Google Scholar
B. Zhu, Z. Xu, and M. Xia, “Dual hesitant fuzzy sets,” Journal of Applied Mathematics, vol. 2012, Article ID 879629, 13 pages, 2012.
View at: Publisher Site | Google Scholar
R. R. Yager, “Pythagorean fuzzy subsets,” in 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS), pp. 57–61, Edmonton, Canada, June 2013.
View at: Publisher Site | Google Scholar
B. C. Cuong, “Picture fuzzy sets,” Journal of Computer Science and Cybernetics, vol. 30, no. 4, pp. 409–420, 2014.
View at: Google Scholar
F. Smarandache, A Unifying Field in Logics: Neutrosophic Logic, Am. Res. Press, Rehoboth, 1999.
L. A. Zadeh, “The concept of a linguistic variable and its application to approximate reasoning: part III,” Information Sciences, vol. 9, no. 1, pp. 43–80, 1975.
View at: Publisher Site | Google Scholar
J. Q. Wang and J. J. Li, “The multi-criteria group decision making method based on multi-granularity intuitionistic two semantics,” Science & Technology Information, vol. 33, pp. 8-9, 2009.
View at: Google Scholar
R. M. Rodriguez, L. Martinez, and F. Herrera, “Hesitant fuzzy linguistic term sets for decision making,” IEEE Transactions on Fuzzy Systems, vol. 20, no. 1, pp. 109–119, 2012.
View at: Publisher Site | Google Scholar
Z. S. Xu, “Induced uncertain linguistic OWA operators applied to group decision making,” Information Fusion, vol. 7, no. 2, pp. 231–238, 2006.
View at: Publisher Site | Google Scholar
Z. Xu and N. Zhao, “Information fusion for intuitionistic fuzzy decision making: an overview,” Information Fusion, vol. 28, pp. 10–23, 2016.
View at: Publisher Site | Google Scholar
G. Beliakov, H. Bustince, D. P. Goswami, U. K. Mukherjee, and N. R. Pal, “On averaging operators for Atanassov’s intuitionistic fuzzy sets,” Information Sciences, vol. 181, no. 6, pp. 1116–1124, 2011.
View at: Publisher Site | Google Scholar
P. Liu and F. Jin, “Methods for aggregating intuitionistic uncertain linguistic variables and their application to group decision making,” Information Sciences, vol. 205, pp. 58–71, 2012.
View at: Publisher Site | Google Scholar
S. Zeng, A. Hussain, T. Mahmood, M. Irfan Ali, S. Ashraf, and M. Munir, “Covering-based spherical fuzzy rough set model hybrid with TOPSIS for multi-attribute decision-making,” Symmetry, vol. 11, no. 4, p. 547, 2019.
View at: Publisher Site | Google Scholar
W. L. Liu and P. D. Liu, “Hybrid multiple attribute decision making method based on relative approach degree of grey relation projection,” African Journal of Business Management, vol. 4, no. 17, pp. 3716–3724, 2010.
View at: Google Scholar
G. W. Wei, “GRA method for multiple attribute decision making with incomplete weight information in intuitionistic fuzzy setting,” Knowledge-Based Systems, vol. 23, no. 3, pp. 243–247, 2010.
View at: Publisher Site | Google Scholar
J. H. Park, H. J. Cho, and Y. C. Kwun, “Extension of the VIKOR method to dynamic intuitionistic fuzzy multiple attribute decision making,” Computers and Mathematics with Applications, vol. 65, no. 4, pp. 731–744, 2013.
View at: Publisher Site | Google Scholar
S. Opricovic and G. H. Tzeng, “Extended VIKOR method in comparison with outranking methods,” European Journal of Operational Research, vol. 178, no. 2, pp. 514–529, 2007.
View at: Publisher Site | Google Scholar
R. Wang, W. Li, X. Luo, and C. Lv, “Extended VIKOR method of multi-attribute decision making under intuitionistic fuzzy environment based on a new distance measure,” Systems Engineering and Electronics, vol. 41, no. 11, pp. 2524–2532, 2019.
View at: Google Scholar
T. Bao, X. Xie, and P. Meng, “Intuitionistic fuzzy hybrid multi-criteria decision making based on prospect theory and evidential reasoning,” System Engineering—Theory and Practice, vol. 37, no. 2, pp. 460–468, 2017.
View at: Google Scholar
Y. Li, Y. Chen, C. Luo, and Z. Cai, “Method for multi-attribute decision making based on probabilistic hesitant-intuitionistic fuzzy entropy and evidential reasoning,” Systems Engineering and Electronics, vol. 42, no. 5, pp. 1116–1123, 2020.
View at: Google Scholar
R. Lourenzutti and R. A. Krohling, “A generalized TOPSIS method for group decision making with heterogeneous information in a dynamic environment,” Information Science, vol. 330, pp. 1–18, 2016.
View at: Publisher Site | Google Scholar
Y. Pan and X. Geng, “Hybrid multiple attribute decision making approach based on Mo-RVIKOR,” Chinese Journal of Management Science, vol. 27, no. 12, pp. 143–151, 2019.
View at: Google Scholar
F. Wang and H. Li, “Novel method for hybrid multiple attribute decision making based on TODIM method,” Journal of Systems Engineering and Electronics, vol. 26, no. 5, pp. 1023–1031, 2015.
View at: Publisher Site | Google Scholar
F. Herrera, L. Martínez, and P. J. Sánchez, “Managing non-homogeneous information in group decision making,” European Journal of Operational Research, vol. 166, no. 1, pp. 115–132, 2005.
View at: Publisher Site | Google Scholar
P. Liu, “A novel method for hybrid multiple attribute decision making,” Knowledge-Based Systems, vol. 22, no. 5, pp. 388–391, 2009.
View at: Google Scholar
J. Xu, S. P. Wan, and J. Y. Dong, “Aggregating decision information into Atanassov’s intuitionistic fuzzy numbers for heterogeneous multi-attribute group decision making,” Applied Soft Computing, vol. 41, pp. 331–351, 2016.
View at: Publisher Site | Google Scholar
S. P. Wan, J. Xu, and J. Y. Dong, “Aggregating decision information into interval-valued intuitionistic fuzzy numbers for heterogeneous multi-attribute group decision making,” Knowledge-Based Systems, vol. 113, pp. 155–170, 2016.
View at: Publisher Site | Google Scholar
S. P. Wan and J. Y. Dong, Decision Making Theories and Methods Based on Interval-Valued Intuitionistic Fuzzy Sets, Springer, 2020.
View at: Publisher Site
Z. Pawlak, “Rough sets,” International Journal of Computer and Information Sciences, vol. 11, no. 5, pp. 341–356, 1982.
View at: Publisher Site | Google Scholar
M. J. Benítez-Caballero, J. Medina, E. Ramírez-Poussa, and D. Ślȩzak, “Rough-set-driven approach for attribute reduction in fuzzy formal concept analysis,” Fuzzy Sets and Systems, vol. 391, pp. 117–138, 2020.
View at: Publisher Site | Google Scholar
F. Wang, Q. Wu, L.-G. Zhou, and H.-Y. Chen, “An approach to multiple attribute group decision making based on the continuous intuitionistic trapezoidal fuzzy similarity measure,” Fuzzy Systems and Mathematics, vol. 32, no. 3, pp. 144–154, 2018.
View at: Google Scholar
T. Wu, L. Bai, E. Liu, and X. Sun, “New entropy formula of intuitionistic fuzzy sets and its application,” Computer Engineering and Applications, vol. 49, no. 23, pp. 48–51, 2013.
View at: Google Scholar
X. Quan, “An improved formula of intuitionistic fuzzy entropy,” Computer Engineering and Software, vol. 36, no. 10, pp. 40–42, 2015.
View at: Google Scholar
D. L. Xu, G. McCarthy, and J. B. Yang, “Intelligent decision system and its application in business innovation self assessment,” Decision Support Systems, vol. 42, no. 2, pp. 664–673, 2006.
View at: Publisher Site | Google Scholar
Y. Zhang and G. Chi, “An evaluation and empirical analysis of urban economic and social development based on the set pair analysis,” Science Research Management, vol. 40, no. 11, pp. 46–56, 2019.
View at: Google Scholar
G. H. Chen, M. J. Li, and Y. T. Chen, Research on Combinatorial Evaluation and Its Computer Integrated System, Tsinghua University Press, 2007.
F. M. Zhang, Method of the Combination Evaluation and Its Application, Science Press, 2018.
J. Song and C. Chu, “Research on the evaluation system of service enterprise competitiveness,” in ICSSSM11, pp. 1–6, Tianjin, 2011.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Jiekun Song et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

649

Downloads

680

Citations