Research Article | Open Access
Hongjun Zhang, Chengxiang Yin, Xiuli Qi, Rui Zhang, Xingdang Kang, "Cognitive Best Worst Method for Multiattribute Decision-Making", Mathematical Problems in Engineering, vol. 2017, Article ID 1092925, 11 pages, 2017. https://doi.org/10.1155/2017/1092925
Cognitive Best Worst Method for Multiattribute Decision-Making
Pairwise comparison based multiattribute decision-making (MADM) methods are widely used and studied in recent years. However, the perception and cognition towards the semantic representation for the linguistic rating scale and the way in which the pairwise comparisons are executed are still open to discuss. The commonly used ratio scale is likely to produce misapplications and the matrix based comparison style needs too many comparisons and is not able to guarantee the consistency of the matrix when the number of objects involved is large. This research proposes a new MADM method CBWM (Cognitive Best Worst Method) which adopts interval scale to represent the pairwise difference and only compares each object to the best object and the worst object rather than all the other objects. CBWM is a vector based method which only needs pairwise comparisons and is more likely to generate consistent comparisons and reliable results. The theoretical analysis and a real world application demonstrate the effectiveness of CBWM.
A typical multiattribute decision-making (MADM) problem can be described in Table 1. In Table 1, is a set of alternatives (actions, stimuli), is a set of criteria, and is the performance of alternative with respect to criterion . There are four kinds of tasks in MADM: description (), choice (), sorting (), and ranking () . elaborates the alternatives (building family of criteria, determining performances, weights, thresholds, etc.), aims at selecting a small number (as small as possible) of good alternatives, assigns each alternative into a family of predefined categories, and generates a partial or complete ordering for the alternatives. To handle MADM problems, various methods such as multiattribute utility theory (UTA , UTAGMS , AHP , ANP , MACBETH , P-CNP , etc.), outranking methods (ELECTRE , PROMETHEE , etc.), and some nonclassical methods (DRSA , FAHP , F-CNP , etc.) have been proposed. To get a whole picture of these methods, we refer to [1, 13–18].
Among these methods, AHP has been increasingly studied by plenty of researchers and applied in various applications due to its simplicity and practicability. AHP is based on pairwise comparison which is first introduced by Thurstone  and derives priority vector from the comparison matrix whose entry indicates the relative importance of object dominating object . In AHP, the paired difference is measured by the ratio scale and correspondingly is a pairwise reciprocal matrix (PRM).
Yuen [7, 20–22] pointed out that the paired ratio scale inappropriately represents the human perception or cognition of paired difference and potentially producing misapplications. Taking the comparison of two persons height, for example, if A is 1.4 m and B is 1.5 m, then we may say that B is slightly taller than A. However, if ratio scale is applied, the comparison result will be 2; for example, B is two times taller than A which is obviously unreasonable. The exaggeration of difference may cause the rank reversal problem and mislead the decision-maker. To handle this problem, Yuen proposed replacing the ratio scale by interval or differential scale which measures the difference rather than the quotient of the importance of two objects and accordingly converts the pairwise reciprocal matrix (PRM) to the pairwise opposite matrix (POM) and then derives the priority vector from POM by Primitive Cognitive Network Process (P-CNP).
Apart from the scale problem, Rezaei [23, 24] pointed out that the unstructured way in which pairwise comparisons are executed would cause the inconsistency of the pairwise comparison matrix. In order to improve the consistency, Rezaei proposed the Best Worst Method (BWM) which only compares each criterion to the best (most important, most desirable) and the worst (least important, least desirable) criterion, respectively. The pairwise comparison results are two vectors based on which a nonlinear model and a linear model are designed to derive the priority vector. BWM not only leads to more consistent comparisons but also reduces the number of comparisons.
Both P-CNP and BWM have been proved to be effective and been applied in some real world applications [22, 25–34]. However, to the best of our knowledge, there has not been a pairwise comparison based MADM method that has the two aspects of advantages possessed by P-CNP and BWM at the same time. In this paper, we propose the Cognitive Best Worst Method (CBWM) which executes the pairwise comparisons in the same way as BWM and adopts the interval scale to measure the difference. CBWM possesses the advantages of both P-CNP and BWM and shows better characteristics than both the two methods. Compared to P-CNP, CBWM needs less pairwise comparisons and is likely to get more consistent pairwise comparisons. Compared to BWM, CBWM adopts the interval scale which is more suitable for measuring the cognitive paired comparisons and acquires more reliable results. The theoretical and experimental analyses demonstrate the good performance of CBWM.
The rest of this paper is organized as follows. Section 2 reviews P-CNP and BWM. Section 3 illustrates the Cognitive Best Worst Method. Section 4 presents an application using CBWM and compares CBWM to AHP, P-CNP, and BWM. Section 5 concludes the research.
2. Review of P-CNP and BWM
The P-CNP is the cognitive architecture which comprises cognitive decision processes: Problem Cognitive Process (PCP), Cognitive Assessment Process (CAP), Cognitive Prioritization Process (CPP), Multiple Information Fusion Process (MIP), and Decision Volition Process (DVP).
In PCP, the goal of the decision-maker and the criteria set and the alternatives set are determined. Besides the elements aforementioned, a measurement scale schema which maps the verbal scales to the corresponding numerical scales is also needed. As P-CNP adopts interval scales to measure the pairwise differences, the numerical representations should be in the following form: is the normal utility which is the mean of individual utility values of the comparison objects. is the number of intervals in the scale schema. From the definition of we can get . For the convenience of computation, we set ; then each element in will be an integer. Table 2 gives an example of the ratio scale and the interval scale ().
In CAP, the pairwise comparisons are executed and the pairwise opposite matrix (POM) is constructed. Let an ideal utility vector of the objects involved in the pairwise comparisons be ; then the ideal POM will be , where . Let be the subjective judgment POM provided by the experts; then is determined by in the following way:
The pairwise comparison matrix is called POM because holds for all . In , Yuen proposed that a POM is perfectly accordant if
The accordance index (AI) is used to measure the degree of accordance.
If , then is perfectly accordant; if , then is satisfactory; if , is unsatisfactory.
The purpose of CPP is to derive the priority vector from the POM. The two common used methods are primitive least squares (PLS) method and least penalty squares (LPS) method.
The PLS method derives the utility vector through the following model:
If there exists , can be increased such that .
LPS can be seen as the weighted version of PLS in which the weight is the penalty factor . The utility vector can be derived by the following model:
After obtaining the utility vector , the normalized priority vector can be obtained easily by
MIP is the same as the aggregation process traditionally mentioned in MADM and DVP is the decision process based on the aggregated global utility of each alternative.
BWM is a vector based MADM method which requires fewer comparisons than the matrix based method such as AHP. Here we briefly describe the steps of BWM.
Step 1. Determine a set of decision criteria.
Step 2. Determine the best criterion and worst criterion .
As is mentioned in , the decision-maker identifies the best and the worst criteria in general in this step. And if more than one criterion is considered to be the best or the worst, one can be chosen arbitrarily. No comparison is made at this stage.
Step 3. Execute pairwise comparisons between the best criterion and the other criteria. The result of the comparisons is the best-to-others vector denoted as
Step 4. Execute pairwise comparisons between the other criteria and the worst criterion. The result of the comparisons is the others-to-worst vector denoted as
Step 5. Derive the weight vector . The weight vector can be obtained by solving the following problem:
In (11), is the weight of the best criterion; is the weight of the worst criterion. Rezaei  pointed out that the solution of problem (11) is not unique when there are more than three criteria and the comparison vectors are not completely consistent and he proposed another linear model to derive the weight vector.
Let be the solution of problem (12); the consistency ratio of the pairwise comparisons in BWM is defined as
3. Cognitive Best Worst Method
In this section, we elaborate the proposed Cognitive Best Worst Method (CBWM) which can be seen as interval ratio based BWM. The basic process of CBWM is the same as BWM, so we focus on the differences caused by introducing interval ratio to represent pairwise difference.
We still use and to denote the best-to-others and others-to-worst vectors, while each element in the two vectors is expressed by interval scale as in Table 2. The best and the worst criteria should be determined by the decision-maker in the same way as mentioned in BWM. Let be the best criterion and be the worst criterion; then denotes the difference between and , and denotes the difference between and . It is notable that all and are nonnegative. As is the difference between the best criterion and the worst criterion, we can get that is the maximal element in both and , and ( is the normal utility and ).
Proposition 1. The pairwise comparison vectors and are perfectly accordant if
3.1. Consistency Index
Based on Proposition 1, we define the consistency index (CI) to measure the deviation of the pairwise comparison vectors and from consistency.
It is easy to verify that and if and only if and are perfectly accordant.
Now we discuss the relation of in (16) and in (4). The basic ideas of and are the same, for they both measure the average deviation of each element in the pairwise comparison matrix (vector) from consistency. The values of and are comparable for the same MADM problem. We define the random consistency index as the mathematical expectation of when all the values except in and are selected randomly and independently from the set .
Theorem 3. Consider the following:
Proof. Let . When the th criterion is the best or the worst one, the value of will be zero; otherwise the value of will be in the closed interval and the corresponding probability distribution is given in Table 4. It is easy to verify that .
According to the probability distribution of , we can get the mathematical expectation of .The values corresponding to different criteria in the two vectors and are independent, so we can get
For , we define random accordance index as the mathematical expectation of when all the elements of the pairwise opposite matrix are selected from the set randomly and independently under the constraint that . To get the value of , we run the simulation which generates the POM in the way as just described 10000 times and calculate each time; then we take the average of the 10000 values as the estimate of .
Table 5 shows the values of and with different and when . From Table 5 we can clearly see that for the given and which means that CBWM is more likely to get a more consistent pairwise comparison result than P-CNP. The reason of this phenomenon is that the elements in vectors of CBWM are all nonnegative while the elements of the POM may be either positive or negative, which leads to the fact that the maximal value of is 1 and the maximal value of is 9.
The above analysis is valid under the circumstance that the decision-maker is able to appropriately determine the best and the worst criteria. Comparing the best and the worst objects to the others matches the habit and process of human cognition and then is likely to get more consistent results than comparing each pair of the objects. However, if the decision-maker is not able to determine the best and the worst criteria, the above analysis is of no sense and CBWM method is not suitable for the problem.
Another advantage of CBWM is that it is easy to check the consistency and identify the cause of inconsistency. The examination and identification can be done intuitively with the help of Table 6. The first and the second rows are the values of and , respectively. We can sum the elements in rows 1 and 2 and compare the results to . If is too different from , we should revise and to get more consistent vectors.
3.2. Derivation of Utility Vector
Theorem 4. When the comparison vectors and are completely consistent, the utility vector can be derived by
When the comparison vectors and are not fully consistent, we propose two methods to derive the utility vector: the minimization of the maximal deviation method (MMD) and the minimization of total deviation method (MTD).
In MMD, the optimal utility vector is the one where, for each pair of and , we have and . To satisfy these conditions, we find a solution where the maximal absolute differences and for all are minimized. The optimal utility vector can be obtained by solving the following problem:
Problem (22) can be transferred to the following linear programming problem:
In MTD, the optimal utility vector should be the one where the total deviation is minimized. It is natural to get the following model:
Also, if there exists , can be increased such that .
3.3. Numerical Example
3.3.1. Example 1
Supposing, in a MADM problem, there are four criteria , among which is the best criterion and is the worst criterion. The comparison vectors provided by the experts are and with . The aim is to get the weight vector which expresses the relative importance of each criterion. We first calculate the consistency index by (16) and we can get . As and are fully consistent, we can use (20) or (21) to get the utility vector. The utility vector derived from (20) is and the corresponding weight vector is .
3.3.2. Example 2
Here we revise Example 1 in  using CBWM to illustrate the CBWM steps discussed above. The example involves selecting a transport mode for a company. The criteria determined by the company are as follows: : load flexibility, : accessibility, and : cost. The company identifies that is the best criterion and is the worst criterion, and the original comparison vectors in ratio scale are and . In interval scale, the corresponding comparison vectors will be and with .
By MMD, we can get the utility vector and the weight vector .
By MTD, we can get the utility vector and the weight vector .
In this section, we compare the proposed MADM method CBWM to AHP, P-CNP, and BWM on a real world MADM problem.
4.1. Problem Description
Here the transport company selection problem discussed by [7, 35] is revised by AHP, P-CNP, BWM, and CBWM methods. A company needs to select a freight transportation company from four alternatives (T1, T2, T3, and T4) to deliver its goods. The criteria considered are transportation costs (TC), defective rate (DR), tardiness rate (TR), flexibility (F), and documentation ability (DA).
Six pairwise reciprocal matrices are shown in Table 7. The top left matrix is the comparisons between criteria and the other five matrices are comparisons between alternatives with respect to different criteria. Saaty’s consistency ratio is given under each matrix.
Tables 9 and 10 show the pairwise comparison vectors under ratio and interval scale, respectively. These vectors are extracted from the corresponding matrices. represents the index of the best criterion (alternative) and represents the index of the worst criterion (alternative). It is worth noting that, on criterion TC, the alternatives T1 and T3 are equal and are both the worst. Rezaei  pointed out that if more than one criterion is considered to be the best or the worst, one can be chosen arbitrarily. Here we choose T1 as the worst with respect to TC.
The comparison matrices on criteria DR and DA are completely consistent in Table 8 while it is not the case in Table 7. The phenomenon indicates the consistent cognition for pairwise comparison in a matrix can be distorted as inconsistent by ratio scale . It is also the same when replacing the comparison matrices with comparison vectors. We can see that the comparison vectors on criteria DR and DA are completely consistent in Table 10 while it is not the case in Table 9. It is also worth noting that the pairwise comparison vectors are always consistent when the corresponding matrices are consistent under whatever scales while the opposite is obviously not the case. As per the results above and the analysis of consistency index in Section 3.1, we can say that CBWM can get more consistent pairwise comparisons than AHP, BWM, and P-CNP.
4.2. Results of Different Methods
Tables 11–15 show the prioritization and aggregation results along with the ranking of the alternatives from the best to the worst. The results of AHP in Table 11 are obtained by the eigenvector methods. The results of BWM in Table 12 are obtained by solving linear model (12). The results of P-CNP in Table 13 are obtained by the PLS method in (5). The results of CBWM-MMD in Table 14 are obtained by the MMD method in (23). The results of CBWM-MTD in Table 15 are obtained by the MTD method in (24).
The results in  show that P-CNP performs better than AHP because P-CNP gets stable rankings with different prioritization methods while AHP get fluctuant rankings with different prioritization methods. From our results in Tables 11–15, we can see that the BWM obtains similar results to AHP with respect to both ranking and total utility, while the two prioritization methods of CBWM both achieve results very close to the P-CNP’s results. We can say that CBWM acquires more reliable results and performs better than BWM in this case based on the conclusion in .
4.3. Comparisons with respect to Total Deviation
In order to measure the performance of different methods further, we employ total deviation (TD)  to make the comparison. The original definition of total deviation (TD) is the Euclidean distance between the ratios of weights and their pairwise comparison . is the pairwise reciprocal matrix using ratio scale; and are the weights of the th criterion and the th criterion, respectively.
For interval scale, we need to modify the definition of TD as is the pairwise opposite matrix using interval scale; and are the utilities of the th criterion and the th criterion, respectively.
As the numbers of pairwise comparisons of P-CNP (AHP) and CBWM (CWM) are and , respectively, it is unfair to judge the performances of these methods directly by TD. To make fair comparison, we employ the average TD which is the quotient of MV divided by the number of pairwise comparisons. So the definitions of TD for each method would be
Table 16 shows the TDs of different methods when determining the relative importance of each criterion. From the table, we can see that the total deviations of ratio scale based methods are significantly bigger than interval scale based methods; that is to say, the proposed CBWM performs better than BWM. It is worth noting that the TD of P-CNP is smaller than CBWM, but it does not mean that P-CNP performs better than CBWM. The reason is that the accordance index of P-CNP is 0.1168 while the consistency index of CBWM is 0.2016. According to the analysis of the relationship of CI and AI in Section 3.1, the phenomenon that is unusual.
5. Conclusion and Future Research
In this paper, a new interval scale and vector based pairwise comparison MADM method CBWM (Cognitive Best Worst Method) is proposed. CBWM combines the ideas of P-CNP and BWM method and shows better characteristics than the two methods. The theoretical and experimental analyses demonstrate the good performance of CBWM. The excellent features CBWM shows are summarized as follows:(1)CBWM is vector based method and needs less pairwise comparisons than matrix based methods. The numbers of pairwise comparisons are and for CBWM and matrix based methods, respectively, where is the number of objects involved in the comparisons.(2)CBWM can get more consistent pairwise comparison results due to the use of interval scale and the best worst comparison strategy.(3)As the interval scale is more suitable for measuring cognitive paired comparisons, CBWM acquires more reliable decision results than ratio scale based methods.
It is worth noting that CBWM is only suitable for the problem in which the decision-maker is able to determine the best and the worst criteria.
The future research will focus on two aspects; one is to apply CBWM to more real world MADM problems, and the other is to extent CBWM to fuzzy or interval judgments to capture the uncertainty in the process of MADM.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
This work was supported by the Natural Science Foundation of Jiangsu Province (Grants no. BK20150720).
- S. Greco, M. Ehrgott, and J. R. Figueira, Multiple Criteria Decision Analysis: State of the Art Surveys, International Series in Operations Research & Management Science, Springer, New York, NY, USA, 2016.
- E. Jacquet-Lagreze and J. Siskos, “Assessing a set of additive utility functions for multicriteria decision-making, the UTA method,” European Journal of Operational Research, vol. 10, no. 2, pp. 151–164, 1982.
- S. Greco, V. Mousseau, and R. Słowiński, “Ordinal regression revisited: multiple criteria ranking using a set of additive value functions,” European Journal of Operational Research, vol. 191, no. 2, pp. 416–435, 2008.
- T. L. Saaty, “How to make a decision: the analytic hierarchy process,” Interfaces, vol. 24, no. 6, pp. 19–43, 1994.
- T. L. Saaty, “Decision making—the Analytic Hierarchy and Network Processes (AHP/ANP),” Journal of Systems Science and Systems Engineering, vol. 13, no. 1, pp. 1–35, 2004.
- C. Bana e Costa and J.-C. Vansnick, “MACBETH—an interactive path towards the construction of cardinal value functions,” International Transactions in Operational Research, vol. 1, no. 4, pp. 489–500, 1994.
- K. K. F. Yuen, “The primitive cognitive network process: comparisons with the analytic hierarchy process,” International Journal of Information Technology & Decision Making, vol. 10, no. 4, pp. 659–680, 2011.
- B. Roy, “The outranking approach and the foundations of ELECTRE methods,” Theory and Decision, vol. 31, no. 1, pp. 49–73, 1991.
- J.-P. Brans, P. Vincke, and B. Mareschal, “How to select and how to rank projects: the PROMETHEE method,” European Journal of Operational Research, vol. 24, no. 2, pp. 228–238, 1986.
- S. Greco, B. Matarazzo, and R. Slowinski, “Rought sets theory for multicriteria decision analysis,” European Journal of Operational Research, vol. 129, no. 1, pp. 1–47, 2001.
- P. J. van Laarhoven and W. Pedrycz, “A fuzzy extension of Saaty's priority theory,” Fuzzy Sets and Systems, vol. 11, no. 3, pp. 229–241, 1983.
- K. K. F. Yuen, “Fuzzy cognitive network process: comparisons with fuzzy analytic hierarchy process in new product development strategy,” IEEE Transactions on Fuzzy Systems, vol. 22, no. 3, pp. 597–610, 2014.
- J. R. Figueira, S. Greco, B. Roy, and R. Słowiński, “An overview of electre methods and their recent extensions,” Journal of Multi-Criteria Decision Analysis, vol. 20, no. 1-2, pp. 61–85, 2013.
- J. Wallenius, J. S. Dyer, P. C. Fishburn, R. E. Steuer, S. Zionts, and K. Deb, “Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead,” Management Science, vol. 54, no. 7, pp. 1336–1349, 2008.
- M. Behzadian, R. B. Kazemzadeh, A. Albadvi, and M. Aghdasi, “PROMETHEE: a comprehensive literature review on methodologies and applications,” European Journal of Operational Research, vol. 200, no. 1, pp. 198–215, 2010.
- N. Subramanian and R. Ramanathan, “A review of applications of Analytic Hierarchy Process in operations management,” International Journal of Production Economics, vol. 138, no. 2, pp. 215–241, 2012.
- C. Kahraman, S. C. Onar, and B. Oztaysi, “Fuzzy multicriteria decision-making: a literature review,” International Journal of Computational Intelligence Systems, vol. 8, no. 4, pp. 637–666, 2015.
- K. K. F. Yuen, “Analytic hierarchy prioritization process in the AHP application development: a prioritization operator selection approach,” Applied Soft Computing, vol. 10, no. 4, pp. 975–989, 2010.
- L. L. Thurstone, “A law of comparative judgment,” Psychological Review, vol. 34, no. 4, pp. 273–286, 1927.
- K. K. F. Yuen, Cognitive network process with fuzzy soft computing technique in collective decision aiding [Ph.D. thesis], Hong Kong Polytechnic University, Hong Kong, 2009.
- K. K. F. Yuen, “Pairwise opposite matrix and its cognitive prioritization operators: comparisons with pairwise reciprocal matrix and analytic prioritization operators,” Journal of the Operational Research Society, vol. 63, no. 3, pp. 322–338, 2012.
- K. K. F. Yuen, “The primitive cognitive network process in healthcare and medical decision making: comparisons with the analytic hierarchy process,” Applied Soft Computing, vol. 14, no. 1, pp. 109–119, 2014.
- J. Rezaei, “Best-worst multi-criteria decision-making method,” Omega, vol. 53, pp. 49–57, 2015.
- J. Rezaei, “Best-worst multi-criteria decision-making method: some properties and a linear model,” Omega, vol. 64, pp. 126–130, 2016.
- K. K. F. Yuen, “Software-as-a-Service evaluation in cloud paradigm: primitive cognitive network process approach,” in Proceedings of the 2nd IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC '12), pp. 119–124, August 2012.
- C. Guan and K. K. F. Yuen, “Towards a hybrid approach of primitive cognitive network process and agglomerative hierarchical clustering for music recommendation,” in Proceedings of the 11th International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness (QSHINE '15), pp. 206–209, Taipei, Taiwan, 2015.
- V. Q. Chen and K. K. F. Yuen, “Towards a hybrid approach of Primitive Cognitive Network Process and Self-Organizing Map for computer product recommendation,” in Proceedings of the International Conference on Intelligent Computing and Internet of Things (ICIT '15), pp. 9–12, January 2015.
- K. Kam, F. Yuen, and M. Yuen, “Department course selection problem: the primitive cognitive network process approach,” in Proceedings of the IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE '12), pp. H1C-15–H1C-17, August 2012.
- K. K. F. Yuen, “Towards an evaluation strategy for consumer electronic products using primitive cognitive network process,” in Proceedings of the IEEE International Conference on Consumer Electronics—Taiwan (ICCE-TW '15), pp. 72–73, June 2015.
- K. K. F. Yuen and W. Wang, “Towards a ranking approach for sensor services using primitive cognitive network process in,” in Proceedings of the IEEE 4th Annual International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER '14), pp. 344–348, Hong Kong, 2014.
- J. Rezaei, T. Nispeling, J. Sarkis, and L. Tavasszy, “A supplier selection life cycle approach integrating traditional and environmental criteria using the best worst method,” Journal of Cleaner Production, vol. 135, pp. 577–588, 2016.
- S. Sadaghiani, K. W. Ahmad, J. Rezaei, and L. Tavasszy, “Evaluation of external forces affecting supply chain sustainability in oil and gas industry using Best Worst Method,” in Proceedings of the 1st Mediterranean Gas and Oil International Conference (MedGO '15), pp. 1–4, April 2015.
- J. Rezaei, J. Wang, and L. Tavasszy, “Linking supplier development to supplier segmentation using Best Worst Method,” Expert Systems with Applications, vol. 42, no. 23, pp. 9152–9164, 2015.
- N. Salimi and J. Rezaei, “Measuring efficiency of university-industry Ph.D. projects using best worst method,” Scientometrics, vol. 109, no. 3, pp. 1911–1938, 2016.
- O. Kulak and C. Kahraman, “Fuzzy multi-attribute selection among transportation companies using axiomatic design and analytic hierarchy process,” Information Sciences, vol. 170, no. 2–4, pp. 191–210, 2005.
- B. Golany and M. Kress, “A multicriteria evaluation of methods for obtaining weights from ratio-scale matrices,” European Journal of Operational Research, vol. 69, no. 2, pp. 210–220, 1993.
Copyright © 2017 Hongjun Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.