Research Article  Open Access
Hongjun Zhang, Chengxiang Yin, Xiuli Qi, Rui Zhang, Xingdang Kang, "Cognitive Best Worst Method for Multiattribute DecisionMaking", Mathematical Problems in Engineering, vol. 2017, Article ID 1092925, 11 pages, 2017. https://doi.org/10.1155/2017/1092925
Cognitive Best Worst Method for Multiattribute DecisionMaking
Abstract
Pairwise comparison based multiattribute decisionmaking (MADM) methods are widely used and studied in recent years. However, the perception and cognition towards the semantic representation for the linguistic rating scale and the way in which the pairwise comparisons are executed are still open to discuss. The commonly used ratio scale is likely to produce misapplications and the matrix based comparison style needs too many comparisons and is not able to guarantee the consistency of the matrix when the number of objects involved is large. This research proposes a new MADM method CBWM (Cognitive Best Worst Method) which adopts interval scale to represent the pairwise difference and only compares each object to the best object and the worst object rather than all the other objects. CBWM is a vector based method which only needs pairwise comparisons and is more likely to generate consistent comparisons and reliable results. The theoretical analysis and a real world application demonstrate the effectiveness of CBWM.
1. Introduction
A typical multiattribute decisionmaking (MADM) problem can be described in Table 1. In Table 1, is a set of alternatives (actions, stimuli), is a set of criteria, and is the performance of alternative with respect to criterion . There are four kinds of tasks in MADM: description (), choice (), sorting (), and ranking () [1]. elaborates the alternatives (building family of criteria, determining performances, weights, thresholds, etc.), aims at selecting a small number (as small as possible) of good alternatives, assigns each alternative into a family of predefined categories, and generates a partial or complete ordering for the alternatives. To handle MADM problems, various methods such as multiattribute utility theory (UTA [2], UTAGMS [3], AHP [4], ANP [5], MACBETH [6], PCNP [7], etc.), outranking methods (ELECTRE [8], PROMETHEE [9], etc.), and some nonclassical methods (DRSA [10], FAHP [11], FCNP [12], etc.) have been proposed. To get a whole picture of these methods, we refer to [1, 13–18].
Among these methods, AHP has been increasingly studied by plenty of researchers and applied in various applications due to its simplicity and practicability. AHP is based on pairwise comparison which is first introduced by Thurstone [19] and derives priority vector from the comparison matrix whose entry indicates the relative importance of object dominating object . In AHP, the paired difference is measured by the ratio scale and correspondingly is a pairwise reciprocal matrix (PRM).
Yuen [7, 20–22] pointed out that the paired ratio scale inappropriately represents the human perception or cognition of paired difference and potentially producing misapplications. Taking the comparison of two persons height, for example, if A is 1.4 m and B is 1.5 m, then we may say that B is slightly taller than A. However, if ratio scale is applied, the comparison result will be 2; for example, B is two times taller than A which is obviously unreasonable. The exaggeration of difference may cause the rank reversal problem and mislead the decisionmaker. To handle this problem, Yuen proposed replacing the ratio scale by interval or differential scale which measures the difference rather than the quotient of the importance of two objects and accordingly converts the pairwise reciprocal matrix (PRM) to the pairwise opposite matrix (POM) and then derives the priority vector from POM by Primitive Cognitive Network Process (PCNP).
Apart from the scale problem, Rezaei [23, 24] pointed out that the unstructured way in which pairwise comparisons are executed would cause the inconsistency of the pairwise comparison matrix. In order to improve the consistency, Rezaei proposed the Best Worst Method (BWM) which only compares each criterion to the best (most important, most desirable) and the worst (least important, least desirable) criterion, respectively. The pairwise comparison results are two vectors based on which a nonlinear model and a linear model are designed to derive the priority vector. BWM not only leads to more consistent comparisons but also reduces the number of comparisons.
Both PCNP and BWM have been proved to be effective and been applied in some real world applications [22, 25–34]. However, to the best of our knowledge, there has not been a pairwise comparison based MADM method that has the two aspects of advantages possessed by PCNP and BWM at the same time. In this paper, we propose the Cognitive Best Worst Method (CBWM) which executes the pairwise comparisons in the same way as BWM and adopts the interval scale to measure the difference. CBWM possesses the advantages of both PCNP and BWM and shows better characteristics than both the two methods. Compared to PCNP, CBWM needs less pairwise comparisons and is likely to get more consistent pairwise comparisons. Compared to BWM, CBWM adopts the interval scale which is more suitable for measuring the cognitive paired comparisons and acquires more reliable results. The theoretical and experimental analyses demonstrate the good performance of CBWM.
The rest of this paper is organized as follows. Section 2 reviews PCNP and BWM. Section 3 illustrates the Cognitive Best Worst Method. Section 4 presents an application using CBWM and compares CBWM to AHP, PCNP, and BWM. Section 5 concludes the research.
2. Review of PCNP and BWM
In this section, we briefly review the concept and process of PCNP and BWM. For the detailed description of the two methods, we refer to [7] and [23, 24], respectively.
2.1. PCNP
The PCNP is the cognitive architecture which comprises cognitive decision processes: Problem Cognitive Process (PCP), Cognitive Assessment Process (CAP), Cognitive Prioritization Process (CPP), Multiple Information Fusion Process (MIP), and Decision Volition Process (DVP).
2.1.1. PCP
In PCP, the goal of the decisionmaker and the criteria set and the alternatives set are determined. Besides the elements aforementioned, a measurement scale schema which maps the verbal scales to the corresponding numerical scales is also needed. As PCNP adopts interval scales to measure the pairwise differences, the numerical representations should be in the following form: is the normal utility which is the mean of individual utility values of the comparison objects. is the number of intervals in the scale schema. From the definition of we can get . For the convenience of computation, we set ; then each element in will be an integer. Table 2 gives an example of the ratio scale and the interval scale ().

2.1.2. CAP
In CAP, the pairwise comparisons are executed and the pairwise opposite matrix (POM) is constructed. Let an ideal utility vector of the objects involved in the pairwise comparisons be ; then the ideal POM will be , where . Let be the subjective judgment POM provided by the experts; then is determined by in the following way:
The pairwise comparison matrix is called POM because holds for all . In [21], Yuen proposed that a POM is perfectly accordant if
The accordance index (AI) is used to measure the degree of accordance.
If , then is perfectly accordant; if , then is satisfactory; if , is unsatisfactory.
2.1.3. CPP
The purpose of CPP is to derive the priority vector from the POM. The two common used methods are primitive least squares (PLS) method and least penalty squares (LPS) method.
The PLS method derives the utility vector through the following model:
Yuen [22] pointed out that the closed form solution of model (5) is the Row Average plus the normal Utility (RAU) which can be expressed as
If there exists , can be increased such that .
LPS can be seen as the weighted version of PLS in which the weight is the penalty factor . The utility vector can be derived by the following model:
After obtaining the utility vector , the normalized priority vector can be obtained easily by
MIP is the same as the aggregation process traditionally mentioned in MADM and DVP is the decision process based on the aggregated global utility of each alternative.
2.2. BWM
BWM is a vector based MADM method which requires fewer comparisons than the matrix based method such as AHP. Here we briefly describe the steps of BWM.
Step 1. Determine a set of decision criteria.
Step 2. Determine the best criterion and worst criterion .
As is mentioned in [23], the decisionmaker identifies the best and the worst criteria in general in this step. And if more than one criterion is considered to be the best or the worst, one can be chosen arbitrarily. No comparison is made at this stage.
Step 3. Execute pairwise comparisons between the best criterion and the other criteria. The result of the comparisons is the besttoothers vector denoted as
Step 4. Execute pairwise comparisons between the other criteria and the worst criterion. The result of the comparisons is the otherstoworst vector denoted as
Step 5. Derive the weight vector . The weight vector can be obtained by solving the following problem:
In (11), is the weight of the best criterion; is the weight of the worst criterion. Rezaei [24] pointed out that the solution of problem (11) is not unique when there are more than three criteria and the comparison vectors are not completely consistent and he proposed another linear model to derive the weight vector.
Let be the solution of problem (12); the consistency ratio of the pairwise comparisons in BWM is defined as
Consistency index in (13) is the maximal possible value of . Table 3 shows the consistency index for different values of which is the preference of the best criterion over the worst criterion.

3. Cognitive Best Worst Method
In this section, we elaborate the proposed Cognitive Best Worst Method (CBWM) which can be seen as interval ratio based BWM. The basic process of CBWM is the same as BWM, so we focus on the differences caused by introducing interval ratio to represent pairwise difference.
We still use and to denote the besttoothers and otherstoworst vectors, while each element in the two vectors is expressed by interval scale as in Table 2. The best and the worst criteria should be determined by the decisionmaker in the same way as mentioned in BWM. Let be the best criterion and be the worst criterion; then denotes the difference between and , and denotes the difference between and . It is notable that all and are nonnegative. As is the difference between the best criterion and the worst criterion, we can get that is the maximal element in both and , and ( is the normal utility and ).
Proposition 1. The pairwise comparison vectors and are perfectly accordant if
Theorem 2. Two conditions (14) and (15) in Proposition 1 are equivalent.
Proof. Deduce (15) from (14). From (14) we can get for all ; then by setting or , we can get for all . Deduce (14) from (15). From (15) we can get for all . Then it is trivial to get (14).
3.1. Consistency Index
Based on Proposition 1, we define the consistency index (CI) to measure the deviation of the pairwise comparison vectors and from consistency.
It is easy to verify that and if and only if and are perfectly accordant.
Now we discuss the relation of in (16) and in (4). The basic ideas of and are the same, for they both measure the average deviation of each element in the pairwise comparison matrix (vector) from consistency. The values of and are comparable for the same MADM problem. We define the random consistency index as the mathematical expectation of when all the values except in and are selected randomly and independently from the set .
Theorem 3. Consider the following:
Proof. Let . When the th criterion is the best or the worst one, the value of will be zero; otherwise the value of will be in the closed interval and the corresponding probability distribution is given in Table 4. It is easy to verify that .
According to the probability distribution of , we can get the mathematical expectation of .The values corresponding to different criteria in the two vectors and are independent, so we can get

For , we define random accordance index as the mathematical expectation of when all the elements of the pairwise opposite matrix are selected from the set randomly and independently under the constraint that . To get the value of , we run the simulation which generates the POM in the way as just described 10000 times and calculate each time; then we take the average of the 10000 values as the estimate of .
Table 5 shows the values of and with different and when . From Table 5 we can clearly see that for the given and which means that CBWM is more likely to get a more consistent pairwise comparison result than PCNP. The reason of this phenomenon is that the elements in vectors of CBWM are all nonnegative while the elements of the POM may be either positive or negative, which leads to the fact that the maximal value of is 1 and the maximal value of is 9.

The above analysis is valid under the circumstance that the decisionmaker is able to appropriately determine the best and the worst criteria. Comparing the best and the worst objects to the others matches the habit and process of human cognition and then is likely to get more consistent results than comparing each pair of the objects. However, if the decisionmaker is not able to determine the best and the worst criteria, the above analysis is of no sense and CBWM method is not suitable for the problem.
Another advantage of CBWM is that it is easy to check the consistency and identify the cause of inconsistency. The examination and identification can be done intuitively with the help of Table 6. The first and the second rows are the values of and , respectively. We can sum the elements in rows 1 and 2 and compare the results to . If is too different from , we should revise and to get more consistent vectors.

3.2. Derivation of Utility Vector
Theorem 4. When the comparison vectors and are completely consistent, the utility vector can be derived by
Proof. When and are completely consistent, we can get and for all . , and ; (20) holds. , and ; (21) holds.
When the comparison vectors and are not fully consistent, we propose two methods to derive the utility vector: the minimization of the maximal deviation method (MMD) and the minimization of total deviation method (MTD).
In MMD, the optimal utility vector is the one where, for each pair of and , we have and . To satisfy these conditions, we find a solution where the maximal absolute differences and for all are minimized. The optimal utility vector can be obtained by solving the following problem:
Problem (22) can be transferred to the following linear programming problem:
In MTD, the optimal utility vector should be the one where the total deviation is minimized. It is natural to get the following model:
Analogous to [22], we can get the closed form solution of model (24) as follows:
Also, if there exists , can be increased such that .
Solving problem (23) or problem (24), the optimal utility vector is obtained. By normalizing , we can get the weight vector .
3.3. Numerical Example
3.3.1. Example 1
Supposing, in a MADM problem, there are four criteria , among which is the best criterion and is the worst criterion. The comparison vectors provided by the experts are and with . The aim is to get the weight vector which expresses the relative importance of each criterion. We first calculate the consistency index by (16) and we can get . As and are fully consistent, we can use (20) or (21) to get the utility vector. The utility vector derived from (20) is and the corresponding weight vector is .
3.3.2. Example 2
Here we revise Example 1 in [23] using CBWM to illustrate the CBWM steps discussed above. The example involves selecting a transport mode for a company. The criteria determined by the company are as follows: : load flexibility, : accessibility, and : cost. The company identifies that is the best criterion and is the worst criterion, and the original comparison vectors in ratio scale are and . In interval scale, the corresponding comparison vectors will be and with .
Firstly, we calculate the consistency index by (16) and we can get . To get the weight vector, we substitute the data into model (23) and model (24) and solve the two problems.
By MMD, we can get the utility vector and the weight vector .
By MTD, we can get the utility vector and the weight vector .
4. Illustrations
In this section, we compare the proposed MADM method CBWM to AHP, PCNP, and BWM on a real world MADM problem.
4.1. Problem Description
Here the transport company selection problem discussed by [7, 35] is revised by AHP, PCNP, BWM, and CBWM methods. A company needs to select a freight transportation company from four alternatives (T1, T2, T3, and T4) to deliver its goods. The criteria considered are transportation costs (TC), defective rate (DR), tardiness rate (TR), flexibility (F), and documentation ability (DA).
Six pairwise reciprocal matrices are shown in Table 7. The top left matrix is the comparisons between criteria and the other five matrices are comparisons between alternatives with respect to different criteria. Saaty’s consistency ratio is given under each matrix.

Table 8 shows six pairwise opposite matrices () under interval scale corresponding to the six matrices in Table 7. The accordance index (AI) defined in (4) is given under each matrix.

Tables 9 and 10 show the pairwise comparison vectors under ratio and interval scale, respectively. These vectors are extracted from the corresponding matrices. represents the index of the best criterion (alternative) and represents the index of the worst criterion (alternative). It is worth noting that, on criterion TC, the alternatives T1 and T3 are equal and are both the worst. Rezaei [23] pointed out that if more than one criterion is considered to be the best or the worst, one can be chosen arbitrarily. Here we choose T1 as the worst with respect to TC.


The comparison matrices on criteria DR and DA are completely consistent in Table 8 while it is not the case in Table 7. The phenomenon indicates the consistent cognition for pairwise comparison in a matrix can be distorted as inconsistent by ratio scale [7]. It is also the same when replacing the comparison matrices with comparison vectors. We can see that the comparison vectors on criteria DR and DA are completely consistent in Table 10 while it is not the case in Table 9. It is also worth noting that the pairwise comparison vectors are always consistent when the corresponding matrices are consistent under whatever scales while the opposite is obviously not the case. As per the results above and the analysis of consistency index in Section 3.1, we can say that CBWM can get more consistent pairwise comparisons than AHP, BWM, and PCNP.
4.2. Results of Different Methods
Tables 11–15 show the prioritization and aggregation results along with the ranking of the alternatives from the best to the worst. The results of AHP in Table 11 are obtained by the eigenvector methods. The results of BWM in Table 12 are obtained by solving linear model (12). The results of PCNP in Table 13 are obtained by the PLS method in (5). The results of CBWMMMD in Table 14 are obtained by the MMD method in (23). The results of CBWMMTD in Table 15 are obtained by the MTD method in (24).





The results in [7] show that PCNP performs better than AHP because PCNP gets stable rankings with different prioritization methods while AHP get fluctuant rankings with different prioritization methods. From our results in Tables 11–15, we can see that the BWM obtains similar results to AHP with respect to both ranking and total utility, while the two prioritization methods of CBWM both achieve results very close to the PCNP’s results. We can say that CBWM acquires more reliable results and performs better than BWM in this case based on the conclusion in [7].
4.3. Comparisons with respect to Total Deviation
In order to measure the performance of different methods further, we employ total deviation (TD) [36] to make the comparison. The original definition of total deviation (TD) is the Euclidean distance between the ratios of weights and their pairwise comparison . is the pairwise reciprocal matrix using ratio scale; and are the weights of the th criterion and the th criterion, respectively.
For interval scale, we need to modify the definition of TD as is the pairwise opposite matrix using interval scale; and are the utilities of the th criterion and the th criterion, respectively.
As the numbers of pairwise comparisons of PCNP (AHP) and CBWM (CWM) are and , respectively, it is unfair to judge the performances of these methods directly by TD. To make fair comparison, we employ the average TD which is the quotient of MV divided by the number of pairwise comparisons. So the definitions of TD for each method would be
Table 16 shows the TDs of different methods when determining the relative importance of each criterion. From the table, we can see that the total deviations of ratio scale based methods are significantly bigger than interval scale based methods; that is to say, the proposed CBWM performs better than BWM. It is worth noting that the TD of PCNP is smaller than CBWM, but it does not mean that PCNP performs better than CBWM. The reason is that the accordance index of PCNP is 0.1168 while the consistency index of CBWM is 0.2016. According to the analysis of the relationship of CI and AI in Section 3.1, the phenomenon that is unusual.

5. Conclusion and Future Research
In this paper, a new interval scale and vector based pairwise comparison MADM method CBWM (Cognitive Best Worst Method) is proposed. CBWM combines the ideas of PCNP and BWM method and shows better characteristics than the two methods. The theoretical and experimental analyses demonstrate the good performance of CBWM. The excellent features CBWM shows are summarized as follows:(1)CBWM is vector based method and needs less pairwise comparisons than matrix based methods. The numbers of pairwise comparisons are and for CBWM and matrix based methods, respectively, where is the number of objects involved in the comparisons.(2)CBWM can get more consistent pairwise comparison results due to the use of interval scale and the best worst comparison strategy.(3)As the interval scale is more suitable for measuring cognitive paired comparisons, CBWM acquires more reliable decision results than ratio scale based methods.
It is worth noting that CBWM is only suitable for the problem in which the decisionmaker is able to determine the best and the worst criteria.
The future research will focus on two aspects; one is to apply CBWM to more real world MADM problems, and the other is to extent CBWM to fuzzy or interval judgments to capture the uncertainty in the process of MADM.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by the Natural Science Foundation of Jiangsu Province (Grants no. BK20150720).
References
 S. Greco, M. Ehrgott, and J. R. Figueira, Multiple Criteria Decision Analysis: State of the Art Surveys, International Series in Operations Research & Management Science, Springer, New York, NY, USA, 2016.
 E. JacquetLagreze and J. Siskos, “Assessing a set of additive utility functions for multicriteria decisionmaking, the UTA method,” European Journal of Operational Research, vol. 10, no. 2, pp. 151–164, 1982. View at: Publisher Site  Google Scholar
 S. Greco, V. Mousseau, and R. Słowiński, “Ordinal regression revisited: multiple criteria ranking using a set of additive value functions,” European Journal of Operational Research, vol. 191, no. 2, pp. 416–435, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 T. L. Saaty, “How to make a decision: the analytic hierarchy process,” Interfaces, vol. 24, no. 6, pp. 19–43, 1994. View at: Publisher Site  Google Scholar
 T. L. Saaty, “Decision making—the Analytic Hierarchy and Network Processes (AHP/ANP),” Journal of Systems Science and Systems Engineering, vol. 13, no. 1, pp. 1–35, 2004. View at: Publisher Site  Google Scholar
 C. Bana e Costa and J.C. Vansnick, “MACBETH—an interactive path towards the construction of cardinal value functions,” International Transactions in Operational Research, vol. 1, no. 4, pp. 489–500, 1994. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, “The primitive cognitive network process: comparisons with the analytic hierarchy process,” International Journal of Information Technology & Decision Making, vol. 10, no. 4, pp. 659–680, 2011. View at: Publisher Site  Google Scholar
 B. Roy, “The outranking approach and the foundations of ELECTRE methods,” Theory and Decision, vol. 31, no. 1, pp. 49–73, 1991. View at: Publisher Site  Google Scholar  MathSciNet
 J.P. Brans, P. Vincke, and B. Mareschal, “How to select and how to rank projects: the PROMETHEE method,” European Journal of Operational Research, vol. 24, no. 2, pp. 228–238, 1986. View at: Publisher Site  Google Scholar  MathSciNet
 S. Greco, B. Matarazzo, and R. Slowinski, “Rought sets theory for multicriteria decision analysis,” European Journal of Operational Research, vol. 129, no. 1, pp. 1–47, 2001. View at: Publisher Site  Google Scholar  MathSciNet
 P. J. van Laarhoven and W. Pedrycz, “A fuzzy extension of Saaty's priority theory,” Fuzzy Sets and Systems, vol. 11, no. 3, pp. 229–241, 1983. View at: Publisher Site  Google Scholar  MathSciNet
 K. K. F. Yuen, “Fuzzy cognitive network process: comparisons with fuzzy analytic hierarchy process in new product development strategy,” IEEE Transactions on Fuzzy Systems, vol. 22, no. 3, pp. 597–610, 2014. View at: Publisher Site  Google Scholar
 J. R. Figueira, S. Greco, B. Roy, and R. Słowiński, “An overview of electre methods and their recent extensions,” Journal of MultiCriteria Decision Analysis, vol. 20, no. 12, pp. 61–85, 2013. View at: Publisher Site  Google Scholar
 J. Wallenius, J. S. Dyer, P. C. Fishburn, R. E. Steuer, S. Zionts, and K. Deb, “Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead,” Management Science, vol. 54, no. 7, pp. 1336–1349, 2008. View at: Publisher Site  Google Scholar
 M. Behzadian, R. B. Kazemzadeh, A. Albadvi, and M. Aghdasi, “PROMETHEE: a comprehensive literature review on methodologies and applications,” European Journal of Operational Research, vol. 200, no. 1, pp. 198–215, 2010. View at: Publisher Site  Google Scholar
 N. Subramanian and R. Ramanathan, “A review of applications of Analytic Hierarchy Process in operations management,” International Journal of Production Economics, vol. 138, no. 2, pp. 215–241, 2012. View at: Publisher Site  Google Scholar
 C. Kahraman, S. C. Onar, and B. Oztaysi, “Fuzzy multicriteria decisionmaking: a literature review,” International Journal of Computational Intelligence Systems, vol. 8, no. 4, pp. 637–666, 2015. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, “Analytic hierarchy prioritization process in the AHP application development: a prioritization operator selection approach,” Applied Soft Computing, vol. 10, no. 4, pp. 975–989, 2010. View at: Publisher Site  Google Scholar
 L. L. Thurstone, “A law of comparative judgment,” Psychological Review, vol. 34, no. 4, pp. 273–286, 1927. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, Cognitive network process with fuzzy soft computing technique in collective decision aiding [Ph.D. thesis], Hong Kong Polytechnic University, Hong Kong, 2009.
 K. K. F. Yuen, “Pairwise opposite matrix and its cognitive prioritization operators: comparisons with pairwise reciprocal matrix and analytic prioritization operators,” Journal of the Operational Research Society, vol. 63, no. 3, pp. 322–338, 2012. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, “The primitive cognitive network process in healthcare and medical decision making: comparisons with the analytic hierarchy process,” Applied Soft Computing, vol. 14, no. 1, pp. 109–119, 2014. View at: Publisher Site  Google Scholar
 J. Rezaei, “Bestworst multicriteria decisionmaking method,” Omega, vol. 53, pp. 49–57, 2015. View at: Publisher Site  Google Scholar
 J. Rezaei, “Bestworst multicriteria decisionmaking method: some properties and a linear model,” Omega, vol. 64, pp. 126–130, 2016. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, “SoftwareasaService evaluation in cloud paradigm: primitive cognitive network process approach,” in Proceedings of the 2nd IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC '12), pp. 119–124, August 2012. View at: Publisher Site  Google Scholar
 C. Guan and K. K. F. Yuen, “Towards a hybrid approach of primitive cognitive network process and agglomerative hierarchical clustering for music recommendation,” in Proceedings of the 11th International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness (QSHINE '15), pp. 206–209, Taipei, Taiwan, 2015. View at: Publisher Site  Google Scholar
 V. Q. Chen and K. K. F. Yuen, “Towards a hybrid approach of Primitive Cognitive Network Process and SelfOrganizing Map for computer product recommendation,” in Proceedings of the International Conference on Intelligent Computing and Internet of Things (ICIT '15), pp. 9–12, January 2015. View at: Publisher Site  Google Scholar
 K. Kam, F. Yuen, and M. Yuen, “Department course selection problem: the primitive cognitive network process approach,” in Proceedings of the IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE '12), pp. H1C15–H1C17, August 2012. View at: Publisher Site  Google Scholar
 K. K. F. Yuen, “Towards an evaluation strategy for consumer electronic products using primitive cognitive network process,” in Proceedings of the IEEE International Conference on Consumer Electronics—Taiwan (ICCETW '15), pp. 72–73, June 2015. View at: Publisher Site  Google Scholar
 K. K. F. Yuen and W. Wang, “Towards a ranking approach for sensor services using primitive cognitive network process in,” in Proceedings of the IEEE 4th Annual International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER '14), pp. 344–348, Hong Kong, 2014. View at: Google Scholar
 J. Rezaei, T. Nispeling, J. Sarkis, and L. Tavasszy, “A supplier selection life cycle approach integrating traditional and environmental criteria using the best worst method,” Journal of Cleaner Production, vol. 135, pp. 577–588, 2016. View at: Publisher Site  Google Scholar
 S. Sadaghiani, K. W. Ahmad, J. Rezaei, and L. Tavasszy, “Evaluation of external forces affecting supply chain sustainability in oil and gas industry using Best Worst Method,” in Proceedings of the 1st Mediterranean Gas and Oil International Conference (MedGO '15), pp. 1–4, April 2015. View at: Publisher Site  Google Scholar
 J. Rezaei, J. Wang, and L. Tavasszy, “Linking supplier development to supplier segmentation using Best Worst Method,” Expert Systems with Applications, vol. 42, no. 23, pp. 9152–9164, 2015. View at: Publisher Site  Google Scholar
 N. Salimi and J. Rezaei, “Measuring efficiency of universityindustry Ph.D. projects using best worst method,” Scientometrics, vol. 109, no. 3, pp. 1911–1938, 2016. View at: Publisher Site  Google Scholar
 O. Kulak and C. Kahraman, “Fuzzy multiattribute selection among transportation companies using axiomatic design and analytic hierarchy process,” Information Sciences, vol. 170, no. 2–4, pp. 191–210, 2005. View at: Publisher Site  Google Scholar
 B. Golany and M. Kress, “A multicriteria evaluation of methods for obtaining weights from ratioscale matrices,” European Journal of Operational Research, vol. 69, no. 2, pp. 210–220, 1993. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2017 Hongjun Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.