Abstract

Supplier selection is a fundamental issue of supply chain area that heavily contributes to the overall supply chain performance, and, also, it is a hard problem since supplier selection is typically a multicriteria group decision problem. In many practical situations, there usually exists incomplete and uncertain, and the decision makers cannot easily express their judgments on the candidates with exact and crisp values. Therefore, in this paper an extended technique for order preference by similarity to ideal solution (TOPSIS) method for group decision making with Atanassov's interval-valued intuitionistic fuzzy numbers is proposed to solve the supplier selection problem under incomplete and uncertain information environment. In other researches in this area, the weights of each decision maker and in many of them the weights of criteria are predetermined, but these weights have been calculated in this paper by using the decision matrix of each decision maker. Also, the normalized Hamming distance is proposed to calculate the distance between Atanassov's interval-valued intuitionistic fuzzy numbers. Finally, a numerical example for supplier selection is given to clarify the main results developed in this paper.

1. Introduction

Supplier selection, the process of finding the right suppliers who are able to provide the buyer with the right quality products and/or services at the right price, at the right time, and in the right quantities, is one of the most critical activities for establishing an effective supply chain.

Selecting the wrong supplier could be enough to deteriorate the whole supply chains financial and operational position. In todays highly competitive, global operating environment, it is impossible to produce low-cost, high-quality products successfully without satisfactory suppliers [1, 2]. The success of a supply chain is highly dependent on selection of good suppliers.

Supplier selection is a fundamental issue of supply chain area that heavily contributes to the overall supply chain performance. Particularly for companies that spend a high percentage of their sales revenue on parts and material supplies and whose material costs represent a larger portion of total costs, savings from supplies are of particular importance. These strongly urge for a more systematic and transparent approach to purchasing decision making, especially regarding the area of supplier selection. Selecting the suppliers significantly reduces the purchasing cost and improves corporate competitiveness, and that is why many experts believe that the supplier selection is the most important activity of a purchasing department. Supplier selection is the process by which suppliers are reviewed evaluated, and chosen to become part of the companys supply chain. The overall objective of supplier selection process is to reduce purchase risk, maximize overall value to the purchaser, and build the closeness and long-term relationships between buyers and suppliers [3].

In other words, the major aims of supply chain management are to reduce supply chain risk, reduce production costs, maximize revenue, improve customer service, and optimize inventory levels, business processes, and cycle times, resulting in increased competitiveness, customer satisfaction, and profitability [49].

Indeed supplier selection is a multiple criteria decision- making (MCDM) problem affected by several conflicting factors such as price, quality, and delivery.

Several factors affect a supplier performance. Dickson [10], Ellram [11], Roa and Kiser [12], Stamm and Golhar [13] identified, respectively, 60, 18, 13, and 23 criteria for supplier selection. One of the well-known studies on supplier selection belongs to Dickson who identified 23 important evaluation criteria for supplier selection. Weber et al. [14] reviewed and classified 74 articles that addressed the supplier selection problem.

Over the years, several techniques have been developed to solve the problem efficiently. Supply chain management has received recently considerable attention in both academia and industry.

De Boer et al. [15] identified four stages for supplier selection including definition of the problem, formulation of criteria, qualification, and final selection, respectively. They reviewed and classified MCDM approaches for supplier selection. Several methodologies have been proposed for the supplier selection problem. The systematic analysis for supplier selection includes categorical method, weighted point method [16, 17], matrix approach [18], vendor performance matrix approach [19], vendor profile analysis [20], analytic hierarchy process (AHP) [2123], analytic network process (ANP) [24], mathematical programming [2528], and multiple objective programming (MOP) [2933].

Essential, the supplier selection problem in supply chain system is a group decision making combination of several and different criteria with different forms of uncertainty [34]. Hence, this problem is a kind of multiple criteria decision making problem (MCDM) that requires MCDM methods for an effective problem solving. The supplier selection process is often influenced by uncertainty in practice [35, 36].

Several influence factors are often not taken into account in the decision making process, such as incomplete information, additional qualitative criteria, and imprecision preferences [3, 37]. Therefore, the fuzzy set theory has been applied to supplier selection recently. Li et al. [38] and Holt [39] discussed the application of the fuzzy set theory in supplier selection. Chen et al. [3] extended the concept of TOPSIS method to develop a methodology for solving supplier selection problems in fuzzy environment. Haq and Kannan [40] presented a structured model for evaluating the supplier selection for the rubber industry using AHP, and the model is verified with the fuzzy AHP. Bayrak et al. [41] presented a fuzzy multicriteria group decision making approach to supplier selection based on fuzzy arithmetic operation. Chou and Chang [4] presented strategy-aligned fuzzy simple multiattribute rating technique (SMART) approach for solving the supplier selection problem from the perspective of strategic management of the supply chain. Chan et al. [42] presented fuzzy AHP to efficiently tackle both quantitative and qualitative decision factors involved in the selection of global supplier. Önüt et al. [43] developed a supplier evaluation approach based on ANP and TOPSIS methods for the supplier selection.

This paper proposes an Atanassov’s interval-valued intuitionistic fuzzy multicriteria group decision making with TOPSIS method for supplier selection problem.

The technique for order preference by Similarity to an ideal solution (TOPSIS) method is presented in Chen and Hwang [44], with reference to [45]. The basic principle is that the chosen alternative should have the shortest distance from the ideal solution and the farthest distance form the negative-ideal solution. In the process of TOPSIS, the performance ratings and the weights of the criteria are given as exact values. In real-world situation, because of incomplete or nonobtainable information, the data (attributes) are often not so deterministic, and therefore they usually are fuzzy/imprecise. Therefore, some researches try to use TOPSIS method for fuzzy/imprecise data. For example, Tsaur et al. [46] first convert a fuzzy MCDM problem into a crisp problem via centroid defuzzification and then solve the nonfuzzy MCDM problem using the TOPSIS method. Chen and Tzeng [47] transform a fuzzy MCDM problem into a nonfuzzy MCDM using fuzzy integral. In [48] Chu proposed a fuzzy TOPSIS approach for selecting plant location, where the ratings of various alternative locations under various criteria and the weights of various criteria are assessed in linguistic terms represented by fuzzy numbers. In the proposed method, the ratings and weights assigned by decision makers are averaged and normalised into a comparable scale. The membership function of each normalised weighted rating can be developed by interval arithmetic of fuzzy numbers. Byun and Lee [49] provide a decision support system for the selection of a rapid prototyping process using the modified TOPSIS method. Recently, in some researches, TOPSIS method is considered for extension. For example, Chen [50] extends the concept of TOPSIS to develop a methodology for solving multiperson multicriteria decision making problems in fuzzy environment. Abo-sinna et al. [51] extend the TOPSIS method to solve multiobjective nonlinear programming problems. Also, Jahanshahloo et al. [52, 53] and Izadikhah [54] extended the TOPSIS method for decision making problems with interval and fuzzy data.

In the fuzzy sets theory, the membership of an element to a fuzzy set is only a single value between zero and one [55]. However, in reality, the degree of nonmembership of an element in a fuzzy set is not certainly equal to 1 minus the degree of membership. That is to say, there may be some hesitation degree. Therefore, Atanassov [56] extended Zadehs fuzzy sets to intuitionistic fuzzy sets, which is a generalization of the concept of fuzzy sets. The theory of intuitionistic fuzzy sets is characterized by a membership degree, a non-membership degree, and a hesitation degree. Atanassov and Gargov [57] also proposed the concept of Atanassov’s interval-valued intuitionistic fuzzy sets as a further generalization of fuzzy set theory.

In Boran et al. [58], the TOPSIS method combined with the intuitionistic fuzzy set is proposed to select appropriate supplier in group decision making environment. Also in Ye [59], an extended TOPSIS method for group decision making with Atanassov’s interval-valued intuitionistic fuzzy numbers is proposed to solve the partner selection problem under incomplete and uncertain information environment.

Group decision making involves weighted aggregation of all individual decisions to obtain a single collective decision. The weights of DMs play an important role in the processes of weighted aggregation.

In this paper an extended technique for order preference by similarity to ideal solution (TOPSIS) method for group decision making with Atanassov’s interval-valued intuitionistic fuzzy numbers is proposed to solve the supplier selection problem under incomplete and uncertain information environment. In other researches in this area, the weights of each decision maker and in many of them the weights of criteria are predetermined (see [50, 59], e.g.,), but these weights have been calculated in this paper in new method by using the decision matrix of each decision maker. In the presented method first, we select the most important criteria by Delphi method, then we define a new similarity measure to obtain the weights of each decision maker and by use of these weights, we can determine the weights of criteria. Also, the normalized Hamming distance is proposed to calculate the distance between Atanassov’s interval-valued intuitionistic fuzzy numbers.

The rest of the paper is organized as follows: In this Section 2 a brief description about the following concepts is given.

First, the concept of Atanassov’s interval-valued intuitionistic fuzzy sets and then some basic operations on IVIF sets are explained. After that TOPSIS method and the Delphi method are reviewed.

In Section 3 we will focus on the proposed method. In Section 4 a numerical example is demonstrated. In this section we consider an example where the managerial board of a university has to outsource construction of their new building, and then we will introduce some useful insights. Some conclusions are drawn for the study in Section 5.

2. Basic Concept

Since the fuzzy set was pioneered by Zadeh [60], a variety of sets involving imprecision have been developed. Due to knowledge limitation and time pressure, hesitancy occurs when an individual faces a problem with uncertainty. The expression of uncertainty and vagueness has been widely discussed. The interval-valued fuzzy set (IVFS) defined by Zadeh [61] is shown by the membership function within a closed subinterval of . Atanassov [56] introduced the intuitionistic fuzzy set, which is characterized by the membership function, nonmembership function, and hesitancy function. IVFSs and Atanassov’s intuitionistic fuzzy sets are regarded as flexible and practical tools for dealing with fuzziness and uncertainty. Atanassov and Gargov [57] further introduced the interval-valued intuitionistic fuzzy set (IVIFS), a generalization of IVFSs and IFSs that provides the membership function and non-membership function with intervals rather than exact numbers.

2.1. The Concept of Atanassov’s Interval-Valued Intuitionistic Fuzzy Sets

In 1986 Atanassov extended Zadeh’s fuzzy sets to intuitionistic fuzzy sets, which is a generalization of the concept of fuzzy sets. The following definitions will be needed throughout the paper.

Definition 1. Let be a finite universal set. An intuitionistic fuzzy set in is an object having the following form: where and are degrees of membership and nonmembership of an element , respectively, with the condition .
is called the intuitionistic fuzzy index of . It represents the degree of indeterminacy or hesitation of . For each , .

In some cases, because of the complexity and uncertainties of the objective things, it is suitable and convenient to express their data in Atanassov’s interval-valued intuitionistic fuzzy sets.

In 1989 Atanassov and Gargov proposed the following definition of Atanassov’s interval-valued intuitionistic fuzzy sets.

Definition 2. Let be a finite universal set. An interval-valued intuitionistic fuzzy set in is an object having the following form: where and .

For the simplicity of notation, we write IVIF sets instead of Atanassov’s interval-valued intuitionistic fuzzy sets and IVIF numbers instead of Atanassov’s interval-valued intuitionistic fuzzy numbers.

2.2. Basic Operations on IVIF Sets

For convenience, Xu [62] denoted by an IVIF number, where , and .

To aggregate IVIF numbers, we use the following operations (see Xu [62] for more details).

Definition 3. Let and be two IVIF numbers, then multiplication between and is defined as follows:

Definition 4. Let be two IVIF numbers; then summation between and is defined as follows:

Definition 5. Let be an IVIF number and an arbitrary positive real number; then

By the above definitions, we have the following.

Corollary 6 (Xu [62]). Let be the set of n IVIF numbers, where . The weighted arithmetic average of them is defined by where is the weight of , , and .

Definition 7. Let be an IVIF number. Xu defined a score function s to measure the IVIF number as follows: Obviously, , and the larger the value of , the higher the .

Definition 8. Let be an IVIF number. Xu defined an accuracy function to measure the IVIF number as follows: where . The larger the value of is, the higher the degree of accuracy of the IVIFN of is.

The separation between alternatives can be measured by the Hamming distance. In this paper, we use the normalized Hamming distance proposed by Park et al. [63].

Definition 9. Let be a vector of IVIF numbers, such that and , m vectors of n IVIF numbers, such that ; then the separation measure between ’s and based on the normalized Hamming distance is defined as follows:

By a similar manner, we can define a distance measure between two matrices.

Definition 10. Let be two matrices where and are IVIF numbers. One can define a distance measure between and based on the Hamming distance as follows:

2.3. TOPSIS Method

The TOPSIS (technique for order preference by similarity to an ideal solution) method is presented in Chen and Hwang [44], with reference to Hwang and Yoon [45]. TOPSIS is a multiple criteria method to identify solutions from a finite set of alternatives. The basic principle is that the chosen alternative should have the shortest distance from the positive ideal solution and the farthest distance from the negative ideal solution. In the process of TOPSIS, the performance ratings and the weights of the criteria are given as exact values. In real-world situation, because of incomplete or nonobtainable information, the data (attributes) are often not so deterministic; therefore they usually are fuzzy/imprecise. Therefore, some researches try to use the TOPSIS method for fuzzy/imprecise data.

2.4. Delphi Method to Select Most Important Criteria

We can select the most important criteria by the Delphi method. Based on Saaty [64], if there are more than seven factors at the same level, there are too many selections on the questionnaires and it is tough for participants to make a choice. This problem can be overcome by the way of elimination or combination. The Delphi method is to reduce the number of criteria while keeping real important attributes. The process is summarized as follows [65].

Step 1. Formation of a team to study the subject, and the panelists are experts in the area to be investigated.

Step 2. Development of the first round Delphi questionnaire.

Step 3. Transmission of the results of the first questionnaire to the panelists and analysis of the first round responses.

Step 4. Preparation of the second round questionnaire.

Step 5. Transmission of the results of the second round questionnaire to the panelists and analysis of the second round responses (Steps 4 and 5 are reiterated as long as desired or necessary to achieve stability in the results).

Step 6. Preparation of a report to present the conclusions.

3. The Proposed Method

In many practical decision making problems, such as the supplier selection or selection of a partner for an enterprise in the field of supply chain management, military system efficiency evaluation, and so on, decision makers usually need to provide their preferences over alternatives. Consider that the socioeconomic environment becomes more complex, the preference information provided by decision makers is usually imprecise, that is, there may be hesitation or uncertainty about preferences because a decision should be made under time pressure and lack of knowledge or data or the decision makers have limited attention and information processing capacities. In such cases, it is suitable and convenient to express the decision makers’ preferences in interval-valued intuitionistic fuzzy sets (IVIFSs). The fundamental characteristic of the IVIFS is that the values of its membership function and nonmembership function are intervals rather than exact numbers. Therefore, it is necessary and interesting to pay attention to the group decision making problems with interval-valued intuitionistic preference information.

Our main goal is to select the most appropriate supplier among alternatives . Assume that a committee (group) of decision makers has been formed to select the most suitable supplier. So, the procedure for Atanassov’s interval-valued intuitionistic fuzzy TOPSIS method has been given as the following steps.

Step 1. Determine the most important criteria.

Usually, there are many criteria (attributes) in supplier selection where some of them are not necessary important or may be very unimportant. Therefore, we select the most important criteria by the Delphi method. Let be the set of criteria selected by Delphi method.

The importance of each criteria and the rating of each alternative , with respect to the criterion , must be determined by decision group. Because of incomplete and uncertain information about the alternatives, decision maker , assigns an interval-valued intuitionistic fuzzy number to estimate his/her judgment on alternative with respect to criterion . For a better decision, we need to specify the importance of the decision of each decision maker. Therefore, we determine the weight of DMs.

Step 2. Determine the weight of decision makers

As mentioned above, decision maker cannot easily estimate an exact value to alternative with respect to criterion . Let be decision matrix of the th decision maker, where is an Atanassov’s interval-valued intuitionistic fuzzy number.

Now, we obtain the matrix , namely ideal matrix. Consider that , where , and therefore, by formula (6) we have: Clearly, is also an Atanassov’s interval-valued intuitionistic fuzzy number.

In order to determine the weights of decision makers, we use the following concept.

The less the distance of decision of from the ideal decision is the higher importance for is expected.

Therefore, by using formula (10) we can define the following similarity measure between decision matrix of and the ideal decision matrix: Then, we can determine the weights of decision makers according to the above similarity measure. Assume that the weight of is denoted by . Hence, we can determine each , as follows: Clearly, and .

Step 3. Construct the aggregated Atanassov’s interval-valued intuitionistic fuzzy decision matrix.

In order to aggregate all the individual decisions and construct one group decision we need to construct aggregated interval-valued intuitionistic fuzzy decision matrix. We denote the aggregated Atanassov’s interval-valued intuitionistic fuzzy decision matrix by , where , and, therefore, where

Step 4. Determine the weights of criteria.

Let us denote by the vector of weights of criteria, where indicates the relative importance of criterion . These weights are expressed as interval-valued intuitionistic fuzzy numbers. In order to obtain W, we must gather the decision makers opinions to get the aggregated Atanassov’s interval-valued intuitionistic fuzzy weight of criteria. Let the fuzzy importance weight of th criterion with respect to th decision maker be . Then, the weights of criteria are calculated by formula (6) as follows: By formula (15) we see that each is an Atanassov’s interval-valued intuitionistic fuzzy number. For simplicity of notation, let us assume that .

Step 5. Determine the weighted decision matrix.

Our next claim is to determine the weighted decision matrix. We can construct the weighted decision matrix by (3). Let be the weighted decision matrix such that ; then .

Step 6. Determine the Atanassov’s interval-valued intuitionistic fuzzy PIS and NIS.

The underlying logic of TOPSIS method is to define the positive-ideal solution (PIS) and the negative-ideal solution (NIS). The PIS is the solution that maximizes the benefit criteria and minimizes the cost criteria, whereas the NIS is the solution that minimizes the benefit criteria and maximizes the cost criteria. The optimal alternative is the one with the shortest distance from the positive solution and the farthest distance from the negative solution.

We denote the set of benefit criteria as and the set of cost criteria as . Then, we can determine the IVIF PIS as , where

And we can determine the IVIF NIS as , where Without loss of generality we can assume that for we have and .

Step 7. Construct the separation measures.

The separation measure degree between candidate and the IVIF positive-ideal solution is defined using the normalized Hamming distance as follows: And, also, the separation measure degree between candidate and the IVIF negative-ideal solution is defined as follows:

Step 8. Calculate the closeness coefficient.

The closeness coefficient (relative closeness) of the alternative with respect to the IVIF PIS is defined as follows:

Step 9. Rank the alternatives.

According to the relative closeness, we can determine the ranking order of all alternative in descending order of ’s.

4. Application

In the process of MADM with intuitionistic fuzzy information, sometimes, the attribute values take the form of intuitionistic fuzzy numbers and the information about attribute weights is incompletely known or completely unknown. In such cases, it is suitable and convenient to express the decision makers’ preferences in an interval-valued intuitionistic fuzzy number (IVIFN). Therefore, it is necessary and interesting to pay attention to the group decision-making problems with interval-valued intuitionistic preference information. Therefore, it is necessary to pay attention to this issue.

In order to illustrate the proposed method, we consider an example where the managerial board of a university has to outsource construction of their new building. There are some construction companies as possible alternatives, and also, there are many factors for evaluating these companies. To hedge risks, a committee of four experts (decision makers), , , , and , has been formed to select the most suitable construction companies.

Step 1. Determine the Most Important Criteria.

In the first part of the study, the most important factors for evaluating suppliers (construction companies) are examined. The concept of the Delphi method is used to generate a consensus of opinions among experts and to extract the most important criteria. A nine-point scale is used in the questionnaires to collect experts opinions, with preferences of very unimportant, unimportant, normal, important, and very important (scores of 1, 3, 5, 7, and 9, resp.), and the value of 2, 4, 6 and 8 is the mid-opinion between 1, 3, 5, 7 and 9. An excerpt of the questionnaire is as shown in Table 1.

Eleven experts are asked to fill out the questionnaire. We arbitrarily set threshold at 64%, and 6 main criteria are selected from each part.

The result is shown in Table 2, and the selected criteria for evaluating companies are italicized. Six main attributes (criteria) are taken into consideration by decision makers during the supplier selection process. These criteria are as follows:: (Price) Company’s suggested net price.: (Quality) Company’s qualitative capabilities.: (Delivery time) Company’s delivery on-time capabilities.: (Performance history) Company’s performance antecedents.: (Economic status) Company’s financial (economic) status.: (Relation with industry) Company’s status in related industry (including credit and leadership).

Therefore, one cost criterion, , and five benefit criteria, , are considered. After preliminary screening, four companies () remain for further evaluation. By using the results from the Delphi method, a hierarchy is developed for incorporating the criteria into the company evaluation process. This hierarchy is as shown in Figure 1.

Since experts may not identify the importance of factors clearly, the results of questionnaires may be biased. To consider the vagueness of experts opinions, the data are considered as IVIF numbers. With the proposed model, the university can have a better understanding of the capabilities that a company must possess and can evaluate and select the most suitable construction company for cooperation. Four decision makers use the linguistic weighting variables shown in Table 3 to assess the importance of the criteria. Also the decision makers use the linguistic rating variables shown in Table 4 to evaluate the ratings of candidates with respect to each criterion.

The ratings of the five companies by the decision makers under the various criteria and the importance weights of the criteria determined by these four decision makers are shown in Tables 5, 6, 7, and 8. The linguistic evaluations shown in Tables 5, 6, 7, and 8 are converted into IVIF numbers.

Step 2. Determine the weight of decision makers.

Now, in order to determine the weight of decision makers we must construct the ideal matrix. It is done by formula (11). The ideal matrix is shown in Table 9. We Use formulas (12) and (13) in order to determine the weights of each decision makers. The result is shown in Table 10.

Table 10 shows that the decision of is more important than those of other decision makers.

Step 3. Construct the Aggregated Atanassov’s Interval-Valued Intuitionistic Fuzzy Decision Matrix.

In order to aggregate all individual decisions and construct one group decision we use formula (14) and construct the aggregated IVIF decision matrix. Table 11 shows the result.

Step 4. Determine the weights of criteria.

By applying formula (15) and Tables 5, 6, 7, 8, and 10, the importance of the criteria can be calculated. See Table 12.

Step 5. Determine the weighted decision matrix.

We can construct the weighted decision matrix by formula (3). Table 13 shows the weighted decision matrix.

Step 6. Determine the Atanassov’s interval-valued intuitionistic PIS and NIS.

By formulas (16) and (17) we can determine the IVIF PIS and IVIF NIS as in Table 14.

Step 7. Construct the Separation Measures.

In this step, we calculate the separation of each alternative from Atanassov’s interval-valued intuitionistic fuzzy positive ideal solution and from Atanassov’s interval-valued intuitionistic fuzzy negative ideal solution, using formulas (18) and (19), respectively. Table 15 shows the distance of each alternative from IVIF PIS and IVIF NIS.

Step 8. Calculate the Closeness Coefficient.

Closeness coefficient of each alternative can be calculated by formula (20). The fourth column of Table 15 shows the closeness coefficient of all alternatives.

Step 9. Rank the Alternatives.

According to the closeness coefficient, the ranking order of all alternatives is shown in the final column of Table 15.

As can be seen, , company 3, is selected as appropriate construction company among the alternatives.

4.1. More Insight

In this section, for the purpose of comparison we calculate the score function of each Atanassov’s interval-valued intuitionistic fuzzy number of weighted decision matrix and IVIF PIS and IVIF NIS. After that, performances of companies with respect to each criterion are calculated and are shown in Figure 2. As can be seen from Figure 2 company 3 performs relatively better than the other three companies under most of the criteria, and is closer to IVIF PIS than other companies. On the other hand, company 1 performs relatively worse than the other three companies under most of the criteria and is closer to NIS than the other companies. To summarize, company 3 should be selected for cooperation.

5. Conclusion

During the recent years, how to determine suitable suppliers in the supply chain has become a key strategic consideration. In supplier selection process the supplier’s information and performances are usually incomplete and uncertain. Therefore, the decision makers are unable (or unwilling) to express their judgment on the suppliers with exact and crisp values and the evaluations are very often expressed in linguistic terms. In such situation fuzzy set theory is an appropriate tool to deal with this kind of problems. In this paper the linguistic is characterized by Atanassov’s interval-valued intuitionistic fuzzy numbers and an extended TOPSIS method for group decision making with IVIF numbers is developed to solve the supplier selection problem.

The proposed approach first uses the Delphi method to select the most important criteria. Next, by means of judgment matrix of each decision maker calculates the weight of each decision maker and the weight of each criteria. Then the weighted decision matrix is constructed, and, then, the IVIF PIS and the IVIF NIS are determined.

Based on the normalized Hamming distance, we calculate the relative closeness of each alternatives to the IVIF PIS and rank the alternative according to the relative closeness and select the most desirable one(s).

The proposed method is very flexible. Using this method not only enables us to determine outranking order of suppliers but also assess and rate the supplier and assess and rate the decision makers.