An Exponential Jensen Fuzzy Divergence Measure with Applications in Multiple Attribute Decision-Making
A divergence measure plays an important role in discriminating two probability distributions and drawing inferences based on such discrimination. This communication introduces one such divergence measure based on Jensen inequality and exponential entropy introduced by Pal and Pal in the settings of probability theory. Further, the idea has been generalized to fuzzy sets to introduce a new fuzzy divergence measure. Besides establishing the validity, some of its major properties are also studied. At last, the application of proposed fuzzy divergence measure is given in strategic decision-making.
Uncertainty in real world is ubiquitous. Before the discovery of fuzzy sets by Zadeh , probability was the only way to measure the uncertainty. Introduction of fuzzy set (FS) theory by Zadeh  provided the researchers with an important tool to handle the uncertainty/fuzziness. Contrary to the classical definition of a set in which a particular either belongs to the set or not, in fuzzy set each member of the set is assigned a membership degree. Fuzzy entropy is an important concept related to FS theory. Fuzzy entropy quantifies the fuzziness arising due to the vagueness of being or not being the member of the set. It was Zadeh again who pioneered in the introduction of fuzzy entropy as weighted Shannon entropy . The axiomatization of the concept of fuzzy entropy by De Luca and Termini  has caused several researchers to introduce fuzzy entropies from their viewpoints and gave their applications in distinct fields [4–6]. Recently, Joshi and Kumar [7, 8] have introduced two new fuzzy entropies and applied them in decision-making. Amongst various applications, one important application of fuzzy entropies has been found in determining the divergence between two distributions. A divergence measure is a measure which is used to quantify the distance between two distributions. To develop new fuzzy divergence measures and seek their applications in different areas is a hot topic amongst the researchers nowadays. Thus, many authors are contributing towards the development of fuzzy divergence measures and their applications in distinct fields like pattern recognition, image segmentation, etc. [9–18]. The above discussion highlights the importance of divergence measures based on fuzzy sets.
Vagueness in scientific studies poses a problem. FSs introduced by Zadeh  have been proved to be more useful to characterizing such vagueness. Therefore, it is natural to develop such measures which can not only measure vagueness but also quantify the divergence between underlying characterizing FSs. The present communication is a sequel in this direction. Using the notion of Jensen-Shannon divergence proposed by Lin , a new concept called Jensen-Exponential divergence measure based on famous Jensen inequality and well-known exponential entropy introduced by Pal and Pal  has been put forward. One of the major benefits of using Jensen-Shannon divergence measure  is that we can give any weight-age to a probability distribution. While introducing the concept of exponential entropy by Pal and Pal , the authors claimed that exponential entropy has several advantages over logarithmic entropy like upper bound, etc. Exploring the properties of exponential entropy introduced by Pal and Pal , a new divergence measure has been proposed in this communication. The prime aims of introducing this manuscript are as follows: (1) to propose a new divergence measure based on exponential entropy introduced by Pal and Pal  and Jensen inequality; (2) to extend this idea to fuzzy settings to introduce a new fuzzy divergence measure; (3) to introduce a new multiple attribute decision-making method based on proposed fuzzy divergence measure; (4) to apply the proposed method in strategic decision-making problem.
The paper is managed as follows: The contribution of earlier researchers to the field and the aim of the manuscript are given in Section 1. Some basic concepts and definitions related to the topic under consideration are given in Section 2. In Section 3, a new divergence measure and its extension to fuzzy sets are given in Section 3. Besides this, the validity of proposed fuzzy divergence measures is also established in this section. Some major properties of proposed fuzzy divergence are discussed in Section 4. Section 5 is devoted to the application of proposed fuzzy divergence measure in decision-making. At last, the paper is summed up with “conclusions” in Section 6.
The next section contains some relevant concepts and definitions necessary to understand this communication.
Definition 1 (See ). Let be a finite universe of discourse. A fuzzy set (FS) in is defined aswhere denotes the membership function and represents the membership degree or measure of belongingness of to .
From here onwards, will denote the set of all fuzzy sets defined on .
Now, we define some basic operations on FSs.
Definition 2 (See ). Let . Then (1) if and only if for all ;(2) if and only if and ;(3);(4);(5).
3. A New Fuzzy Divergence Measure
Let , , be a set of complete probability distributions. For some , the exponential entropyproposed by Pal and Pal  is one of the well-known index of diversity. The concavity of measure (2) bifurcates the mixed distribution into two parts as follows:The first term in (3), that is, , is the average diversity within distributions and and the second term, that is,is called Exponential Jensen difference. Convexity of implies the convexity of Jensen difference given by (4). Again, at confirms that (4) is a natural measure of divergence [20, 21]. Besides this, the measure (4) also meets the intuitive requirement that average divergence between and is not less than their convex combination; that is, , where satisfying . The convex behavior of Jensen difference (4) is an additional feature of exponential entropy (2).
The authors claim that (2) has some advantages over Shannon entropy  particularly in image processing. This is due to fact that entropy (2) has a fixed upper bound, that is, for an uniform distribution ; as compared to infinite limit (as ) in case of Shannon entropy.
Based on the concept of Jensen-Shannon divergence , corresponding to (2), for any two probability distributions with and as their respective weights satisfying , we define a new divergence measure asTo justify the existence, we now prove that proposed measure satisfies the following properties.
Properties of . Some major properties of proposed divergence measure are(1) with equality when ;(2) is a convex function of and .
Proof. First we prove that .
Since (2) represents a concave function, therefore, for any , using Jensen’s inequality, we haveThis impliesSimilarly,Adding (7) and (8), we get .
Now, we prove the convexity of (5).
For this, we consider a function given by
Definition 3. The Hessian matrix of a function of two variables and is defined asThe function is said to be convex at any point in its domain if is positive semidefinite and concave if is negative semidefinite at that point.
Now, differentiating (9) partially with respect to and , we getTo determine stationary point, we substitute and . This gives as a stationary point. Now, computing the Hessian matrix of at and using , we have which is positive semidefinite. This confirms the convex character of .
Extending the idea from probabilistic settings to fuzzy settings, in the next subsection, we introduce a new fuzzy divergence measure based on measure (5).
Definition 4. Let be a finite universe of discourse. For any , we define a fuzzy divergence measure as
Now, a very natural question that comes in mind is about the validation of the proposed measure. We answer this query by showing that the proposed measure satisfies (1) nonnegativity and (2) convexity.
Proof. We start with proving the nonnegativity of (14).
Using (6), we haveSimilarly,Adding (15) and (16), we have .
Since and for all and , therefore, convexity of (14) follows directly from the convexity of (5).
This, justifies the existence of (14).
In the next Section, we study some major properties of .
4. Properties of Proposed Divergence Measure
Measure (14) possesses the following properties.
Theorem 5. For ,(1);(2) if and only if ;(3) if and only if for all ;(4);(5);(6);(7);(8);(9);(10);(11).(12);(13);(14), where and are the complements of FSs and , respectively.
Proof. Proofs of above properties have been provided in the Appendix.
In the next section, we give an application of proposed divergence measure in multiple attribute decision-making problem (MADM) with the help of an illustrative example.
5. Application of Proposed Fuzzy Divergence Measure in Decision-Making
In recent years, fuzzy divergence measures have been extensively applied by many researchers in many fields like in image thresholding, bioinformatics, etc. [5, 8–11]. In this paper, we apply the proposed fuzzy divergence measure in strategic decision-making. In strategic decision-making problems, we have a set of strategies say and another set of inputs say . Our aim is to find a particular strategy which if applied with a specific input produces optimum results. Degree of effectiveness of a particular strategy corresponding to specific input can be yielded by the method suggested by Liu and Wang  as follows.
Consider a team comprised of -number of experts. Team members are expected to respond in the form “” if he/she supports a particular strategy coupled with a specific input and “” in case he/she does not feel the particular strategy to be applied with a specific input. Let the number of experts who support the strategy to be applied with input “” be denoted by “”. Then, the effectiveness of strategy “” with input ’ can be calculated asNow, let the degree of effectiveness of ’s at uniform inputs be denoted by fuzzy set given by where denotes the membership degree satisfying .
Further, let the degree of effectiveness of ’s at particular inputs be denoted by the fuzzy set given by
5.1. A New MADM Method
TOPSIS (Technique of Order Preference by Similarity to Ideal Solutions) method is a well-known technique employed for solving multiple attribute decision-making (MADM) problems. In this technique, an option nearest to the positive ideal solution and farthest from the negative ideal solution is chosen as most suitable option. Using the concept of TOPSIS initially introduced by Xu and Yager , we now propose a new MADM method to solve the above strategic decision-making problem. The procedural steps of proposed method are listed as follows:(1)Determine the best strategy as follows:(2)Construct the fuzzy decision matrix as and . The number “” in the above matrix denotes the degree of effectiveness of strategy corresponding to input using (17).(3)Determine the normalized fuzzy decision matrix as(4)Determine the weighted normalized fuzzy decision matrix as where denote the weight matrix and is the weight of th strategy.(5)Determine the positive ideal solution () and negative ideal solution () as where , , , and .(6)Determine the separation of each alternative from and , respectively, by using (14). Let these be denoted by and .(7)Determine the relative closeness coefficients of each alternative from and as(8)Rank the alternatives according to relative closeness coefficients obtained in Step (7).
Therefore, if the strategy coupled with input is applied, then we get optimal output.
An Illustrative Example. This example is adapted from Joshi and Kumar .
Consider an example of a company that wants to launch a new product in the market. For an effective marketing of the product, company has conducted a survey to know the opinion of people about the product before its launching. The whole compiled views are divided into five categories called inputs denoted by . Depending upon these views, company’s think tank has prepared five strategies to launch the product in the market denoted by . Now, our aim is to find a particular strategy which if coupled with a specific input returns maximum gains. As a part of full-proof success of the product in the market, company has constituted a committee of 100 experts (in real world problem, no. of experts may increase or decrease). Tables 1 and 2 represent the degrees of effectiveness of different strategies at uniform inputs and at particular inputs.
Now, we employ the proposed measure (14) to compute the above example using TOPSIS method defined above.(1)Applying Step (1) in Table 1, the best strategy so obtained is given by .(2)The calculated fuzzy decision matrix using Step (2) is given in Table 2.(3)The computed weighted normalized fuzzy decision matrix using (22) and (23) is shown in Table 3.(4)Computed values of positive ideal solution and negative ideal solution using Step (5) are given in Table 4.(5)Separation measures of ’s from and using (14) are displayed in Table 5.(6)Calculated values of relative closeness coefficients using Step (7) are presented in Table 6.
Arranging the alternatives according to values of relative closeness coefficients in descending order, the preferential sequence so obtained is given by the following.
Thus, for different values of and , the best alternative remains unaltered.
Now, we compute the above Example by fuzzy MOORA (Multiobjective Optimization on the basis of Ratio Analysis) method suggested by Brauers and Zavadskas  for the sake of comparison. This method refers to a matrix of responses of alternatives to objectives, to which ratios are applied. The procedural steps are briefed as follows.
Fuzzy MOORA Method . Steps (1)-(4) of fuzzy MOORA method are same as Steps (2)-(4) of the proposed method. The remaining steps are as follows:(5)Compute the overall performance index for all ’s; The calculated values are given in Table 7.(6)Rank the ’s according to the values of obtained in Step (5) in descending order. The ranking results so obtained for different values of and are shown in Table 7.
The ranking order of alternatives is as follows:
For ; .
For ; .
Thus, the best alternative, that is, , remains unaltered for different values of and .
5.2. A Comparative Analysis
On comparing the output obtained by using proposed method with that of fuzzy MOORA method proposed by Brauers and Zavadskas , we find that the best alternative generated by two methods coincide. But there is a big difference in computational procedures adopted in two methods. In fuzzy MOORA method, the best alternative is decided on the basis of overall performance score values of positive ideal solution and negative ideal solution. In this way, each attribute may not get its due weight-age during the selection of the best alternative, whereas, in proposed method, the best alternative is decided on the basis of relative closeness coefficients; that is, each attribute is given due weight-age in decision-making process . Secondly, in proposed method there is a particular strategy with a specific input whereas this is not the case with fuzzy MOORA method. Thus, the performance of proposed method is considerably good.
6. Concluding Remarks
In this communication, we have successfully introduced an exponential divergence measure based on the concept of Jensen-Shannon divergence measure. Further, the proposed divergence measure has been extended to fuzzy sets to introduce a new fuzzy divergence measure. The validation of proposed divergence measure is well established along with a discussion on some major properties. In the end, the application of proposed dissimilarity measure is given in decision-making. The proposed fuzzy divergence can be further generalized to intuitionistic fuzzy settings. This work is under consideration and will be reported somewhere else.
Proofs of Properties
Proof. To prove the properties, we bifurcate into two parts and such thatFrom (A.1), it is clear that, for all ,and, for all ,(1) Proof of Properties (1), (2), and (3) follows directly from definition (9).
(2) Proof of Property (4)This implies Similarly, we can prove that .
(3) Proof of Property (5)Similarly, we may prove that(4) Proof of Property (6). Proof follows from Property (5) and Property (1).
(5) Proof of Property (7)(6) Proof of Property (8). Proof of Property (8) is similar to that of Property (7).
(7) Proof of Property (9). ConsiderThis impliesTherefore, .
(8) Proof for Property (10). Similarly, we can prove Property (10).
(9) Proof of Property (11). ConsiderUsing (A.1) to (A.3), we get(10) Proofs of Properties (12), (13), and (14) follows directly from definition.
All data sources have been cited in the article where necessary.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this manuscript.
N. R. Pal and S. K. Pal, “Object background segmentation using new definition of entropy,” IEE Proceedings E, vol. 366, pp. 284–295, 1989.View at: Google Scholar
R. K. Bajaj and D. S. Hooda, “On some new generalized measures of fuzzy information,” World Academy of Science, Engineering and Technology, vol. 62, pp. 747–753, 2010.View at: Google Scholar
G. A. Papakostas, A. G. Hatzimichailidis, and V. G. Kaburlasos, “Distance and similarity measures between intuitionistic fuzzy sets: a comparative analysis from a pattern recognition point of view,” Pattern Recognition Letters, vol. 34, no. 14, pp. 1609–1622, 2013.View at: Publisher Site | Google Scholar
R. C. Lewontin, “The apportionment of human diversity,” Evolutionary biology, vol. 6, pp. 381–398, 1972.View at: Google Scholar