Research Article  Open Access
An Exponential Jensen Fuzzy Divergence Measure with Applications in Multiple Attribute DecisionMaking
Abstract
A divergence measure plays an important role in discriminating two probability distributions and drawing inferences based on such discrimination. This communication introduces one such divergence measure based on Jensen inequality and exponential entropy introduced by Pal and Pal in the settings of probability theory. Further, the idea has been generalized to fuzzy sets to introduce a new fuzzy divergence measure. Besides establishing the validity, some of its major properties are also studied. At last, the application of proposed fuzzy divergence measure is given in strategic decisionmaking.
1. Introduction
Uncertainty in real world is ubiquitous. Before the discovery of fuzzy sets by Zadeh [1], probability was the only way to measure the uncertainty. Introduction of fuzzy set (FS) theory by Zadeh [1] provided the researchers with an important tool to handle the uncertainty/fuzziness. Contrary to the classical definition of a set in which a particular either belongs to the set or not, in fuzzy set each member of the set is assigned a membership degree. Fuzzy entropy is an important concept related to FS theory. Fuzzy entropy quantifies the fuzziness arising due to the vagueness of being or not being the member of the set. It was Zadeh again who pioneered in the introduction of fuzzy entropy as weighted Shannon entropy [2]. The axiomatization of the concept of fuzzy entropy by De Luca and Termini [3] has caused several researchers to introduce fuzzy entropies from their viewpoints and gave their applications in distinct fields [4–6]. Recently, Joshi and Kumar [7, 8] have introduced two new fuzzy entropies and applied them in decisionmaking. Amongst various applications, one important application of fuzzy entropies has been found in determining the divergence between two distributions. A divergence measure is a measure which is used to quantify the distance between two distributions. To develop new fuzzy divergence measures and seek their applications in different areas is a hot topic amongst the researchers nowadays. Thus, many authors are contributing towards the development of fuzzy divergence measures and their applications in distinct fields like pattern recognition, image segmentation, etc. [9–18]. The above discussion highlights the importance of divergence measures based on fuzzy sets.
Vagueness in scientific studies poses a problem. FSs introduced by Zadeh [1] have been proved to be more useful to characterizing such vagueness. Therefore, it is natural to develop such measures which can not only measure vagueness but also quantify the divergence between underlying characterizing FSs. The present communication is a sequel in this direction. Using the notion of JensenShannon divergence proposed by Lin [19], a new concept called JensenExponential divergence measure based on famous Jensen inequality and wellknown exponential entropy introduced by Pal and Pal [5] has been put forward. One of the major benefits of using JensenShannon divergence measure [19] is that we can give any weightage to a probability distribution. While introducing the concept of exponential entropy by Pal and Pal [5], the authors claimed that exponential entropy has several advantages over logarithmic entropy like upper bound, etc. Exploring the properties of exponential entropy introduced by Pal and Pal [5], a new divergence measure has been proposed in this communication. The prime aims of introducing this manuscript are as follows: (1) to propose a new divergence measure based on exponential entropy introduced by Pal and Pal [5] and Jensen inequality; (2) to extend this idea to fuzzy settings to introduce a new fuzzy divergence measure; (3) to introduce a new multiple attribute decisionmaking method based on proposed fuzzy divergence measure; (4) to apply the proposed method in strategic decisionmaking problem.
The paper is managed as follows: The contribution of earlier researchers to the field and the aim of the manuscript are given in Section 1. Some basic concepts and definitions related to the topic under consideration are given in Section 2. In Section 3, a new divergence measure and its extension to fuzzy sets are given in Section 3. Besides this, the validity of proposed fuzzy divergence measures is also established in this section. Some major properties of proposed fuzzy divergence are discussed in Section 4. Section 5 is devoted to the application of proposed fuzzy divergence measure in decisionmaking. At last, the paper is summed up with “conclusions” in Section 6.
The next section contains some relevant concepts and definitions necessary to understand this communication.
2. Preliminaries
Definition 1 (See [1]). Let be a finite universe of discourse. A fuzzy set (FS) in is defined aswhere denotes the membership function and represents the membership degree or measure of belongingness of to .
From here onwards, will denote the set of all fuzzy sets defined on .
Now, we define some basic operations on FSs.
Definition 2 (See [1]). Let . Then (1) if and only if for all ;(2) if and only if and ;(3);(4);(5).
3. A New Fuzzy Divergence Measure
3.1. Background
Let , , be a set of complete probability distributions. For some , the exponential entropyproposed by Pal and Pal [5] is one of the wellknown index of diversity. The concavity of measure (2) bifurcates the mixed distribution into two parts as follows:The first term in (3), that is, , is the average diversity within distributions and and the second term, that is,is called Exponential Jensen difference. Convexity of implies the convexity of Jensen difference given by (4). Again, at confirms that (4) is a natural measure of divergence [20, 21]. Besides this, the measure (4) also meets the intuitive requirement that average divergence between and is not less than their convex combination; that is, , where satisfying . The convex behavior of Jensen difference (4) is an additional feature of exponential entropy (2).
The authors claim that (2) has some advantages over Shannon entropy [22] particularly in image processing. This is due to fact that entropy (2) has a fixed upper bound, that is, for an uniform distribution ; as compared to infinite limit (as ) in case of Shannon entropy.
Based on the concept of JensenShannon divergence [19], corresponding to (2), for any two probability distributions with and as their respective weights satisfying , we define a new divergence measure asTo justify the existence, we now prove that proposed measure satisfies the following properties.
Properties of . Some major properties of proposed divergence measure are(1) with equality when ;(2) is a convex function of and .
Proof. First we prove that .
Since (2) represents a concave function, therefore, for any , using Jensen’s inequality, we haveThis impliesSimilarly,Adding (7) and (8), we get .
Now, we prove the convexity of (5).
For this, we consider a function given by
Definition 3. The Hessian matrix of a function of two variables and is defined asThe function is said to be convex at any point in its domain if is positive semidefinite and concave if is negative semidefinite at that point.
Now, differentiating (9) partially with respect to and , we getTo determine stationary point, we substitute and . This gives as a stationary point. Now, computing the Hessian matrix of at and using , we have which is positive semidefinite. This confirms the convex character of .
Extending the idea from probabilistic settings to fuzzy settings, in the next subsection, we introduce a new fuzzy divergence measure based on measure (5).
3.2. Definition
Definition 4. Let be a finite universe of discourse. For any , we define a fuzzy divergence measure as
3.3. Justification
Now, a very natural question that comes in mind is about the validation of the proposed measure. We answer this query by showing that the proposed measure satisfies (1) nonnegativity and (2) convexity.
Proof. We start with proving the nonnegativity of (14).
Using (6), we haveSimilarly,Adding (15) and (16), we have .
Since and for all and , therefore, convexity of (14) follows directly from the convexity of (5).
This, justifies the existence of (14).
In the next Section, we study some major properties of .
4. Properties of Proposed Divergence Measure
Measure (14) possesses the following properties.
Theorem 5. For ,(1);(2) if and only if ;(3) if and only if for all ;(4);(5);(6);(7);(8);(9);(10);(11).(12);(13);(14), where and are the complements of FSs and , respectively.
Proof. Proofs of above properties have been provided in the Appendix.
In the next section, we give an application of proposed divergence measure in multiple attribute decisionmaking problem (MADM) with the help of an illustrative example.
5. Application of Proposed Fuzzy Divergence Measure in DecisionMaking
In recent years, fuzzy divergence measures have been extensively applied by many researchers in many fields like in image thresholding, bioinformatics, etc. [5, 8–11]. In this paper, we apply the proposed fuzzy divergence measure in strategic decisionmaking. In strategic decisionmaking problems, we have a set of strategies say and another set of inputs say . Our aim is to find a particular strategy which if applied with a specific input produces optimum results. Degree of effectiveness of a particular strategy corresponding to specific input can be yielded by the method suggested by Liu and Wang [23] as follows.
Consider a team comprised of number of experts. Team members are expected to respond in the form “” if he/she supports a particular strategy coupled with a specific input and “” in case he/she does not feel the particular strategy to be applied with a specific input. Let the number of experts who support the strategy to be applied with input “” be denoted by “”. Then, the effectiveness of strategy “” with input ’ can be calculated asNow, let the degree of effectiveness of ’s at uniform inputs be denoted by fuzzy set given by where denotes the membership degree satisfying .
Further, let the degree of effectiveness of ’s at particular inputs be denoted by the fuzzy set given by
5.1. A New MADM Method
TOPSIS (Technique of Order Preference by Similarity to Ideal Solutions) method is a wellknown technique employed for solving multiple attribute decisionmaking (MADM) problems. In this technique, an option nearest to the positive ideal solution and farthest from the negative ideal solution is chosen as most suitable option. Using the concept of TOPSIS initially introduced by Xu and Yager [24], we now propose a new MADM method to solve the above strategic decisionmaking problem. The procedural steps of proposed method are listed as follows:(1)Determine the best strategy as follows:(2)Construct the fuzzy decision matrix as and . The number “” in the above matrix denotes the degree of effectiveness of strategy corresponding to input using (17).(3)Determine the normalized fuzzy decision matrix as(4)Determine the weighted normalized fuzzy decision matrix as where denote the weight matrix and is the weight of th strategy.(5)Determine the positive ideal solution () and negative ideal solution () as where , , , and .(6)Determine the separation of each alternative from and , respectively, by using (14). Let these be denoted by and .(7)Determine the relative closeness coefficients of each alternative from and as(8)Rank the alternatives according to relative closeness coefficients obtained in Step (7).
Therefore, if the strategy coupled with input is applied, then we get optimal output.
An Illustrative Example. This example is adapted from Joshi and Kumar [8].
Consider an example of a company that wants to launch a new product in the market. For an effective marketing of the product, company has conducted a survey to know the opinion of people about the product before its launching. The whole compiled views are divided into five categories called inputs denoted by . Depending upon these views, company’s think tank has prepared five strategies to launch the product in the market denoted by . Now, our aim is to find a particular strategy which if coupled with a specific input returns maximum gains. As a part of fullproof success of the product in the market, company has constituted a committee of 100 experts (in real world problem, no. of experts may increase or decrease). Tables 1 and 2 represent the degrees of effectiveness of different strategies at uniform inputs and at particular inputs.


Now, we employ the proposed measure (14) to compute the above example using TOPSIS method defined above.(1)Applying Step (1) in Table 1, the best strategy so obtained is given by .(2)The calculated fuzzy decision matrix using Step (2) is given in Table 2.(3)The computed weighted normalized fuzzy decision matrix using (22) and (23) is shown in Table 3.(4)Computed values of positive ideal solution and negative ideal solution using Step (5) are given in Table 4.(5)Separation measures of ’s from and using (14) are displayed in Table 5.(6)Calculated values of relative closeness coefficients using Step (7) are presented in Table 6.




Arranging the alternatives according to values of relative closeness coefficients in descending order, the preferential sequence so obtained is given by the following.
For .
For .
Thus, for different values of and , the best alternative remains unaltered.
Now, we compute the above Example by fuzzy MOORA (Multiobjective Optimization on the basis of Ratio Analysis) method suggested by Brauers and Zavadskas [25] for the sake of comparison. This method refers to a matrix of responses of alternatives to objectives, to which ratios are applied. The procedural steps are briefed as follows.
Fuzzy MOORA Method [25]. Steps (1)(4) of fuzzy MOORA method are same as Steps (2)(4) of the proposed method. The remaining steps are as follows:(5)Compute the overall performance index for all ’s; The calculated values are given in Table 7.(6)Rank the ’s according to the values of obtained in Step (5) in descending order. The ranking results so obtained for different values of and are shown in Table 7.

The ranking order of alternatives is as follows:
For ; .
For ; .
Thus, the best alternative, that is, , remains unaltered for different values of and .
5.2. A Comparative Analysis
On comparing the output obtained by using proposed method with that of fuzzy MOORA method proposed by Brauers and Zavadskas [25], we find that the best alternative generated by two methods coincide. But there is a big difference in computational procedures adopted in two methods. In fuzzy MOORA method, the best alternative is decided on the basis of overall performance score values of positive ideal solution and negative ideal solution. In this way, each attribute may not get its due weightage during the selection of the best alternative, whereas, in proposed method, the best alternative is decided on the basis of relative closeness coefficients; that is, each attribute is given due weightage in decisionmaking process [8]. Secondly, in proposed method there is a particular strategy with a specific input whereas this is not the case with fuzzy MOORA method. Thus, the performance of proposed method is considerably good.
6. Concluding Remarks
In this communication, we have successfully introduced an exponential divergence measure based on the concept of JensenShannon divergence measure. Further, the proposed divergence measure has been extended to fuzzy sets to introduce a new fuzzy divergence measure. The validation of proposed divergence measure is well established along with a discussion on some major properties. In the end, the application of proposed dissimilarity measure is given in decisionmaking. The proposed fuzzy divergence can be further generalized to intuitionistic fuzzy settings. This work is under consideration and will be reported somewhere else.
Appendix
Proofs of Properties
Proof. To prove the properties, we bifurcate into two parts and such thatFrom (A.1), it is clear that, for all ,and, for all ,(1) Proof of Properties (1), (2), and (3) follows directly from definition (9).
(2) Proof of Property (4)This implies Similarly, we can prove that .
(3) Proof of Property (5)Similarly, we may prove that(4) Proof of Property (6). Proof follows from Property (5) and Property (1).
(5) Proof of Property (7)(6) Proof of Property (8). Proof of Property (8) is similar to that of Property (7).
(7) Proof of Property (9). ConsiderThis implies