Literature DB >> 25392793

Sequence of inequalities among fuzzy mean difference divergence measures and their applications.

Vijay Prakash Tomar1, Anshu Ohlan1.   

Abstract

This paper presents a sequence of fuzzy mean difference divergence measures. The validity of these fuzzy mean difference divergence measures is proved axiomatically. In addition, it introduces a sequence of inequalities among some of these fuzzy mean difference divergence measures. The applications of proposed fuzzy mean difference divergence measures in the context of pattern recognition have been presented using a numerical example. It is shown that the proposed fuzzy mean difference divergence measures are well suited to use with linguistic variables. Finally, on establishing inequalities, we find that our proposed measures are computationally much more efficient.

Entities:  

Keywords:  Fuzzy divergence measure; Fuzzy entropy; Fuzzy mean difference divergence measures; Inequalities; Pattern recognition

Year:  2014        PMID: 25392793      PMCID: PMC4216826          DOI: 10.1186/2193-1801-3-623

Source DB:  PubMed          Journal:  Springerplus        ISSN: 2193-1801


Introduction

Shannon (1948) was first to use the word “entropy” to measure an uncertain degree of the randomness in a probability distribution. Entropy as a measure of fuzziness was first introduced by Zadeh (1968). There is an intrinsic similarity between two equations however Shannon entropy measures the average uncertainty in bits associated with the prediction of outcomes in a random experiment, but the entropy of fuzzy set describes the degree of fuzziness in a fuzzy set. The concept of fuzzy sets proposed by Zadeh (1968) has proven useful in the context of pattern recognition, image processing, speech recognition, bioinformatics, fuzzy aircraft control, feature selection, decision making, etc. Entropy, as a very important notion for measuring fuzziness degree or uncertain information in fuzzy set theory, has received a great attention. For example, Kullback and Leibler (1951) obtained the measure of directed divergence between two probability distributions. Bhandari and Pal (1993) presented some axioms to describe the measure of directed divergence between fuzzy sets, which is proposed corresponding to Kullback and Leibler (1951) measure of directed divergence. Thereafter, many other researchers have studied the fuzzy divergence measures in different ways and provide their application in different areas. In 1999, Fan and Xie introduced the divergence measure based on exponential operation and studied its relation with divergence measure introduced in Bhandari and Pal (1993). Montes et al. (2002) studied the special classes of divergence measures and used the link between fuzzy and probabilistic uncertainty. Parkash et al. (2006) proposed two fuzzy divergence measures corresponding to Ferreri (1980) probabilistic measure of directed divergence. Ghosh et al. (2010) gave the application of Bhandari and Pal (1993) divergence measure in the area of automated leukocyte recognition. Bhatia and Singh (2012) proposed the fuzzy divergence measure corresponding to Taneja (2008) Arithmetic–geometric divergence measure. In the recent years, many authors have introduced various divergence measures between fuzzy sets. We introduce a sequence of fuzzy mean difference divergence measures and established the inequalities among them to explore the fuzzy inequalities. The advantage of establishing the inequalities is to make the computational work much simpler. The technique of inequalities provides a better comparison among fuzzy mean divergence measures.

Preliminaries on fuzzy divergence measures

Fuzziness, a feature of uncertainty, results from the lack of sharp difference of being or not being a member of the set, i.e., the boundaries of the set under consideration are not sharply defined. A fuzzy set A defined on a universe of discourse X is given as Zadeh (1965): where μ : X → [0, 1] is the membership function of A. The membership value μ(x) describes the degree of the belongingness of x ∈ X in A. When μ(x) is valued in {0, 1}, it is the characteristic function of a crisp (non-fuzzy) set. Zadeh (1965) gave some notions related to fuzzy sets, one of them which we shall need in our discussion, is as follows: The measure of information defined by Shannon (1948) is given by Taking into consideration the concept of fuzzy sets, De Luca and Termini (1972) introduced the measure of fuzzy entropy corresponding to Shannon’s entropy given in (2) as Kullback and Leibler (1951) obtained the measure of directed divergence of probability distribution P = (p1, p2, … p) from probability distribution Q = (q1, q2, … q) as Measure of fuzzy divergence between two fuzzy sets gives the difference between two fuzzy sets and this measure of distance/difference between two fuzzy sets is called the fuzzy divergence measure. Bhandari and Pal (1993) introduced the measure of fuzzy directed divergence corresponding to (4) as The fuzzy mean divergence measures corresponding to seven geometrical mean measures given in Taneja (2012) are presented in Table 1.
Table 1

Fuzzy mean divergence measures

Sr. no.Fuzzy mean divergence measureDefinition
1.Fuzzy Arithmetic Mean Measure
2.Fuzzy Geometric Mean Measure
3.Fuzzy Harmonic Mean Measure
4.Fuzzy Heronian Mean Measure
5.Fuzzy Contra-harmonic Mean Measure
6.Fuzzy Root-mean-square Mean Measure
7.Fuzzy Centroidal Mean Measure
Fuzzy mean divergence measures We have the following Lemma in fuzzy context corresponding to the Lemma of Taneja (2005): Lemma 1: Let f : I ⊂ R+ → R be a convex and differentiable function satisfying . Consider a function Then the function φ(a, b) is convex . Additionally, if f′(1/2) = 0, then the following inequality holds: Lemma 2: Schwarz’s Lemma: Let f1, f2 : I ⊂ R+ → R be two convex functions satisfying the assumptions: ; f1 and f2 are twice differentiable in R+; there exist the real constants α, β such that 0 ≤ α < β and , , for all z > 0 then we have the inequalities:for all a, b ∈ (0, 1), where the function φ(.)(a, b) is defined as

Results and discussion

Sequence of fuzzy mean difference divergence measures

Corresponding to the fuzzy mean divergence measures defined in Table 1, we propose a sequence of fuzzy mean difference divergence measures as follows: Theorem 1: All the proposed measures (6) - (23) are valid measures of fuzzy mean difference directed divergence. Proof: (a) Non-negativity: From one of inequality in Taneja (2012), for two fuzzy sets A and B, we have H(A, B) ≤ G(A, B) ≤ N(A, B) ≤ A(A, B) ≤ R(A, B) ≤ S(A, B) ≤ C(A, B). Hence, the condition of non-negativity of measures (6) - (23) is proved. Also clearly, for all measures from (6) - (23) where A1 and B1 belongs to the fuzzy mean divergence measures given in Table 1. (b) Invariant under complementation: From the notion of compliment of a fuzzy set given in (1) we can easily check for measures (6) - (23) that . (c) Convexity: Now we shall prove the condition of convexity of measures (6) - (23) with the help of Lemma 1. For simplicity, Let us write where with A1 ≥ B1. Let us take μ = z ⇒ μ = 1 − z. So, corresponding to measures (6) - (23) we have the following generating functions: Now in all the cases from (24) - (41), we can easily check that . It is understood that z ∈ [0, 1]. The first and second order derivatives of the functions (24) - (41) are as follows: We see that in the entire cases second order derivative are positive and satisfies for all z ∈ [0, 1]. Thus according to the Lemma 1 and equation (42) - (59), we get the convexity of the measures (6) - (23). Hence all the defined measures (6) - (23) are valid measures of fuzzy mean difference directed divergence.

Inequalities among fuzzy mean difference divergence measures

Theorem 2: The fuzzy mean difference divergence measures defined in (6) - (23) admit the following inequalities: i.e., we have the following inequalities: , , , . Proof: The proof of the above theorem is based on Lemma 2 and is given in parts in the following propositions. Proposition 1: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (60), we get Proposition 2: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (61), we get Proposition 3: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (62), we get Proposition 4: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (63), we get Proposition 5: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (64), we get Proposition 6: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (65), we get Proposition 7: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (66), we get Proposition 8: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (67), we get Proposition 9: We have D ≤ 3D Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (68), we get Proposition 10: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (69), we get Proposition 11: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (70), we get Proposition 12: We have Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (71), we get Proposition 13: We have D ≤ 5D Proof: Let us consider the function This gives And we have Applying Lemma 2 for the difference of fuzzy means D(A, B) and D(A, B) and using (72), we get

Application of fuzzy mean difference divergence measures to pattern recognition

We now present the application of the proposed fuzzy mean difference divergence measures in the context of pattern recognition. Next, an example related to pattern recognition is given to demonstrate the results obtained by the fuzzy mean difference divergence measures (6) - (23). In order to demonstrate the application of the introduced fuzzy mean difference divergence measures to pattern recognition, suppose that we are given three known patterns P1, P2 and P3 which have classifications C1, C2 and C3 respectively. The patterns are represented by the following fuzzy sets in the universe of discourse X = {x1, x2, x3, x4}: Given an unknown pattern Q, represented by the fuzzy set Our aim is to classify Q to one of the classes C1, C2 and C3. According to the principle of minimum divergence/discrimination information between fuzzy sets, the process of assigning Q to is described by Table 2 presents D(P, Q), k = {1, 2, 3}. It is observed that Q has been classified to C3 correctly.
Table 2

Computed values of fuzzy mean difference divergence measures D (P , Q) with k = {1, 2, 3}

P 1 P 2 P 3
Q 0.2741(6) 0.2877(6) 0.1385(6)
0.5825(7) 0.6430(7) 0.3127(7)
0.8002(8) 0.8400(8) 0.4064(8)
0.3423(9) 0.3631(9) 0.1772(9)
0.5135(10) 0.5446(10) 0.2659(10)
1.0270(11) 1.0892(11) 0.5318(11)
0.2385(12) 0.2569(12) 0.1274(12)
0.3340(13) 0.3553(13) 0.1742(13)
0.5252(14) 0.5523(14) 0.2679(14)
0.7520(15) 0.8015(15) 0.3933(15)
0.1712(16) 0.1815(16) 0.0887(16)
0.2667(17) 0.2799(17) 0.1355(17)
0.4579(18) 0.4769(18) 0.2292(18)
0.6847(19) 0.7261(19) 0.3546(19)
0.0955(20) 0.0984(20) 0.0468(20)
0.2867(21) 0.2954(21) 0.1405(21)
0.5135(22) 0.5446(22) 0.2659(22)
0.1912(23) 0.1970(23) 0.0937(23)

For convenience, we use the notation * ( in Table 2 to present the divergence/distance value computed from equation i.

Computed values of fuzzy mean difference divergence measures D (P , Q) with k = {1, 2, 3} For convenience, we use the notation * ( in Table 2 to present the divergence/distance value computed from equation i.

Numerical example

We now establish that the proposed fuzzy mean difference divergence measures (6) - (23) are reliable in applications with compound linguistic variables. Example: Let F = {(x, μ(x))/x ∈ X} be a fuzzy set in X. Tomar and Ohlan (2014) defined for any positive real number n, from the operation of power of a fuzzy set: F = {(x, [μ(x)])/x ∈ X}. Using the above operation, the concentration and dilation of a fuzzy set F are as follows: CON (F) and DIL (F) are treated as “very (F)” and “more or less (F)”, respectively. We consider F in X = {x1, x2, x3, x4, x5} defined as: By taking into account the characterization of linguistic variables, we regard F as “LARGE” in X. Using the operations of concentration and dilation F1/2 may be treated as “More or less LARGE”, F2 may be treated as “Very LARGE”, F4 may be treated as “Vey very Large”. The proposed fuzzy mean difference divergence measures are used to calculate the degree of divergence/distance between these fuzzy sets. The divergence/distance values have been calculated by Eqs. (6) - (23) between different fuzzy sets. The comparative results are summarized in Table 3. For convenience, we use the notation * ( in Table 3 to present the divergence/distance value computed from equation i. The following abbreviated notions are used in Table 3.
Table 3

Divergence/distance values calculated by Eqs. ( 6 ) - ( 23 )

L.M.L.L.V.L.V.V.L.L.M.L.L.V.L.V.V.L.L.M.L.L.V.L.V.V.L.L.M.L.L.V.L.V.V.L.
L.M.L.L.V.L.V.V.L.
0.0000(6) 0.0884(6) 0.1304(6) 0.4250(6) 0.0884(6) 0.0000(6) 0.4523(6) 0.8566(6) 0.1304(6) 0.4523(6) 0.0000(6) 0.1114(6) 0.4250(6) 0.8566(6) 0.1114(6) 0.0000(6)
0.0000(7) 0.2249(7) 0.2945(7) 0.9380(7) 0.2249(7) 0.0000(7) 1.0043(7) 1.9197(7) 0.2945(7) 1.0043(7) 0.0000(7) 0.2485(7) 0.9380(7) 1.9197(7) 0.2485(7) 0.0000(7)
0.0000(8) 0.3013(8) 0.3836(8) 1.2589(8) 0.3013(8) 0.0000(8) 1.3277(8) 2.5594(8) 0.3836(8) 1.3277(8) 0.0000(8) 0.3262(8) 1.2589(8) 2.5594(8) 0.3262(8) 0.0000(8)
0.0000(9) 0.1124(9) 0.1666(9) 0.5183(9) 0.1124(9) 0.0000(9) 0.5617(9) 0.6388(9) 0.1666(9) 0.5617(9) 0.0000(9) 0.1399(9) 0.5183(9) 0.6388(9) 0.1399(9) 0.0000(9)
0.0000(10) 0.1866(10) 0.2499(10) 0.7775(10) 0.1866(10) 0.0000(10) 0.8426(10) 1.5441(10) 0.2499(10) 0.8426(10) 0.0000(10) 0.2097(10) 0.7775(10) 1.5441(10) 0.2097(10) 0.0000(10)
0.0000(11) 0.4092(11) 0.4998(11) 1.5550(11) 0.4092(11) 0.0000(11) 1.6852(11) 3.0882(11) 0.4998(11) 1.6852(11) 0.0000(11) 0.4194(11) 1.5550(11) 3.0882(11) 0.4194(11) 0.0000(11)
0.0000(12) 0.0982(12) 0.1195(12) 0.3525(12) 0.0982(12) 0.0000(12) 0.3903(12) 0.6875(12) 0.1195(12) 0.3903(12) 0.0000(12) 0.0983(12) 0.3525(12) 0.6875(12) 0.0983(12) 0.0000(12)
0.0000(13) 0.1365(13) 0.1641(13) 0.5130(13) 0.1365(13) 0.0000(13) 0.5520(13) 1.0631(13) 0.1641(13) 0.5520(13) 0.0000(13) 0.1371(13) 0.5130(13) 1.0631(13) 0.1371(13) 0.0000(13)
0.0000(14) 0.2129(14) 0.2532(14) 0.8339(14) 0.2129(14) 0.0000(14) 0.8754(14) 1.7028(14) 0.2532(14) 0.8754(14) 0.0000(14) 0.2148(14) 0.8339(14) 1.7028(14) 0.2148(14) 0.0000(14)
0.0000(15) 0.3208(15) 0.3694(15) 1.1300(15) 0.3208(15) 0.0000(15) 1.2329(15) 2.2316(15) 0.3694(15) 1.2329(15) 0.0000(15) 0.3080(15) 1.1300(15) 2.2316(15) 0.3080(15) 0.0000(15)
0.0000(16) 0.0742(16) 0.0833(16) 0.2592(16) 0.0742(16) 0.0000(16) 0.2809(16) 0.9053(16) 0.0833(16) 0.2809(16) 0.0000(16) 0.0698(16) 0.2592(16) 0.9053(16) 0.0698(16) 0.0000(16)
0.0000(17) 0.1125(17) 0.1279(17) 0.4197(17) 0.1125(17) 0.0000(17) 0.4426(17) 1.2809(17) 0.1279(17) 0.4426(17) 0.0000(17) 0.1086(17) 0.4197(17) 1.2809(17) 0.1086(17) 0.0000(17)
0.0000(18) 0.1889(18) 0.2170(18) 0.7406(18) 0.1889(18) 0.0000(18) 0.7660(18) 1.9206(18) 0.2170(18) 0.7660(18) 0.0000(18) 0.1863(18) 0.7406(18) 1.9206(18) 0.1863(18) 0.0000(18)
0.0000(19) 0.2968(19) 0.3332(19) 1.0367(19) 0.2968(19) 0.0000(19) 1.1235(19) 2.4494(19) 0.3332(19) 1.1235(19) 0.0000(19) 0.2795(19) 1.0367(19) 2.4494(19) 0.2795(19) 0.0000(19)
0.0000(20) 0.0383(20) 0.0446(20) 0.1605(20) 0.0383(20) 0.0000(20) 0.1617(20) 0.3756(20) 0.0446(20) 0.1617(20) 0.0000(20) 0.0388(20) 0.1605(20) 0.3756(20) 0.0388(20) 0.0000(20)
0.0000(21) 0.1147(21) 0.1337(21) 0.4814(21) 0.1147(21) 0.0000(21) 0.4851(21) 1.0153(21) 0.1337(21) 0.4851(21) 0.0000(21) 0.1165(21) 0.4814(21) 1.0153(21) 0.1165(21) 0.0000(21)
0.0000(22) 0.2226(22) 0.2499(22) 0.7775(22) 0.2226(22) 0.0000(22) 0.8426(22) 1.5441(22) 0.2499(22) 0.8426(22) 0.0000(22) 0.2097(22) 0.7775(22) 1.5441(22) 0.2097(22) 0.0000(22)
0.0000(23) 0.0764(23) 0.0891(23) 0.3209(23) 0.0764(23) 0.0000(23) 0.3234(23) 0.6397(23) 0.0891(23) 0.3234(23) 0.0000(23) 0.0777(23) 0.3209(23) 0.6397(23) 0.0777(23) 0.0000(23)
Divergence/distance values calculated by Eqs. ( 6 ) - ( 23 ) L.: LARGE M.L.L.: More or less LARGE V.L.: Very LARGE V.V.L.: Very very LARGE From the viewpoint of mathematical operations and the characterization of linguistic variables, the divergence/distance between the above fuzzy sets has the following requirements: From the numerical results presented in Table 3, we see that the proposed fuzzy mean difference divergence measures (6) - (23) satisfy the requirement (73) - (76). Therefore, the proposed fuzzy mean difference divergence measures are consistent in the application with compound linguistic measures.

Conclusion

To sum up, we present a sequence of fuzzy mean difference divergence measures. We also establish a sequence of inequalities among some of the proposed fuzzy mean difference divergence measures. An application of the proposed divergence measures in the field of pattern recognition is established. A numerical example is used to present the consistency of these divergence measures in application with compound linguistic variables. Numerical results show that the fuzzy mean difference divergence measures are much simpler with the difference of the means involved.
  1 in total

1.  Automated leukocyte recognition using fuzzy divergence.

Authors:  Madhumala Ghosh; Devkumar Das; Chandan Chakraborty; Ajoy K Ray
Journal:  Micron       Date:  2010-05-08       Impact factor: 2.251

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.