Kernel Estimation of Cumulative Residual Tsallis Entropy and Its Dynamic Version under ρ-Mixing Dependent Data.

Tsallis introduced a non-logarithmic generalization of Shannon entropy, namely Tsallis entropy, which is non-extensive. Sati and Gupta proposed cumulative residual information based on this non-extensive entropy measure, namely cumulative residual Tsallis entropy (CRTE), and its dynamic version, namely dynamic cumulative residual Tsallis entropy (DCRTE). In the present paper, we propose non-parametric kernel type estimators for CRTE and DCRTE where the considered observations exhibit an ρ-mixing dependence condition. Asymptotic properties of the estimators were established under suitable regularity conditions. A numerical evaluation of the proposed estimator is exhibited and a Monte Carlo simulation study was carried out.

1. Introduction

Shannon [1] made his signature in statistics by introducing the concept of entropy, a measure of disorder in probability distribution. Associated with an absolutely continuous random variable X with probability density function (pdf) , cumulative distribution function (cdf) and survival function (sf) , Shannon entropy is defined as where is the natural logarithm with standard convention Nowadays, this measure has gained a peculiar place in sciences such as physics, chemistry, computer sciences, wavelet analysis, image recognition and fuzzy sets. Following the pioneering work of Shannon, the available literature has generated a significant amount of papers related to it, obtained by incorporating some additional parameters which make these entropies sensitive to different the shapes of probability distributions.

A vital generalization of Shannon entropy is Tsallis entropy, which was first introduced by Havrda and Charvát [2] in the status of cybernetics theory. Then, Tsallis [3] exploited its non-extensive features and described its paramount importance in physics. In parallel to Shannon entropy, it measures the disorder in macroscopic systems. For an absolutely continuous random variable X with pdf , the Tsallis entropy of order is defined as when 1, . Tsallis’s idea was to bestow a new formula instead of a classical logarithm used in Shannon entropy. Tsallis entropy is relevant in various fields of science; it is used in a broad range of contexts in physics science such as: statistical physics [4]; astrophysics [5]; turbulence [6]; inverse problems [7]; or quantum physics [8]. Tsallis entropy is applied in the description of the fluctuation of magnetic field in solar wind, in mammograms and in the analysis of magnetic resonance imaging (MRI) (as can be seen in Cartwright [9]). In recent years, this entropy has prompted many authors to define new discrimination measures as well as dual versions of entropy measures (see [10]).

Rao et al. [11] proposed another measure of uncertainty, called cumulative residual entropy (CRE), which is obtained by writing a survival function in place of pdf in (1) and is given by The basic idea in this choice is that, in many situations, we prefer cumulative distribution function (cdf) over pdf. Moreover, a cdf exists in situations in which density does not exist such as in the case of a mixture density, combination of Gaussians and delta functions. The CRE is specifically applicable to describe the information in problems related to aging properties in reliability theory based on the mean residual life function. For other variants of CRE, one may refer to Rao [12], Psarrakos and Toomaj [13] and the references therein.

As in the scenario of introducing the concept of CRE, Sati and Gupta [14] introduced cumulative residual Tsallis entropy (CRTE) of order , which is defined as when 1, . Since is not applicable to a system that has survived for some units of time t, Sati and Gupta [14] proposed a dynamic version of CRTE based on the random variable whose definition is given below.

The dynamic cumulative residual Tsallis entropy (DCRTE) of order is defined as where is the sf of X. Khammar and Jahanshahi [15] developed a weighted form of CRTE and DCRTE and discussed many of its reliability properties. Sunoj et al. [16] discussed a quantile-based study of CRTE and certain characterization results using order statistics. Mohamed [17] studied the CRTE and DCRTE of concomitants of generalized order statistics. Recently, Toomaj and Atabay [18] elaborately elucidated certain new results based on CRTE. The huge increase in the number of articles on CRTE and DCRTE shows the remarkable importance of both these measures from a theoretical and applied perspective especially in the physical context. As far as statistical inferential aspects are concerned, to the best of our knowledge, not even a single work has been performed to date in the available literature. Hence, in this work, our main objective is to propose non-parametric estimators for CRTE and DCRTE using kernel type estimation where the observations under considerations are exhibiting some mode of dependence. Practically, it seems more realistic to replace the independence with some mode of dependence.

The study of non-parametric density estimation in the case of dependent data was started decades back. Bradley [19] discussed the weak consistency and asymptotic normality of the kernel density estimator under -mixing. Masry [20] established a non-parametric recursive density estimator in the -mixing context and studied some of its properties. Masry and Györfi [21] established the strong consistency of recursive density estimator under -mixing. Boente [22] discussed the strong consistency of the non-parametric density estimator under -mixing and -mixing processes. The mixing coefficients -mixing, -mixing and -mixing are defined by Rosenblatt [23], Ibragimov [24] and Kolmogorov and Rozanov [25], respectively. For more properties of the different mixing coefficients, see Bradley [26].

Rajesh et al. [27] discussed the local linear estimation of the residual entropy function of conditional distributions where underlying observations are assumed to be -mixing. The kernel estimation of the Mathai–Haubold entropy function under -mixing dependence conditions were studied by Maya and Irshad [28]. Recently, non-parametric estimation using kernel type estimation under -mixing dependence conditions of residual extropy, past extropy and negative cumulative residual extropy functions were studied by Maya and Irshad [29], Irshad and Maya [30] and Maya et al. [31], respectively. Compared to the -mixing, -mixing is stronger, as can be seen in Kolmogorov and Rozanov [25]. In this work, we propose non-parametric estimators of CRTE and DCRTE using kernel type estimation based on the assumption that underlying lifetimes are assumed to be -mixing.

Let as

The rest of the paper is structured as follows. In Section 2, we propose non-parametric kernel type estimators for CRTE and DCRTE. Section 3 contains the expression for the bias and variances of the estimators proposed for CRTE and DCRTE and examines its consistency property. The mean consistently integrated in the quadratic mean and asymptotic normality of the proposed estimators are also discussed here in the form of several theorems. A numerical study on the asymptotic normality of the proposed estimators is given in Section 4.

2. Estimation

In this section, we propose non-parametric estimators for CRTE and DCRTE functions. Let be a strictly stationary process with univariate probability density function . Note that ’s need not be mutually independent, that is, the lifetimes are assumed to be -mixing. Wegman and Davies [32] introduced a recursive density estimator of given by where satisfies the following conditions: The bandwidth parameter satisfies and as Let x be a point of continuity of f. Suppose f is times continuously differentiable at the point x such that: Assume that: and the bandwidth parameter satisfies: Then the mean and variance of are given by (see, Masry [20]) and: where and . Equation (8) implies that is not an asymptotically unbiased estimator of . By simple scaling, we can find an asymptotically unbiased estimator of given by The bias and variance of are given by (see, Masry [20]) and:

We propose kernel estimators for CRTE and DCRTE functions that are, respectively, given by and: where: is the non-parametric estimator of survival function .

3. Asymptotic Results

Here, we propose the expression for bias, variance and certain asymptotic results of the proposed estimators.

Let and:

The proof of the theorem is similar to the proof of bias and variance of given in Masry [20] and hence omitted. □

Suppose

1. By using the Taylor’s series expansion, we obtain: Using the above equation, the bias and the variance of are given by and: The corresponding MSE is given by From (18), as : Therefore: Hence, is a consistent estimator (in the probability sense) of .

2. By using Taylor’s series expansion, the expressions for the bias of and are given by whereas the variances are given by The corresponding MSE’s are given by and: From (23) and (24), as : and: Therefore: Hence, is a consistent estimator (in the probability sense) of . □

Let where

We have: with , since .

Therefore: We have: By substituting (27) in (28), we obtain (25). □

Suppose and the variances are given for

By using Equations (16) and (17), we obtain the bias and variance of and by using Proposition 1 and Equations (19)–(22), we obtain the bias and variance of . □

Suppose

1. Consider the mean integrated squared error (MISE) of the estimator . That is:

Using (29) and (31), we obtain:

From (34), as :

Therefore, from (33), we have:

From (35), we can say that is integratedly uniformly consistent in quadratic mean estimator of (as can be seen in Wegman [33]).

2. Consider the MISE of the estimator —that is:

Using (30) and (32), we obtain: From (37), as : Therefore, from (36), we have: From (38), we can say that is integratedly uniformly consistent in the quadratic mean estimator of (as can be seen in Wegman [33]). □

Suppose that has a standard normal distribution where:

By using the asymptotic normality of given in Masry [20], it is immediate that: is asymptotically normal with a mean of zero, variance of 1 and given in (40). □

Suppose that has a standard normal distribution where:

By using the asymptotic normality of given in Masry [20], it is immediate that: is asymptotically normal with a mean of zero, variance of 1 and given in (43). □

4. Numerical Evaluation of and Monte Carlo Simulation

In this section, a numerical evaluation of is given and a Monte Carlo simulation is carried out to support the asymptotic normality of the estimator given in (39). Let X be exponentially distributed with parameter (mean ). Then, the CRTE of order of X is given by

In order to obtain the desired estimator, it is necessary to fix a function K and a sequence which satisfy the assumptions given in Section 2. Here, we consider:

By using these assumptions, it readily follows that: where and .

To fix the ideas, consider and . Our goal is to check that: has a standard normal distribution. By using the function exprnd of MATLAB, 500 samples of size n, whose parent distribution is exponential with parameter 1, are generated. These data satisfy the assumption in (6). Hence, by using the fixed parameters, the functions and are obtained for each sample and finally the kernel estimator of CRTE is computed. This procedure is repeated by choosing , 2 and 3. Then, in order to check the asymptotic normality of the estimator in (39), the histogram in Figure 1 is displayed.

Figure 1

Histogram of (39) with parameters given in Section 4 and different choices of .

5. Conclusions

In this paper, non-parametric kernel type estimators for CRTE and DCRTE were proposed for observations which exhibit -mixing dependence. The bias and the variance of the proposed estimators were evaluated. Moreover, it was proven that those estimators are consistent and a Monte Carlo simulation was carried out to show their asymptotic normality.