Generalized Wavelet Fisher’s Information of Signals
This paper defines the generalized wavelet Fisher information of parameter . This information measure is obtained by generalizing the time-domain definition of Fisher’s information of Furuichi to the wavelet domain and allows to quantify smoothness and correlation, among other signals characteristics. Closed-form expressions of generalized wavelet Fisher information for signals are determined and a detailed discussion of their properties, characteristics and their relationship with wavelet -Fisher information are given. Information planes of signals Fisher information are obtained and, based on these, potential applications are highlighted. Finally, generalized wavelet Fisher information is applied to the problem of detecting and locating weak structural breaks in stationary signals, particularly for fractional Gaussian noise series. It is shown that by using a joint Fisher/F-Statistic procedure, significant improvements in time and accuracy are achieved in comparison with the sole application of the F-statistic.
signals are used as models of several phenomena in a diversity of fields of science. From physics  to computer networking  and even in psychology , processes govern the observed characteristics of the phenomena within these fields. The parameter , which appears in several equations defining these processes, plays an important role since the behaviour and characteristics of the signals is dependent upon the values of . Consequently, the estimation of is of importance since the estimated not only describes the phenomena, but also allows to propose actions in accordance with the relation of and the process it describes. For instance, in computer networking, a value of gives rise to increased delays and packet losses in the network. In response, network analysts may increase network resources or modify network node algorithmics with the purpose of reducing the observed delays and losses and enhance network performance. This type of problem is also observed in other fields and, as a consequence, the efficient and robust estimation of plays a role of major importance [4, 5]. In the literature, several methodologies have been proposed for estimating but it is recognized that no technique can provide robust and efficient estimates for the variety of conditions observed in measured data . Modern techniques, which may consist of combinations of single techniques, attempt to estimate under these conditions; however, they have shown limited performance. Current techniques utilizing signal processing techniques  and information theory approaches offer new possibilities of obtaining robust and efficient estimates. Information theory techniques have indeed been used to study the nature, structure, and complexity of many physical phenomena [6–9]. Fisher information, for instance, was used in  to study electroencephalogram (EEG) signals and later in  for characterizing nonlinear systems. Moreover, Fisher information in wavelet domain was used in  to detect weak structural breaks in signals. Tsallis entropies, on the other hand, have been used for studying a variety of signal characteristics  and its wavelet counterparts are currently being used from structural damage identification in , signal classification in , and for detecting structural breaks in the mean in pure-power law (PPL) signals  among others [17, 18]. In general, with the use of wavelet based information tools, significant improvements can be achieved in the overall analysis and estimation of signals. This paper extends the generalized Fisher information proposed by Furuichi in [19, 20] to the wavelet domain and then obtains a closed-form expression of this quantifier for signals. The relationship between generalized wavelet Fisher’s information and wavelet -Fisher information is discussed in detail since both quantifiers measure similar characteristics and are dependent upon . Furthermore, the construction of information planes for signals Fisher information allows to identify analysis/estimation applications. Finally, the application of this technique to the problem of detecting and locating structural breaks within signals is given along with statistical analyses of their results. Since the family of signals is of importance in physics, biology, physiology, medicine, and so forth, the results presented in this paper are relevant for enhancing the analyses and estimation procedures within these fields. The rest of the paper is structured as follows. In Section 2, a brief review of the properties, definitions, types, and open issues regarding signals is provided. Also, some important results of the wavelet analysis of these signals are also briefly outlined. Section 3, defines the generalized wavelet Fisher’s information concept, derives a closed-form expression of this quantifier for the family of signals, and studies the behaviour of the information planes of signals’s Fisher information. A comparison with the wavelet -Fisher information is discussed in detail in this section. Section 4 highlights the potential applications of generalized wavelet Fisher’s information for the class of signals and proposes a technique to detect and locate structural breaks in the mean within these processes. Section 5 presents the results of the level-shift detection capabilities of generalized wavelet Fisher’s information on synthesized fractional Gaussian noise (fGn) signals and finally; Section 6 draws the conclusions of the paper.
2. Signals with Behaviour
signals are ubiquitous in science and engineering and model phenomena as diverse as DNA sequences [21, 22], heart-beat time series [23, 24], mood , self-steem , and so forth. An important feature of signals is their power-law behaviour of their power spectral density (PSD); that is, as,where is a constant, is the scaling parameter, and represent the power-law scaling interval . Depending upon , several well-known processes are obtained; for example, when and , long-memory signals are obtained. Moreover, signals are self-similar in the sense that their distributional properties are invariant under dilations in time and space. signals may be regarded as stationary if and nonstationary if [4, 28]. The well-known fractional Brownian motion (fBm), a Gaussian nonstationary self-similar signal with parameter whose autocovariance given bywith , has a spectral density given byand thus it can be regarded as a signal with parameter . Fractional Gaussian noise (fGn), the first difference of fBm is a stationary Gaussian self-similar signal with PSD given by and . As , and therefore is a signal. Many other signals exist and the interested reader is referred to [4, 27, 28] for further information.
2.1. Wavelet Representations of Signals
Wavelets and wavelet transforms have been extensively used for the analysis and estimation of signals [8, 9, 29–31]. In this paper, the wavelet spectrum  of signals is of interest since it allows constructing distributions from which information measures can be computed. For signals, the wavelet spectrum is computed aswhere is the Fourier integral of the mother wavelet , is the PSD of the process , is the expectation operator, and is the discrete wavelet transform of the process at time and wavelet scale [29–31]. Using the well-known PSD of signals, (5) now becomeswhere is a constant. For a more detailed discussion of the wavelet analysis and synthesis of scaling signals, please refer to [27–31].
3. Generalized Wavelet Fisher’s Information Measure
The first uses of Fisher information were in the context of statistical estimation [32, 33]. Recently, however, Fisher information has been used to characterize nonstationarity in complex processes such as EEGs and other nonlinear signals [10, 11]. Fisher information quantifies the spreading of a probability distribution in the sense that is high for flat densities and low for narrow ones. Fisher information is also sensitive to local discontinuities in the density as reported in . Furthermore, Fisher’s information also measures the oscillatory degree of a function and their smoothness character. In this context, Fisher’s information is large for smooth signals and small for highly oscillatory ones. In the same way Tsallis -entropies generalize Shannon entropy, generalizations of Fisher information have been proposed in the literature. Plastino and coworkers defined the -Fisher information in ; later, this measure was extended to the wavelet domain in . Lutwak et al. defined the Fisher information in [35, 36] and later Furuichi defined the generalized Fisher information in [19, 20]. The wavelet domain generalization of Plastino’s (wavelet -Fisher information) was used to detect and locate weak structural breaks in signals using a joint wavelet and Bai & Perron technique . Significant improvements were found specifically for long time series with LRD. This paper presents a wavelet-domain extension to the time-domain generalization of Fisher’s information of Furuichi . To study in more detail the properties of generalized Fisher’s information for signals, a closed-form expression is first obtained. In addition, an in-depth discussion of their relationship with the wavelet -Fisher information is given. The generalized Fisher information of a probability density is computed as [19, 20]where is the -expectation operator defined as and is the -score function which is defined as the derivative of the -logarithm of a density; that is, aswhere is the -logarithm function. For discrete distributions, , the generalized Fisher information is computed using a discrete-time version of (7), which is given byfor some and . When is substituted by the relative wavelet energy (RWE), (9) results in the generalized wavelet Fisher information of parameter which measures the spreading of a distribution, the oscillatory nature of signals, among others. Unlike standard wavelet Fisher information measure, generalized wavelet Fisher information provides increased flexibility (with ) and the possibility to adapt the analyses to the characteristics of the data under study.
3.1. Generalized Wavelet Fisher’s Information of Signals
Generalized wavelet Fisher’s information is obtained by substituting the RWE in (9). Recall that the of signals is obtained by means of the wavelet spectrum or wavelet variance of these signals. For stationary signals, the wavelet spectrum is , where is a constant depending on the mother wavelet and . The RWE of signals is thus given by [7–9, 15, 16],where and represent the (logarithmic) length of the signal and the wavelet scale, respectively. The generalized wavelet Fisher information of parameter is, thus,
Equations (11) are employed for the construction of information planes which permit to study in more detail the characteristics and behaviour of Fisher information for signals. Figure 1 displays signals Fisher information for , , and negative . It is interesting to note that under these conditions, the Fisher information planes display two different states. First state corresponds to Fisher information values of zero and the second to nonzero exponentially increasing Fisher information values . The exponential increase of Fisher information starts in and it is entirely controlled by . Observe that by setting , the two states lie in the intervals and and a maping of zero Fisher information values to stationary signals and of nonzero values to nonstationary signals is made. In the same way, by setting , a maping of zero Fisher values to nonstationary fBms is made and a maping of nonzero exponentially increasing Fisher values to extended fBms is performed. The case allows to distinguish among the stationary and nonstationary families of signals while the case permits distinguishing among nonstationary ones. Parameter controls the boundary ; decreasing further shifts the value of to the right. Figure 2 displays signals Fisher information for . As in Figure 1, the planes of Figure 2 were obtained for and . For the particular case , the Fisher information are exponentially decreasing in the interval and converging to zero for . As increases, the information planes converge to zero more quickly. Notice that, for , a two-state behaviour is observed as well. In contrast to the case, the displays an exponentially decreasing behaviour for the first state and zero values for the second one. Similar applications as those for negative can also be attached to the case. Generalized wavelet Fisher information therefore allows characterizing the complexities of signals. Fisher information for () are zero (exponentially decreasing) for random signals and exponentially increasing (converging to zero) for smooth correlated signals. The length of the intervals on which the Fisher information is zero (exponentially decreasing) and exponentially increasing (converging to zero) is controlled by the value of parameter . Because of the similarities in the information planes with those of the wavelet -Fisher information, an interesting question is how generalized wavelet Fisher information is related with wavelet -Fisher information. In the following, we elaborate further on this question and discuss the similarities and/or differences between both information measures in more detail.
3.2. Relation with Wavelet -Fisher Information
This section explores the relationship that exists between generalized wavelet Fisher’s information and wavelet -Fisher information. In principle, both quantifiers can be used to measure smoothness, complexity, and correlation within a signal or system . For , it is straightforward to derive that generalized wavelet Fisher information is given by the relationOn the other hand, wavelet -Fisher’s information (for ) is given by the following equation [7, 12]:Observe the similarity that exists between (12) and (13). Notice that both equations differ only in the term that multiplies expression . The exact relationship between these two quantifiers is obtained by observing the fact that, for and , On the other hand, for , is negative, which gives rise to The above results allow to establish the following exact relationship between these two quantifiers; that is,Figure 3 displays this mathematical relationship between these two quantifiers. Notice that both Fisher information intersect at which means that, for , they are equal only when they analyze random white noise. For the rest of Fisher information values, they seem to have opposite behaviour. Standard wavelet Fisher information is higher than Furuichi’s wavelet Fisher information for but it is less than when . As can be noted in Figure 3, the analysis of signals with standard versions of generalized Fisher information is limited and thus the attention is now turned to the case . The relationship between these two quantifiers for the case is obtained by first recalling that, for , the following holds : Based on this, it is observed that the following relationship is satisfied:Thus, for , for the case and for the case , . For nonnegative , holds for and for the case , . Although some differences are observed between these two quantifiers, both Fisher information are equal at and some similar behaviour are observed for different values of the parameter . The above results allow us to obtain an exact relationship between generalized wavelet Fisher information of parameter and wavelet -Fisher information in the following way:where and are given by the following polynomial expressions:with , , , and .
Figure 4 displays the behaviour of signals Fisher information for and values of . Note that as decreases, the exponential increase of Fisher information is higher. This behaviour can be used to apply generalized wavelet Fisher information to a variety of phenomena. First, generalized Fisher information can be used to detect nonstationary behaviour within stationary signals. In addition, it can also be used to extend the analyses of standard Fisher information in EEG and nonlinear signals in [10, 11]. Another application can also be in the classification of scaling signals as stationary or nonstationary. The classification as stationary or nonstationary has been recognized as fundamental for signal analysis and estimation. Other application area is on the detection and location of weak structural breaks within signals. In this context, weak level-shift detection and location can be mapped to the problem of detecting the transition from zero to exponentially increasing Fisher information. As a matter of fact, as would be explained in the next section, level-shift detection in the context of generalized wavelet Fisher information is simply the problem of detecting and locating impulses which indicate the presence and location of level-shifts. Next section focuses on the detection and location of weak level-shifts embedded within fGn signals, a particular class of signals.
5. Detection of Level-Shifts with Fisher Information
The detection of weak level-shifts embedded in random signals is of importance in many disciplines of science since they indicate the presence of some irregularity in the phenomena. Level-shifts can indicate the presence of a change in an economical policy , the presence of a malignant tumor in a magnetic resonace image (MRI) signal , and so forth. Although important and widely studied, level-shift detection is still complex and time-consuming, specially for highly correlated waveforms . In the following, the results of the joint application of the generalized wavelet Fisher information and the -statistic for the detection and location of weak level-shifts are discussed. The wavelet Fisher information is used as a preprocessing technique and the -statistic as a location and detection methodology. The purpose of using this joint technique is for enhancing the detection/location and to reduce the time required to get an estimate as well. The detection/location procedure is started by computing the generalized wavelet Fisher information in sliding windows of length and sliding factor . With this, the time evolution of generalized wavelet Fisher information, denoted by , is obtained by applying (9) to subsets of the data of the form:for various , where and is the well-known rectangular function. A plot of versus for represents the time evolution of generalized wavelet Fisher information. The work of Stoev et al.  demonstrated that a sudden jump in the structure of a self-similar fGn signal caused its theoretical Hurst parameter in the wavelet domain to be . In view of this, the jump will cause the Fisher information of the sudden jump to change from zero Fisher information to highly increasing Fisher information; therefore, the time evolution plot of the generalized Fisher information will show the presence of a weak level-shift in the form of an impulse-like signal. Therefore, an impulse shaped function in the generalized wavelet Fisher information indicates the presence of a level-shift in the signal under study. It is important to note that by the use of the generalized wavelet Fisher information the objective is twofold. First is to highlight further the detection of the weak level-shift and secondly to decrease the time required for obtaining a detection and location estimate. In order to achieve a detection and location estimate, the -statistic is used.
5.1. Level-Shift Detection in fGn Signals
Figure 5 shows the generalized wavelet Fisher information of a fGn signal with Hurst parameter and a single level-shift at time , that is, located in the middle of the signal. The level shift is small and its magnitude is of , where is the signal variance. Generalized Fisher information in the wavelet domain is computed with using windows of and . Note that the resulting time-evolution of generalized wavelet Fisher information displays an impulse-shaped form at indicating that a level-shift is located around that point. Increasing the window length increases accuracy and long windows are preferred whenever . Decreasing further increases the Fisher information values and as a consequence increases the detection/location process maintaining the form of the graph, that is, as an impulse shaped form. The generalized wavelet Fisher information, therefore, enhances the detection procedure and outputs a small length signal. Note that level-shift detection can even be done by eye. In order to get a better location and detection, the -statistic is used. Using the -statistic, the resulting location estimate is , that is, the exact place where the level-shift is located.
5.2. Results for Fractional Gaussian Noise Signals
Figure 6 displays the results of the detection and location estimates of a single level-shift within fGn signals of parameter using the -statistic alone and various versions of the joint Fisher/-statistic technique. The level-shifts were set at and for each value of , fGn signals with a single level-shift were generated. Top left plot shows the results for the -statistic. Note that small variations in the estimates are observed for while for the variations increase correlation in the signal. Top right graph of Figure 6 displays the joint application of generalized wavelet Fisher information as a preprocessing tool and the -statistic as a detection/location technique. It is observed that no variantion is observed when and when the variation is constant although the average estimates are . The variance is higher than those observed for the -statistic for and . This same behaviour is observed for the case and (bottom left plot) and it is only when that the joint technique outperforms the results of the -statistic.
In this paper, generalized wavelet Fisher information of parameter was defined as a wavelet-domain extension of the Furuichi’s generalized Fisher information. Closed-form formulas for the generalized wavelet Fisher information were obtained for the class of signals and those expressions allowed to construct signal Fisher information planes and compare their properties with those of wavelet -Fisher information. signal Fisher information planes describe the characteristics and properties of generalized wavelet Fisher information for signals and permitted to propose several applications for the analysis and estimation of these signals. An application of particular interest was the detection and location of weak level-shifts within fGn signals and it was demonstrated, using a detailed statistical study, that generalized wavelet Fisher information in conjunction with the -statistic detects and locates weak level shifts in these signals. By appropiately selecting the value of and the length of the anlalysing window, the proposed technique can ourperform the results obtained by using the -statistic alone.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Julio Ramírez-Pacheco thanks PROMEP for the partial financial support. Homero Toral-Cruz thanks PROMEP-UQROO-PTC-110 for partial finantial support.
M. T. Martin, F. Pennini, and A. Plastino, “Fisher's information and the analysis of complex signals,” Physics Letters A, vol. 256, no. 2-3, pp. 173–180, 1999.View at: Google Scholar
N. Balke, “Detecting level-shifts in time series,” Journal of Business & Economic Statistics, vol. 11, no. 1, pp. 81–92, 1993.View at: Google Scholar