Abstract

Fractal time series substantially differs from conventional one in its statistic properties. For instance, it may have a heavy-tailed probability distribution function (PDF), a slowly decayed autocorrelation function (ACF), and a power spectrum function (PSD) of type. It may have the statistical dependence, either long-range dependence (LRD) or short-range dependence (SRD), and global or local self-similarity. This article will give a tutorial review about those concepts. Note that a conventional time series can be regarded as the solution to a differential equation of integer order with the excitation of white noise in mathematics. In engineering, such as mechanical engineering or electronics engineering, engineers may usually consider it as the output or response of a differential system or filter of integer order under the excitation of white noise. In this paper, a fractal time series is taken as the solution to a differential equation of fractional order or a response of a fractional system or a fractional filter driven with a white noise in the domain of stochastic processes.

1. Introduction

Denote by the n-dimensional Euclidean space for where is the set of positive integers. Then, things belonging to for are visible, such as a curve for , a picture for , and a three-dimensional object for .

Denote an element belonging to by and Denote a regularly orthogonal coordinate system in by . Then, the inner product is given by

Then,

In the domain of the Hilbert space, is allowed (Griffel [1], Liu [2]). Unfortunately, due to the limitation of the eyes of human being, a high-dimensional image of , for example, , is invisible unless some of its elements are fixed. One can only see an image for partly. For example, if we fix the values of for , is visible. Luckily, human being has nimbus such that people are able to think about high-dimensional objects in even in the case of .

Note that the nature is rich and colorful (Mandelbrot [3], Korvin [4], Peters [5], Bassingthwaighte et al. [6]). Spaces of integer dimension are not enough. As a matter of factor, there exist spaces with fractional dimension, such as where is a fraction. Therefore, even in the low-dimensional case of , those in are not completely visible.

We now turn to time series. Intuitively, we say that is a conventional series if On the other side, is said to be a fractal time series if it belongs to for . A curve of we usually see, such as a series of stock market price, is only its integer part belonging to However, it is the fractional part of that makes it substantially differ from a conventional series in the aspects of PDF, ACF, and PSD, unless is infinitesimal.

The theory of conventional series is relatively mature; see, for example, Fuller [7], Box et al. [8], Mitra and Kaiser [9], Bendat and Piersol [10], but the research regarding fractal time series is quite academic. However, its applications to various fields of sciences and technologies, ranging from physics to computer communications, are increasing, for instance, coastlines, turbulence, geophysical record, economics and finance, computer memories (see, e.g., Mandelbrot [11]), network traffic, precision measurements (Beran [12], Li and Borgnat [13]), electronics engineering, chemical engineering, image compression; see, for example, Levy-Vehel et al. [14], physiology; see, for example, Bassingthwaighte et al. [6], just naming a few. The goal of this paper is to provide a short tutorial with respect to fractal time series.

The remaining article is organized as follows. In Section 2, the concept of fractal time series from the point of view of systems of fractional order will be addressed. The basic properties of fractal time series are explained in Section 3. Some models of fractal time series are discussed in Section 4. Conclusions are given in Section 5.

2. Fractal Time Series: A View from Fractional Systems

A time series can be taken as a solution to a differential equation. In terms of engineering, it is often called signal while a differential equation is usually termed system, or filter. Therefore, without confusions, equation, system, or filter is taken as synonyms in what follows.

2.1. Realization Resulted from a Filter of Integer Order

A stationary time series can be regarded as the output of a filter under the excitation of white noise . Denote by the impulse function of a linear filter. Then,

On the other side, a nonstationary random function can be taken as the output of a filter under the excitation of nonstationary white noise. In general, filters with different ’s may yield different series under the excitation of . Hence, conventionally, one considers as the headspring or root of random series; see, for example, Press et al. [15]. In this paper, we only consider stationary series.

A stochastic filter can be written by

Denote the Fourier transforms of , and by , , and , respectively, where and is angular frequency. Then, according to the theorem of convolution, one has

Denote the PSDs of and by and , respectively. Then, when one notices that 1 if is the normalized white noise [9, 10], one has

Denote the Laplace transform of by , where is a complex variable. Then (Lam [16]),

If the system is stable, all poles of are located on the left of s plan. For a stable filter, therefore, one has (Papoulis [17])

where F stands for the operator of the Fourier transform. A basic property of a linear stable system of integer order is stated as follows.

Note. Taking into account and (2.6), one sees that of a stable system of integer order is convergent for and so is .
In the discrete case, the system function is expressed by the transform of g(n). That is,
where Z represents the operator of transform. There are two categories of digital filters (Harger [18], Van de Vegte [19], Li [20]). One is in the category of infinite impulse response (IIR) filters, which correspond to the case of . The other is in the category of finite impulse response filters (FIRs), which imply [9, 16], (Harger [18], Van de Vegte [19]). In the FIR case, one has Thus, an FIR filter is always stable with a linear phase.

Note. A realization resulted from an FIR filter of integer order under the excitation of is linear. It belongs to

2.2. Realization Resulted from a Filter of Fractional Order

Let and be a piecewise continuous on and integrable on any finite subinterval of . For , denote by the Riemann-Liouville integral operator of order [21, page 45]. It is given by

where is the Gamma function. For simplicity, we write by below.

Let and be two strictly decreasing sequences of nonnegative numbers. Then, for the constants and , we have

which is a stochastically fractional differential equation with constant coefficients of order It corresponds to a stochastically fractional filter of order The transfer function of this filter expressed by using the Laplace transform is given by (Ortigueira [22])

In the discrete case, it is expressed in domain by (Ortigueira [23, 24], Chen and Moore [25], Vinagre et al. [26]) Denote the inverse Laplace transform and the inverse transform by and , respectively. Then, the impulse responses of the filter expressed by (2.10) in the continuous and discrete cases are given by

respectively.

Without loss of the generality to explain the concept of fractal time series, we reduce (2.10) to the following expression:

Consequently, (2.11) and (2.12) are reduced to

Recall that the realization resulted from such a class of filters can be expressed in the continuous case by

where implies the operation of convolution, or in the discrete case by

Hence, we have the following notes.

Note. A realization resulted from a stochastically fractional differential equation may be unbelonging to

Note. For a stochastically fractional differential equation, Note 1 may be untrue.

We shall further explain Note 4 in the next section. As an example to interpret the point in Note 3, we consider a widely used fractal time series called the fractional Brownian motion (fBm) introduced by Mandelbrot and van Ness [27].

Replacing with H 0.5 in (2.9) for , where H is the Hurst parameter, fBm defined by using the Riemann-Liouville integral operator is given by

where , , is the Wiener Brownian motion; see, for example, Hida [28] for Brownian motion. The differential of is in the sense of generalized function over the Schwartz space of test functions; see, for example, Gelfand and Vilenkin [29] for generalized functions. Taking into account the definition of the convolution used by Mikusinski [30], we have the impulse response of a fractional filter given by

Consequently, fBm denoted by can be taken as an output of the filter (2.19) under the excitation (Li and Chi [31]). That is,

Therefore, Note 5 comes.

Note. FBm is a special case as a realization of a fractional filter driven with

Other articles discussing fBm from the point of view of systems or filters of fractional order can be seen in Ortigueira [32], Ortigueira and Batista [33, 34], and Podlubny [35]. In the end of this section, I use another equation to interpret the concept of fractal time series. The fractional oscillator or fractional Ornstein-Uhlenbeck process is the solution of the fractional Langevin equation given by

where is a positive constant, and is the white noise (Lim et al. [36, 37]). Obviously, the fractal time series in (2.21) is a realization resulted from a fractional filter under the excitation . More about this will be discussed in Section 4.

3. Basic Properties of Fractal Time Series

Fractal time series has its particular properties in comparison with the conventional one. Its power law in general is closely related to the concept of memory. A particular point, which has to be paid attention to, is that there may usually not exist mean and/or variance in such a series. This may be a main reason why measures of fractal dimension and the Hurst parameter play a role in the field of fractal time series.

3.1. Power Law in Fractal Time Series

Denote the ACF of by where Then, is called SRD if is integrable (Beran [12]), that is,

On the other side, is LRD if is nonintegrable, that is,

A typical form of such an ACF for being nonintegrable has the following asymptotic expression:

where is a constant and 01. The above expression implies a power law in the ACF of LRD fractal series.

Denote the PSD of by . Then,

In the LRD case, the above does not exist as an ordinary function but it can be regarded as a function in the domain of generalized functions. Since

see, for example, [29] and Li and Lim [38, 39], the PSD of LRD series has the property of power law. It is usually called noise or () noise (Mandelbrot [40]). Thus, comes Note 6.

Note. The PSD of an LRD fractal series is divergent for . This is a basic property of LRD fractal time series, which substantially differs from that as described in Note 1.

Denote the PDF of by . Then, the ACF of can be expressed by

Considering that is nonintegrable in the LRD case, one sees that a heavy-tailed PDF is an obvious consequence of LRD series; see, for example, Li [41, 42], Abry et al. [43].

Denote the mean of . Then,

The variance of is given by

One thing remarkable in LRD fractal time series is that the tail of may be so heavy that the above integral either (3.7) or (3.8) may not exist. To explain this, we recall a series obeying the Pareto distribution that is a commonly used heavy-tailed distribution. Denote the PDF of the Pareto distribution. Then,

where . The mean and variance of that follows are respectively given by

It can be easily seen that and do not exist for . That fractal time series with LRD may not have its mean and or variance is one of its particular points [6].

Note that implies a global property of while represents a local property of . For an LRD , unfortunately, in general, the concepts of mean and variance are inappropriate to describe the global property and the local one of . We need other measures to characterize the global property and the local one of LRD . Fractal dimension and the Hurst parameter are utilized for this purpose.

3.2. Fractal Dimension and the Hurst Parameter

In fractal time series, one, respectively, uses the fractal dimension and the Hurst parameter of to describe its local property and the global one ([3], Li and Lim [39, 44]). In fact, if is sufficiently smooth on and if

where is a constant and is the fractal index of , the fractal dimension of is expressed by

see, for example, Kent and Wood [45], Hall and Roy [46], and Adler [47].

On the other side, expressing in (3.3) by the Hurst parameter yields

Therefore,

Different from those in conventional series, we, respectively, use and to characterize the local property and the global one of LRD rather than mean and variance (Gneiting and Schlather [48], Lim and Li [49]).

In passing, we mention that the estimation of and/or becomes a branch of fractal time series as can be seen from [11, 12]. Various methods regarding the estimation of fractal parameters are reported; see, for example, Taqqu et al. [50], methods based on ACF regression (Li and Zhao [51] and Li [52]), periodogram regression method (Raymond et al. [53]), generalized linear regression (Beran [54, 55]), scaled and rescaled windowed variance methods ([5658], Schepers et al. [59], Mielniczuk and Wojdłło [60], Cajueiro and Tabak [61]), dispersional method (Raymond and Bassingthwaighte [62, 63]), maximum likelihood estimation methods (Kendziorski et al. [64], Guerrero and Smith [65]), methods based on wavelet [6672], fractional Fourier transform (Chen et al. [73]) and detrended method (Govindan [74]).

In the end of this section, we note that self-similarity of a stationary process is a concept closely relating to fractal time series. Fractional Gaussian noise (fGn) is an only stationary increment process with self-similarity (Samorodnitsky and Taqqu [75]). In general, however, a fractal time series may not be globally self-similar. Nevertheless, a series that is not self-similar may be locally self-similar [47].

4. Some Models of Fractal Time Series

Fractal time series can be classified into two classes from a view of statistical dependence. One is LRD and the other is SRD. It can be also classified into Gaussian series or nonGaussian ones. I shall discuss the models of fractal time series of Gaussian type in Sections 4.14.4, and 4.6. Series of nonGaussian type will be described in Section 4.5.

4.1. Fractional Brownian Motion (fBm)

FBm is commonly used in modeling nonstationary fractal time series. It is Gaussian (Sinai [76, 77]). The definition of fBm described in (2.18) is called the Riemann-Liouville type since it uses the Riemann-Liouville integral; see, for example, [27], Sithi and Lim [78], Muniandy and Lim [79], and Feyel and de la Pradelle [80]. Its PSD is given by

where is the Bessel function of order (G.A. Korn and T.M. Korn [81]), is the Struve function of order , and the subscript on the left side implies the type of the Riemann-Liouville integral, see [78] for details. The ACF of the fBm of the Riemann-Liouville type is given by

where is the hypergeometric function.

Note that the increment process of the fBm of the Riemann-Liouville type is nonstationary (Lim and Muniandy [82]). Therefore, another definition of fBm based on the Weyl integral [27] is usually used when considering stationary increment process of fBm.

The Weyl integral of order is given for by [21]

Thus, the fBm of the Weyl type is defined by

It has stationary increment. Its PSD is given by (Flandrin [83])

Its ACF is expressed by

where is the strength of the fBm and it is given by

The basic properties of fBm are listed below.

Note. Either the fBm of the Riemann-Liouville type or the one of the Weyl type is nonstationary as can be seen from (4.1) and (4.5).

Note. Both the fBm of the Riemann-Liouville type and the one of the Weyl type are self-similar because they have the property expressed by where denotes equality in the sense of probability distribution.

Note. The PSD of fBm is divergent at , exhibiting a case of noise.

Note. The process fBm reduces to the standard Brownian motion when , as can be seen from (2.18) and (4.4).

Note. A consequence of Note 10 is which is the PSD of the standard Brownian motion [78].

Note. The fractal dimension of fBm is given by

4.2. Generalized Fractional Brownian Motion with Holder Function

Recall that the fractal dimension of a sample path represents its self-similarity. For fBm, however, is linearly related to (4.10). On the other hand, (4.8) holds for all time scales. Hence, (4.8) represents a global self-similarity of fBm. This is a monofractal character, which may be too restrictive for many practical applications. Lim and Muniandy [82] replaced the Hurst parameter in (4.4) by a continuously deterministic function to obtain a form of the generalized fBm. The function satisfies Denote the generalized fBm by , instead of so as to distinguish it from the standard one. Then,

By using , one has a tool to characterize local properties of fBm. The following ACF holds for :

The self-similarity expressed below is in the local sense as is time varying

Assume that is a -Holder function. Then, . Therefore, one has the following local Hausdorff dimension of for

The above expression also exhibits the local self-similarity of .

Based on the local growth of the increment process, one may write a sequence expressed by

where is the largest integer not exceeding . Then, at point is given by

see Peltier and Levy-Vehel [84, 85] for the details. Li et al. [86] demonstrate an application of this type of fBm to network traffic modeling, and Muniandy et al. [87] in financial engineering.

4.3. Fractional Gaussian Noise (fGn)

The continuous fGn is the derivative of the smoothed fBm that is in the domain of generalized functions. Its ACF denoted by is given by

where is the Hurst parameter and is used by smoothing fBm so that the smoothed fBm is differentiable [27].

FGn includes three classes of time series. When is positive and finite for all It is nonintegrable and the corresponding series is LRD. For the integral of is zero and diverges when In addition, changes its sign and becomes negative for some proportional to in this parameter domain [27, page 434]. FGn reduces to the white noise when .

The PSD of fGn is given by (Li and Lim [38])

Denote the discrete fGn by dfGn. Then, the ACF of dfGn is given by

Its PSD, see Sinai [77], is given by

where

Note that the expression is the finite second-order difference of . Approximating it with the second-order differential of yields

The above approximation is quite accurate for [11]. Hence, taking into account (3.12) and (3.13), the following immediately appears (Li and Lim [44]):

Hence, we have the following notes.

Note. The fGn as the increment process of the fBm of the Weyl type is stationary. It is exactly self-similar with the global self-similarity described by (4.22).

Note. The PSD of the fGn is divergent at .

Again, we remark that the fGn may be too strict for modeling a real series in practice. Hence, generalized versions of fGn are expected. One of the generalization of fGn is to replace by in (4.19) ([82]) so that

Another generalization by Li [88] is given by

In (4.23), if const, the ACF reduces to that of the standard fGn. On the other side, in (4.24) becomes the ACF of the standard fGn if .

4.4. Generalized Cauchy (GC) Process

As discussed in Section 2, we use two parameters, namely, and , to respectively measure the local behavior and the global one of fractal time series instead of variance and mean. More precisely, the former measures a local property, namely, local irregularity, of a sample path while the latter characterizes a global property, namely, LRD. The parameter is independent of in principle as can be seen from [3]. By using a single parameter model, such as fGn and fBm, D and H happen to be linearly related. Hence, a single parameter model fails to separately capture the local irregularity and LRD. To release such relationship, two-parameter model is needed. The GC process is one of such models.

A series is called the GC process if it is a stationary Gaussian centred process with the ACF given by

where and The ACF is positive-definite for the above ranges of and and it is a completely monotone for When one gets the usual Cauchy process that is modeled by its ACF expressed by

which has been applied in geostatistics; see, for example, Chiles and Delfiner [89].

The function has the asymptotic expressions of (3.11) and (3.14). More precisely, we have

According to (3.12) and (3.13), therefore, one has

When considering the multiscale property of a series, one may utilize the time varying and on an interval-by-interval basis. Denote the fractal dimension and the Hurst parameter in the Ith interval by and , respectively. Then, we have the ACF in the Ith interval given by

Consequently, we have

Denote . Then, the PSD of the GC process is given by (Li and Lim [39]) 

where

In practice, the asymptotic expressions of for small frequency and large one may be useful. The PSD of the GC process for 0 is given by

which is actually the inverse Fourier transform of for . On the other hand, for is given by

see [49] for details. As shown in (4.34) and (4.35), one may easily observe the power law that obeys.

Note. The GC process is LRD if It is SRD if Its statistical dependence is measured by (4.29).

Note. The GC process has the local self-similarity measured by expressed by (4.28).

Note. The GC process is nonMarkovian since does not satisfy the triangular relation given by which is a necessary condition for a Gaussian process to be Markovian (Todorovic [90]). In fact, up to a multiplicative constant, the Ornstein-Uhlenbeck process is the only stationary Gaussian Markov process (Lim and Muniandy [91], Wolpert and Taqqu [92]).

The above discussions exhibit that the GC model can be used to decouple the local behavior and the global one of fractal time series, flexibly better agreement with the real data for both short-term and long-term lags. Li and Lim gave an analysis of the modeling performance of the GC model in Hilbert space [93]. The application of the GC process to network traffic modeling refers to [44], and Li and Zhao [94]. Recently, Lim and Teo [95] extended the GC model to describe the Gaussian fields and Gaussian sheets. Vengadesh et al. [96] applied it to the analysis of bacteriorhodopsin in material science.

4.5. Alpha-Stable Processes

As previously mentioned, two-parameter models are useful as they can separately characterize the local irregularity and global persistence. The CG process is one of such models and it is Gaussian. In some applications, for example, network traffic at small scales, a series is nonGaussian; see, for example, Scherrer et al. [97]. One type of models that are of two-parameter and nonGaussian in general is -stable process.

Stable distributions imply a family of distributions. They are defined by their characteristic functions given by [75, page 5], for a random variable ,

The expression implies that follows

The parameters in are explained as follows.

(i)The parameter is characteristic exponent. It specifies the level of local roughness in the distribution, that is, the weight of the distribution tail.(ii)The parameter specifies the skewness. Its positive values correspond to the right tail while negative ones to the left.(iii)The parameter is a scale factor, implying the dispersion of the distribution.(iv) is the location parameter, expressing the mean or median of the distribution.

Note. The family of -stable distributions does not have a closed form of expressions in general. A few exceptions are the Cauchy distribution and the Levy one.

Note. The property of heavy tail is described as follows. for , and for .

When , the characteristic function (4.37) reduces to that of the Gaussian distribution with the mean denoted by and the variance denoted by That is,

In this case, the PDF of is symmetric about the mean.

Alpha-stable processes are in general nonGaussian. They include two. One is linear fractional stable noise (LFSN) and the other log-fractional stable noise (Log-FSN).

The model of linear fractional stable motion (LFSM) is defined by the following stochastic integral [75, page 366]. Denote by the LFSM. Then,

where and are arbitrary constants, is a random measure, and the Hurst parameter. The range of is given by

Denote by the Log-FSM. Then,

LSFN is the increments process of LSFM while Log-FSN is the increment process of Log-FSM. Denote the LSFN and Log-FSN respectively by and Then,

LSFN is nonGaussian except 2. It is stationary self-similar with the self-similarity measured by H and the local roughness characterized by [75]. However, two parameters are not independent because the LRD condition ([75], Karasaridis and Hatzinakos [98]) relates them by

4.6. Ornstein-Uhlenbeck (OU) Processes and Their Generalizations

In the above subsections, the series may be LRD. We now turn to a type of SRD fractal time series called OU processes.

4.6.1. Ordinary OU Process

Following the idea addressed by Uhlenbeck and Ornstein [99], the ordinary OU process is regarded as the solution to the Langevin equation (see, e.g., [91, 92], Lu [100], Valdivieso et al. [101]), which is a stochastic differential equation given by

where is a positive parameter, is the white noise with zero mean, and is a random variable independent of the standard Brownian motion . The stationary solution to the above equation is given by

Denote the Fourier transforms of and respectively, by and . Note that the system function of (4.44) in the frequency domain is given by

Then, according to the convolution theorem, one has

Since the PSD of the normalized equals to 1, that is, , we immediately obtain the PSD of the OU process given by

Consequently, the ACF of the OU process is given by

where is the operator of the inverse Fourier transform.

The ordinary OU process is obviously SRD. It is one-dimensional. What interests people in the field of fractal time series is the generalized OU processes described hereinafter.

4.6.2. Generalized Version I of the OU process

Consider the following fractional Langevin equation with a single parameter 0:

Denote by the impulse response function of the above system. Then, it is the solution to the following equation:

where is the Dirac- function. Doing the Fourier transforms on the both sides on the above equation yields

where is the Fourier transform of

Note that the PSD of is equal to

where is the complex conjugate of Then,

which is the solution to (4.50) in the frequency domain. The solution to (4.50) in the time domain, therefore, is given by

where and is the modified Bessel function of the second kind of order v [29, 91].

Let . Then, one has

which exhibits that is SRD because its PSD is convergent for .

Keep in mind that the Langevin equation is in the sense of generalized functions since we take as the differential of the standard Brownian motion , which is differentiable if it is regarded as a generalized function only. In the domain of generalized functions and following [17, page 278], there is a generalized limit given by

Therefore, the PSD of the fBm of the Weyl type (see (4.5)) has the following asymptotic property:

On the other hand, from (4.56), we see that the PSD of has the asymptotic expression given by

Therefore, we see that has the approximation given by

Hence, we have Note 20.

Note. The generalized OU process governed by (4.50) can be taken as the locally stationary counterpart of fBm.

According to (3.5), we have

Therefore, we obtain

where is a constant. Following (3.11) and (3.12), we have the fractal dimension of given by

4.6.3. Generalized Version II of the OU Process (Lim et al. [37])

We now further extend the Langevin equation by indexing it with two fractions so that

where is the operator of the Weyl fractional derivative. Denote by the impulse response function of the above system. Then,

The Fourier transform of , which is denoted by is given by

Therefore, the PSD of is given by

Note that

In addition,

Thus, the ACF of has the asymptotic expression given by

where is a constant. Hence, the fractal dimension of is given by

In the above, which is a condition to assure

Note. The local irregularity of series relies on the fractal dimension instead of the statistical dependence. The local irregularity of an SRD series may be strong if its fractal dimension is large.

5. Conclusions

The concepts, such as power law in PDF, ACF, and PSD in fractal time series, have been discussed. Both LRD and SRD series have been explained. Several models, fBm, fGn, the GC process, alpha-stable processes, and generalized OU processes have been interpreted. Note that several models revisited above are a few in the family of fractal time series. There are others; see, for example, [78, 102112]. As a matter of fact, the family of fractal time series is affluent but those revisited might yet be adequate to describe the fundamental of fractal time series from the point of view of engineering in the tutorial sense.

Acknowledgment

This work was partly supported by the National Natural Science Foundation of China (NSFC) under the project Grant nos. 60573125 and 60873264.