Mathematical Problems in Engineering

Volume 2012 (2012), Article ID 716474, 23 pages

http://dx.doi.org/10.1155/2012/716474

*H*_{∞} Filtering for a Class of Piecewise Homogeneous Markovian Jump Nonlinear Systems

^{1}School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China^{2}School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu 611731, China

Received 14 June 2012; Revised 15 August 2012; Accepted 28 August 2012

Academic Editor: Xing-Gang Yan

Copyright © 2012 Yucai Ding et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

filtering problem for a class of piecewise homogeneous Markovian jump nonlinear systems is investigated. The aim of this paper is to design a mode-dependent filter such that the filtering error system is stochastically stable and satisfies a prescribed disturbance attenuation level. By using a new mode-dependent Lyapunov-Krasovskii functional, mixed mode-dependent sufficient conditions on stochastic stability are formulated in terms of linear matrix inequalities (LMIs). Based on this, the mode-dependent filter is obtained. A numerical example is given to illustrate the effectiveness of the proposed main results.

#### 1. Introduction

The filtering problem has received significant attention in the past decade. Current efforts on this topic can be divided into two classes: the Kalman filtering approach and the filtering approach. As we all know, Kalman filtering approach is based on the assumption that the system is exactly known, and its disturbances are stationary Gaussian noises with known statistics. These assumptions limit the application scope of the Kalman filtering technique when there are uncertainties in either the exogenous input signals or the system model [1]. To overcome the restriction described above, filtering has been introduced as an alternative filtering technique [2–6].

On the other hand, Markovian jump systems are an active area of research. It switches from one mode to another in a random way, and the switching between the modes is governed by a Markovian process with discrete and finite state space. These models serve as convenient tools for analyzing plants that are subjected to random abrupt parameter changes due to, for instance, component and/or interconnection failures, sudden environmental changes, or change of the operating point of a linearized model of a nonlinear plant. A wide class of industrial system applications experience time delays due to various reasons including inherent physical properties (mass transport flow, recycling), data transmission delays or finite capabilities of information exchange [7]. When considering the continuous systems with time-varying delay, the systems can be clarified into two types, one is slow time-varying delay systems, that is, the derivative of the time delay is less than one, for example, [2, 8, 9], and the other is fast time-varying delay systems, that is, there are no constraints on the derivative of the time delay. Both Lyapunov-Krasovskii and Lyapunov-Razumikhin approaches are fundamental for time-delay systems, and some existing work usually do not require the derivative of the time delay to be less than one, see, for example, [10, 11]. Due to their extensive practical applications, considerable attention has been devoted to Markovian jump systems with time delays. The issues of stability and control have been well investigated; see, for example, [9, 11–29] and references therein. In [30–32], the sliding mode control of Markovian jump singular systems was studied, and, new integral-type sliding surface functions were designed. Moreover, strict LMI conditions of the stochastic stability were proposed in [30, 31], which are easy to be checked by Matlab LMI toolbox. In [32], a suitable switching surface function and a sliding mode control law were designed to ensure the attraction of the sliding surface when the system changes from one mode to another under Markovian switching, and the slack matrix approach was used to derive less conservative LMI conditions assuring stochastic admissibility. The filtering problem for Markovian jump time-delay systems was reported in [8, 33–40]. Many nonlinear physical systems can be represented as a connection of a linear dynamical system and a nonlinear element. Filtering for Markovian jump nonlinear system is an important research area that has attracted considerable interest [41–43]. It should be pointed out that the above-mentioned references assume that the Markovian processes are homogeneous, that is, the considered transition probabilities (TPs) in Markovian process are assumed to be time invariant. However, the assumption cannot always be satisfied in real applications, and the ideal assumption on TPs inevitably limits the applications of the established results to some extent [44]. Therefore, it is important and necessary to pay attention to the study of Markovian jump systems with time-varying TPs. Recently, the problem of estimation for discrete-time Markovian jump linear system with time-varying TPs has been investigated in [44]. The control problem has been conducted for a class of discrete-time Markovian jump systems with time-varying TPs in [45], where the average dwell-time switching is used to describe the variation among the TPs. The stochastic stability analysis of piecewise homogeneous Markovian jump neural networks with mixed time delays has been studied in [46]. But, the time-varying delays in [46] are independent of jump mode. To the best of our knowledge, no results have been given for piecewise homogeneous Markovian jump nonlinear systems with mode-dependent time-varying delays. With the appearance of time-varying TPs and mode-dependent time-varying discrete and distributed delays, the main difficulties are as follows: the new Lyapunov functional should be constructed to deal with above problem; since the system involves joint jump processes and mode-dependent time-varying delays, the calculation of derivative of the Lyapunov functional and the using of inequality techniques become more complicated. Moreover, the Lyapunov matrix is assumed to be diagonal matrix in some existing literature, which leads to some conservativeness. Therefore, the key problems in this research are: how to choose a Lyapunov function to derive a sufficient stochastic stability condition for the considered systems; how to use the inequality techniques and calculate the parameters of the filter such that the resulting sufficient conditions are less conservative? Which has motivated this paper.

In this study, we are concerned to develop an efficient approach for filtering problem of piecewise homogeneous Markovian jump system. The system under study involves mode-dependent time-varying discrete and distributed delays and inherent sector-like nonlinearities. By using a novel Lyapunov-Krasovskii functional, mixed mode-dependent sufficient condition on stochastic stability with an performance is derived in terms of LMIs. Based on this, the existence condition of the desired filter which guarantees stochastic stability and an performance of the corresponding filtering error system is presented. A numerical example is provided to show the effectiveness of the proposed results.

*Notation.* Throughout this paper, denotes the -dimensional Euclidean space. is a probability space, is the sample space, is the -algebra of subsets of the sample space, and is the probability measure on . refers to the expectation operator with respect to some probability measure . We use diag as a block diagonal matrix. means is a symmetric positive (negative) definite matrix. denotes the transpose of matrix , is the identity matrix with compatible dimension.

#### 2. System Description and Definitions

Fix a probability space and consider the following stochastic Markovian jump system with mode-dependent time-varying delays: where is the state vector; is the exogenous disturbance input which belongs to ; is the measured output; is the signal to be estimated; is a compatible vector-valued initial function defined on ; , , , , , , , , , and are real constant matrices with appropriate dimensions. is the mode-dependent time-varying delay. The process is described by a Markov chain with finite state space , and its transition probability matrix, , is governed by where and ; for is the transition rate from mode at time to mode at time and . In this study, we assume that vary in another finite set , and the variations are considered as the stochastic variation. The variation of is governed by a higher-level transition probability (HTP) matrix and the TPs of Markov chain satisfy where for is the transition rate from mode at time to mode at time and . The stochastic processes and are assumed to be independent throughout this paper. For vector-valued functions and , we assume:

where for all and are the known constant matrices. In what follows, for implicity of presentations and without loss of generality, we always assume that and .

For simplicity, a matrix will be denoted by . For example, is denoted by , is denoted by and is denoted by , . When the mode is in , the mode-dependent time-varying delay satisfies where .

In this study, the following full-order linear filter is proposed to estimate the signal : where is the filter state vector, and are appropriately dimensioned filter matrices to be determined.

Define the estimation error by , we obtain the following filtering error system: where , , and

*Remark 2.1. *According to the definitions of homogeneous Markovian chain and nonhomogeneous Markovian chain in [44, 47], one can see that the Markovian chain in this paper is homogeneous, while the Markovian chain is neither homogeneous nor nonhomogeneous, but a state between them, which can be called the finite piecewise homogeneous Markovian chain.

*Remark 2.2. * In this paper, the nonlinear functions and are said to belong to sectors, which means that the nonlinearities are bounded by sectors. The nonlinear descriptions in (2.4) are quite general that include the usual Lipschitz conditions as a special case [2].

The following lemma and definitions are introduced, which will be used in the proof of the main results.

Lemma 2.3 (see [48]). * For any matrix , scalar , vector function such that the integrations concerned are well defined, the following inequality holds:
*

*Definition 2.4. *The filtering error system (2.7) with is said to be stochastically stable, if for any initial defined on and modes and , the following relation holds: [7]

*Definition 2.5. *Given a scalar , the filtering error system (2.7) is said to be stochastically stable with an performance , if for every system mode , the filtering error system (2.7) with is stochastically stable and, under zero initial condition, it satisfies for any nonzero .

#### 3. Main Results

In this section, we first propose a delay-dependent sufficient condition for stochastic stability with the performance of filtering error system (2.7). Now, consider the following Lyapunov-Krasovskii functional for systems (2.7): where

Let be the weak infinitesimal generator of the random process . Then, for each , , the stochastic differential of along the trajectory of system (2.7) is given by Using Lemma 2.3 and considering (2.5), it can be deduced that In addition, it is not difficult to get

Next, following a similar method of [46], to (3.5), denote When , according to Jensen’s inequality, we have that It is clear that [49] which implies Then, we can get from (3.9) and (3.11) that Note that when or , we have or , respectively. So relation (3.12) still holds. It is clear that (3.12) implies where

The following equation is true for any matrix with appropriate dimensions: From (2.4), it is clear that [2] where , , , . It implies from (3.17) and (3.18) that there exist and such that We define From the above discussion, we have where Therefore, we have the following result for the performance analysis.

Theorem 3.1. *Given scalars , , and , the filtering error system (2.7) is stochastically stable with an performance for any time delay satisfying (2.5), if there exist matrices , , , , , , , , , and matrices , such that for each , **
where
*

*Proof. *Using the Schur complement formula to (3.23), it can be seen that inequality (3.23) is equivalent to
which implies . Now, we show that the filtering error system (2.7) with is stochastically stable. If , from (3.1), (3.21), (3.24)–(3.28), and , there exists a scalar such that
Therefore, for any , by Dynkin’s formula, we have
which yields
Thus, the filtering error system (2.7) with is stochastically stable by Definition 2.4.

In the sequel, we will deal with the performance of the filtering error system (2.7). Using (3.30) and performance, we have
Noting that the zero initial condition, then it follows from (3.34) that
Hence, if (3.23)–(3.28) hold, can be guaranteed. That is, for all nonzero . Therefore, the filtering error system (2.7) is stochastically stable with the performance by Definition 2.5. This completes the proof.

*Remark 3.2. *A new stochastic stability criterion is obtained in Theorem 3.1 by constructing a novel mode-dependent Lyapunov functional. The Lyapunov functional in this paper uses all information about , and . The Lyapunov matrices , , , and depend on both the system mode and the higher-level Markovian chain . Compared with the mode-independent Lyapunov matrices [40, 42], the mode-dependent Lyapunov matrices can reduce the conservativeness since they provide additional degrees of freedom which are very important for deriving LMIs solutions in general. Hence, the Lyapunov functional in this paper is more general and the condition on stability is more applicable.

*Remark 3.3. *It should be pointed out that the aim of the introduction of is to propose a stability condition which depends not only on the delay upper bound , but also on the subsystems’ delay upper bounds , in other words, if is not considered, the obtained stability condition only depends on the delay upper bound . Hence, the introduction of may reduce some conservativeness.

Based on Theorem 3.1, the filter synthesis problem can be developed in terms of LMIs for the system (2.1) with higher-level Markovian chain.

Theorem 3.4. *Consider the systems (2.1). Given scalars , and , the filtering error system (2.7) is stochastically stable with an performance for any time delay satisfying (2.5), if there exist matrices , , , , , , , , , , , , , , , , , and matrices , such that for each , **
where
**
In this case, the parameters of the desired filter can be chosen by
*

* Proof. *For each , , we define a matrix by . By invoking a small perturbation, if necessary, we can assume that and are nonsingular. Thus, we can introduce the following invertible matrix . Pre- and postmultiplying (3.23) by diag and its transpose, respectively. Then, we define
It is easy to obtain (3.36).

On the other hand, according to (3.44), we have
From (2.6), the transfer function from measured output to estimated signal can be described by
Therefore, we can conclude from (3.46) that the parameters of the filter in (2.6) can be constructed by (3.43). This completes the proof.

*Remark 3.5. *It should be pointed out that some existing work in control and filter design of Markovian jump systems, the Lyapunov matrix is assumed to be diagonal matrix, for example, see [42]. It is well known that such assumption can lead to much more conservative result. Although the first diagonal element in (3.23) includes , , and in this paper, is not assumed to be diagonal matrices.

*Remark 3.6. *In [30–32, 38], the authors have achieved some excellent work of Markovian jump singular systems. Due to the presence of the singular matrix , the issues of stability and control of such systems are more difficult and complicated. However, there is no results on piecewise homogeneous Markovian jump singular systems in the existing work, and the problem of control for such system is an interesting issue.

*Remark 3.7. *Theorem 3.4 solves the filtering problem of a class of piecewise homogeneous Markovian jump nonlinear systems. The obtained conditions are formulated in terms of LMIs, which could be easily checked by using the LMI toolbox in Matlab. The feasible solutions to the conditions presented in Theorem 3.4 will depend on both the mode and the higher-level Markovian chain , which ensure that the error system is stochastically stable. A numerical example verifies the validity of the designed filter in Section 4.

#### 4. A Numerical Example

In this section, a numerical example will be presented to show the validity of the main results derived above.

*Example 4.1. *Let us consider the stochastic system (2.1) with the following system of matrices:
The piecewise homogeneous TP matrices are given as
The HTP matrix for the Markovian chain is considered as follows:
In this example, we assume , , . For . By solving LMIs (3.36)–(3.41), the filter matrices are obtained as
For simulation purposes, we assume the initial condition and . The time delays are , . The nonlinear functions and are selected as

Figures 1–5 illustrate the simulation results. A case for stochastic variation with HTP matrix is shown in Figure 1, and possible realizations of the Markov jumping mode of system and delay are plotted in Figure 2, where the initial modes are assumed to be and . Figure 3 shows the state responses of real states and its estimate . Figure 4 shows the state responses of real states and its estimate . Figure 5 is the simulation result of the estimation error response of . The simulation results demonstrate that the designed filters are feasible and effective.