## Robust Control, Optimization, and Applications to Markovian Jumping Systems

View this Special IssueResearch Article | Open Access

Yushun Tan, Qiong Qi, Jinliang Liu, "State Estimation for Time-Delay Systems with Markov Jump Parameters and Missing Measurements", *Abstract and Applied Analysis*, vol. 2014, Article ID 379565, 11 pages, 2014. https://doi.org/10.1155/2014/379565

# State Estimation for Time-Delay Systems with Markov Jump Parameters and Missing Measurements

**Academic Editor:**Shuping He

#### Abstract

This paper is concerned with the state estimation problem for a class of time-delay systems with Markovian jump parameters and missing measurements, considering the fact that data missing may occur in the process of transmission and its failure rates are governed by random variables satisfying certain probabilistic distribution. By employing a new Lyapunov function and using the convexity property of the matrix inequality, a sufficient condition for the existence of the desired state estimator for Markovian jump systems with missing measurements can be achieved by solving some linear matrix inequalities, which can be easily facilitated by using the standard numerical software. Furthermore, the gain of state estimator can also be derived based on the known conditions. Finally, a numerical example is exploited to demonstrate the effectiveness of the proposed method.

#### 1. Introduction

As a class of multimodal systems, Markovian jump systems (MJSs) have received considerable attention in the past two decades [1–6]. The system parameters usually jump in a finite mode set, in which the transitions among different modes are governed by a Markov chain. Due to the fact that many dynamical systems subject to random abrupt variations can be modeled by MJSs, many applications of MJSs can be showed, such as power systems, failure prone manufacturing systems, communication systems, biochemical systems with diverse changes of environmental conditions, and economy system. Quite a number of useful results have been extensively studied, such as stability and stabilization, robust control, optimal control, control, synchronization, filtering, and sliding mode control [7–19]. For example, the author in [7] studied the problem of unbiased estimation of Markov jump systems with distributed delays, and sufficient conditions are obtained for the unbiased filtering scheme to MJSs by stochastic Lyapunov-Krasovskii functional framework. The author in [8] considered robust control problems for stochastic fuzzy neutral MJSs with parameters uncertainties and multiple time delays, and a sufficient condition and control criteria are formulated in the form of linear matrix inequalities by selecting appropriate Lyapunov functions. In term of the peak-to-peak filtering problem for a class of MJSs with uncertain parameters, the author in [9] investigated it. Sufficient conditions that the solution of the peak-to-peak filter existed are given by using the constructed Lyapunov functional and linear matrix inequalities. More details on this topic can be found in [20] and the references therein.

In recent years, due to the fact that, for many practical state estimation applications, the problem of state estimation with linear or nonlinear time-delay systems has received much attention, it is of great significance to estimate systems states and then utilize the estimated systems states to achieve certain design objectives. At the same time, in the procedure of state estimator design, time delays cannot be neglected and their existence often results in a poor performance. Some nice results on state estimation for time-delay systems have been showed in the literature [21–23]. Meanwhile, some state estimation problem for JMSs has been hot topics so that many important results have been reported in the literature [16, 24, 25]. The author in [16] studied the state estimation and sliding-mode control problems for continuous-time Markovian jump singular systems with unmeasured states. The author in [24] concerned the problem of estimation for a class of Markov jump linear systems (MJLSs) with time-varying transition probabilities in discrete-time domain. In [25] efficient simulation-based algorithms called particle filters were used to solve the optimal state estimates for a class of jump Markov linear systems. The author in [26] considered state estimation for Markovian jumping delayed continuous-time recurrent neural networks, where only matrix parameters were mode-dependent. Different from the studies [26, 27] studied state estimation problem for a class of discrete-time neural networks with Markovian jumping parameters and mode-dependent mixed time delay, where the discrete and distributed delays were mode-dependent.

Recently, Liu et al. [28] studied the filter design for Markovian jump systems with time-varying delays. However, these papers do not consider the data missing of sensor in the process of transmission. Motivated by the idea of above papers, we will investigate the problem of state estimation for Markovian jump systems with both time delays and missing measurements. This work is not a simple extension of [28] to MJSs. Our main difficulties come from the state estimator design and missing measurements analysis for the MJSs. Thus, how to design an appropriate state estimator and how to establish a sufficient condition for the existence of the desired state estimator derived are the key problems to be solved. Based on the above analysis, in this paper, we studied state estimator design for MJSs with both missing measurements and time delays via employing a new Lyapunov function and using the convexity property of the matrix inequality. With the proposed method, we established a sufficient condition for the existence of the desired state estimator. Furthermore, the problem of state estimator design is studied; that is, an observer is designed for the MJSs with missing measurements to estimate the states.

In this paper, the problem of state estimator design for MJSs with interval time-varying delay is narrated. A new Lyapunov function is established to obtain less conservative results, in which the lower and upper delay bound of interval time-varying delay is included. Based on above analysis, the item can depart into two parts to deal with, respectively, and the convexity of the matrix functions is used to avoid the conservative caused by enlarging to in the deriving results.

The rest of this paper is organized as follows. Section 2 presents the problem statement and preliminaries. An LMI-based sufficient condition for the existence of the desired state estimator derived is proposed in Section 3. A numerical example is provided in Section 4 and we conclude this paper in Section 5.

and denote the -dimensional Euclidean space and the set of real matrices; the superscript “” represents matrix transposition; represents the Euclidean vector norm or the induced matrix 2-norm as appropriate; is the identity matrix of appropriate dimension. represents the expectation of when is a stochastic variable. denote a symmetric matrix, where * denotes the entries implied by symmetry, for a matrix and two symmetric matrices and . The notation (resp., ), for , means that the matrix is real symmetric positive definite (resp., positive semidefinite).

#### 2. Problem Statement and Preliminaries

Fix a probability space (, , and ) and consider the following class of uncertain linear stochastic systems with Markovian jump parameters and time-varying delays: is the state vector, is the measurement vector, is the signal to be estimated, is the exogenous disturbance signal, and is a continuous-time Markovian process which has right continuous trajectories and takes values in a finite set with stationary transition probabilities: where , , and , for is the transition rate from mode at time to the mode at time and In the system (1), the time delay is a time-varying continuous function satisfying the following assumption: where is the upper bound and is the lower bound of the communication delay, and is the upper bound of change rate of communication delay.

When considering the data missing in the sensor channel, the actual output of sensor measurements in system (1) can be described as where , , and are unrelated stochastic variables taking values in . The mathematical expectation and variance of are and , respectively.

*Remark 1. *It can be seen from (5) that stochastic is introduced to reflect the unreliable sensors, which describes the status of the whole sensor and has been extensively studied in the literature such as [29–33]. Generally speaking, different sensor has different failure rate. So it is reasonable to assume that the failure rate for each individual sensor satisfies individual probabilistic distribution, and the elements of the random matrix correspond to the status of the th sensor. At one moment, if , it indicates that the th sensor is well working; if , it indicates that th sensor fails completely or data missing in the sensor channel; if , it means that the th sensor fails partly. Therefore, while , it means the status of the whole sensor is in good working condition. Thus the model which we will establish in this paper is more general.

In this paper, considering the data missing of sensor in the process of information communication and based on the measurement , we consider the following state estimator for system (1): where .

*Remark 2. *Similar to (5), we also consider the data missing of sensor in the process of information communication for the system (6) of state estimation.

The set contains the various operation modes of system (1) and, for each possible value of , , the matrices connected with “th mode” will be denoted by where , and are constant matrices for any . In this paper we assume that the jumping process is accessible; that is, the operation mode of system (1) is known for every .

Set the estimation error and . Then the following error dynamics of the state estimation system will be showed as follows: where

The state estimation problem which is addressed in this paper is to design a state estimator in form of (8) such that(i)the estimation error system (8) with is exponentially stable;(ii)the performance is sure for all nonzero and a prescribed under the condition , for all .

Before giving the main results, the following lemmas and definitions are needed in the proof of our main results.

Lemma 3 (see [34]). *For any constant matrix , , vector function , and constant such that the following integration is well defined; then the following inequality holds:
*

Lemma 4 (see [35]). *Suppose , , and are constant matrices of appropriate dimensions, ; then
**
if and only if the following two inequalities hold:
*

*Definition 5. *The system (8) is considered to be exponentially stable in the mean-square sense (EMSS), if there exist constants , , such that :

*Definition 6. *For a given function , its infinitesimal operator [36] is defined as

#### 3. Main Results

Theorem 7. *For some given constants and , the system (8) is exponentially mean-square stable (EMSS) with a prescribed performance , if there exist , , , , , , , , , and with appropriate dimensions, so that the following matrix inequalities hold:
**
where*

*Proof. *Introduce a new vector
and two matrices
The system (8) can be rewritten as

Let ). Then, the same as [37], is a Markov process. Choose the following Lyapunov functional candidate:
where

Let be the weak infinite generator of the random process . Then, for each , taking expectation on it, we obtain

Note that
From (16) and (24), we can derive that

It follows from Lemma 3 that

Combining ((23), (25), and (26)) and introducing slack matrices , , , we obtain
where , .

Note that

Combining (27)–(29), we can obtain

By using Lemma 4 and Schur complement, it is easy to see that (15) and are sufficient conditions to guarantee

Then, the following inequality can be concluded:

Define a new function as

Its infinitesimal operator is given by

By the generalized formula [36], we can obtain from (34) that

Then, similar to the method of [1], we can see that there exists a positive number such that for

Since , it can be shown from (36) that for
where . Recalling Definition 5, the proof can be completed.

*Remark 8. *In the above proof, a new Lyapunov function is constructed, and the term in (25) is separated into two parts. It is easy to see that this method is less conservative than the ones in the literature [5, 38].

*Remark 9. *A delay-dependent stochastic stability condition for MJSs with interval time-varying delays is provided in Theorem 7. In the proof of Theorem 7, the convexity property of the matrix inequality is treated in terms of Lemma 4, which need not enlarge to , so the common existed conservatism caused by this kind of enlargement in [39–42] can be avoided, and thus the conservative result will be decreased.

Theorem 7 established some analysis results. In the following, the problem of state estimator design is to be considered and the following results can be readily obtained from Theorem 7.

Theorem 10. *For some given constants and , the augmented system (8) is stochastically stable with a prescribed performance if there exist , , , , , , , , , , and with appropriate dimensions so that the following LMIs hold for a given :
**
where
**
and , ,, and are as defined in Theorem 7.**Moreover, the state estimator gain in the form of (6) is as follows:
*

*Proof. *Defining , from (15) and using Schur complement, the matrix inequality (15) holds if and only if
where
Due to
we can have
Substituting with in (42), we obtain (38), so if (38) holds, we have (15) holds, and from above proof, we know that the desired state estimator gain matrix is . This completes the proof.

*Remark 11. *Inequality (45) is used to bound the term . This step can be improved by adopting the cone complementary algorithm [43], which is popular in recent control designs. The scaling parameter here can be used to improve conservatism in Theorem 10. In addition, Theorem 10 shows that for given we can obtain the state estimator gain by solving a set of LMIs in (38) and (39).

#### 4. Numerical Example

In this section, well-studied example is considered to illustrate the effectiveness of above approaches proposed and also to explain the proposed method on state estimator design.

Consider linear Markovian jump systems in the form of (1) with two modes. For modes 1 and 2, the dynamics of system with following parameters [28] are described as

Suppose the initial conditions are given by , , and the transition probability matrix

By Theorem 10, we get the maximum time delay for , , , and . Meanwhile, we can get the fact that the maximum time delay will become larger with decreasing rates of when other variables are fixed. For example, the maximum time delay is for if other parameters did not change.

The corresponding state estimator gain matrices for are given by

To illustrate the performance of the designed state estimator, choose the disturbance function as follows:

With this state estimator, the simulation results are shown in Figures 1, 2, and 3 which show the operation modes of the MJSs, interval time-varying delay, and estimated signal error , respectively. From Figures 1, 2, and 3, it can be showed that the designed state estimator performs well.

#### 5. Conclusions

In this paper, we established the design method of state estimation problem for a class of time-delay systems with Markov jump parameters and missing measurements. By employing a new Lyapunov function method and using the convexity property of the matrix inequality, an LMI-based sufficient condition for the existence of the desired state estimator derived is proposed, which can lead to much less conservative analysis results. Finally, a numerical example has been carried out to show the effectiveness of our obtained results of the proposed method.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

The authors would like to acknowledge the Natural Science Foundation of China (no. 11226240), the Natural Science Foundation of Jiangsu Province of China (no. BK2102469), National Center for International Joint Research on E-Business Information Processing under Grant 2013B01035, and a project funded by the Priority Academic Program Department of Jiangsu Higher Education Institutions (PAPD).

#### References

- D. Yue and Q.-L. Han, “Delay-dependent exponential stability of stochastic systems with time-varying delay, nonlinearity, and Markovian switching,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 2, pp. 217–222, 2005. View at: Publisher Site | Google Scholar | MathSciNet - L. Zhang and E.-K. Boukas, “Mode-dependent ${H}_{\infty}$ filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities,”
*Automatica*, vol. 45, no. 6, pp. 1462–1467, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. Shao, “Delay-range-dependent robust ${H}^{\infty}$ filtering for uncertain stochastic systems with mode-dependent time delays and Markovian jump parameters,”
*Journal of Mathematical Analysis and Applications*, vol. 342, no. 2, pp. 1084–1095, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - O. Costa and M. Fragoso, “A separation principle for the ${H}_{2}$-control of continuous-time infinite Markov jump linear systems with partial observations,”
*Journal of Mathematical Analysis and Applications*, vol. 331, no. 1, pp. 97–120, 2007. View at: Publisher Site | Google Scholar | MathSciNet - S. Xu, T. Chen, and J. Lam, “Robust ${H}^{\infty}$ filtering for uncertain Markovian jump systems with mode-dependent time delays,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 5, pp. 900–907, 2003. View at: Publisher Site | Google Scholar | MathSciNet - J. Liu, E. Tian, Z. Gu, and Y. Zhang, “State estimation for Markovian jumping genetic regulatory networks with random delays,”
*Communications in Nonlinear Science and Numerical Simulation*, vol. 19, no. 7, pp. 2479–2492, 2014. View at: Publisher Site | Google Scholar | MathSciNet - S. He and F. Liu, “Unbiased estimation of markov jump systems with distributed delays,”
*Signal Processing*, vol. 100, pp. 85–92, 2014. View at: Google Scholar - S. He and F. Liu, “Controlling uncertain fuzzy neutral dynamic systems with Markov jumps,”
*Journal of Systems Engineering and Electronics*, vol. 21, no. 3, pp. 476–484, 2010. View at: Publisher Site | Google Scholar - S. He and F. Liu, “Robust peak-to-peak filtering for Markov jump systems,”
*Signal Processing*, vol. 90, no. 2, pp. 513–522, 2010. View at: Publisher Site | Google Scholar - O. L. Costa and W. L. de Paulo, “Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems,”
*Automatica*, vol. 43, no. 4, pp. 587–597, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. Zhang, H. Yan, J. Liu, and Q. Chen, “Robust ${H}_{\infty}$ filters for Markovian jump linear systems under sampled measurements,”
*Journal of Mathematical Analysis and Applications*, vol. 356, no. 1, pp. 382–392, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - C. E. de Souza, “Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems,”
*IEEE Transactions on Automatic Control*, vol. 51, no. 5, pp. 836–841, 2006. View at: Publisher Site | Google Scholar | MathSciNet - Z. Wang, Y. Liu, L. Yu, and X. Liu, “Exponential stability of delayed recurrent neural networks with Markovian jumping parameters,”
*Physics Letters A*, vol. 356, no. 4-5, pp. 346–352, 2006. View at: Publisher Site | Google Scholar - Z. Wang, J. Lam, and X. Liu, “Exponential filtering for uncertain Markovian jump time-delay systems with nonlinear disturbances,”
*IEEE Transactions on Circuits and Systems II*, vol. 51, no. 5, pp. 262–268, 2004. View at: Publisher Site | Google Scholar - J. Xiong and J. Lam, “Robust ${H}_{2}$ control of Markovian jump systems with uncertain switching probabilities,”
*International Journal of Systems Science*, vol. 40, no. 3, pp. 255–265, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Wu, P. Shi, and H. Gao, “State estimation and sliding-mode control of Markovian jump singular systems,”
*IEEE Transactions on Automatic Control*, vol. 55, no. 5, pp. 1213–1219, 2010. View at: Publisher Site | Google Scholar | MathSciNet - L. Hou, G. Zong, W. Zheng, and Y. Wu, “Exponential ${l}_{2}-{l}_{\infty}$ control for discrete-time switching markov jump linear systems,”
*Circuits, Systems, and Signal Processing*, vol. 32, no. 6, pp. 2745–2759, 2013. View at: Google Scholar - M. G. Todorov and M. D. Fragoso, “A new perspective on the robustness of Markov jump linear systems,”
*Automatica*, vol. 49, no. 3, pp. 735–747, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - O. Costa and G. Benites, “Robust mode-independent filtering for discrete-time Markov jump linear systems with multiplicative noises,”
*International Journal of Control*, vol. 86, no. 5, pp. 779–793, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - O. L. V. Costa, M. M. D. Fragoso, and R. P. Marques,
*Discrete-Time Markov Jump Linear Systems*, Springer, London, UK, 2005. View at: MathSciNet - Y. Liu, Z. Wang, J. Liang, and X. Liu, “Synchronization and state estimation for discrete-time complex networks with distributed delays,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 38, no. 5, pp. 1314–1325, 2008. View at: Publisher Site | Google Scholar - Z. Wang, Y. Liu, and X. Liu, “State estimation for jumping recurrent neural networks with discrete and distributed delays,”
*Neural Networks*, vol. 22, no. 1, pp. 41–48, 2009. View at: Publisher Site | Google Scholar - J. Liang, Z. Wang, and X. Liu, “State estimation for coupled uncertain stochastic networks with missing measurements and time-varying delays: the discrete-time case,”
*IEEE Transactions on Neural Networks*, vol. 20, no. 5, pp. 781–793, 2009. View at: Publisher Site | Google Scholar - L. Zhang, “${H}_{\infty}$ estimation for discrete-time piecewise homogeneous Markov jump linear systems,”
*Automatica*, vol. 45, no. 11, pp. 2570–2576, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A. Doucet, N. J. Gordon, and V. Krishnamurthy, “Particle filters for state estimation of jump Markov linear systems,”
*IEEE Transactions on Signal Processing*, vol. 49, no. 3, pp. 613–624, 2001. View at: Publisher Site |