Research Article | Open Access

Jia You, Shen Yin, Hamid Reza Karimi, "Robust Estimation for Discrete Markov System with Time-Varying Delay and Missing Measurements", *Mathematical Problems in Engineering*, vol. 2013, Article ID 321935, 9 pages, 2013. https://doi.org/10.1155/2013/321935

# Robust Estimation for Discrete Markov System with Time-Varying Delay and Missing Measurements

**Academic Editor:**Xudong Zhao

#### Abstract

This paper addresses the filtering problem for time-delayed Markov jump systems (MJSs) with intermittent measurements. Within network environment, missing measurements are taken into account, since the communication channel is supposed to be imperfect. A Bernoulli process is utilized to describe the phenomenon of the missing measurements. The original system is transformed into an input-output form consisting of two interconnected subsystems. Based on scaled small gain (SSG) theorem and proposed Lyapunov-Krasovskii functional (LKF), the scaled small gains of the subsystems are analyzed, respectively. New conditions for the existence of the filters are established, and the corresponding filter design scheme is proposed. Finally, a simulation example is provided to demonstrate the effectiveness of the proposed approach.

#### 1. Introduction

In recent years, networked control systems (NCSs) have found a great deal of applications in a range of engineering areas [1–6]. Compared to traditional control systems, the NCSs hold many magnificent advantages, such as reduced power and weight requirements, low cost, improved flexibility and suppleness, high reliability, and facilitated system diagnosis and maintenance. Consequently, NCSs have drawn extensive investigation, and a great deal of significant results have been reported [7–12].

On the other hand, some unexpected phenomena appear in the networked environment, since the digital communication channels have been introduced, on which all measured signals are transmitted with limited capacity. Intermittent measurements and time-delay are widely emerged in many kinds of NCSs, which could always lead to poor performance even instability of the systems. Some research issues in networked environment, such as filtering problems have become much more complicated since most traditional approaches are proposed on the assumption that the communication channel between the physical plant and filter is perfect. In this sense, a great attention has been attracted to the filtering problems with limited capacity and led to many important results. To mention them, [13] addresses the filtering problem with communication delay, [14] investigates the filtering problem for nonlinear stochastic systems, and robust filtering problems subject to stochastic missing measurements which described by different methods are introduced in [15–17].

Based on the direct Lyapunov method, a great deal of stability criteria have been reported [9, 18]. Meanwhile, an input-output approach has been introduced to analyze the stability of the systems by transforming the original system into a form of interconnection of two subsystems via employing a two-term approximation for the delayed variables [19]. Recently, Observing that the resulting performance largely depends on the error between the delayed variable and the approximation, an approach for estimating the delay by the upper and the lower delay bounds was introduced [20], of which the approximation error is much smaller than the error obtained by other one-term approaches [21, 22]. However, to the best of the authors’ knowledge, corresponding results for time-delay MJSs with limited capacity channel have been relatively few, which motivates the research in this paper.

In this paper, we investigate the filtering problem for time-delayed MJSs with intermittent measurements. The communication channel between the plant and the filter is supposed to be imperfect. And the phenomenon of missing measurements is modeled by employing a stochastic variable satisfying Bernoulli random binary distribution. By using a new two-term approximation to the delay variables, the system is transformed into an interconnected systems comprised of two subsystems. Based on the scaled small gain (SSG) theorem and proposed Lyapunov-Krasovskii functional (LKF), sufficient conditions for the existence of the filters and the corresponding filter design method are proposed. Finally, a numerical example is provided to show effectiveness of the approach.

The remainder of this paper is organized as follows. In Section 2, the problem of filtering is formulated for time-delayed MJSs with intermittent measurements; Section 3 presents the results for performance analysis, and filter design problem is solved in Section 4; a numerical example is provided to demonstrate the effectiveness of the design filtering technique in Section 5, and we conclude the paper with Section 6.

*Notation.* Throughout this paper, represents the -dimensional Euclidean space, is the set of all real matrices, the superscripts “−1” and “,” respectively, stand for the matrix inverse and matrix transpose. is the shorten notation for , and the notation (resp., ), for means that is real symmetric and positive definite (resp., semidefinite). The symmetric elements of the symmetric matrix is represented by an asterisk (), and the block-diagonal matrices are denoted by . means the series connection of mapping and . denotes the expectation operator with respect to probability measure, and for vector , .

#### 2. Problem Formulation

Consider the following Markov jump system with the time-varying delay: where denotes system state; is the measured output; is the measurement noise which belongs ; is the signal to be estimated; and is a given real-valued initial condition. Let be a Markov chain that takes values in a given finite set with transition probability , where for and . And is a positive integer, denoting the time-varying delay satisfying where and are the minimum and the maximum delay, respectively. The delay interval is defined as .

Then, we consider the following mode-independent filter with full order: where is the filter state vector and is the output of the filter; , , and are the filter gains to be determined.

In the network the data transmitted in the digital channel may be lost at a certain probability as shown in Figure 1. As a result, the output of the physical plant is no more equivalent to the input of the filter, which is denoted by . In this paper, this phenomenon is modeled via a Bernoulli process: where is Bernoulli process, which models the intermittent transmission between the plant and the filter. When , the data is transmitted to the filter successfully. While when , the transmission fails and the data is lost. It can be described as:

Combining (3) and (5), we have Defining yields and .

Then, denote By connecting (1) with (3), the filtering error dynamic can be described by where

Moreover, we introduce the definition of stochastic stability which is vital and important in this paper.

*Definition 1 (see [23]). *For the system in (1) with , the system is stochastically stable if for any ,

*Definition 2 (see [23]). *A mapping is input-output stable in mean-square if there exists such that

Then, the filtering design for MJSs with intermittent measurements to be addressed in this paper can be formulated as follows.

Consider system (1) with intermittent measurements modeled by (5). Given positive integers and a prescribed scalar , the filter gains , , and of filter (3) are designed such that for any time-delay satisfying (2), the filter error system (8) is stochastically stable, and holds under zero initial conditions.

#### 3. Main Results

In this section, by developing SSG Theorem to stochastic systems and a new model transformation to system (8), we will focus on the filter performance analysis. Sufficient conditions are presented, under which system is stochastically stable with a prescribed performance index.

##### 3.1. Filtering Performance Analysis

Lemma 3 (see [24]). *One considers the following system consisting of two subsystems as shown in Figure 2:
**The closed loop system is input-output stable in mean-square for all the subsystems and , if holds for some nonsingular matrices and with .*

*Proof. *According to (12) and the condition in Lemma 3, by defining , and without loss of generality, it can be assumed that

Obviously, we have

Since , system (12) is input-output stable in mean-square, which completes the proof.

Then, to separate the uncertainties from the filtering error system, the time-delay system in (8) is transformed into the interconnection of two subsystems introduced in Lemma 3.

Notice that the time-varying delay can be written as where is the approximation of the time-varying delay , and is the approximation error. Then, we can describe system as

Defining and we can obtain

From (18), we know that mapping includes the uncertainty in leaving only two constant delays and in (16). Then the system in (16) can be described as where

Furthermore, the following lemma shows that the scaled small gain of the mapping has an upper bound.

Lemma 4. * has an upper bound:
*

*Proof. *By using Jensen's inequality, it can be derived under zero initial condition according to the fact that ,
where , which implies . The proof is completed.

Now, we are in the position to propose the sufficient conditions under which the filtering error system (8) is stochastically stable with a prescribed performance attention level . First we assume the filter matrices , , and are fixed and the corresponding conditions are established in the following theorem.

Theorem 5. *Consider system (1), and assume the filter matrices , , and are fixed. Given integers and a constant , the filtering error system (16) is input-output stable in mean-square with an performance attention level for any time-varying delay satisfying (2) if there exist matrices , , , satisfying
**
where
*

*Proof. *Choose the following Lyapunov-Krasovskii functional:
with
where and are the matrices to be determined.

Defining , we have
where .

Moreover, define

Together with (25), and according to and , we have

It is obvious that , if
which, by Schur complement, is equivalent to (23). Therefore, defining , we have , if (23) holds, which means
if Theorem 5 holds, which means the SSG of subsystem satisfying . By Lemmas 3 and 4, the filtering error system (16) is input-output stable in mean-square. Furthermore, we can obtain from (31) together with (22). The proof is completed.

Theorem 5 guarantees the input-output stability in mean-square of system in (19). Through the following research, it can be proved that the system in (19) is stochastically stable by Lyapunov-Krasovskii functional method.

Theorem 6. *For the forward system in (19) with , if there exists an LKF and satisfying , then the system in (19) is stochastically stable by the following LKF:
*

*Proof. *Defining ; we have
which is implied by (23). Let , we have

By summing up the inequality on both sides from , it can be obtained that

When , we have
which implies that the systems in (19) are stochastically stable. The proof is completed.

#### 4. Filter Design

Theorem 7. *Consider the Markov jump system (1). For given integers and a constant , if there exist matrices , , , , , , , , , and such that
**
where
**
then, there exists an filter of the type (3) such that the filtering error system in (8) is stochastically stable with a prescribed performance level . Furthermore, the filter gains are given by
*

*Proof. *Suppose there exist matrices , , , , , , , and satisfying (23). Partition as
and define matrices and as follows:

According to the construction of and and the fact that and are nonsingular even disturbed by a small perturbation, it is obvious that matrix is invertible. Let

Then, multiply (23) by from the left side and its transpose from the right side, respectively, and define
we obtain (37).

On the other hand, suppose that matrices , , , , , , , , , and satisfy (37). Introduce and nonsingular square matrices and satisfying . By Schur complement, is equivalent to and . Then, without loss of generality, setting yields (39). The proof is completed.

#### 5. Numerical Example

In this section, we provide an example to demonstrate the effectiveness of the filter design method proposed in the preceding sections.

Consider system (1) with the following parameters: and the mode switching is governed by a Markov chain with transition probability:

Suppose and and the initial condition , . Then, by Theorem 7, a filter in the form of (3) is designed such that the system (8) is stochastically stable with a guaranteed performance level .

Suppose the packet loss parameter is as shown in Figure 3. By (37), it can be obtained that the minimum performance , and and the filter matrices are as follows:

In addition, by (39), we have

To illustrate the performance of the filter, it is assumed that the external disturbance . By calculation, the switching of Markov chain is shown in Figure 4. Figure 5 shows the system state and its estimation and signal and its estimation . Moreover, it can be obtained that the and as shown in Figure 5, that yields which is below the minimum , demonstrating the effectiveness of the proposed filter design.

**(a) and estimation**

**(b) and estimation**

**(c) and estimation**

**(d) signal**

#### 6. Conclusion

This paper addresses the filtering problem for time-delay Markov jump systems subject to intermittent measurements. The communication link failure from the plant to the filter is modeled by a stochastic variable satisfying the Bernoulli random binary distribution. The system is transformed into an input-output form consisted of two interconnected subsystems. Based on the SSG Theorem developed to stochastic systems and the proposed Lyapunov-Krasovskii function, sufficient conditions under which the filter can be achieved with the prescribed performance index is established. Finally, a numerical example is presented to demonstrate the effectiveness of the proposed filter design scheme.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgment

This work is supported by National Natural Science Foundation of China (Grant no. 61304102) and Natural Science Foundation of Liaoning Province of China (Grant no. 2013020002).

#### References

- H. Gao, W. Sun, and P. Shi, “Robust sampled-data ${H}_{\infty}$ control for vehicle active suspension systems,”
*IEEE Transactions on Control Systems Technology*, vol. 18, no. 1, pp. 238–245, 2010. View at: Publisher Site | Google Scholar - P. Shi, E. Boukas, and R. K. Agarwal, “Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters,”
*IEEE Transactions on Automatic Control*, vol. 44, no. 8, pp. 1592–1597, 1999. View at: Publisher Site | Google Scholar | Zentralblatt MATH - W. Sun, Y. Zhao, J. Li, L. Zhang, and H. Gao, “Active suspension control with frequency band constraints and actuator input delay,”
*IEEE Transactions on Industrial Electronics*, vol. 59, no. 1, pp. 530–537, 2012. View at: Publisher Site | Google Scholar - L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded ${L}_{2}$ gain performance of Markovian jump singular time-delay systems,”
*Automatica*, vol. 48, no. 8, pp. 1929–1933, 2012. View at: Google Scholar - S. Yin, S. Ding, A. Abandan Sari, and H. Hao, “Data-driven monitoring for stochastic systems and its application on batch process,”
*International Journal of Systems Science*, vol. 44, no. 7, pp. 1366–1376, 2013. View at: Google Scholar - S. Yin, H. Luo, and S. Ding, “Real-time implementation of fault-tolerant control systems with performance optimization,”
*IEEE Transactions on Industrial Electronics*, 2013. View at: Publisher Site | Google Scholar - M. Liu, D. W. C. Ho, and Y. Niu, “Stabilization of Markovian jump linear system over networks with random communication delay,”
*Automatica*, vol. 45, no. 2, pp. 416–421, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - M. Liu, D. W. C. Ho, and Y. Niu, “Robust filtering design for stochastic system with mode-dependent output quantization,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 12, pp. 6410–6416, 2010. View at: Publisher Site | Google Scholar - X. Meng, J. Lam, B. Du, and H. Gao, “A delay-partitioning approach to the stability analysis of discrete-time systems,”
*Automatica*, vol. 46, no. 3, pp. 610–614, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH - L. Wu, P. Shi, H. Gao, and C. Wang, “A new approach to robust ${H}_{\infty}$ filtering for uncertain systems with both discrete and distributed delays,”
*Circuits, Systems, and Signal Processing*, vol. 26, no. 2, pp. 229–248, 2007. View at: Publisher Site | Google Scholar - L. Wu, X. Yao, and W. Zheng, “Generalized ${H}_{2}$ fault detection for two-dimensional Markovian jump systems,”
*Automatica*, vol. 48, no. 8, pp. 1741–1750, 2012. View at: Google Scholar - L. Wu and W. X. Zheng, “Passivity-based sliding mode control of uncertain singular time-delay systems,”
*Automatica*, vol. 45, no. 9, pp. 2120–2127, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust ${H}_{\infty}$ filtering for stochastic time-delay systems with missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 54, no. 7, pp. 2579–2587, 2006. View at: Publisher Site | Google Scholar - F. Yang, Z. Wang, D. W. C. Ho, and X. Liu, “Robust ${H}_{2}$ filtering for a class of systems with stochastic nonlinearities,”
*IEEE Transactions on Circuits and Systems II*, vol. 53, no. 3, pp. 235–239, 2006. View at: Publisher Site | Google Scholar - Z. Wang, D. Ho, and X. Liu, “Variance-constrained filtering for uncertain stochastic systems with missing measurements,”
*IEEE Transactions on Automatic Control*, vol. 48, no. 7, pp. 1254–1258, 2003. View at: Publisher Site | Google Scholar - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust finite-horizon filtering for stochastic systems with missing measurements,”
*IEEE Signal Processing Letters*, vol. 12, no. 6, pp. 437–440, 2005. View at: Publisher Site | Google Scholar - D. Yue, Q. Han, and J. Lam, “Network-based robust ${H}_{\infty}$ control of systems with uncertainty,”
*Automatica*, vol. 41, no. 6, pp. 999–1007, 2005. View at: Publisher Site | Google Scholar - H. Gao and T. Chen, “New results on stability of discrete-time systems with time-varying state delay,”
*IEEE Transactions on Automatic Control*, vol. 52, no. 2, pp. 328–334, 2007. View at: Publisher Site | Google Scholar - P. Bliman, “Extension of Popov absolute stability criterion to non-autonomous systems with delays,”
*International Journal of Control*, vol. 73, no. 15, pp. 1349–1361, 2000. View at: Publisher Site | Google Scholar | Zentralblatt MATH - C. Kao and B. Lincoln, “Simple stability criteria for systems with time-varying delays,”
*Automatica*, vol. 40, no. 8, pp. 1429–1434, 2004. View at: Publisher Site | Google Scholar | Zentralblatt MATH - K. Gu, Y. Zhang, and S. Xu, “Small gain problem in coupled differential-difference equations, time-varying delays, and direct Lyapunov method,”
*International Journal of Robust and Nonlinear Control*, vol. 21, no. 4, pp. 429–451, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH - X. Li and H. Gao, “A new model transformation of discrete-time systems with time timevarying delay and its application to stability analysis,”
*IEEE Transactions on Automatic Control*, no. 99, pp. 2172–2178, 2011. View at: Google Scholar - P. Seiler and R. Sengupta, “An ${H}_{\infty}$ approach to networked control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 3, pp. 356–364, 2005. View at: Publisher Site | Google Scholar - K. Gu, V. Kharitonov, and J. Chen,
*Stability of Time-Delay Systems*, Birkhäauser, Boston, Mass, USA, 2003.

#### Copyright

Copyright © 2013 Jia You et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.