## Advanced Stochastic Control Systems with Engineering Applications

View this Special IssueResearch Article | Open Access

Yanbo Li, Yonggui Kao, Jing Xie, "Robust Guaranteed Cost Observer Design for Singular Markovian Jump Time-Delay Systems with Generally Incomplete Transition Probability", *Abstract and Applied Analysis*, vol. 2014, Article ID 832891, 11 pages, 2014. https://doi.org/10.1155/2014/832891

# Robust Guaranteed Cost Observer Design for Singular Markovian Jump Time-Delay Systems with Generally Incomplete Transition Probability

**Academic Editor:**Shen Yin

#### Abstract

This paper is devoted to the investigation of the design of robust guaranteed cost observer for a class of linear singular Markovian jump time-delay systems with generally incomplete transition probability. In this singular model, each transition rate can be completely unknown or only its estimate value is known. Based on stability theory of stochastic differential equations and linear matrix inequality (LMI) technique, we design an observer to ensure that, for all uncertainties, the resulting augmented system is regular, impulse free, and robust stochastically stable with the proposed guaranteed cost performance. Finally, a convex optimization problem with LMI constraints is formulated to design the suboptimal guaranteed cost filters for linear singular Markovian jump time-delay systems with generally incomplete transition probability.

#### 1. Introduction

Descriptor systems are also referred to as singular systems, implicit systems, generalized state-space systems, or semistate systems and provide convenient and natural representations in the description of economic systems, power systems, robotics, network theory, and circuits systems [1]. The stability for singular system is more complicated than that for nonsingular systems because not only the asymptotic stability but also the system regularity and impulse elimination are needed to be addressed [2–5].

In practice, in many physical systems, such as aircraft control, solar receiver control, power systems, manufacturing systems, networked control systems, air intake systems, and other practical systems, abrupt variations may happen in their structure, due to random failures, repair of components, sudden environmental disturbances, changing subsystem interconnections, or abrupt variations in the operating points of a nonlinear plant [6–19]. Therefore, more and more attention has been paid to the problem of stochastic stability and stochastic admissibility for singular Markovian jump systems (SMJSs) [20–30]. Long et al. [23] derived stochastic admissibility for a class of singular Markovian jump systems with mode-dependent time delays. Wang and Zhang [27] focused on the asynchronous filtering for discrete-time stochastic Markov jump systems with randomly occurring sensor nonlinearities. However, the TRs in the above mentioned literatures are assumed to be completely known.

In practice, the TRs in some jumping processes are difficult to be precisely estimated due to the cost and some other factors. Therefore, analysis and synthesis problems for normal MJSs with incomplete information on transition probability have attracted more and more attentions [31–49]. Xiong and Lam [32] probed robust control of Markovian jump systems with uncertain switching probabilities. Karan et al. [33] considered the stochastic stability robustness for continuous-time and discrete-time Markovian jump linear systems (MJLSs) with upper bounded TRs. Zhang and Boukas [34] discussed stability and stabilization for the continuous-time MJSs with partly unknown TRs. Lin et al. [38] considered delay-dependent filtering for discrete-time singular Markovian jump systems with time-varying delay and partially unknown transition probabilities. Guo and Wang [49] proposed another description for the uncertain TRs, which is called generally uncertain TRs (GUTRs).

On the other hand, state estimation plays an important role in systems and control theory, signal processing, and information fusion [50, 51]. Certainly, the most widely used estimation method is the well-known Kalman filtering [52, 53]. A common feature in the Kalman filtering is that an accurate model is available. In some applications, however, when the system is subject to parameter uncertainties, the accurate system model is hard to obtain. To overcome this difficulty, the guaranteed cost filtering approach has been proposed to ensure the upper bound of guaranteed cost function [54]. Robust filtering for uncertain Markovian jump systems with mode-dependent time delays was proposed in [55]. In [56], guaranteed cost and filtering for time-delay systems were presented in terms of LMIs. However, to the best of our knowledge, there are few considering the robust guaranteed cost observer for a class of linear singular Markovian jump time-delay systems with generally incomplete transition probability, which is still an open problem.

In this paper, based on LMI method, we address the design problem of the robust guaranteed cost observer for a class of uncertain descriptor time-delay systems with Markovian jumping parameters and generally uncertain transition rates. The design problem proposed here is to design a memoryless observer such that for all uncertainties, including generally uncertain transition rates, the resulting augmented system is regular, impulse-free, and robust stochastically stable, and satisfies the proposed guaranteed cost performance.

#### 2. Problem Formulation

Consider the following descriptor time-delay systems with Markovian jumping parameters: where and are the state vector and the controlled output, respectively. represents the state time delay. For convenience, the input terms in system (1) have been omitted. is a continuous vector-valued initial function. The random parameter represents a continuous-time discrete-state Markov process taking values in a finite set and having the transition probability matrix . The transition probability from mode to mode is defined by where satisfies , is the transition probability from mode to mode and satisfies In this paper, the transition rates of the jumping process are assumed to be partly available; that is, some elements in matrix have been exactly known, some have been merely known with lower and upper bounds, and others may have no information to use. For instance, for system (1) with four operation modes, the transition rate matrix might be described by where and represent the estimate value and estimate error of the uncertain TR , respectively, where and are known. ? represents the complete unknown TR, which means that its estimate value and estimate error bound are unknown.

For notational clarity, for all , the set denotes with , . Moreover, if , it is further described as , where represents the th bound-known element with the index in the th row of matrix . We assume that the known estimate values of the TRs are well defined. That is

*Assumption 1. *If , then , and .

*Assumption 2. *If and , then , and .

*Assumption 3. *If and , then .

*Remark 4. *The above assumption is reasonable, since it is the direct result from the properties of the TRs (e.g., and ). The above description about uncertain TRs is more general than either the MJSs model with bounded uncertain TRs or the MJSs model with partly uncertain TRs. If , then generally uncertain TR matrix (4) reduces to bounded uncertain TR matrix (5) as follows:
where , , and ; if , then generally uncertain TR matrix (4) reduces to partly uncertain TR matrix (6) as follows:
Our results in this paper can be applicable to the general Markovian jump systems with bounded uncertain or partly uncertain TR matrix.

, , , and are matrix functions of the random jumping process . To simplify the notion, the notation represents when . For example, is denoted by and so on. Further, for each , it is assumed that the matrices , , , and can be described by the following form:
where are known real coefficient matrices with appropriate dimensions. Time-varying matrices , , and represent norm-bounded uncertainties and satisfy
where , and are known constant real matrices of appropriate dimensions, which represent the structure of uncertainties, and is an unknown matrix function with Lebesgue measurable elements and satisfies .

Further, for convenience, we assume that the system has the same dimension at each mode and the Markov process is irreducible. Consider the following nominal unforced descriptor time-delay system:

Let , and be the initial state, initial mode, and the corresponding solution of the system (9) at time , respectively.

*Definition 5. *System (9) is said to be stochastically stable if, for all and initial mode , there exists a matrix such that

The following definition can be regarded as an extension of the definition in [2].

*Definition 6. * System (9) is said to be regular if det are not identically zero.

System (9) is said to be impulse free if deg.

System (9) is said to be admissible if it is regular, impulse free, and stochastically stable.

The linear memoryless observer under consideration is as follows:
where is the observer state, and the constant matrices and are observer parameters to be designed.

Denote the error state , and the augmented state vector . Let represent the output of the error states, where is a known constant matrix. Define
and combine (1) and (11); then we derive the augmented systems as follows:
Similar to [5], it is also assumed in this paper that, for all , there exists a scalar such that .

Associated with system (13) is the cost function

*Definition 7. *Consider the augmented system (13), if there exist the observer parameters and a positive scalar , for all uncertainties, such that the augmented system (13) is robust, stochastically stable and the value of the cost function (14) satisfies , then is said to be a robust guaranteed cost and observer (11) is said to be a robust guaranteed cost observer for system (1) with (4).

*Problem 8 (robust guaranteed cost observer problem for a class of linear singular Markovian jump time-delay systems with generally incomplete transition probability). *Given system (1) with GUTR Matrix (4), can we determine an observer (11) with parameters and such that the observer is a robust guaranteed cost observer for system (1) with GUTR Matrix (4)?

Lemma 9. *Given any real number and any matrix Q, the matrix inequality holds for any matrix .*

#### 3. Main Results

Theorem 10. *Consider the augmented system (13) with GUTR Matrix (4) and the cost function (14). Then the robust guaranteed cost observer (11) with parameters and can be designed if there exist matrices , , and , and symmetric positive definite matrix , satisfying the following LMIs, respectively:**Case *1. If and , there exist a set of symmetric positive definite matrices such that
*Case 2*. If , and , there exist a set of symmetric positive definite matrices such that
*Case 3*. If and , there exist a set of symmetric positive definite matrices such that
*
where
*

*Proof. *According to Definition 2 and Theorem 1 in [2], we can derive from (15)–(21) that system (13) is regular and impulse free. Let the mode at time be , and consider the following Lyapunov function with respect to the augmented system (13)
where is the symmetric positive definite matrix to be chosen, and is a matrix satisfying (15)–(21). The weak infinitesimal operator of the stochastic process , is presented by
*Case 1* (). Note that in this case and ; then from (24), we have

On the other hand, in view of Lemma 9, we have
*Case 2* ( and ). Because of and , there must be so that :

By using Lemma 9, we have
*Case 3 *( and ). Consider
*Case 1*. Substituting (25) and (26) into (24), it results in
where and
*Case 2*. Substituting (27) and (28) into (24), it results in
where and
*Case 3.* Substituting (29) into (24), we get
where and
Similar to [5], using* Dynkin’s* formula, we drive for each :
By Definition 5, it is easy to see that the augmented system (13) is stochastically stable. Furthermore, from (16), (19), and (21), we have
On the other hand, we have
As the augmented system (13) is stochastically stable, it follows from (38) that . From Definition 7, it is concluded that a robust guaranteed cost for the augmented system (13) can be given by .

In the following, based on the above sufficient condition, the design of robust guaranteed cost observers can be turned into the solvability of a system of LMIs.

Theorem 11. *Consider system (13) with GUTR Matrix (4) and the cost function (14). If there exist matrices and positive scalars , symmetric positive definite matrix Q, and the full rank matrices , and matrices , satisfying the following LMIs, respectively.*

*Case 1*. If and , a set of positive definite matrices exist such that

*Case 2*. If and , a set of positive definite matrices exist such that

*Case 3*. If and , a set of positive definite matrices exist such that
where

Then a suitable robust guaranteed cost observer in the form of (11) has parameters as follows: and is a robust guaranteed cost for system (13) with GUTR Matrix (4).

*Proof. *DefineThen (16) is equivalent to
Then (19) is equivalent to
Then (21) is equivalent to
By applying Lemma 2.4 in [57], (50), (51), and (52) hold for all uncertainties satisfying if and only if there exist positive scalars , such that
Let , and using (47), we can conclude from Schur complement results that the above matrix inequalities are equivalent to the coupled LMIs (40), (43), and (45). It further follows from Theorem 10 that is a robust guaranteed cost for system (13) with (4).

*Remark 12. *The solution of LMIs (39)–(45) parameterizes the set of the proposed robust guaranteed cost observers. This parameterized representation can be used to design the guaranteed cost observer with some additional performance constraints. By applying the methods in [14], the suboptimal guaranteed cost observer can be determined by solving a certain optimization problem. This is the following theorem.

Theorem 13. *Consider system (13) with GUTR Matrix (4) and the cost function (14), and suppose that the initial conditions and are known; if the following optimization problem
**
has a solution , and , then the observer (11) is a suboptimal guaranteed cost observer for system (1), where .*

*Proof. *It follows from Theorem 11 that the observer (11) constructed in terms of the solution , and , is a robust guaranteed cost observer. By noting that
it follows that the suboptimal guaranteed cost observer problem is turned into the minimization problem (55).

*Remark 14. *Theorem 13 gives the suboptimal guaranteed cost observer conditions of a class of linear Markovian jumping time-delay systems with generally incomplete transition probability and LMI constraints, which can be easily solved by the LMI toolbox in MATLAB.

#### 4. Numerical Example

In this section, a numerical example is presented to demonstrate the effectiveness of the method mentioned in Theorem 11. Consider a 2-dimensional system (1) with 3 Markovian switching modes. In this numerical example, the singular system matrix is set as , and the 3-mode transition rate matrix is , where ; and . The other system matrices are as follows.

For mode , there are

For mode , there are

For mode , there are

Then, we set the error state matrix , and the positive scalars in Theorem 11 are . According to the definitions of augmented state matrices in (12), we can easily obtain the following parameter matrices in Theorem 11 by MATLAB

Therefore, we can design a linear memoryless observer as (11) with the constant matrices

Finally, the observer (11) with the above parameter matrices for this numerical example is a suboptimal guaranteed cost observer by Theorems 11 and 13.

#### 5. Conclusions

In this paper, the robust guaranteed cost observer problem for a class of uncertain descriptor time-delay systems with Markovian jumping parameters and generally uncertain transition rates is studied by using LMI method. In this GUTR singular model, each transition rate can be completely unknown or only its estimate value is known. The parameter’s uncertainty is time varying and is assumed to be norm-bounded. Memoryless guaranteed cost observers are designed in terms of a set of linear coupled matrix inequalities. The suboptimal guaranteed cost observer is designed by solving a certain optimization problem. Our results can be applicable to the general Markovian jump systems with bounded uncertain or partly uncertain TR matrix.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This research is supported by the National Natural Science Foundations of China (10701020, 10971022, 60973048, 61272077, 60974025, 60673101, and 60939003), NCET-08-0755, National 863 Plan Project (2008 AA04Z401, 2009AA043404), SDPW IMZQWH010016, the Natural Science Foundation of Shandong Province (no. ZR2012FM006), the Scientific and Technological Project of Shandong Province (no. 2007GG3WZ04016), and the Natural Science Foundation of Guangxi Autonomous Region (no. 2012GXNSFBA053003).

#### References

- L. Dai,
*Singular Control Systems*, Springer, Berlin, Germany, 1989. View at: Publisher Site | MathSciNet - S. Xu, P. V. Dooren, R. Ştefan, and J. Lam, “Robust stability and stabilization for singular systems with state delay and parameter uncertainty,”
*IEEE Transactions on Automatic Control*, vol. 47, no. 7, pp. 1122–1128, 2002. View at: Publisher Site | Google Scholar | MathSciNet - M. Fu and G. Duan, “Robust guaranteed cost observer for uncertain descriptor time-delay systems with Markovian jumping parameters,”
*Acta Automatica Sinica*, vol. 31, pp. 479–483, 2005. View at: Google Scholar - Y. Q. Xia, E.-K. Boukas, P. Shi, and J. H. Zhang, “Stability and stabilization of continuous-time singular hybrid systems,”
*Automatica*, vol. 45, no. 6, pp. 1504–1509, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - S. Xu and J. Lam,
*Robust Control and Filtering of Singular Systems*, Springer, Berlin, Germany, 2006. View at: MathSciNet - Y.-Y. Cao and J. Lam, “Robust ${H}_{\infty}$ control of uncertain Markovian jump systems with time-delay,”
*IEEE Transactions on Automatic Control*, vol. 45, no. 1, pp. 77–83, 2000. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y. Li and Y. Kao, “Stability of stochastic reaction-diffusion systems with Markovian switching and impulsive perturbations,”
*Mathematical Problems in Engineering*, vol. 2012, Article ID 429568, 13 pages, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. Mao and C. Yuan,
*Stochastic Differential Equations with Markovian Switching*, Imperial College Press, London, UK, 2006. View at: MathSciNet - E.-K. Boukas,
*Stochastic Switching Systems: Analysis and Design*, Birkhäuser, Basel, Switzerland, 2005. View at: MathSciNet - Y. Kao, C. Wang, and L. Zhang, “Delay-dependent exponential stability of impulsive markovian jumping Cohen-Grossberg neural networks with reaction-diffusion and mixed delays,”
*Neural Processing Letters*, vol. 38, no. 3, pp. 321–346, 2013. View at: Google Scholar - Y.-G. Kao, J.-F. Guo, C.-H. Wang, and X.-Q. Sun, “Delay-dependent robust exponential stability of Markovian jumping reaction-diffusion Cohen-Grossberg neural networks with mixed delays,”
*Journal of the Franklin Institute*, vol. 349, no. 6, pp. 1972–1988, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Y. Kao, C. Wang, F. Zha, and H. Cao, “Stability in mean of partial variables for stochastic reaction—diffusion systems with Markovian switching,”
*Journal of the Franklin Institute*, vol. 351, no. 1, pp. 500–512, 2014. View at: Publisher Site | Google Scholar | MathSciNet - N. Kumaresan and P. Balasubramaniam, “Optimal control for stochastic nonlinear singular system using neural networks,”
*Computers & Mathematics with Applications*, vol. 56, no. 9, pp. 2145–2154, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Yu and J. Chu, “An LMI approach to guaranteed cost control of linear uncertain time-delay systems,”
*Automatica*, vol. 35, no. 6, pp. 1155–1159, 1999. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - S. Yin, H. Luo, and S. Ding, “Real-time implementation of fault-tolerant control systems with performance optimization,”
*IEEE Transactions on Industrial Electronics*, vol. 64, no. 5, pp. 2402–2411, 2014. View at: Google Scholar - S. Yin, G. Wang, and H. Karimi, “Data-driven design of robust fault detection system for wind turbines,”
*Mechatronics*, 2013. View at: Publisher Site | Google Scholar - S. Yin, S. X. Ding, A. H. A. Sari, and H. Hao, “Data-driven monitoring for stochastic systems and its application on batch process,”
*International Journal of Systems Science*, vol. 44, no. 7, pp. 1366–1376, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - S. Yin, S. Ding, A. Haghani, H. Hao, and P. Zhang, “A comparison study of basic datadriven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process,”
*Journal of Process Control*, vol. 22, no. 9, pp. 1567–1581, 2012. View at: Google Scholar - Y. G. Kao and C. H. Wang, “Global stability analysis for stochastic coupled reaction-diffusion systems on networks,”
*Nonlinear Analysis. Real World Applications*, vol. 14, no. 3, pp. 1457–1465, 2013. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - E. K. Boukas, “Stabilization of stochastic singular nonlinear hybrid systems,”
*Nonlinear Analysis. Theory, Methods & Applications*, vol. 64, no. 2, pp. 217–228, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - E.-K. Boukas,
*Control of Singular Systems with Random Abrupt Changes*, Springer, Berlin, Germany, 2008. View at: MathSciNet - Y. Ding, H. Zhu, S. Zhong, and Y. Zeng, “Exponential mean-square stability of time-delay singular systems with Markovian switching and nonlinear perturbations,”
*Applied Mathematics and Computation*, vol. 219, no. 4, pp. 2350–2359, 2012. View at: Publisher Site | Google Scholar | MathSciNet - S. Long, S. Zhong, and Z. Liu, “Stochastic admissibility for a class of singular Markovian jump systems with mode-dependent time delays,”
*Applied Mathematics and Computation*, vol. 219, no. 8, pp. 4106–4117, 2012. View at: Publisher Site | Google Scholar | MathSciNet - Z. Wu, P. Shi, H. Su, and J. Chu, “Asynchronous ${I}_{2}-{I}_{\infty}$ filtering for discrete-time stochastic Markov jump systems with randomly occurred sensor nonlinearities,”
*Automatica*, vol. 50, no. 1, pp. 180–186, 2014. View at: Google Scholar - Z. Wu, P. Shi, H. Su, and J. Chu, “Stochastic synchronization of Markovian jump neural networks with time-varying delay using sampled-data,”
*IEEE Transactions on Cybernetics*, vol. 43, no. 6, pp. 1796–1806, 2013. View at: Publisher Site | Google Scholar - S. Ma and E.-K. Boukas, “Guaranteed cost control of uncertain discrete-time singular Markov jump systems with indefinite quadratic cost,”
*International Journal of Robust and Nonlinear Control*, vol. 21, no. 9, pp. 1031–1045, 2011. View at: Publisher Site |