Further Results on Stability Analysis of Discrete-Time Markov Jump Linear Systems with Time-Varying Delay and Partly Known Transition Probabilities

Zhao, Xingang; Han, Jianda; Zhao, Yiwen

doi:https://doi.org/10.1155/2015/524584

Mathematical Problems in Engineering

On this page

Abstract Introduction Preliminaries Conclusions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 524584 | https://doi.org/10.1155/2015/524584

Further Results on Stability Analysis of Discrete-Time Markov Jump Linear Systems with Time-Varying Delay and Partly Known Transition Probabilities

Xingang Zhao,¹Jianda Han,¹and Yiwen Zhao¹

Academic Editor: Quanxin Zhu

Received08 Aug 2014

Revised23 Oct 2014

Accepted23 Oct 2014

Published02 Mar 2015

Abstract

This paper is concerned with the stability analysis of discrete-time Markov jump linear systems (MJLSs) with time-varying delay and partly known transition probabilities. The time delay is varying between lower and upper bounds, and the partly known transition probabilities cover the cases of known, uncertain with known lower and upper bounds, and completely unknown, which is more general than the existing result. Via constructing an appropriate Lyapunov function and employing a new technique to separate Lyapunov variables from unknown transition probabilities, a novel stability criterion is obtained in the framework of linear matrix inequality. A numerical example is given to show the effectiveness of the proposed approach.

1. Introduction

Markov jump linear systems (MJLSs), a class of stochastic systems, have been widely applied in manufacturing systems, power systems, aerospace systems, and networked control systems. This is due to its ability to model many practical systems with abrupt random changes in their structures and parameters. Regarding the details on the basic theory of MJLSs, for example, controllability, observability, stability, stabilisability, and optimal control, and so forth, please refer to [1–8] and the references therein.

Time delay, unavoidable in many practical systems, can degrade the closed loop system performance or even lead the resulting system to be unstable. In recent years, therefore, the time delay problem has been widely studied and a great number of research results concerning this point exist in the references for linear system; see, for example, [9–13] and so on. Regarding the study of MJLSs with time delay, mean square stochastic stability conditions are presented in [7] and exponential stability conditions are proposed in [8]. However, these results are delay independent. To make full use of the available information on the size of delays, delay-dependent results are more attractive. Employing a model transformation, delay-dependent stability conditions for MJLSs with constant delay are proposed in [14]. To derive less conservative results, this idea was further improved by [15, 16]. Instead of using model transformation or bounding for cross terms, zero equations are utilized by [17]. Considering the fact that time delay for practical system is time varying, based on the free weighting matrix technique, [18] proposes a less conservative stability criterion for MJLSs with time-varying delays. By introducing some improved integral equalities, a new stability condition for MJLSs with time-varying delay is proposed in [19]. Motivated by above results, [20] proposes improved stochastic stability conditions for MJLSs with interval time delay. Regarding the stability analysis of Markovian jump neural systems with mixed delay, sample data control, impulse control, and exponential stability are investigated in [21–27]. With resorting to new technique to deal with the time delay, based on a Lyapunov-Krasovskii functional and the stochastic analysis theory, some novel sufficient conditions are established in the framework of linear matrix inequalities [22–27]. It deserves to note that all above results are based on transition probabilities which are known. Practically, it is hard or costly to obtain the complete knowledge on the transition probabilities [28, 29]. A typical example can be found in networked control systems (NCSs). Due to the complexity of the network environment, the variation of delays could be vague and random, which leads to the fact that all or part of the elements in the expected transition probabilities matrix are probably hard or expensive to obtain [28–32]. To be consistent with the actual situation, transition probabilities in [28–32] are assumed to be known or unknown. With this assumption, stability analysis of MJLSs with time-varying delay is investigated in [32]. However, in these results, when transition probabilities are unknown with known lower and upper bounds, they are treated as completely unknown, which may cause conservativeness. Moreover, the technique to separate Lyapunov variables and unknown transition probabilities in [32] still leaves some room for further improvement.

Motivated by the above observations, this paper is devoted to the stability analysis of discrete-time MJLSs with time-varying delay and partly known transition probabilities. The boundary information of time-varying delay is made full use of and the partly known transition probabilities include the cases of known, uncertain with known lower and upper bounds, and completely unknown, which is more general than the existing result. Via constructing an appropriate Lyapunov-Krasovskii functional, combining the property of transition probabilities and free weighted matrix technique, a novel stability criterion is obtained in the framework of linear matrix inequality. A numerical example is utilized to show the effectiveness of the proposed approach.

The rest of the paper is organized as follows. Section 2 gives the problem description, in Section 3, a novel theorem about delay range dependent stability for systems with more general transition probabilities is derived by using Lyapunov function method, Section 4 illustrates the efficiency of the proposed method, and Section 5 concludes this paper.

Notation. denotes the dimensional Euclidean space and the notation means that is real symmetric and positive definite (semidefinite). represents the set of positive integers. In symmetric block matrices or complex matrix expressions, we use an asterisk to represent a term that is induced by symmetry and stands for a block-diagonal matrix. and represent, respectively, the identity matrix and zero matrix.

2. System Description and Preliminaries

Consider the following class of discrete-time Markov jump linear systems: where is the state vector. The time delay is considered to be time-varying with known lower and upper bounds, namely, . () is a discrete-time homogeneous Markov chain, which takes values in a finite set with the following mode transition probabilities: where and .

Considering the fact that transition probabilities are hard to be measured exactly, they are assumed to be known, unknown with known lower and upper bounds, and completely unknown in this context [31]. To present the considered transition probabilities clearly, an example of partly known transition probability matrix is given in the following: where “” denotes that the corresponding element is completely unknown, and , represent unknown elements with known bounds, and represents the exactly known elements. Subsequently, all transition probabilities in the above matrix can be classified by the following two sets:

Remark 1. With the fact that known transition probabilities can be treated as equal lower and upper bounds, that is to say, , the first set, , includes not only unknown transition probabilities with known bounds but also completely known case.

Before proceeding further, let us introduce the following stability definition.

Definition 2. System (1) is said to be stochastically stable if for every initial condition , and , the following holds:

3. Main Results

In this part, a new delay-dependent stochastic stability condition for MJLSs with partly known transition probabilities is presented in the following theorem.

Theorem 3. Consider the MJLSs (1) with partly known transition probabilities (3), if there exist symmetric matrices , , , , , , , , , , such that where

Proof. Consider system (1) and construct a stochastic Lyapunov functional as where
Defining , it follows that
Summing up (10), one has
Therefore, we have where
On the other hand, the following formula holds:
Considering the fact that , it yields Since transition probabilities are partly known, we have and . Therefore, it follows that
According to (6), we can get .

Remark 4. According to Theorem 3, when calculating the forward difference of , is divided as and .

Remark 5. Different from the existing result [32], to separate Lyapunov variables from unknown transition probabilities, the property of transition probabilities is made full use of, namely, . Thanks to this separation, the method proposed in Theorem 3 is less conservative than that of [32].

4. Illustrative Example

To show the effectiveness of the proposed method, a numerical example is given below.

Example 1. Consider the MJLSs (1) with four operation modes and the following system matrices: Our purpose is to check the stability of (1) with different cases of transition probabilities.

Case 1. Transition probabilities are known In this case, given and , system (1) is unstable even if all the transition probabilities are known. It implies that the underlying system will be unstable for any time-varying delay starting from .

Case 2. Transition probabilities are partly known In this case, we assume that the range of the time-varying delay belongs to . By solving the conditions given in Theorem 1 of [32] and Theorem 3 in this paper, respectively, no feasible solution can be found for the former. Therefore, the method proposed in this paper is less conservative than the existing result.

Case 3. We consider the case that there are unknown elements in the transition probability matrix varying an interval where .
By solving the conditions given in Theorem 3, Table 1 is obtained.
According to Table 1, it can be seen that the more transition probabilities knowledge we have, the larger the delay range can be obtained.

5. Conclusions

The stability analysis for a class of discrete-time MJLSs with time-varying delay and partly known transition probabilities is investigated in this paper. To separate Lyapunov variables from unknown transition probabilities, the property of transition probabilities is made full use of. Via constructing an appropriate Lyapunov function, a novel stability criterion is obtained in the framework of linear matrix inequality. The effectiveness of the proposed approach is demonstrated by a numerical example. In the future, the obtained results are considered to be extended to deal with the fault tolerant control of Markov jump systems with partly known transition probabilities and mixed time-varying delay.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work is supported by the National Natural Science Foundation of China (Grants nos. 61273355, 61273356, and 61035005), the Foundation of State Key Laboratory of Robotics (Grant no. Z2013-06), and Natural Science Foundation of Liaoning Province, China (Grant no. 2014020082).

References

O. L. Costa, M. D. Fragoso, and R. P. Marques, Discrete-Time Markov Jump Linear Systems, Springer, London, UK, 2005.
View at: Publisher Site | MathSciNet
C. E. de Souza, A. Trofino, and K. A. Barbosa, “Mode-independent $H_{\infty}$ filters for Markovian jump linear systems,” IEEE Transactions on Automatic Control, vol. 51, no. 11, pp. 1837–1841, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
C. E. de Souza, “Robust stability and stabilization of uncertain discrete-time Markovian jump linear systems,” IEEE Transactions on Automatic Control, vol. 51, no. 5, pp. 836–841, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
A. P. Goncalves, A. R. Fioravanti, and J. C. Geromel, “ $H_{\infty}$ filtering of discrete-time Markov jump linear systems through linear matrix inequalities,” IEEE Transactions on Automatic Control, vol. 54, no. 6, pp. 1347–1351, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, “pth moment exponential stability of impulsive stochastic functional differential equations with Markovian switching,” Journal of the Franklin Institute, vol. 351, no. 7, pp. 3965–3986, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
D. Li and Q. Zhu, “Comparison principle and stability of stochastic delayed neural networks with Markovian switching,” Neurocomputing, vol. 123, pp. 436–442, 2014.
View at: Publisher Site | Google Scholar
K. Benjelloun and E. K. Boukas, “Mean square stochastic stability of linear time-delay system with Markovian jumping parameters,” IEEE Transactions on Automatic Control, vol. 43, no. 10, pp. 1456–1460, 1998.
View at: Publisher Site | Google Scholar | MathSciNet
H. Fujisaki, “On correlation values of $M$ -phase spreading sequences of Markov chains,” IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, vol. 49, no. 12, pp. 1745–1750, 2002.
View at: Publisher Site | Google Scholar | MathSciNet
D. Ye and G. H. Yang, “Delay-dependent adaptive reliable $H_{\infty}$ control of linear time-varying delay systems,” International Journal of Robust and Nonlinear Control, vol. 19, no. 4, pp. 462–479, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
D. Ye and G.-H. Yang, “Robust switching-type $H_{\infty}$ filter design for linear uncertain systems with time-varying delay,” Information Sciences, vol. 181, no. 9, pp. 1686–1699, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
H. Gao and T. Chen, “New results on stability of discrete-time systems with time-varying state delay,” IEEE Transactions on Automatic Control, vol. 52, no. 2, pp. 328–334, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
S. Xu and J. Lam, “Improved delay-dependent stability criteria for time-delay systems,” IEEE Transactions on Automatic Control, vol. 50, no. 3, pp. 384–387, 2005.
View at: Publisher Site | Google Scholar | MathSciNet
Y. He, Q. Wang, C. Lin, and M. Wu, “Delay-range-dependent stability for systems with time-varying delay,” Automatica, vol. 43, no. 2, pp. 371–376, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
E. K. Boukas, Z. K. Liu, and P. Shi, “Delay-dependent stability and output feedback stabilisation of Markov jump system with time-delay,” IEE Proceedings: Control Theory and Applications, vol. 149, no. 5, pp. 379–386, 2002.
View at: Publisher Site | Google Scholar
W.-H. Chen, J.-X. Xu, and Z.-H. Guan, “Guaranteed cost control for uncertain Markovian jump systems with mode-dependent time-delays,” IEEE Transactions on Automatic Control, vol. 48, no. 12, pp. 2270–2277, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
Y.-Y. Cao, J. Lam, and L. Hu, “Delay-dependent stochastic stability and $H_{\infty}$ analysis for time-delay systems with Markovian jumping parameters,” Journal of the Franklin Institute. Engineering and Applied Mathematics, vol. 340, no. 6-7, pp. 423–434, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
J. Wu, T. W. Chen, and L. Wang, “Delay-dependent robust stability and $H_{\infty}$ control for jump linear systems with delays,” Systems & Control Letters, vol. 55, no. 11, pp. 939–948, 2006.
View at: Publisher Site | Google Scholar
S. Xu, J. Lam, and X. Mao, “Delay-dependent $H_{\infty}$ control and filtering for uncertain Markovian jump systems with time-varying delays,” IEEE Transactions on Circuits and Systems. I. Regular Papers, vol. 54, no. 9, pp. 2070–2077, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
J. Wang and Y. Luo, “Further improvement of delay-dependent stability for Markov jump systems with time-varying delay,” in Proceedings of the 7th IEEE World Congress on Intelligent Control and Automation (WCICA '08), pp. 6319–6324, Chongqing, China, June 2008.
View at: Publisher Site | Google Scholar
X. D. Zhao and Q. S. Zeng, “Delay-dependent stability analysis for Markovian jump systems with interval time-varying-delays,” International Journal of Automation and Computing, vol. 7, no. 2, pp. 224–229, 2010.
View at: Publisher Site | Google Scholar
Z.-G. Wu, P. Shi, H. Su, and J. Chu, “Stochastic synchronization of markovian jump neural networks with time-varying delay using sampled data,” IEEE Transactions on Cybernetics, vol. 43, no. 6, pp. 1796–1806, 2013.
View at: Publisher Site | Google Scholar
R. Rakkiyappan, Q. Zhu, and T. Radhika, “Design of sampled data state estimator for Markovian jumping neural networks with leakage time-varying delays and discontinuous Lyapunov functional approach,” Nonlinear Dynamics, vol. 73, no. 3, pp. 1367–1383, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu and J. Cao, “Robust exponential stability of markovian jump impulsive stochastic Cohen-Grossberg neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 21, no. 8, pp. 1314–1325, 2010.
View at: Publisher Site | Google Scholar
Q. Zhu and J. Cao, “Stability analysis of markovian jump stochastic BAM neural networks with impulse control and mixed time delays,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 3, pp. 467–479, 2012.
View at: Publisher Site | Google Scholar
Q. Zhu and J. Cao, “Exponential stability of stochastic neural networks with both Markovian jump parameters and mixed time delays,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 41, no. 2, pp. 341–353, 2011.
View at: Publisher Site | Google Scholar
Q. Zhu and J. Cao, “Stability of Markovian jump neural networks with impulse control and time varying delays,” Nonlinear Analysis: Real World Applications, vol. 13, no. 5, pp. 2259–2270, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, F. Xi, and X. Li, “Robust exponential stability of stochastically nonlinear jump systems with mixed time delays,” Journal of Optimization Theory and Applications, vol. 154, no. 1, pp. 154–174, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
L. Zhang and E.-K. Boukas, “Mode-dependent filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities,” Automatica, vol. 45, no. 6, pp. 1462–1467, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
L. Zhang and J. Lam, “Necessary and sufficient conditions for analysis and synthesis of Markov jump linear systems with incomplete transition descriptions,” IEEE Transactions on Automatic Control, vol. 55, no. 7, pp. 1695–1701, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
L. Zhang, E.-K. Boukas, and P. Shi, “ $H_{\infty}$ model reduction for discrete-time Markov jump linear systems with partially known transition probabilities,” International Journal of Control, vol. 82, no. 2, pp. 343–351, 2009.
View at: Publisher Site | Google Scholar
M. Shen, G. Zhang, Y. Yuan, and D. Ye, “Relaxed $H_{\infty}$ controller design for continuous Markov jump system with incomplete transition probabilities,” Circuits, Systems, and Signal Processing, vol. 33, no. 5, pp. 1393–1410, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
L. Zhang, E.-K. Boukas, and J. Lam, “Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities,” IEEE Transactions on Automatic Control, vol. 53, no. 10, pp. 2458–2464, 2008.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2015 Xingang Zhao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

824

Downloads

796

Citations