Research Article  Open Access
New Results on Stability and Stabilization of Markovian Jump Systems with Time Delay
Abstract
This technical paper deals with the problem of stochastic stability and stabilization for a class of linear Markovian jumping systems with discrete timevarying delay. A novel delaydependent stochastic stability criterion for Markovian delay systems is established based on new augmented LyapunovKrasovskii functional and delay fractioning techniques. Then a state feedback controller is designed to guarantee the stochastic stability of the resulting closedloop system. Numerical examples are provided to illustrate the effectiveness of the proposed design approach in this paper.
1. Introduction
Markovian jump systems are a special class of hybrid systems with both modes and state variables. Since many dynamical systems such as the chemical processes, transportation systems, and manufacturing systems can be modeled as Markovian jump systems, considerable attention has been devoted to the problem of analysis and synthesis for Markovian jump systems over the past decades; see, for example, [1–4] and the references therein.
On the other hand, time delays are often encountered in various practical systems such as biological, electronics, and economical systems, which are frequently one of the main causes of poor performance, oscillation, or even instability [5–10]. Thus the analysis and synthesis of Markovian jump systems with time delay are of theoretical and practical importance and have received considerable research interest in the past few decades (e.g., [1–4, 10–13]).
In the literature, different design approaches have been proposed to deal with the delays. Generally, to get stability criteria, a Lyapunov function (or functional) is involved. For more details, one can see [10–14] and references therein. In those results, the information of delay is included in some criteria, which is socalled delay dependent, while others are irrelevant to the delay [15–17], which is called delay independent. It is well known that the former ones are generally much less conservative than the latter ones due to using the information of delay such as its length or rules of changes [18–20]. Therefore, how to choose a Lyapunov function (or functional) and derive a less conservative condition from the time derivative of such a function (or functional) is one of the most important techniques in the analysis and synthesis process.
Since cross products between two vectors are commonly encountered, different bound techniques are introduced. For example, Park’s inequality and Moon’s inequality were frequently used for bounding some cross terms. Moreover, many researchers tried to construct special forms of Lyapunov functional to obtain a feasible result. Some delaydependent conditions were obtained through model transformation approaches; more details can be found in [18–22] and references therein. But these choices of specific functional and overbounding techniques are the origin of conservatism [20–23].
Slack matrices technique has been proven to be an effective approach to establish an improved result. To mention a few, by introducing two auxiliary matrices a new LMI representation of H∞ performance is presented for the linear systems with a single timevarying state delay in [19]. Wu et al. [20] and He et al. [21] tried to seek the relationship between the terms in the NewtonLeibniz formula and to introduce some free weighting matrices to express this relationship and some delaydependent stability conditions with less conservativeness have been established. These methods are quite different from the conventional one of using model transformation which may introduce some superfluous dynamics into the original system. Additional studies can be found in [22–26] and references cited therein.
To improve the delaydependent conditions, some efforts on constructing new Lyapunov functional were made by employing the delay partitioning method [21, 23–26]. To mention a few, a delay partitioning method has been developed for the delaydependent stability analysis of fuzzy timevarying state delay systems based on a novel fuzzy LyapunovKrasovskii functional in [23]. In [24], by choosing an augmented LyapunovKrasovskii functional and utilizing the delaypartitioning method, novel delaydependent mean square asymptotic stability conditions are derived in terms of LMIs. With the idea of delay partitioning, in [25] a new delaydependent stochastic stability criterion on the stochastic stability of Markovian jump systems with timedelay has been proposed, which is less conservative than most existing results. However, when revisiting those problems, we find that there is still much room left for improvement, which motivates the present study.
In this context, we are interested in investigating the delaydependent stability analysis and stabilization problem for a class of Markovian jump systems with timevarying delay. By employing the delay partitioning method and introducing some slack matrix variables based on the NewtonLeibniz formula, a less conservative delaydependent stability condition is proposed. Then a state feedback controller, which guarantees the stochastic stability of the corresponding closedloop system, is designed.
The rest of the paper is organized as follows. Section 2 gives problem formulation and some necessary lemmas. In Section 3, we present our main results of stability analysis and stabilization problem. Numerical examples are given in Section 4, followed by the conclusions, which are presented in Section 5.
Notations. The notations used throughout the paper are standard except where otherwise stated. The superscript “” stands for matrix transposition. “” and “0” denote the identity matrix and a zero matrix with compatible dimensions, respectively. The notation “” means that is real symmetric and positive definite (positive semidefinite); stands for a blockdiagonal matrix with matrices on the diagonal. “” represents the elements below the main diagonal of a symmetric matrix. denotes the Euclidean norm of a vector or the spectral norm of a matrix. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations.
2. Problem Formulations and Preliminaries
Consider the following stochastic linear statedelay systems with Markovian jumping parameters: where is the system state vector, is the controlled input vector, and , and are matrix functions of the random jumping process . is a continuoustime Markovian jump process with right continuous trajectories taking discrete values in a given finite set with transition probability matrix given by where and , for , is the transition rate from mode at time to mode at time and for each mode , . is the system’s initial function which is continuous differentiable on and are the initial conditions of the continuous state and mode. is a continuously differentiable function, which denotes the timevarying delay when the mode is in , satisfying the conditions as follows: where and are known positive real constants.
Remark 1. It should be pointed out that, when a timevarying delay is considered, it is usually assumed that , while we only require in this paper, which is more general, as discussed by Xu et al. [22].
For notational simplicity, in the sequel, for each possible , , a matrix will be denoted as ; for example, and are denoted as and , respectively, and so on.
To facilitate further developments, we introduce the following lemma and definition that will be frequently used in deriving the main results.
Lemma 2 (Schur complement). Given constant matrices , , and with appropriate dimensions, where and , then if and only if
Definition 3. The Markovian jump system is said to be stochastically stable, if for any finite defined on and the following condition is satisfied:
3. Main Results
In this section, we will consider the stability and stabilization problem of the system (1). First of all, we introduce the following results which will be used in deriving the main results.
By the LeibnizNewton formula, we have and then for any appropriate dimensional matrices , , , , , , we have that the following equation holds:
Moreover, since , , for any appropriate dimensional matrix , where
3.1. Stability Analysis
Combining delay partitioning approach and freeweighting matrices technique, a new delaydependent stochastic stability condition is established in the theorem as follows.
Theorem 4. For given positive scalars and , the autonomous Markovian jump system (1) with is stochastically stable if there exist matrices , , , , , , , and freeweighting matrices with appropriate dimensions, such that the following LMIs hold: where
Proof. We define the following LyapunovKrasovskii functional candidate:
with
where , , , , , , and are matrices to be determined.
Let be the weak infinitesimal generator of the random process . Then, for each , , we have
According to (8)–(11) and considering , in (4), we have
where
and is denoted in (14).
By Schur complement (Lemma 2) and some matrices primary manipulations, it is easy to see that the abovementioned matrix in (22) is equivalent to (13).
Since , , , we have .
It is easy to see that if LMIs (13)–(15) hold.
Set ; then . For any , we have
By Dynkin’s formula, we have
Hence
Set ; then . From (17), it is easy to see that for any
From inequalities (26) and (27), we know that
where , .
By GronwellBellman lemma, we have
Thus, according to (28), we have
As , we have
For there always exists a scalar , such that
From Definition 3, we know that the Markovian jump system in (1) with is stochastically stable.
The proof is thus completed.
Remark 5. Benefiting from a novel LKF construction, Theorem 4 presents a delaydependent stochastic stability criterion which is much less conservative than most existing results in the literature. The idea of delay portioning used here is different from those approaches in the literature. For example, assuming the time delay can be denoted as a constant part and timevarying part, the idea of delay partitioning is employed to the constant part and some LKF are constructed in [21, 23–26]. As a further improved result, an appropriate LKF is established with the idea of partitioning the lower bound of time delay in [26]. However, in this brief, we divided the whole time varying delay interval into multiparts, with which a novel LKF is constructed.
If the system mode set , the jump linear system (1) is simplified into a general linear system. Then we have the following simplified result.
Corollary 6. For given positive scalars and , the autonomous Markovian jump system (1) with is stochastically stable if there exist matrices , , , , and freeweighting matrices , with appropriate dimensions, such that the following LMIs hold: where
3.2. Stabilization Controller Design
Now we are in a position to present a solution to the stabilization problem for system (1). We assume that the state feedback controller is in the general formula as follows: where and are the gain matrices of the state feedback controller to be designed.
Then, for each , the resulting closeloop system of (1) with (36) becomes where , . Thus, representing by , by in Theorem 4, and by some matrices primary manipulations, we can obtain the following delaydependent theorem.
Theorem 7. For given positive scalars and , the autonomous Markovian jump system (1) is stochastically stable if there exist matrices , , , , , , , and freeweighting matrices with appropriate dimensions, such that the following LMIs hold: where
In this case, if the conditions abovementioned are feasible, the matrices in (36) are given by and . That is, the state feedback control law (36) can be designed as
Proof. By performing a congruence transformation to both sides of (12), and defining matrices , , we can obtain (38).
Similarly, by performing a congruence transformation to (14) by and defining matrices , , , we have (40).
By performing a congruence transformation to (13) with diag and defining matrices , , , , , we have
According to the definition of and , the following equation always holds:
which implies that
This completes the proof.
Remark 8. The stabilization controller design problem is solved in Theorem 7, which guarantees the addressed Markovian jump system to be stochastically stable. Sometimes, we would like to design a memoryless state feedback control law ; in this case, just set in Theorem 7.
Remark 9. It is worth pointing out that our main results are based on the LMI conditions, which can be easily obtained using LMI Control Toolbox.
4. Numerical Examples
In this section, some examples are presented to demonstrate the effectiveness of our proposed theoretical results.
Example 1. Consider a Markovian jump system in (1) with two modes and the following parameters [27]:
The generator matrix of the stochastic process is
To compare our stability result in Theorem 4 with those in [27–30], we assume . When and , the result of [28] cannot be applied to stability. When and , based on the result of [29], the system is found to be delayindependent stable. If we increase , for example, and , the result of [29] cannot guarantee system stability. By the results in [27, 30], we can obtain a feasible solution with and , respectively. By Theorem 4 of this paper, we can obtain a feasible solution with , which is much larger than that of [27, 30]. We can see that our criterion gives a less conservative result than those in [27–30].
Example 2. Consider the Markovian jump system (1) as Example 1. For and and various , the results obtained by the proposed method in Theorem 4 for the admissible upper bound value of for which the system (1) remains stochastic stable are shown in Table 1.

Example 3. Consider the Markovian jump system (1) as Example 1. Suppose , , , and ; according to Theorem 7, one can obtain a state feedback controller designed as
The simulation results are illustrated in Figures 1–3 with the initial condition . Among them, Figure 1 shows the Markovian jumping signal. The control input signal is given in Figure 2, while Figure 3 plots the state responses of system (1) under the presented control law . From the simulation, it is shown that the designed control scheme is feasible and effective since the resulting closedloop system is stable.
5. Conclusion
In this paper, new delaydependent conditions for stochastic stability and stabilization of a class of Markovian jump systems with time delay are presented. By the idea of delay fractioning approach and introducing some zero equations, a sufficient condition is given to guarantee the stochastic stability of the Markovian jump systems, which is less conservative than most existing results. Furthermore, based on the new criterion, an approach has been shown to design a state feedback controller, which guarantees the resulting closedloop system to be stochastically stable. Finally, numerical examples have been provided to demonstrate the effectiveness of the proposed methods in this paper.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
This work is supported by the National Natural Science Foundation of China (nos. 61304108, 61273094, and 51307035) and the Project for Distinguished Young Scholars of the Basic Research Plan in Shenzhen City under Contract no. JCJ201110001. The authors are very thankful to the reviewers for their valuable suggestions and comments.
References
 J. Wang, H. Wu, L. Guo, and Y. Luo, “Robust ${H}_{\infty}$ fuzzy control for uncertain nonlinear Markovian jump systems with timevarying delay,” Fuzzy Sets and Systems, vol. 212, no. 1, pp. 41–61, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 L. Wu, X. Su, and P. Shi, “Sliding mode control with bounded L_{2} gain performance of Markovian jump singular timedelay systems,” Automatica, vol. 48, no. 8, pp. 1929–1933, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 U. U. Kocer, “Forecasting intermittent demand by Markov chain model,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 8, pp. 3307–3318, 2013. View at: Google Scholar
 S. Long, S. Zhong, H. Zhu, and L. Xiong, “Delaydependent stochastic admissibility for a class of discretetime nonlinear singular Markovian jump systems with timevarying delay,” Communications in Nonlinear Science and Numerical Simulation, vol. 19, no. 3, pp. 673–685, 2014. View at: Publisher Site  Google Scholar  MathSciNet
 L. Wu and Z. Wang, “Guaranteed cost control of switched systems with neutral delay via dynamic output feedback,” International Journal of Systems Science. Principles and Applications of Systems and Integration, vol. 40, no. 7, pp. 717–728, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 M. T. Alrifai, M. Zribi, M. Rayan, and M. S. Mahmoud, “On the control of time delay power systems,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 2, pp. 769–792, 2013. View at: Google Scholar
 L. Wu and W. X. Zheng, “Passivitybased sliding mode control of uncertain singular timedelay systems,” Automatica, vol. 45, no. 9, pp. 2120–2127, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 H. K. Lam and F. H. F. Leung, “Stability analysis of discretetime fuzzymodelbased control systems with time delay: time delayindependent approach,” Fuzzy Sets and Systems, vol. 159, no. 8, pp. 990–1000, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 R. Yang, G. Liu, P. Shi, C. Thomas, and M. V. Basin, “Predictive output feedback control for networked control systems,” IEEE Transactions on Industrial Electronics, vol. 61, no. 1, pp. 512–520, 2014. View at: Publisher Site  Google Scholar
 H. Li, Q. Zhou, B. Chen, and H. Liu, “Parameterdependent robust stability for uncertain Markovian jump systems with time delay,” Journal of the Franklin Institute, vol. 348, no. 4, pp. 738–748, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 L. Wu and W. Zheng, “Weighted H_{∞} model reduction for linear switched systems with timevarying delay,” Automatica, vol. 45, no. 1, pp. 186–193, 2009. View at: Publisher Site  Google Scholar
 X. Zhao, H. Liu, and Z. Wang, “Weighted ${H}_{\infty}$ performance analysis of switched linear systems with modedependent average dwell time,” International Journal of Systems Science, vol. 44, no. 11, pp. 2130–2139, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 J. Lin, S. Fei, and J. Shen, “Delaydependent ${H}_{\infty}$ filtering for discretetime singular Markovian jump systems with timevarying delay and partially unknown transition probabilities,” Signal Processing, vol. 91, no. 2, pp. 277–289, 2011. View at: Google Scholar
 L. Wu, X. Su, P. Shi, and J. Qiu, “Model approximation for discretetime statedelay systems in the TS fuzzy framework,” IEEE Transactions on Fuzzy Systems, vol. 19, no. 2, pp. 366–378, 2011. View at: Publisher Site  Google Scholar
 F. O. Souza, M. C. de Oliveira, and R. M. Palhares, “Stability independent of delay using rational functions,” Automatica, vol. 45, no. 9, pp. 2128–2133, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 S. Hirche, T. Matiakis, and M. Buss, “A distributed controller approach for delayindependent stability of networked control systems,” Automatica, vol. 45, no. 8, pp. 1828–1836, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 P. A. Bliman, “LMI characterization of the strong delayindependent stability of linear delay systems via quadratic LyapunovKrasovskii functionals,” Systems & Control Letters, vol. 43, no. 4, pp. 263–274, 2001. View at: Publisher Site  Google Scholar
 E. Fridman and U. Shaked, “Delaydependent stability and H∞ control: constant and timevarying delays,” International Journal of Control, vol. 76, no. 1, pp. 48–60, 2003. View at: Publisher Site  Google Scholar  MathSciNet
 F. Li, X. Wang, and P. Shi, “Robust quantized ${H}_{\infty}$ control for network control systems with Markovian jumps and time delays,” International Journal of Innovative Computing, Information and Control, vol. 9, no. 12, pp. 4889–4902, 2013. View at: Google Scholar
 M. Wu, Y. He, and J. She, “New delaydependent stability criteria and stabilizing method for neutral systems,” IEEE Transactions on Automatic Control, vol. 49, no. 12, pp. 2266–2271, 2004. View at: Publisher Site  Google Scholar  MathSciNet
 Y. He, Q. Wang, L. Xie, and C. Lin, “Further improvement of freeweighting matrices technique for systems with timevarying delay,” IEEE Transactions on Automatic Control, vol. 52, no. 2, pp. 293–299, 2007. View at: Publisher Site  Google Scholar  MathSciNet
 S. Xu, J. Lam, and Y. Zou, “New results on delaydependent robust ${H}_{\infty}$ control for systems with timevarying delays,” Automatica, vol. 42, no. 2, pp. 343–348, 2006. View at: Publisher Site  Google Scholar  MathSciNet
 L. Wu, X. Su, P. Shi, and J. Qiu, “A new approach to stability analysis and stabilization of discretetime TS fuzzy timevarying delay systems,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 41, no. 1, pp. 273–286, 2011. View at: Publisher Site  Google Scholar
 W. Chen, Q. Ma, G. Miao, and Y. Zhang, “Stability analysis of stochastic neural networks with Markovian jump parameters using delaypartitioning approach,” Neurocomputing, vol. 103, pp. 22–28, 2013. View at: Publisher Site  Google Scholar
 Z. Fei, H. Gao, and P. Shi, “New results on stabilization of Markovian jump systems with time delay,” Automatica, vol. 45, no. 10, pp. 2300–2306, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 H. Gao, Z. Fei, J. Lam, and B. Du, “Further results on exponential estimates of Markovian jump systems with modedependent timevarying delays,” IEEE Transactions on Automatic Control, vol. 56, no. 1, pp. 223–229, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 J. Wu, T. Chen, and L. Wang, “Delaydependent robust stability and ${H}_{\infty}$ control for jump linear systems with delays,” Systems and Control Letters, vol. 55, no. 11, pp. 939–948, 2006. View at: Publisher Site  Google Scholar
 K. Benjelloun and E. K. Boukas, “Mean square stochastic stability of linear timedelay system with Markovian jumping parameters,” IEEE Transactions on Automatic Control, vol. 43, no. 10, pp. 1456–1460, 1998. View at: Publisher Site  Google Scholar  MathSciNet
 Y. Cao and J. Lam, “Robust $H\infty $ control of uncertain Markovian jump systems with timedelay,” IEEE Transactions on Automatic Control, vol. 45, no. 1, pp. 77–83, 2000. View at: Publisher Site  Google Scholar  MathSciNet
 Y. Cao, J. Lam, and L. Hu, “Delaydependent stochastic stability and ${H}_{\infty}$ analysis for timedelay systems with Markovian jumping parameters,” Journal of the Franklin Institute, vol. 340, no. 67, pp. 423–434, 2003. View at: Publisher Site  Google Scholar  MathSciNet
Copyright
Copyright © 2014 Hongwei Xia et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.