Time-Delay Systems: Modeling, Analysis, Estimation, Control, and SynchronizationView this Special Issue
Research Article | Open Access
Xiushan Jiang, Xuemin Tian, Weihai Zhang, "Robust Quadratic Stabilizability and Control of Uncertain Linear Discrete-Time Stochastic Systems with State Delay", Mathematical Problems in Engineering, vol. 2016, Article ID 7843940, 11 pages, 2016. https://doi.org/10.1155/2016/7843940
Robust Quadratic Stabilizability and Control of Uncertain Linear Discrete-Time Stochastic Systems with State Delay
This paper mainly discusses the robust quadratic stability and stabilization of linear discrete-time stochastic systems with state delay and uncertain parameters. By means of the linear matrix inequality (LMI) method, a sufficient condition is, respectively, obtained for the stability and stabilizability of the considered system. Moreover, we design the robust state feedback controllers such that the system with admissible uncertainties is not only quadratically internally stable but also robust controllable. A sufficient condition for the existence of the desired robust controller is obtained. Finally, an example with simulations is given to verify the effectiveness of our theoretical results.
It is well known that stability and stabilization are very important concepts in linear system theory. Due to a great number of applications of stochastic systems in the realistic world, the studies of stability and stabilization for stochastic systems attract lots of researchers’ attention in recent years; we refer the reader to the classic book  and the follow-up books [2, 3], together with references [4–11] and the references therein, which include robust stochastic stability , exponential stabilization , mean-square stability, and -stability and -stability . The stabilization of various systems, including impulsive Markovian jump delay systems , stochastic singular systems [10, 12, 13], uncertain stochastic T-S fuzzy systems , and time-delay systems [6, 11, 15–17], has been studied extensively. control is one of the most important robust control approaches when the system is subject to the influence of external disturbance, which has been shown to be effective in attenuating the disturbance. The objective of standard control requires designing a controller to attenuate -gain from the external disturbance to controlled output below a given level ; see . The study of control of general linear discrete-time stochastic systems with multiplicative noise seems to be first initiated by . Then, stochastic control and its applications have been investigated extensively; see [14, 16, 20–24].
Because time-delay exists widely in practice and affects the system stability, there have been many works concerning the study in stability or control of stochastic systems [4, 6, 9, 11, 14–16, 22, 25]. Due to limitations of measurement technique and tools, it is not easy to construct exact mathematical models. Compared with the nominal stochastic systems without uncertain terms investigated in [2, 5, 24], our considered system allows the coefficient matrix to vary in a certain range.
Discrete-time stochastic difference systems have attracted a great deal of attention with the development of computer technology in recent years. In our viewpoint, there are at least two motivations to study discrete-time stochastic systems, Firstly, discrete-time stochastic systems are ideal mathematical models in practical modeling such as genetic regulatory networks . Secondly, discrete-time stochastic systems provide a better approach to understand extensively continuous-time stochastic Itô systems [2, 3, 26]. Therefore, it is of significance to study the stabilization and control of discrete-time stochastic time-delay uncertain systems.
This paper will study quadratic stability, stabilization, and robust state feedback control for uncertain discrete-time stochastic systems with state delay. The parameter uncertainties are time varying and norm bounded. It can be found that, up to now, many criteria for testing quadratic stabilization and control have been given in terms of LMIs and algebraic Riccati equations by applying Lyapunov function approach. One of our main contributions is to study quadratic stability and stabilization via LMIs instead of algebraic Riccati equations which is hardly solved. What we have obtained extended the work of  about the quadratic stability and stabilization of deterministic uncertain systems. Another contribution is to solve the state feedback control and present a state feedback controller design.
The paper is organized as follows. In Section 2 we give some adequate preliminaries and useful definitions. In Section 3, sufficient conditions for quadratic stability and stabilization are given in terms of LMIs which is convenient to compute by the MATLAB LMI toolbox. Section 4 designs a state feedback controller. Two numerical examples with simulations are given in Section 5 to verify the efficiency of the proposed results. Finally, we end this paper in Section 6 with a brief conclusion.
For convenience, the notations in this paper are quite standard such as the following: we let and represent the set of all real -dimensional vectors and real matrices. For symmetric matrices and , (resp., stands for the idea that the matrix is positive semidefinite (resp., positive definite). denotes the identity matrix of appropriate dimensions and denotes the matrix transpose of . represents the Euclidean norm or spectral norm of the vector . , especially, , , and , represents the set of integers between and (inclusive). In symmetric block matrices, the symbol “” is used as an ellipsis for terms induced by symmetry. is the expectation operator.
Consider a class of uncertain linear discrete-time stochastic systems with state delay described by where is the system state and is the control input, and are independent white noise process satisfying the following assumptions:), , where is a Kronecker function defined by for while for .() are defined on the filtered probability space with . In addition, is an increasing sequence of -algebras with .
, , , , , are known real constant matrices with compatible dimensions. , , , , , are norm bounded and time-varying uncertain parameter which are assumed to have the following form:where , , , , , , are constant matrices and is the uncertain matrix satisfyingFor the purpose of simplicity, throughout this paper, we write system (1) in the following form:where , , , , are bounded uncertain system matrices withBelow, we define robust quadratic stability and robust quadratic stabilizability for the uncertain time-delay discrete-time system (1), which generalize Definition 1 of  to stochastic systems.
Definition 1. Uncertain discrete time-delay system (1) is said to be robustly quadratically stable, if there exist matrices , and a scalar such that, for all admissible uncertain terms and given initial condition for , the unforced system of (1) (with ) satisfiesfor with and
Definition 2. Uncertain discrete time-delay system (1) is said to be robustly quadratically stabilizable if there exists a matrix such that closed-loop system (1) with , that is,is robustly quadratically stable for given for .
3. Robust Quadratic Stabilization
In this section, a sufficient condition about robust quadratic stability and robust quadratic stabilization will be presented via LMIs, respectively. First, we cite the following lemma which is essential in proving our main results.
Theorem 4. Consider uncertain discrete-time stochastic delay system (1) with . This system is robustly quadratically stable if there exist positive definite matrices , such that the following LMI holds.where
Proof. From Definition 1, taking a Lyapunov function as in the form of (7), if uncertain discrete time-delay stochastic system (1) is quadratically stable, then, for all admissible uncertainties of (1), there exist matrices , and a scalar such that associated with unforced system (8) satisfies (6). In view of the assumption (), it is easy to computewhere , , , and are given in (5) and is shown as By Definition 1, system (1) with is robustly quadratically stable, only ifwhich is equivalent to Note that can be rewritten as By Schur’s complement, it is easy to derive that is equivalent towhereThen, using the same way as in (16)–(19) yieldsThe above inequality can be rewritten aswhereBecause is a symmetric matrix, applying Lemma 3, (21) holds iff the following inequality holds:whereTakeand then by substituting (25) into (23), for , we getwhere , , are shown in (12).
Using the same method as in (16)–(20), (11)-(12) follow immediately from the above inequality.
Theorem 5. System (1) is robustly quadratically stabilizable if there exist positive matrices , , and a scalar with such that the following LMI holds.whereMoreover, a quadratically stabilizing state feedback controller is given by
Proof. By Definition 2, using the same way as in the proof of Theorem 4, the following inequality which has a similar form to (11)-(12) can be obtained by taking whereIn order to eliminate the nonlinear quadratic termspre- and postmultiplyingon both sides of (30) and considering , (27)-(28) can be obtained easily. This theorem is proved.
Remark 6. Compared with the results about quadratic stability and quadratic stabilizability of deterministic systems given in , our two theorems not only extend the results of  to stochastic systems, but also provide the corresponding LMI criteria which can be easily tested by MATLAB LMI toolbox.
Remark 7. From these two theorems, we also can get the result about quadratic stability with the given decay rate. Take the functionand then, substituting (34) into (8), we obtain the following new system:where So system (1) is quadratically stabilizable with decay rate if system (35) is quadratically stabilizable.
4. State Feedback Control
In this section we consider the state feedback discrete-time control problem for the following uncertain linear stochastic system with state delay:where and are called the controlled output and external disturbance, respectively. In addition, the effect of the disturbance on the controlled output is described by a perturbation operator , which maps any finite energy disturbance signal into the corresponding finite energy output signal of the closed-loop system. The size of this linear operator, that is, , measures the influence of the disturbances in the worst case. We denote by the set of all nonanticipative square summable -valued stochastic processes -norm of is defined by
Firstly, for system (37), we define the perturbed operator and its norm as follows.
Definition 8. The perturbed operator of system (37), , is defined as with its norm Next, we present the definition about stochastic robust control.
Definition 9. For a certain level , is the control of the system (37), if (i)system (37) is internally stabilizable when ;(ii)the norm of the perturbed operator of system (37) satisfies for all external disturbance .
Besides, if exists, then system (37) is called controllable in the disturbance attenuation. Furthermore, it is called strongly robust controllable if .
Proof. By Theorem 5, when disturbance , it is easy to test that system (37) is internally stabilizable with . Now we only need to show . By Definition 1, choose the Lyapunov function with and to be determined, and then So in the case of , , we have where Obviously, it is easy to get that if . Then, we need to eliminate the uncertainties. Using the same method as in the proof of Theorem 4, we know that, for some , a sufficient condition for can be got from the following matrix inequality.where Then, by pre- and postmultiplying on both sides of (47), we haveFor some constant with , Theorem 10 is concluded; that is, an control of system (37) is obtained by solving LMIs (42)-(43). This completes the proof.
5. Simulation Example
In this section, we consider two simple examples with simulations to illustrate the effectiveness of the proposed approach.
Example 11. Consider discrete-time stochastic system (1) with the following parameters:Using LMI toolbox to solve (11)-(12) in Theorem 4, we find out that which means that there is no feasible solution and indicates that system (1) with is unstable. Figure 1 verifies the result. By solving LMI (27), a group of feasible solutions with are shown as and By Theorem 5, the system is mean-square stabilizable which is verified by Figure 2. A robust stabilizing controller is given by
Example 12. Consider system (42) with the following parameters:For perturbed system (42), we take the external disturbance as and the certain level as . In addition, according to Lemma 3, an appropriate is given as . Then, by the result of Theorem 10, using LMI toolbox to solve (43) and (47), we find that , which means we have got a group of feasible solutions withThe simulation results of state trajectories and controlled output trajectories of system (42) are given in Figures 3 and 4 with the controller This further verifies the effectiveness of Theorem 10.
In this paper, we have studied the robust quadratic stability, quadratic stabilization, and robust state feedback control of discrete-time stochastic systems with state delay and uncertain parameters. Based on LMI technique, a sufficient condition about quadratic stability and quadratic stabilization of our considered system is, respectively, given. Moreover, an state feedback controller is obtained by solving two LMIs. Finally, we supply two simulation examples to show the validity of the proposed results. It is expected to solve the output feedback control and filtering in our forthcoming work.
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by the National Natural Science Foundation of China (no. 61573227 and no. 61273160), Natural Science Foundation of Shandong Province of China (no. 2013ZRE28089), the Research Fund for the Taishan Scholar Project of Shandong Province of China, the Postgraduate Innovation Funds of China University of Petroleum (East China) (no. YCX2015051), and the SDUST Research Fund (no. 2015TDJH105).
- T. Söderström, Discrete-Time Stochastic Systems, Springer, New York, NY, USA, 2002.
- V. Dragan, T. Morozan, and A.-M. Stoica, Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems, Springer, New York, NY, USA, 2010.
- A. Seierstad, Stochastic Control in Discrete and Continuous Time, Springer, New York, NY, USA, 2009.
- Y. Zhang and C. Wang, “Robust stochastic stability of uncertain discrete-time impulsive Markovian jump delay systems with multiplicative noises,” International Journal of Systems Science, vol. 46, no. 12, pp. 2210–2220, 2015.
- W. Zhang and B.-S. Chen, “On stabilizability and exact observability of stochastic systems with their applications,” Automatica, vol. 40, no. 1, pp. 87–94, 2004.
- Z. Wang, Y. Liu, and X. Liu, “Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays,” IEEE Transactions on Automatic Control, vol. 55, no. 7, pp. 1656–1662, 2010.
- X. Li, X. Y. Zhou, and M. Ait Rami, “Indefinite stochastic linear quadratic control with Markovian jumps in infinite time horizon,” Journal of Global Optimization Theory and Applications, vol. 27, no. 2-3, pp. 149–175, 2003.
- T. Hou, W. Zhang, and B.-S. Chen, “Study on general stability and stabilizability of linear discrete-time stochastic systems,” Asian Journal of Control, vol. 13, no. 6, pp. 977–987, 2011.
- J. Lian and Z. Feng, “Passivity analysis and synthesis for a class of discrete-time switched stochastic systems with time-varying delay,” Asian Journal of Control, vol. 15, no. 2, pp. 501–511, 2013.
- W. Zhang, Y. Zhao, and L. Sheng, “Some remarks on stability of stochastic singular systems with state-dependent noise,” Automatica, vol. 51, pp. 273–277, 2015.
- F. Li, L. Wu, and P. Shi, “Stochastic stability of semi-Markovian jump systems with mode-dependent delays,” International Journal of Robust and Nonlinear Control, vol. 24, no. 18, pp. 3317–3330, 2014.
- L. Huang and X. Mao, “Stability of singular stochastic systems with Markovian switching,” IEEE Transactions on Automatic Control, vol. 56, no. 2, pp. 424–429, 2011.
- M. Sun, W. Zhang, and G. Li, “Stochastic admissibility of continuous-time singular Markov jump systems with general uncertain transition rates,” Journal of Shandong University of Science and Technology, vol. 35, no. 4, pp. 86–92, 2016.
- T. Senthilkumar and P. Balasubramaniam, “Delay-dependent robust stabilization and control for uncertain stochastic T-S fuzzy systems with multiple time delays,” Iranian Journal of Fuzzy Systems, vol. 9, no. 2, pp. 89–111, 2012.
- S. Xu, J. Lam, and C. Yang, “Quadratic stability and stabilization of uncertain linear discrete-time systems with state delay,” Systems and Control Letters, vol. 43, no. 2, pp. 77–84, 2001.
- G. Chen and Y. Shen, “Robust filter design for neutral stochastic uncertain systems with time-varying delay,” Journal of Mathematical Analysis and Applications, vol. 353, no. 1, pp. 196–204, 2009.
- J.-N. Li, Y. Zhang, and Y.-J. Pan, “Mean-square exponential stability and stabilisation of stochastic singular systems with multiple time-varying delays,” Circuits, Systems, and Signal Processing, vol. 34, no. 4, pp. 1187–1210, 2015.
- O. L. V. Costa, M. D. Fragoso, and R. P. Marques, Discrete-Time Markov Jump Linear Systems, Probability and Its Applications, Springer, New York, NY, USA, 2005.
- A. E. Bouhtouri, D. Hinrichsen, and A. J. Pritchard, “-type control for discrete-time stochastic systems,” International Journal of Robust Nonlinear Control, vol. 9, no. 13, pp. 923–948, 1999.
- Z. Lin, Y. Lin, and W. Zhang, “A unified design for state and output feedback control of nonlinear stochastic Markovian jump systems with state and disturbance-dependent noise,” Automatica, vol. 45, no. 12, pp. 2955–2962, 2009.
- Y. Zhang, P. Shi, S. K. Nguang, and Y. Song, “Robust finite-time control for uncertain discrete-time singular systems with Markovian jumps,” IET Control Theory & Applications, vol. 8, no. 12, pp. 1105–1111, 2014.
- H. Li and Y. Shi, “State-feedback control for stochastic time-delay nonlinear systems with state and disturbance-dependent noise,” International Journal of Control, vol. 85, no. 10, pp. 1515–1531, 2012.
- K. Mathiyalagan and R. Sakthivel, “Robust stabilization and control for discrete-time stochastic genetic regulatory networks with time delays,” Canadian Journal of Physics, vol. 90, no. 10, pp. 939–953, 2012.
- W. Zhang, Y. Huang, and L. Xie, “Infinite horizon stochastic control for discrete-time systems with state and disturbance dependent noise,” Automatica, vol. 44, no. 9, pp. 2306–2316, 2008.
- X. Jiang, X. Tian, T. Zhang, and W. Zhang, “Robust quadratic stability and stabilizability of uncertain linear discrete-time stochastic systems with state delay,” in Proceedings of the 28th Chinese Control and Decision Conference (CCDC '16), pp. 1728–1732, Yinchuang, China, 2016.
- W. Wang, Y. Zhang, and X. Liang, “Exact observability of Markov jump stochastic systems with multiplicative noise,” Journal of Shandong University of Science and Technology, vol. 35, no. 3, pp. 99–105, 2016.
- W. Zhang, Q. Li, and Y. Hua, “Quadratic stabilization and output feedback control of stochastic uncertain systems,” in Proceedings of the 5th World Congress on Intelligent Control and Automation (WCICA '04), pp. 728–732, Hangzhou, China, June 2004.
Copyright © 2016 Xiushan Jiang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.