Mathematical Problems in Engineering

Volume 2012 (2012), Article ID 291624, 17 pages

http://dx.doi.org/10.1155/2012/291624

## Robust Stabilization for Stochastic Systems with Time-Delay and Nonlinear Uncertainties

^{1}School of Electrical Engineering and Automation, Shandong Polytechnic University, Jinan 250353, China^{2}School of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China

Received 17 September 2011; Accepted 3 November 2011

Academic Editor: Weihai Zhang

Copyright © 2012 Zhiguo Yan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper deals with the problem of robust stabilization of stochastic systems with time-delay and nonlinear uncertainties via memory state feedback. Based on Lyapunov krasoviskii functional, some sufficient conditions on local (global) stabilization are given in terms of matrix inequalities. In particular, these stabilizable conditions for a class of nonlinear stochastic time-delay systems are derived in the form of linear matrix inequalities, which have the advantage of easy computation. Moreover, the corresponding results are further extended to the stochastic multiple time-delays systems. Finally, an example is presented to show the superiority of memory state feedback controller to memoryless state feedback controller.

#### 1. Introduction

Stochastic differential delay equations are one of the most useful stochastic models in applications, for example, aircraft, chemical or process control system, and distributed networks. It is known that time-delay is, in many cases, a source of poor system performance or instability. Hence, the stability and stabilization of stochastic time delay systems have been recently attracting the attention of a number of researchers, see [1–18] and the references therein. In [2], the authors studied the stability of linear stochastic systems with uncertain time delay by generalized Riccati equation approach, while [3] extended the results of [2] to nonlinear case via linear matrix inequalities. Reference [4] investigated the problems of stabilization for a class of linear stochastic systems with norm-bounded uncertainties and state delay, and it developed two criteria for the stability analysis: delay-dependent and delay-independent. The memoryless nonfragile state feedback control law for nonlinear stochastic time-delay systems was designed in [5], in which new sufficient conditions for the existence of such controllers were presented based on the linear matrix inequalities approach. Reference [6] was concerned with the stability analysis and proposed improved delay-dependent stability criteria for uncertain stochastic systems with interval time-varying delay. The study of exponential stability of stochastic delay-differential equations was discussed in [7–9]. The output feedback stabilization of stochastic nonlinear time-delay systems was investigated in [10], and some stabilization criterions for nonlinear stochastic time-delay systems with state and control-dependent noise were given in [11, 12] by means of matrix inequalities.

We usually design memoryless state feedback controller for the stabilization of systems because of its advantage of easy implementation. However, its performance, for time-delay systems, cannot be better than a memory state feedback controller which utilizes the available information of the size of delay. Reference [19] has given a general form of a memory state feedback (delayed feedback) controller: But the task of storing all the previous states and computing the values of time-varying gain matrices makes the practical realization of infinite-dimensional controller (1.1) very difficult. For these reasons, the controller could be considered as a compromise between the performance improvement and the implementation simplicity. Reference [20] gave the sufficient conditions for the stabilization of deterministic state-delayed systems. References [21] and [22] designed a memory state feedback controller for neutral time-delay systems and singular timedelay systems, respectively. Reference [23] studied the stabilization problem for a class of discrete-time Markovian jump linear systems with time-delays both in the system state and in the mode signal via time-delayed controller and obtained a sufficient condition. What [13] actually studied is the stabilization problem of linear stochastic time-delay systems using generalized Riccati equation method. Up to now, to the best of the authors’ knowledge, the issue on memory state feedback stabilization of stochastic systems with time-delay and nonlinear uncertainties has not been fully investigated in previous literatures.

In this paper, we consider the problem on robust stabilization for stochastic systems with time-delay and nonlinear uncertainties via memory state feedback. This problem contains three inevitable aspects of practical application: timedelay, nonlinear uncertainties and more effective controller, which is more complex than the stabilization of pure stochastic systems via memoryless control. These complexities result in some difficulties of memory stabilizing controller design. By the Itô formula, mathematical expectation properties, and matrix transformation, some sufficient conditions are obtained on locally and globally asymptotic stabilization in probability by means of matrix inequalities. Especially for a class of nonlinear stochastic time-delay systems, a sufficient condition for the existence of memory state feedback stabilizing controller is obtained in terms of LMIs, which has the advantage of easy computation. Meanwhile, a memoryless state feedback controller is also given as a special case of memory state feedback controller. Moreover, the robust stabilization problem for stochastic multiple time-delays systems is further studied and a general sufficient condition is derived.

The paper is organized as follows. Some preliminaries and problem formulations are presented in Section 2. In Section 3, main results are given. Section 4 presents one example to illustrate the effectiveness of our developed results. Section 5 concludes this paper.

*Notation 1. *: the transpose of matrix ; : is positive semidefinite (positive definite) symmetric matrix; : identity matrix; : Euclidean norm; , , : space of nonanticipative stochastic process with respect to an increasing -algebra satisfying . : identity matrix.

#### 2. Preliminaries and Problem Statement

Consider the following continuous nonlinear stochastic time-delay systems: where and are system state and control input, respectively; is 1-dimensional standard Wiener process defined on the probability space , , , with ; , ; , , , , , and are constant matrices; is a certain timedelay. Under very mild conditions on , , 1, (2.1) exists a unique global solution [1]. It should be pointed out that any general nonlinear stochastic system which is sufficiently differentiable can take the form of (2.1) via Taylor’s series expansion at the origin.

Next, we give the following definitions essential for the paper.

*Definition 2.1 (see [1]). *System (2.1) with is said to be stable in probability, if for any ,
Additionally, if we also have
then system (2.1) with is said to be locally asymptotically stable in probability.

If (2.2) holds and
for all , then system (2.1) with is said to be globally asymptotically stable in probability.

*Definition 2.2. *If there exists a constant memory state feedback control law
such that the equilibrium point of the closed-loop system
is asymptotically stable in probability [1] for all , then stochastic time-delay differential system (2.1) is called locally robustly stabilizable. If (2.6) is robustly stable [2], that is, the equilibrium point of (2.6) is asymptotically stable in the large [1] for all , (2.1) is globally robustly stabilizable.

*Remark 2.3. *Definition 2.2 gives locally (globally) robustly stabilizable of stochastic time-delay systems via memory state feedback control law , which is more general than that via memoryless state feedback control law [12]. This is because Definition 2.2 reduces to the corresponding definition under memoryless state feedback control law when .

The aim of this paper is to find a constant memory state feedback control law (2.5), such that the equilibrium point of (2.6) is asymptotically stable in probability for all .

#### 3. Main Results

In this section, we will give some sufficient conditions of the stabilization of system (2.1). Without loss of generality, we can give the following assumption for nonlinear function .

*Assumption 3.1. **There exists an **, such that*
holds for all (a neighborhood of the origin).

The following general theorem is presented, which yields several applicable corollaries.

Theorem 3.2. *If (3.1) holds and , , , are the solutions of the following matrix inequality
**
then system (2.1) can be locally robustly stabilized by (2.5). If is replaced by , then system (2.1) can be globally robustly stabilized by the same controller.**In (3.2), and are defined by**
where
*

*Proof. *Choose the following Lyapunov-Krasoviskii functional:
where and are the solutions of (3.2). Let be the infinitesimal generator of the closed-loop system (2.6), then, by the Itô’s formula, we have
In addition, by (3.1), we obtain
By inequality , then (3.7) becomes
Substituting (3.8) into (3.6), it follows
According to (3.2), that is in the domain for , so the local stabilization of Theorem 3.2 is obtained by Corollary of [1]. By the same discussion, the global stabilization conditions can be also obtained by Theorem 4.4 of [1].

From Theorem 3.2, we can derive some useful results, which can be expressed in terms of LMIs.

Corollary 3.3. *If , , 1, and the matrix inequality has solutions , and , , then the linear stochastic time-delay system
**
is globally robustly stabilizable. If , , and the following LMI:
**
has solutions , , , and , then
**
is globally robustly stabilizable, where , and a stabilizing feedback control law .*

*Proof. *If , , we can take in (3.1), then for , except possibly at .

Thus, the first part of Corollary 3.3 is proved.

Furthermore, if , , (3.2) degenerates into
where .

According to Schur’s complement, (3.13) is equivalent to
Then, pre- and post-(3.14) by , we have
Setting , , , and . Again, by Schur’s complement, (3.15) is equivalent to (3.11). Thus, the second part of Corollary 3.3 is also proved.

*Remark 3.4. *Reference [13] considered the analogous problem to Corollary 3.3 by delay feedback, where the main result is expressed by means of generalized algebraic Riccati equations (GAREs) GAREs. However, Corollary 3.3 gives a sufficient condition in terms of LMIs which are easy to be solved.

Corollary 3.5. *If the following LMI:
**
has solution , , and , then the stochastic linear time-delay controlled system
**
is globally robustly stabilizable, where . Moreover, the stabilizing feedback control law
*

*Proof. *Applying the well-known inequality
and supposing for simplicity, we have
Let , . Then,
Obviously, if , then . Applying the Theorem 3.2, the closed-loop system of (3.17) is robustly stable [2].

Then, pre- and post-multiplying by , and by Schur’s complement, we have is equivalent to
where . Set , , , (3.22) is equivalent to (3.16). This ends the proof of Corollary 3.5.

Below, for , , we give another sufficient condition for the local (global) stabilization of system (2.1) in the terms of LMIs.

Theorem 3.6. *For , in (2.1), suppose (3.1) holds for all . If the LMIs:
**
have solutions , , , , and , then system (2.1) can be locally (globally) robustly stabilized by
**
where .*

*Proof. *Applying the well-known inequality (3.19) again and supposing for simplicity, we have (if for some )
which holds because
Substituting (3.28) into (3.6), it follows that
where
Considering (3.24), (3.25), and (3.26), it follows that
Let
where .

Obviously, if , then . So if (3.1) holds for all , and , then system (2.1) can be locally (globally) robustly stabilized by .

Note that is equivalent to that
Then pre- and postmultiply (3.34) by , we have
Setting , , and by the Schur’s complement, (3.35) is equivalent to (3.23). Thus, the theorem is proved.

In the special case when , our results reduce the corresponding results in memoryless state feedback case. The following theorem gives a sufficient condition for the existence of memoryless state feedback controller of system (2.1) with , .

Theorem 3.7. *For , in (2.1), suppose there exists an ,
**
holds for all , , if the LMIs
**
and (3.24), (3.25), and (3.26) have solutions , , , and , then system (2.1) can be locally (globally) robustly stabilized by
*

*Proof. *It is derived by the same procedure as the proof of Theorem 3.6.

By the above discussion about stochastic systems with single delay (2.1), we further study robust stabilization for the following stochastic systems with multiple delays where , , denote the state delay; .

For system (3.39), the following memory state feedback control law is adopted: Applying control law (3.40) to system (3.39), the resulting closed-loop system is given by where , , , .

By the same analysis as Theorem 3.2, we obtain the following theorem which gives a general sufficient condition for the robust stabilization of stochastic multiple time-delays system (3.39).

Theorem 3.8. *If (3.1) holds, and , , , and are the solutions of the following matrix inequality
**
then system (3.39) can be locally robustly stabilized by . Especially if is replaced by , then system (3.39) can be globally robustly stabilized by the same controller.**In (3.42), and are defined by**
where
*

*Remark 3.9. **From Theorem 3.7, some useful results can be easily derived for stochastic multiple time-delays systems (3.39), which are similar to the results obtained for stochastic single time-delay systems (2.1).*

#### 4. Numerical Example

Now, we present one example to illustrate the effectiveness of our developed result (Theorem 3.6) in testing the stabilization of nonlinear stochastic time-delay system (2.1).

In (2.1), take , , and Obviously, (2.1) holds for all with .

*Case 1 (Memory State Feedback Stabilization). *Substituting all the above data into (3.23) and then solving the LMIs (3.23), (3.24), (3.25), and (3.26) by LMIs Toolbox, we can obtain solutions
So by Theorem 3.6, system (2.1) can be globally robustly stabilized by
The state trajectories of close-loop system (2.6) and control curve in memory state feedback case are illustrated as Figure 1, from which, we see that the closed-loop system (2.6) takes only one second to have been stable.

*Case 2 (Memory-Less State Feedback Stabilization). *Solving LMIs (3.37), (3.24), (3.25), and (3.26), we obtain
So by Theorem 3.7, system (2.1) can be globally robustly stabilized by
The state trajectories of close-loop system (2.6) and control curve in memoryless state feedback case are illustrated as Figure 2, from which, it can be seen that the closed-loop system (2.6) takes 1.5 seconds to have been stable.

From the two simulation results, the time needed to stabilize system using memory state feedback controller is less than that using memory-less state feedback controller, which shows the advantage of memory state feedback control.

#### 5. Conclusions

This paper has discussed memory state feedback stabilization of stochastic systems with time-delay and nonlinear uncertainties. Some sufficient conditions have been given for the existence of a memory state feedback stabilizing control law in terms of linear matrix inequalities, which have the advantage of easy computation. The corresponding results to stochastic single time-delay systems have been further extended to the stochastic multiple time-delays systems. The results obtained in this paper can be reduced to the corresponding results in memoryless state feedback case and may also be extended to other stochastic system model.

#### Acknowledgment

This work is supported by the National Natural Science Foundation of China under Grant 61074088, and the Starting Research Foundation of Shandong Polytechnic University under Grant 12045501. The authors thank the reviewers and editors for their very helpful comments and suggestions which have improved the presentation of this paper.

#### References

- R. Z. Has’minskii,
*Stability of Differential Equations[M]*, Sijtioff and Noordhoff, Alphen, The Netherlands, 1980. - E. I. Verriest and P. Florchinger, “Stability of stochastic systems with uncertain time delays,”
*Systems and Control Letters*, vol. 24, no. 1, pp. 41–47, 1995. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - J. Li, W. Zhang, and Y. Mu, “Stability of nonlinear stochastic systems with uncertain time delays,” in
*Proceedings of the 7th World Congress on Intelligent Control and Automation (WCICA '08)*, pp. 5540–5544, June 2008. View at Publisher · View at Google Scholar · View at Scopus - C. Y. Lu, T. J. Su, and J. S. H. Tsai, “On robust stabilization of uncertain stochastic time-delay systems—an LMI-based approach,”
*Journal of the Franklin Institute*, vol. 342, no. 5, pp. 473–487, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - J. Zhang, P. Shi, and H. Yang, “Non-fragile robust stabilization and H∞ control for uncertain stochastic nonlinear time-delay systems,”
*Chaos, Solitons and Fractals*, vol. 42, no. 5, pp. 3187–3196, 2009. View at Publisher · View at Google Scholar · View at Scopus - Y. Zhang, Y. He, and M. Wu, “Delay-dependent robust stability for uncertain stochastic systems with interval time-varying delay,”
*Acta Automatica Sinica*, vol. 35, no. 5, pp. 577–582, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - X. Mao, “Robustness of stability of nonlinear systems with stochastic delay perturbations,”
*Systems and Control Letters*, vol. 19, no. 5, pp. 391–400, 1992. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - X. Mao, “Robustness of exponential stability of stochastic differential delay equations,”
*IEEE Transactions on Automatic Control*, vol. 41, no. 3, pp. 442–447, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - X. Mao, N. Koroleva, and A. Rodkina, “Robust stability of uncertain stochastic differential delay equations,”
*Systems and Control Letters*, vol. 35, no. 5, pp. 325–336, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - Y. Fu, Z. Tian, and S. Shi, “Output feedback stabilization for a class of stochastic time-delay nonlinear systems,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 6, pp. 847–851, 2005. View at Publisher · View at Google Scholar · View at Scopus - W. Zhang, B. S. Chen, and Q. Li, “Feedback stabilization of nonlinear stochastic time-delay systems with state and control-dependent noise,” in
*Proceedings of the American Control Conference*, pp. 3689–3692, July 2004. View at Scopus - W. Zhang, X. Liu, S. Kong, and Q. Li, “On stabilization for a class of nonlinear stochastic time-delay systems: a matrix inequality approach[J],”
*Journal of Control Theory and Application*, vol. 3, pp. 229–234, 2006. View at Google Scholar - P. Florchinger and E. I. Verriest, “Stabilization of nonlinear stochastic systems with delay feedback,” in
*Proceedings of the 32nd Conference on Decision and Control*, pp. 859–860, December 1993. View at Publisher · View at Google Scholar · View at Scopus - D. Yue and S. Won, “Delay-dependent robust stability of stochastic systems with time delay and nonlinear uncertainties,”
*Electronics Letters*, vol. 37, no. 15, pp. 992–993, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - J. P. Richard, “Time-delay systems: an overview of some recent advances and open problems,”
*Automatica*, vol. 39, no. 10, pp. 1667–1694, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - W. H. Chen, Z. H. Guan, and X. Lu, “Delay-dependent exponential stability of uncertain stochastic systems with multiple delays: An LMI approach,”
*Systems and Control Letters*, vol. 54, no. 6, pp. 547–555, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - S. Xu, P. Shi, Y. Chu, and Y. Zou, “Robust stochastic stabilization and H∞ control of uncertain neutral stochastic time-delay systems,”
*Journal of Mathematical Analysis and Applications*, vol. 314, no. 1, pp. 1–16, 2006. View at Publisher · View at Google Scholar · View at Scopus - W. Zhang, G. Feng, and Q. Li, “Robust ${H}_{\infty}$ filtering for nonlinear stochastic state-delayed systems,” in
*Proceedings of the 7th World Congress on Intelligent Control and Automation (WCICA '08)*, pp. 2212–2217, June 2008. View at Publisher · View at Google Scholar · View at Scopus - D. W. Ross, “Controller design for time lag systems via a quadratic criterion,”
*IEEE Transactions on Automatic Control*, vol. 16, no. 6, pp. 664–672, 1971. View at Google Scholar · View at Scopus - Y. S. Moon, P. Park, W. H. Kwon, and Y. S. Lee, “Delay-dependent robust stabilization of uncertain state-delayed systems,”
*International Journal of Control*, vol. 74, no. 14, pp. 1447–1455, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - B. Chen, J. Lam, and S. Xu, “Memory state feedback guaranteed cost control for neutral delay systems[J],”
*Internation Journal of Innovative Computing, Information, Control*, vol. 2, pp. 293–303, 2006. View at Google Scholar - Z. H. Jiang, W. H. Gui, Y. F. Xie, and C. H. Yang, “Memory state feedback control for singular systems with multiple internal incommensurate constant point delays,”
*Acta Automatica Sinica*, vol. 35, no. 2, pp. 174–179, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - J. Xiong and J. Lam, “Stabilization of discrete-time Markovian jump linear systems via time-delayed controllers,”
*Automatica*, vol. 42, no. 5, pp. 747–753, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus