<svg xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="http://www.w3.org/2000/svg" style="vertical-align:-4.5247pt" id="M1" height="16.402pt" version="1.1" viewBox="-0.0657574 -11.8773 27.7437 16.402" width="27.7437pt"><g transform="matrix(.018,0,0,-0.018,0,0)"><path id="g113-73" d="M828 650H570L564 622C646 614 650 609 634 524L604 366H253L281 524C296 608 308 615 382 622L388 650H132L126 622C211 615 214 609 198 524L121 122C106 42 102 35 23 28L17 0H276L282 28C196 35 191 40 206 122L243 324H597L559 123C544 42 537 35 452 28L446 0H710L716 28C632 35 628 43 643 122L719 524C735 610 741 615 822 622L828 650Z"/></g><g transform="matrix(.013,0,0,-0.013,13.86,4.308)"><path id="g50-30" d="M1000 227C1000 351 905 451 780 451C658 451 590 380 530 279C465 385 388 451 261 451C168 451 38 376 38 210C38 98 121 -12 261 -12C381 -12 448 59 508 160C573 53 652 -12 780 -12C879 -12 1000 64 1000 227ZM485 199C434 109 370 25 271 25C188 25 133 117 133 241C133 355 189 414 249 414C357 414 426 302 485 199ZM903 204C903 70 852 25 790 25C681 25 611 136 552 240C603 330 669 414 768 414C855 414 903 321 903 204Z"/></g></svg> Control for Nonlinear Stochastic Systems with Time-Delay and Multiplicative Noise

Gao, Ming; Zhang, Weihai; Zhu, Zhengmao

doi:https://doi.org/10.1155/2015/382859

Mathematical Problems in Engineering

On this page

Abstract Introduction Preliminaries Conclusions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 382859 | https://doi.org/10.1155/2015/382859

Control for Nonlinear Stochastic Systems with Time-Delay and Multiplicative Noise

Ming Gao,^1,2Weihai Zhang,²and Zhengmao Zhu³

Academic Editor: Quanxin Zhu

Received08 Aug 2014

Accepted26 Sept 2014

Published02 Mar 2015

Abstract

This paper studies the infinite horizon control problem for a general class of nonlinear stochastic systems with time-delay and multiplicative noise. The exponential/asymptotic mean square control design of delayed nonlinear stochastic systems is presented by solving Hamilton-Jacobi inequalities. Two numerical examples are provided to show the effectiveness of the proposed design method.

1. Introduction

It is well known that control is one of the most effective approaches to eliminate the effect of the external disturbance [1]. For deterministic linear systems, norm is defined by a norm of the transfer function, which cannot be extended to stochastic or nonlinear systems directly. In 1989, Doyle et al. found that, from the view point of time-domain, the norm of a transfer function was the -induced norm of the input-output operator [2], which made it possible to develop the nonlinear or stochastic theory [3, 4]. Following along the lines of [4], Zhang and Chen developed infinite and finite horizon nonlinear stochastic control designs by means of Hamilton-Jacobi equations [5]. Moreover, the mixed control has also received much attention due to its important significance in practical applications [6].

The phenomena of time-delay are frequently encountered in many engineering applications owing to the finite speed of information processing [7]. Time-delay, nonlinearity, and stochasticity are arguably three of the main sources in reality which result in the complexity of a system. Over the past years, the stability of delayed nonlinear stochastic systems (DNSSs) has gained significant research interests [8–15]. In [8], Mao established the LaSalle-type theorems for the solutions of stochastic differential delay equations, which was applied to establish sufficient criteria for the stochastically asymptotic stability of the delay equations. In [10], the problem of exponential stability for a class of impulsive nonlinear stochastic differential equations with mixed time-delays was investigated, and some interesting results were derived. In [13], the delay-dependent stability conditions for DNSSs were derived based on the convergence theorem for semimartingale inequalities.

Although many results for the stability analysis of DNSSs have been published, the control problem of DNSSs has received relatively little attention [16–18]. In [16], the analysis problem was studied for a general class of nonlinear stochastic systems with time-delay by using the Razumikhin-type method. In [17], the problem of robust output feedback control was studied for a class of uncertain discrete-time DNSSs with missing measurements. In [18], the quantized control problem was investigated for delayed nonlinear stochastic network-based systems with data missing. However, most of the above literatures only considered the stochastic systems with state-dependent noise. As pointed in [19], the control input and external disturbance may also be corrupted by noise. Therefore, it is necessary to study the stochastic systems with state, control, and disturbance-dependent noise [20, 21].

Motivated by the preceding discussion, this paper will investigate the infinite horizon control for a class of nonlinear stochastic state-delayed systems with multiplicative noise. Compared with [16–18, 22], the considered system in this paper is more general since state, control, and disturbance enter into the diffusion term simultaneously. By means of Hamilton-Jacobi inequalities (HJIs), a sufficient condition is derived for the exponential and asymptotic mean square control of DNSSs, respectively. In contrast to the conditions for delay-free control [20, 21], the current HJIs depend on more variables owing to the appearance of time-delay. Finally, two numerical examples are given to demonstrate the effectiveness of the obtained results.

Throughout this paper, the following notations will be used. is -dimensional Euclidean space. is the set of all real matrices. is the transpose of a matrix . : is a positive definite (positive semidefinite) symmetric matrix. is the mathematical expectation. is the Euclidean norm of a vector . is the space of nonanticipative stochastic processes with respect to an increasing -algebras satisfying . is the class of functions twice continuously differential with respect to and once continuously differential with respect to , except possibly at the point . is a vector space of all continuous -valued functions defined on . : .

2. Definitions and Preliminaries

Consider the following delayed nonlinear stochastic system with multiplicative noise: where , , , and represent the system state, control input, exogenous disturbance, and regulated output, respectively. is the one-dimensional standard Wiener process defined on a complete filtered space , a filtration satisfying usual conditions. denotes all -measurable bounded -valued random variable . Assume that , , , , , , and satisfy the local Lipschitz condition and the linear growth condition, which guarantee system (1) has a unique strong solution [23]. Moreover, suppose that ; hence is an equilibrium point of (1). For simplicity, we denote and .

For each , an operator associated with (1) is defined as follows [8]: where , , and .

To deal with the infinite horizon control of system (1), the following internal stability is needed.

Definition 1 (see [23]). The delayed nonlinear stochastic system, is exponentially mean square stable, if there exist positive constants and such that every solution of (3) satisfies where .

Lemma 2 (see [24]). System (3) is exponentially mean square stable, if there exist a positive definite Lyapunov function and with such that(i), ,(ii), .

Definition 3. For given , is said to be an exponential mean square control of system (1), if(i)for any nonzero and , , one always has (ii)system (1) with and is internally stable; that is, the system is exponentially mean square stable.

Equation (5) is equivalent to , where the perturbation operator is defined by as

Definition 4. In (ii) of Definition 3, if the equilibrium point of system (6) is asymptotically mean square stable, that is, and (5) holds, then is called an asymptotic mean square control.

Lemma 5 (see [25]). For a positive definite symmetric matrix and any matrices (or vectors) and , one has

Lemma 6 (see [21]). For any vectors and symmetric matrix , exists, and one has

3. Infinite Horizon Stochastic Control

In this section, several sufficient conditions are presented for the infinite horizon control of system (1) by using inequality technique.

Theorem 7. Assume that there exist a positive function and with such that(i), ,(ii), .For given , if solves the Hamilton-Jacobi inequalities (HJIs) then is an exponential mean square control of (1).

Proof. Applying Itô’s formula to , we have Taking mathematical expectation on both sides of (14), we obtain where Considering and Lemma 5, we have Therefore, where
Set According to Lemma 6, and can be rewritten as Implementing (21) and into (18) yields According to (11), we have Considering (12) and taking , (23) leads to Let , and then (5) of Definition 3 is proved.
Next, we will prove system (6) to be exponentially mean square stable. Let be the infinitesimal generator of the system (6), and then Setting and implementing into and , it yields
Substituting (28) into (25) and considering conditions (i), (ii), and (11) in Theorem 7, it follows that From Lemma 2, system (6) is exponentially mean square stable. This theorem is proved.

The following theorem is derived for the asymptotic mean square control, which is weaker than the exponential mean square control.

Theorem 8. Assume that has an infinitesimal upper limit; that is, and for some . If solves HJIs (11)-(12), then (13) is an asymptotic mean square control of (1).

Proof. It only needs to prove that system (6) is asymptotically mean square stable when . We know that from (29), which implies that system (6) is globally asymptotically stable in probability 1 [26]. According to Itô formula and the property of stochastic integration, we obtain Let , and then (30) leads to which means that is a nonnegative supermartingale with respect to . According to Doob’s convergence theorem [27] and a.s., we have a.s. Furthermore, . Since for some , it yields that . The proof is completed.

Remark 9. In [24], Zhang et al. studied the robust filtering problem of nonlinear stochastic systems with time delay. However, the control problem was not tackled in [24], mainly due to mathematical difficulties in dealing with the case that state, control, and disturbance enter into the diffusion term simultaneously. In this paper, Lemma 6 is applied to solve this problem, and two sufficient conditions for control of delayed nonlinear stochastic systems are obtained in Theorems 7 and 8.

Remark 10. A further development of the present issue is twofold. On the one hand, in order to avoid solving HJIs (11) and (12), the global linearization approach [25] or fuzzy approach based on Takagi-Sugeno model [28] can be used to design control for delayed nonlinear stochastic systems. On the other hand, Lévy noise is more versatile and interesting with a wider range of applications in comparison to the standard Gaussian noise [29, 30]. Therefore, the control of stochastic differential equations with Lévy noise is another valuable research topic.

4. Numerical Examples

In this section, two numerical examples are given to illustrate the proposed control design.

Example 1. Consider the following one-dimensional nonlinear stochastic state-delayed system:
Set , to be determined, and then HJIs (11)-(12) become Given , the above inequalities have a solution . From Theorem 7, the control of system (32) is .

The initial condition is chosen as for any with and . Applying the Euler-Maruyama method [31], the state responses of the unforced system and the controlled system and the control input are shown in Figures 1, 2, and 3, respectively. It is found that the controlled system can achieve stability and attenuation performance by using the proposed control.

Example 2. Consider a two-dimensional system (1) with the following parameters: Take with to be determined. For a given disturbance attenuation level , is a solution to (11)-(12). According to Theorem 7, is an control of system (1). The initial condition is chosen as for any , and take . By using a similar method in Example 1, the states of the controlled system and the control input are shown in Figures 4-5, which show the effectiveness of the designed controller.

5. Conclusions

For general delayed nonlinear stochastic systems with state, control, and disturbance-dependent noise, this paper has presented a sufficient condition for exponential/asymptotic mean square control problem in terms of HJIs. There still remain many interesting topics, for example, how to derive delay-dependent conditions or how to design control for delayed nonlinear stochastic systems. These issues deserve further research.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work is supported by the National Natural Science Foundation of China (nos. 61174078, 61203053, and 61403420), China Postdoctoral Science Foundation Funded Project (no. 2013M531635), Special Funds for Postdoctoral Innovative Projects of Shandong Province (no. 201203096), Research Fund for the Taishan Scholar Project of Shandong Province of China, and SDUST Research Fund (no. 2011KYTD105).

References

T. Basar and P. Bernhar, H_∞ Optimal Control and Related Minimax Design Problems: A Dynamic Game Approach, Birkhäuser, Boston, Mass, USA, 1995.
J. C. Doyle, K. Glover, P. P. Khargonekar, and B. A. Francis, “State-space solutions to standard H₂ and $H_{\infty}$ control problems,” IEEE Transactions on Automatic Control, vol. 34, no. 8, pp. 831–847, 1989.
View at: Publisher Site | Google Scholar | MathSciNet
A. J. van der Schaft, “ $L_{2}$ -gain analysis of nonlinear systems and nonlinear state feedback $L_{\infty}$ control,” IEEE Transactions on Automatic Control, vol. 37, no. 6, pp. 770–784, 1992.
View at: Google Scholar
D. Hinrichsen and A. J. Pritchard, “Stochastic $H_{\infty}$ ,” SIAM Journal on Control and Optimization, vol. 36, no. 5, pp. 1504–1538, 1998.
View at: Publisher Site | Google Scholar
W. Zhang and B.-S. Chen, “State feedback $H_{\infty}$ control for a class of nonlinear stochastic systems,” SIAM Journal on Control and Optimization, vol. 44, no. 6, pp. 1973–1991, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
L. Sheng, W. Zhang, and M. Gao, “Relationship between Nash equilibrium strategies and $H_{2}$ / $H_{\infty}$ control of stochastic Markov jump systems with multiplicative noise,” IEEE Transactions on Automatic Control, vol. 59, no. 9, pp. 2592–2597, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J.-P. Richard, “Time-delay systems: an overview of some recent advances and open problems,” Automatica, vol. 39, no. 10, pp. 1667–1694, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
X. Mao, “LaSalle-type theorems for stochastic differential delay equations,” Journal of Mathematical Analysis and Applications, vol. 236, no. 2, pp. 350–369, 1999.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
L. Sheng and H. Yang, “Robust stability of uncertain Markovian jumping Cohen-Grossberg neural networks with mixed time-varying delays,” Chaos, Solitons & Fractals, vol. 42, no. 4, pp. 2120–2128, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu and B. Song, “Exponential stability of impulsive nonlinear stochastic differential equations with mixed delays,” Nonlinear Analysis: Real World Applications, vol. 12, no. 5, pp. 2851–2860, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, F. Xi, and X. Li, “Robust exponential stability of stochastically nonlinear jump systems with mixed time delays,” Journal of Optimization Theory and Applications, vol. 154, no. 1, pp. 154–174, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Q. Zhu, “Stabilization of stochastically singular nonlinear jump systems with unknown parameters and continuously distributed delays,” International Journal of Control, Automation and Systems, vol. 11, no. 4, pp. 683–691, 2013.
View at: Publisher Site | Google Scholar
M. Basin and A. Rodkina, “On delay-dependent stability for a class of nonlinear stochastic systems with multiple state delays,” Nonlinear Analysis: Theory, Methods & Applications, vol. 68, no. 8, pp. 2147–2157, 2008.
View at: Publisher Site | Google Scholar
X. Li and X. Mao, “A note on almost sure asymptotic stability of neutral stochastic delay differential equations with Markovian switching,” Automatica, vol. 48, no. 9, pp. 2329–2334, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, “ $p$ th moment exponential stability of impulsive stochastic functional differential equations with Markovian switching,” Journal of the Franklin Institute: Engineering and Applied Mathematics, vol. 351, no. 7, pp. 3965–3986, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
H. Shu and G. Wei, “ $H_{\infty}$ analysis of nonlinear stochastic time-delay systems,” Chaos, Solitons & Fractals, vol. 26, no. 2, pp. 637–647, 2005.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Wang, D. W. Ho, Y. Liu, and X. Liu, “Robust $H_{\infty}$ control for a class of nonlinear discrete time-delay stochastic systems with missing measurements,” Automatica, vol. 45, no. 3, pp. 684–691, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Wang, B. Shen, H. Shu, and G. Wei, “Quantized $H_{\infty}$ control for nonlinear stochastic time-delay systems with missing measurements,” IEEE Transactions on Automatic Control, vol. 57, no. 6, pp. 1431–1444, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
B. Øksendal, Stochastic Differential Equations, Springer, New York, NY, USA, 1998.
View at: Publisher Site | MathSciNet
W. Zhang, B.-S. Chen, H. Tang, L. Sheng, and M. Gao, “Some remarks on general nonlinear stochastic $H_{\infty}$ control with state, control, and disturbance-dependent noise,” IEEE Transactions on Automatic Control, vol. 59, no. 1, pp. 237–242, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
L. Sheng, M. Zhu, W. Zhang, and Y. Wang, “Nonlinear stochastic $H_{\infty}$ control with Markov jumps and $(x, u, v)$ -dependent noise: finite and infinite horizon cases,” Mathematical Problems in Engineering, vol. 2014, Article ID 948134, 10 pages, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
H. Yang and L. Sheng, “Robust stability of uncertain stochastic fuzzy cellular neural networks,” Neurocomputing, vol. 73, no. 1–3, pp. 133–138, 2009.
View at: Publisher Site | Google Scholar
X. Mao, Stochastic Differential Equations and Applications, Horwood, Chichester, UK, 2nd edition, 2007.
View at: Publisher Site | MathSciNet
W. Zhang, G. Feng, and Q. Li, “Robust $H_{\infty}$ filtering for general nonlinear stochastic state-delayed systems,” Mathematical Problems in Engineering, vol. 2012, Article ID 231352, 15 pages, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
B.-S. Chen, W.-H. Chen, and H.-L. Wu, “Robust $H_{2} / H_{\infty}$ global linearization filter design for nonlinear stochastic systems,” IEEE Transactions on Circuits and Systems. I: Regular Papers, vol. 56, no. 7, pp. 1441–1454, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
R. Z. Has'minskii, Stochastic Stability of Differential Equations, vol. 7 of Monographs and Textbooks on Mechanics of Solids and Fluids: Mechanics and Analysis, Sijthoff & Noordhoff, Alphen aan den Rijn, The Netherlands, 1980.
View at: MathSciNet
J. L. Doob, Stochastic Processes, John Wiley & Sons, New York, NY, USA, 1953.
L. Sheng, M. Gao, and W. Zhang, “Dissipative control for Markov jump non-linear stochastic systems based on T-S fuzzy model,” International Journal of Systems Science, vol. 45, no. 5, pp. 1213–1224, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
D. Applebaum and M. Siakalli, “Asymptotic stability of stochastic differential equations driven by Lévy noise,” Journal of Applied Probability, vol. 46, no. 4, pp. 1116–1129, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, “Asymptotic stability in the $p$ th moment for stochastic differential equations with Lévy noise,” Journal of Mathematical Analysis and Applications, vol. 416, no. 1, pp. 126–142, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
D. J. Higham, “An algorithmic introduction to numerical simulation of stochastic differential equations,” SIAM Review, vol. 43, no. 3, pp. 525–546, 2001.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2015 Ming Gao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

673

Downloads

781

Citations