## Recent Developments on the Stability and Control of Stochastic Systems

View this Special IssueResearch Article | Open Access

Wenwen Cheng, Quanxin Zhu, Zhangsong Yao, "Globally Asymptotic Stability of Stochastic Nonlinear Systems by the Output Feedback", *Mathematical Problems in Engineering*, vol. 2015, Article ID 574906, 8 pages, 2015. https://doi.org/10.1155/2015/574906

# Globally Asymptotic Stability of Stochastic Nonlinear Systems by the Output Feedback

**Academic Editor:**Antonino Laudani

#### Abstract

We address the problem of the globally asymptotic stability for a class of stochastic nonlinear systems with the output feedback control. By using the backstepping design method, a novel dynamic output feedback controller is designed to ensure that the stochastic nonlinear closed-loop system is globally asymptotically stable in probability. Our way is different from the traditional mathematical induction method. Indeed, we develop a new method to study the globally asymptotic stability by introducing a series of specific inequalities. Moreover, an example and its simulations are given to illustrate the theoretical result.

#### 1. Introduction

As is well known, the stability problem of nonlinear systems with the state feedback or output feedback control has received much attention since it can be extensively applied in many fields such as engineering and finance. In the practical application, nonlinear systems with the feedback control can model many kinds of stochastic influences either natural or man-made. The output feedback control especially has been used more widely for the reason that a system by the output feedback is more flexible to respond to the information of control systems than the state feedback.

In recent years, there has been a larger number of research works on the global stability for nonlinear systems with the output feedback control [1–6]. For example, Qian and Lin [5] have considered the global stability by the output feedback for a family of triangular nonlinear systems in which the gain parameter is dependent on the parameters of the controller. Combining the backstepping method and output feedback domination approach, M.-L. Liu and Y.-G. Liu [4] have investigated the semiglobally asymptotic stability for a class of uncertain nonlinear systems. In [1], Andrieu and Praly have applied the output feedback to study the globally asymptotic stability of nonlinear systems based on a unifying point. In [2], Du et al. have discussed the global output feedback stabilization of a class of uncertain upper-triangular systems with the input delay in which the controller with a scaling gain was used to deal with a larger input delay by a coordinate change. However, all the above works did not consider noise disturbances. Actually, the synaptic transmission in real systems can be viewed as a noisy process introduced by random fluctuations from the release of information and other probabilistic causes. Moreover, a system can be stabilized or destabilized by certain stochastic inputs. Therefore, noise disturbances should be taken into account when studying the stability of nonlinear systems.

It is worth pointing out that the problem of global output feedback stability for a class of deterministic lower-triangular systems has been solved in [5] by using the feedback domination design method and constructing a linear output compensator. Unfortunately, the noise disturbance was ignored in [5]. As discussed in the above, the noise disturbance has an important effect on the stability of a real system. So it is natural to question whether a nonlinear output feedback system is stable or not when it is affected by the noise disturbance. About this issue, the previous work on output feedback control of stochastic nonlinear systems almost combines the backstepping method and the mathematical induction to design the output feedback control. For example, Liu et al. [7, 8] have discussed the output feedback control of a class of stochastic nonlinear systems with linearly bounded unmeasurable states and a class of stochastic non-minimum-phase nonlinear systems. Chen et al. [9] and Liu and Xie [10] have talked about the state feedback stability for stochastic nonlinear systems with time-varying delay. Guo et al. [11] have solved the output feedback stability for a class of stochastic nonlinear systems with power growth conditions. More results can be found in [12–16]. The proofs in these papers are complicated.

In the spirit of stochastic stability theorem of Khasminskii [17] and that of Mao [18] about globally asymptotic stability in probability, we construct a novel Lyapunov function directly to prove the stability of the nonlinear stochastic output feedback system. As the discussion in [5], we also abandon the separation principle paradigm and apply a recursive control algorithm to design the linear control and the Lyapunov function. Different from the mathematical induction, we use some of the ingenious distortion of inequalities to make the infinitesimal generator negative definite. To obtain more concise result, we take the dynamic gain from 2 rather than 1. In particular, a novel linear observer system is designed and the Lyapunov function is constructed by the following formula:Without using the mathematical induction, we construct some variables to achieve the multiform inequalities. As a consequence, our result has more brief frame of the linear controller than that given in [19]. Moreover, the model discussed in [19] can be regarded as the special case of ours.

The rest of this paper is arranged as follows. In Section 2, we present the preparation of globally asymptotic stability and introduce some inequalities which play an important role in the proof of our main results. In Section 3, a novel dynamic output feedback is designed by the backstepping procedure. In Section 4, we use an example to illustrate the theoretical results. Finally, in Section 5, we conclude the paper with some general remarks.

#### 2. Preliminaries

In this section, we mainly give the definition of the globally asymptotic stability in probability and introduce several preliminary lemmas.

Consider the following stochastic nonlinear systems:where is the state; is an -dimensional standard Brownian motion; and the Borel measurable functions and are locally Lipschitz and satisfy , .

*Definition 1. *The function is said to be , if is continuous, strictly increasing, and vanishing at zero.

*Definition 2 (see [8]). *The equilibrium of (2) is said to be globally asymptotically stable in probability if, for any , there exists such thatand for any initial condition ,

*Definition 3 (see [8]). *For any given associated with system (2), the differential operator is defined as , where is called Hessian term of .

Lemma 4 (see [8]). *Consider system (2) and suppose that there exist positive definite, radially unbounded, twice continuously differentiable function , and a positive definite function such that ; then*(i)*for (2) there exists an almost surely unique strong solution on for each ;*(ii)*the equilibrium of system (2) is globally asymptotically stable in probability.*

Lemma 5 (see [13]). *Let . Then for any ,*

Lemma 6 (see [13]). *For any given real numbers , and any real-valued functions , , the following inequality holds:**where . Particularly when one takes , , and , then the inequality will become*

Lemma 7. *For any constants and , one has that, for any ,**where and .*

*Proof. *We first prove (8). Let , where is a parameter. Then we haveSo for any , , and , . With the sufficient condition of extreme value, is the maximum point of function . Therefore, it follows thatWe now prove (9). Similarly, letting , where is a parameter, we haveSo for any , , and , . With the sufficient condition of extreme value, is the maximum point of function . Thus, we get

Lemma 8. *For a series of numbers , one has*

Lemma 9 (Cauchy-Schwartz’s inequality). *Let the vector and , then*

Lemma 10 (Young’s inequality). *For vectors , , one has , where , , , and .*

#### 3. The Output Feedback Model and Control Design

In this section, we design a novel linear observer system (18) for the stochastic nonlinear system (16) below. Using the backstepping method, a simple linear control is constructed to guarantee that the closed-loop stochastic system is globally asymptotically stable in probability.

Consider the following nonlinear stochastic system:where is the state vector, is the control input, is the -dimensional standard Wiener process, and are the system output. The nonlinear functions and are locally Lipschitz with , , .

*Assumption 11. *The nonlinear functions and , , are locally Lipschitz with and for . Moreover, there exist two constants and such that

The linear observer system is designed aswhere is an appropriate constant and , are coefficients of the Hurwitz polynomial:The observation error satisfieswhere is a Hurwitz matrix. Therefore, there is a positive-definite matrix such that

Theorem 12. *Assume that Assumption 11 holds. Then, the equilibrium at origin of the closed-loop nonlinear stochastic system (16) and (18) with the linear controller (31) below is globally asymptotically stable in probability. Furthermore, it follows from Lemma 4 that there exists an almost surely unique strong solution on for each .*

*Proof. *Consider the following Lyapunov function . Then, we havewhere denotes the minimum eigenvalue and is the maximum eigenvalue of the matrix .

It follows from Assumption 11 thatRecalling that , we getwhere .

Substituting (24) into (22) yieldswhereNow, we take the Lyapunov function as follows:And , , and , where and is needed to be determined later. Then, a direct computation yieldswhereFrom Lemma 7, it follows thatwhereNow, we choose the gain constant , and then the right-hand side of (30) becomes negative definite. Therefore, it follows from Lemma 4 that the equilibrium of the closed-loop nonlinear stochastic system is globally asymptotically stable in probability and there exists an almost surely unique strong solution on for each .

*Remark 13. *Letting for all and , then system (16) is reduced to the deterministic system, which was studied by Qian and Lin in [5]. Therefore, we extend the conclusion for the deterministic system to the stochastic nonlinear system and construct a novel linear output feedback controller.

*Remark 14. *Letting for all and , then system (16) is reduced to that in [19], which was studied by Deng and Krstić. It is worth pointing out that the output feedback control in [19] is nonlinear, which is very complex. However, our research is based on a novel linear output feedback control. Therefore, our result extends and improves that in [19].

*Remark 15. *In [7], Liu and Zhang studied the stability of stochastic nonlinear systems with linearly bounded unmeasurable states by the output feedback control. It should be mentioned that the mathematical induction played a key role in the proof of the main result in [7]. However, in this paper, we construct a novel lyapunov function and prove the stability directly without using the mathematical induction, which make the proof more concise and help us construct the linear output feedback controller more easily.

#### 4. An Example

In this section, we will use an example to illustrate our main result.

*Example 1. *Consider the following stochastic nonlinear system:Obviously, the functions , , , are locally Lipschitz such that which verifies that Assumption 11 holds. Moreover, it is easy to check thatThe linear observer system is designed aswith a suitable choice of the parameter . The observation errors and satisfyFor the above matrix , there exists a positive-definite matrix satisfying , where It is easy to get the minimum eigenvalue and maximum eigenvalue of the matrix .

Now, taking , then we getwhereChoosing, and , we havewhere , , , and . Obviously, which is positive-definite and proper. By Theorem 12, we see that the equilibrium of the nonlinear closed-loop stochastic system (32) and (35) is globally asymptotically stable in probability and there exist an almost unique strong solution on . The state response and control input with initial conditions , , , and are presented in Figures 1–3.

Figures 1–3 show that the equilibrium of the closed-loop system is unique and tends to 0 when the initial state is nonzero. In other words, for the closed-loop system, the equilibrium is globally asymptotically stable in probability and there exists an almost surely unique strong solution on for each , which verifies our theoretical results.

#### 5. Conclusion

In this paper, we have studied the problem of globally asymptotic stability of stochastic nonlinear systems by the output feedback with a novel method. It is worth pointing out that the design of the dynamic output feedback controller plays an important role in the proof of our main result, especially that the Young inequality is a key tool. We believe that our formulation and approach can be used to analyse the stabilization problem of stochastic nonlinear systems with input delays, in which the feedback domination design will be a more complex structure.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

This work was jointly supported by the National Natural Science Foundation of China (61374080), the Natural Science Foundation of Zhejiang Province (LY12F03010), and a Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.

#### References

- V. Andrieu and L. Praly, “A unifying point of view on output feedback designs for global asymptotic stabilization,”
*Automatica*, vol. 45, no. 8, pp. 1789–1798, 2009. View at: Publisher Site | Google Scholar | MathSciNet - H.-B. Du, C.-J. Qian, S.-H. Li, and M. T. Frye, “Global output feedback stabilization of a class of upper-triangular systems with input delay,” in
*Proceedings of the American Control Conference (ACC ’12)*, pp. 5435–5439, Montréal, Canada, June 2012. View at: Google Scholar - D. Karagiannis, A. Astolfi, and R. Ortega, “Two results for adaptive output feedback stabilization of nonlinear systems,”
*Automatica*, vol. 39, no. 5, pp. 857–866, 2003. View at: Publisher Site | Google Scholar | MathSciNet - M.-L. Liu and Y.-G. Liu, “Semi-global stabilization via output-feedback for a class of uncertain nonlinear systems,”
*Acta Automatica Sinica*, vol. 39, no. 12, pp. 2154–2159, 2013. View at: Publisher Site | Google Scholar | MathSciNet - C.-J. Qian and W. Lin, “Output feedback control of a class of nonlinear systems: a nonseparation principle paradigm,”
*IEEE Transactions on Automatic Control*, vol. 47, no. 10, pp. 1710–1715, 2002. View at: Publisher Site | Google Scholar | MathSciNet - A. Teel and L. Praly, “Tools for semiglobal stabilization by partial state and output feedback,”
*SIAM Journal on Control and Optimization*, vol. 33, no. 5, pp. 1443–1488, 1995. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - S.-J. Liu and J.-F. Zhang, “Output-feedback control of a class of stochastic nonlinear systems with linearly bounded unmeasurable states,”
*International Journal of Robust and Nonlinear Control*, vol. 18, no. 6, pp. 665–687, 2008. View at: Publisher Site | Google Scholar | MathSciNet - S.-J. Liu, Z.-P. Jiang, and J.-F. Zhang, “Global output-feedback stabilization for a class of stochastic non-minimum-phase nonlinear systems,”
*Automatica*, vol. 44, no. 8, pp. 1944–1957, 2008. View at: Publisher Site | Google Scholar | MathSciNet - W.-S. Chen, J. Wu, and L.-C. Jiao, “State-feedback stabilization for a class of stochastic time-delay nonlinear systems,”
*International Journal of Robust and Nonlinear Control*, vol. 22, no. 17, pp. 1921–1937, 2012. View at: Publisher Site | Google Scholar | MathSciNet - L. Liu and X.-J. Xie, “State feedback stabilization for stochastic feedforward nonlinear systems with time-varying delay,”
*Automatica*, vol. 49, no. 4, pp. 936–942, 2013. View at: Publisher Site | Google Scholar | MathSciNet - L.-C. Guo, X. Zuo, J.-W. Liu, and H.-Q. Liang, “Output-feedback control of a class of stochastic nonlinear systems with power growth conditions,”
*International Journal of Control, Automation, and Systems*, vol. 12, pp. 274–282, 2014. View at: Google Scholar - H. Deng, M. Krstić, and R. J. Williams, “Stabilization of stochastic nonlinear systems driven by noise of unknown covariance,”
*IEEE Transactions on Automatic Control*, vol. 46, no. 8, pp. 1237–1253, 2001. View at: Publisher Site | Google Scholar | MathSciNet - S.-Y. Khoo, J.-L. Yin, Z.- H. Man, and X.-H. Yu, “Finite-time stabilization of stochastic nonlinear systems in strict-feedback form,”
*Automatica*, vol. 49, no. 5, pp. 1403–1410, 2013. View at: Publisher Site | Google Scholar | MathSciNet - Z.-J. Wu, X.-J. Xie, and S.-Y. Zhang, “Stochastic adaptive backstepping controller design by introducing dynamic signal and changing supply function,”
*International Journal of Control*, vol. 79, no. 12, pp. 1635–1646, 2006. View at: Publisher Site | Google Scholar | MathSciNet - Z.-J. Wu, X.-J. Xie, and S.-Y. Zhang, “Adaptive backstepping controller design using stochastic small-gain theorem,”
*Automatica*, vol. 43, no. 4, pp. 608–620, 2007. View at: Publisher Site | Google Scholar | MathSciNet - X.-J. Xie and L. Liu, “Further results on output feedback stabilization for stochastic high-order nonlinear systems with time-varying delay,”
*Automatica*, vol. 48, no. 10, pp. 2577–2586, 2012. View at: Publisher Site | Google Scholar | MathSciNet - R. Khasminskii,
*Stochastic Stability of Differential Equations*, Springer, New York, NY, USA, 2011. View at: Publisher Site | MathSciNet - X.-R. Mao,
*Stochastic Differential Equations and Applications*, Horwood, 2008. - H. Deng and M. Krstić, “Output-feedback stochastic nonlinear stabilization,”
*IEEE Transactions on Automatic Control*, vol. 44, no. 2, pp. 328–333, 1999. View at: Publisher Site | Google Scholar | MathSciNet

#### Copyright

Copyright © 2015 Wenwen Cheng et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.