Recent Developments on the Stability and Control of Stochastic SystemsView this Special Issue
Globally Asymptotic Stability of Stochastic Nonlinear Systems by the Output Feedback
We address the problem of the globally asymptotic stability for a class of stochastic nonlinear systems with the output feedback control. By using the backstepping design method, a novel dynamic output feedback controller is designed to ensure that the stochastic nonlinear closed-loop system is globally asymptotically stable in probability. Our way is different from the traditional mathematical induction method. Indeed, we develop a new method to study the globally asymptotic stability by introducing a series of specific inequalities. Moreover, an example and its simulations are given to illustrate the theoretical result.
As is well known, the stability problem of nonlinear systems with the state feedback or output feedback control has received much attention since it can be extensively applied in many fields such as engineering and finance. In the practical application, nonlinear systems with the feedback control can model many kinds of stochastic influences either natural or man-made. The output feedback control especially has been used more widely for the reason that a system by the output feedback is more flexible to respond to the information of control systems than the state feedback.
In recent years, there has been a larger number of research works on the global stability for nonlinear systems with the output feedback control [1–6]. For example, Qian and Lin  have considered the global stability by the output feedback for a family of triangular nonlinear systems in which the gain parameter is dependent on the parameters of the controller. Combining the backstepping method and output feedback domination approach, M.-L. Liu and Y.-G. Liu  have investigated the semiglobally asymptotic stability for a class of uncertain nonlinear systems. In , Andrieu and Praly have applied the output feedback to study the globally asymptotic stability of nonlinear systems based on a unifying point. In , Du et al. have discussed the global output feedback stabilization of a class of uncertain upper-triangular systems with the input delay in which the controller with a scaling gain was used to deal with a larger input delay by a coordinate change. However, all the above works did not consider noise disturbances. Actually, the synaptic transmission in real systems can be viewed as a noisy process introduced by random fluctuations from the release of information and other probabilistic causes. Moreover, a system can be stabilized or destabilized by certain stochastic inputs. Therefore, noise disturbances should be taken into account when studying the stability of nonlinear systems.
It is worth pointing out that the problem of global output feedback stability for a class of deterministic lower-triangular systems has been solved in  by using the feedback domination design method and constructing a linear output compensator. Unfortunately, the noise disturbance was ignored in . As discussed in the above, the noise disturbance has an important effect on the stability of a real system. So it is natural to question whether a nonlinear output feedback system is stable or not when it is affected by the noise disturbance. About this issue, the previous work on output feedback control of stochastic nonlinear systems almost combines the backstepping method and the mathematical induction to design the output feedback control. For example, Liu et al. [7, 8] have discussed the output feedback control of a class of stochastic nonlinear systems with linearly bounded unmeasurable states and a class of stochastic non-minimum-phase nonlinear systems. Chen et al.  and Liu and Xie  have talked about the state feedback stability for stochastic nonlinear systems with time-varying delay. Guo et al.  have solved the output feedback stability for a class of stochastic nonlinear systems with power growth conditions. More results can be found in [12–16]. The proofs in these papers are complicated.
In the spirit of stochastic stability theorem of Khasminskii  and that of Mao  about globally asymptotic stability in probability, we construct a novel Lyapunov function directly to prove the stability of the nonlinear stochastic output feedback system. As the discussion in , we also abandon the separation principle paradigm and apply a recursive control algorithm to design the linear control and the Lyapunov function. Different from the mathematical induction, we use some of the ingenious distortion of inequalities to make the infinitesimal generator negative definite. To obtain more concise result, we take the dynamic gain from 2 rather than 1. In particular, a novel linear observer system is designed and the Lyapunov function is constructed by the following formula:Without using the mathematical induction, we construct some variables to achieve the multiform inequalities. As a consequence, our result has more brief frame of the linear controller than that given in . Moreover, the model discussed in  can be regarded as the special case of ours.
The rest of this paper is arranged as follows. In Section 2, we present the preparation of globally asymptotic stability and introduce some inequalities which play an important role in the proof of our main results. In Section 3, a novel dynamic output feedback is designed by the backstepping procedure. In Section 4, we use an example to illustrate the theoretical results. Finally, in Section 5, we conclude the paper with some general remarks.
In this section, we mainly give the definition of the globally asymptotic stability in probability and introduce several preliminary lemmas.
Consider the following stochastic nonlinear systems:where is the state; is an -dimensional standard Brownian motion; and the Borel measurable functions and are locally Lipschitz and satisfy , .
Definition 1. The function is said to be , if is continuous, strictly increasing, and vanishing at zero.
Lemma 4 (see ). Consider system (2) and suppose that there exist positive definite, radially unbounded, twice continuously differentiable function , and a positive definite function such that ; then(i)for (2) there exists an almost surely unique strong solution on for each ;(ii)the equilibrium of system (2) is globally asymptotically stable in probability.
Lemma 5 (see ). Let . Then for any ,
Lemma 6 (see ). For any given real numbers , and any real-valued functions , , the following inequality holds:where . Particularly when one takes , , and , then the inequality will become
Lemma 7. For any constants and , one has that, for any ,where and .
Proof. We first prove (8). Let , where is a parameter. Then we haveSo for any , , and , . With the sufficient condition of extreme value, is the maximum point of function . Therefore, it follows thatWe now prove (9). Similarly, letting , where is a parameter, we haveSo for any , , and , . With the sufficient condition of extreme value, is the maximum point of function . Thus, we get
Lemma 8. For a series of numbers , one has
Lemma 9 (Cauchy-Schwartz’s inequality). Let the vector and , then
Lemma 10 (Young’s inequality). For vectors , , one has , where , , , and .
3. The Output Feedback Model and Control Design
In this section, we design a novel linear observer system (18) for the stochastic nonlinear system (16) below. Using the backstepping method, a simple linear control is constructed to guarantee that the closed-loop stochastic system is globally asymptotically stable in probability.
Consider the following nonlinear stochastic system:where is the state vector, is the control input, is the -dimensional standard Wiener process, and are the system output. The nonlinear functions and are locally Lipschitz with , , .
Assumption 11. The nonlinear functions and , , are locally Lipschitz with and for . Moreover, there exist two constants and such that
The linear observer system is designed aswhere is an appropriate constant and , are coefficients of the Hurwitz polynomial:The observation error satisfieswhere is a Hurwitz matrix. Therefore, there is a positive-definite matrix such that
Theorem 12. Assume that Assumption 11 holds. Then, the equilibrium at origin of the closed-loop nonlinear stochastic system (16) and (18) with the linear controller (31) below is globally asymptotically stable in probability. Furthermore, it follows from Lemma 4 that there exists an almost surely unique strong solution on for each .
Proof. Consider the following Lyapunov function . Then, we havewhere denotes the minimum eigenvalue and is the maximum eigenvalue of the matrix .
It follows from Assumption 11 thatRecalling that , we getwhere .
Substituting (24) into (22) yieldswhereNow, we take the Lyapunov function as follows:And , , and , where and is needed to be determined later. Then, a direct computation yieldswhereFrom Lemma 7, it follows thatwhereNow, we choose the gain constant , and then the right-hand side of (30) becomes negative definite. Therefore, it follows from Lemma 4 that the equilibrium of the closed-loop nonlinear stochastic system is globally asymptotically stable in probability and there exists an almost surely unique strong solution on for each .
Remark 13. Letting for all and , then system (16) is reduced to the deterministic system, which was studied by Qian and Lin in . Therefore, we extend the conclusion for the deterministic system to the stochastic nonlinear system and construct a novel linear output feedback controller.
Remark 14. Letting for all and , then system (16) is reduced to that in , which was studied by Deng and Krstić. It is worth pointing out that the output feedback control in  is nonlinear, which is very complex. However, our research is based on a novel linear output feedback control. Therefore, our result extends and improves that in .
Remark 15. In , Liu and Zhang studied the stability of stochastic nonlinear systems with linearly bounded unmeasurable states by the output feedback control. It should be mentioned that the mathematical induction played a key role in the proof of the main result in . However, in this paper, we construct a novel lyapunov function and prove the stability directly without using the mathematical induction, which make the proof more concise and help us construct the linear output feedback controller more easily.
4. An Example
In this section, we will use an example to illustrate our main result.
Example 1. Consider the following stochastic nonlinear system:Obviously, the functions , , , are locally Lipschitz such that which verifies that Assumption 11 holds. Moreover, it is easy to check thatThe linear observer system is designed aswith a suitable choice of the parameter . The observation errors and satisfyFor the above matrix , there exists a positive-definite matrix satisfying , where It is easy to get the minimum eigenvalue and maximum eigenvalue of the matrix .
Now, taking , then we getwhereChoosing, and , we havewhere , , , and . Obviously, which is positive-definite and proper. By Theorem 12, we see that the equilibrium of the nonlinear closed-loop stochastic system (32) and (35) is globally asymptotically stable in probability and there exist an almost unique strong solution on . The state response and control input with initial conditions , , , and are presented in Figures 1–3.
Figures 1–3 show that the equilibrium of the closed-loop system is unique and tends to 0 when the initial state is nonzero. In other words, for the closed-loop system, the equilibrium is globally asymptotically stable in probability and there exists an almost surely unique strong solution on for each , which verifies our theoretical results.
In this paper, we have studied the problem of globally asymptotic stability of stochastic nonlinear systems by the output feedback with a novel method. It is worth pointing out that the design of the dynamic output feedback controller plays an important role in the proof of our main result, especially that the Young inequality is a key tool. We believe that our formulation and approach can be used to analyse the stabilization problem of stochastic nonlinear systems with input delays, in which the feedback domination design will be a more complex structure.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was jointly supported by the National Natural Science Foundation of China (61374080), the Natural Science Foundation of Zhejiang Province (LY12F03010), and a Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.
H.-B. Du, C.-J. Qian, S.-H. Li, and M. T. Frye, “Global output feedback stabilization of a class of upper-triangular systems with input delay,” in Proceedings of the American Control Conference (ACC ’12), pp. 5435–5439, Montréal, Canada, June 2012.View at: Google Scholar
L.-C. Guo, X. Zuo, J.-W. Liu, and H.-Q. Liang, “Output-feedback control of a class of stochastic nonlinear systems with power growth conditions,” International Journal of Control, Automation, and Systems, vol. 12, pp. 274–282, 2014.View at: Google Scholar
X.-R. Mao, Stochastic Differential Equations and Applications, Horwood, 2008.