About this Journal Submit a Manuscript Table of Contents 
Mathematical Problems in Engineering
Volume 2012 (2012), Article ID 673878, 15 pages
doi:10.1155/2012/673878
Research Article

Adaptive Output Feedback Control for a Class of Stochastic Nonlinear Systems with SiISS Inverse Dynamics

Na Duan and Hai-Kuan Liu

School of Electrical Engineering and Automation, Jiangsu Normal University, Xuzhou 221116, China

Received 29 October 2011; Accepted 24 November 2011

Academic Editor: Xue-Jun Xie

Copyright © 2012 Na Duan and Hai-Kuan Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

The adaptive stabilization scheme based on tuning function for stochastic nonlinear systems with stochastic integral input-to-state stability (SiISS) inverse dynamics is investigated. By combining the stochastic LaSalle theorem and small-gain type conditions on SiISS, an adaptive output feedback controller is constructively designed. It is shown that all the closed-loop signals are bounded almost surely and the stochastic closed-loop system is globally stable in probability.

1. Introduction

Global stabilization control design of stochastic nonlinear systems is one of the most important topics in nonlinear control theory, which has received and is increasingly receiving a great deal of attention; see, for example, [1–37] and the references therein. For a class of stochastic nonlinear systems with stochastic inverse dynamics, much progress has been made in the design of the global stabilization controller [12, 13, 15, 16, 24, 25, 31]. However, all these controllers are only robust against stochastic inverse dynamics with stringent stability margin. To weaken the stringent condition on stochastic inverse dynamics, a natural idea is to benefit from input-to-state stability (ISS) in [38] and integral input-to-state stability (iISS) in [39] which are now recognized as the central unifying concepts in feedback design and stability analysis of deterministic nonlinear systems. Tsinias in [21], Tang and Basar in [19] first proposed the concept of stochastic input-to-state stability (SISS) independently. Further in-depth study on SISS and its applications are presented in [9–11, 18, 22]. Motivated by these aforementioned important results, [34] showed that SISS condition can be weakened to stochastic integral input-to-state stability (SiISS) and developed a unifying output feedback framework for global regulation.

Nonlinear small-gain theorem plays an important role in the controller design and stability analysis of deterministic nonlinear systems in [40, 41]. While for stochastic nonlinear systems, there are fewer results on the small-gain theorem. [25] firstly established a gain-function-based stochastic nonlinear small-gain theorem for ISpS in probability. In some succeeding research work, [9, 11, 35] presented some Lyapunov-based small-gain type conditions on SISS and SiISS, respectively. [4] further discusses the relationship of small-gain type conditions on SiISS and studies the problem of GAS in probability via output feedback.

In this paper, inspired by [4], a more general class of stochastic nonlinear systems with uncertain parameters and stochastic integral input-to-state stability (SiISS) inverse dynamics is investigated. By combining the stochastic LaSalle theorem and small-gain type conditions on SiISS, an adaptive output feedback controller is proposed to guarantee that all the closed-loop signals are bounded almost surely and the stochastic closed-loop system is globally stable in probability.

The paper is organized as follows. Section 2 begins with the mathematical preliminaries. Section 3 presents statement of the problem. The design of adaptive output feedback controller is given in Section 4. The corresponding analysis is given in Section 5. Section 6 concludes the paper.

2. Mathematical Preliminaries

The following notations are used throughout the paper. stands for the set of all nonnegative real numbers, is the -dimensional Euclidean space, and is the space of real -matrices. For , one defines , . denotes the family of all the functions with continuous th partial derivatives. is the family of all functions such that . For a given vector or matrix , denotes its transpose, denotes its trace when is square. denotes the Euclidean norm of a vector , and for a matrix . denotes the set of all functions: , which are continuous, strictly increasing, and vanishing at zero; is the set of all functions which are of class and unbounded; denotes the set of all functions : , which are of for each fixed and decrease to zero as for each fixed .

Consider the stochastic nonlinear delay-free system where , is an -dimensional standard Wiener process defined in a complete probability space with being a sample space, being a -field, being a filtration, and being the probability measure. Borel measurable functions : and : are piecewise continuous in and locally bounded and locally Lipschitz continuous in uniformly in . Let denote infinitesimal generator of function along stochastic system (2.1) with the definition of

Definition 2.1 (see [34]). Stochastic process is said to be bounded almost surely if a.s.

Lemma 2.2 (Stochastic LaSalle Theorem [14]). For system (2.1), if there exist functions , , , and a continuous nonnegative function such that for all , , then for each ,(i)system (2.1) has a unique strong solution on , and solution is bounded almost surely;(ii)when , , , the equilibrium is globally stable in probability.

In the following, we cite two small-gain type conditions on SiISS in [35].

Consider the following stochastic nonlinear system where is the state, is the input, and is an -dimensional standard Wiener process defined as in (2.1). Borel measurable functions : and : are locally bounded and locally Lipschitz continuous with respect to uniformly in .

Definition 2.3 (see [34]). System (2.4) is said to be stochastic integral input-to-state stable (SiISS) using Lyapunov function if there exist functions , , and a merely positive definite continuous function such that The function satisfying (2.5) is said to be a SiISS-Lyapunov function, and in (2.5) is called the SiISS supply rate of system (2.4).

Lemma 2.4 (see [35]). For system (2.4) satisfying (2.5), if there exists a positive definite continuous function such that , , then there exists a function such that is a new SiISS supply rate of system (2.4). Moreover, if , then , where is any positive integer.

The following lemma shows that the condition at infinity can be removed if more prior information on stochastic system is known.

Assumption H. For functions , , given in (2.4), (2.5) with , there exist known smooth positive definite functions , such that , and .

Lemma 2.5 (see [35]). For system (2.4) satisfying (2.5) and Assumption H, if there exists a positive definite function such that where , are smooth increasing functions with , for any , then there exists a function such that is a new SiISS supply rate of system (2.4). Moreover, if , then , where is any positive integer.

Lemma 2.6. Let be real variables, then for any positive integers , and continuous function , , where is any real number.

3. Problem Statement

In this paper, we consider a class of stochastic nonlinear systems described by where , represent the unmeasurable state, the control input, and the measurable output, respectively. is referred to as the stochastic inverse dynamics. The initial value can be chosen arbitrarily. is an -dimensional standard Wiener process defined as in (2.1). Uncertain functions , , , are smooth functions. It is assumed that and are locally Lipschitz continuous functions.

The research purpose of this paper is to design an adaptive output feedback controller for system (3.1) by using stochastic LaSalle theorem and small-gain type conditions on SiISS, in such a way that, for all initial conditions, the solutions of the closed-loop system are bounded almost surely and the closed-loop systems are globally stable in probability. To achieve the control purpose, we need the following assumptions.

Assumption 3.1. For each , there exist the unknown constant , the known nonnegative smooth functions , , and with , , , such that , .

For Assumption 3.1, there exist smooth functions and satisfying which will be frequently used in the subsequent sections.

Assumption 3.2. For the -subsystem, there exists an SiISS-Lyapunov function . Namely, satisfies , , where are class functions, and is merely a continuous positive definite function.

4. Design of an Adaptive Output Feedback Controller

4.1. Reduced-Order Observer Design

Introduce the following reduced-order observer: where is chosen such that is asymptotically stable. Define the error variable By (3.1), (4.1), and (4.2), one gets whose compact form is where

4.2. The Design of Adaptive Backstepping Controller

From (3.1), (4.1), (4.2), and (4.4), the interconnected system is represented as Next, we will develop an adaptive backstepping controller by using the backstepping method. Firstly, a coordinate transformation is introduced

Step 1. By (4.6) and (4.7), one has

Since is asymptotically stable, there exists a positive definite matrix such that . Choose where , is the estimate of . In view of (2.2), (4.4), (4.8), and (4.9), then Applying Assumption 3.1, (3.2), (4.3), (4.7), and Lemma 2.6, it follows that where , , , , and are smooth functions, are constants.

Using , , , Assumption 3.1, (3.2), and (4.5), one gets Substituting (4.11)-(4.12) into (4.10) and using lead to

where Choosing the virtual control and the tuning function one gets where is design parameter and is a smooth function to be chosen later.

Step i [ ]
For notation coherence, denote , . At this step, we can obtain a property similar to (4.16), which is presented by the following lemma.

Lemma 4.1. For the th Lyapunov function , there are the virtual control law and the tuning function with the form such that where is the designed parameters, , , , are some positive constants, , , , are smooth nonnegative functions, whose choices are given in the proof.

Proof. See the appendix.

Therefore, at the end of the recursive procedure, the controller can be constructed as Choosing parameters , , , , , , to satisfy by (4.16) and (4.18), one has where

5. Stability Analysis

We state the main theorems in this paper. This section is divided into two parts.

5.1. Case I

Theorem 5.1. Assume that Assumptions 3.1 and 3.2 hold with the following properties: If in Assumption 3.2, by appropriately choosing the positive smooth function in (4.15) and the parameters , , , , , , , , to satisfy (4.20), then(i)the closed-loop system consisting of (3.1), (4.1), (4.2), (4.7), (4.15), (4.17), and (4.19) has a unique and almost surely bounded strong solution on ;(ii)for each initial value , the equilibrium is globally stable in probability, where .

Proof. For any constant , by (5.1), one has For the -subsystem, by Lemma 2.4, there exists a positive and radially unbounded Lyapunov function and such that where is a positive constant satisfying for all . Choosing the following Lyapunov function for the entire closed-loop system and combining (4.21) and (5.3), one obtains By (5.4), there always exists a smooth function to satisfy the following two inequalities: Substituting (5.7) into (5.6) leads to Noting that and are nonnegative smooth functions and using (4.22), it follows that and are continuous nonnegative functions. By (5.5), (5.8), and Lemma 2.2, one concludes that all the solutions of the closed-loop system are bounded almost surely, the equilibrium is globally stable in probability. By (3.1), (4.1), (4.2), (4.7), (4.15), (4.17), (4.19), and the almost sure boundedness of all the signals, it is not difficult to recursively prove that the equilibrium is globally stable in probability.

5.2. Case II

If more information about in Assumption 3.2 is known, that is, , further results under the weaker conditions is given as follows.

Assumption 5.2. For functions and given by (4.22) and Assumption 3.2, there exist known smooth nonnegative functions and with , such that and .

Lemma 5.3. For , , , and given by (4.22), Assumptions 3.2 and 5.2, if where and are smooth increasing functions satisfying is any positive constant. Then there exists a function such that is a new SiISS supply rate of the -subsystem in (3.1). Moreover, if in Assumptions 3.2 satisfies , then .

Since the condition (5.9) is weaker than (5.1), by using Lemma 5.3, we give further results under the weaker condition (5.9).

Theorem 5.4. Suppose that Assumptions 3.1–5.2 and the conditions of Lemma 5.3 hold. If in Assumption 3.2, by appropriately choosing the positive smooth function in (4.15) and the parameters , , , , , , , , to satisfy (4.20), then(1)the closed-loop system consisting of (3.1), (4.1), (4.2), (4.7), (4.15), (4.17), and (4.19) has a unique and almost surely bounded strong solution on ;(2)for each initial value , the equilibrium is globally stable in probability.

6. Conclusions

This paper further considers a more general class of stochastic nonlinear systems with uncertain parameters and SiISS inverse dynamics. By combining the stochastic LaSalle theorem and small-gain type conditions on SiISS, an adaptive output feedback controller is designed to guarantee that all the closed-loop signals are bounded almost surely and the stochastic closed-loop system is globally stable in probability.

There are two remaining problems to be investigated: (1) an essential problem is to find a practical example with explicit physical meaning for system (3.1). A preliminary attempt on high-order stochastic nonlinear system can be found in [28]. (2) How to design an output feedback controller by using this method in this paper for system (3.1) in which the drift and diffusion vector fields depend on the unmeasurable states besides the measurable output?

Appendix

Proof of Lemma 4.1. We prove Lemma 4.1 by induction. Assume that at Step , there are virtual control laws such that satisfies where are the designed parameters, , , , are some positive constants, and , , , are smooth nonnegative functions.In the sequel, we will prove that Lemma 4.1 still holds for Step . Choosing with the use of (4.6), (4.7), (4.15), and (A.1), the ItÔ differential of is given as follows: where    . Using (2.2) and (A.2)–(A.4), we arrive at Now, we estimate the last five terms, respectively, in the right-hand side of (A.5). According to Assumption 3.1, (3.2), (4.7), and Lemma 2.6, there exist positive real numbers , , , , , , , , , smooth nonnegative functions , , , such that Choosing and as (4.17) and substituting (A.6) into (A.5), (4.18) holds, where is a design parameter,

Acknowledgments

This work was supported by National Natural Science Foundation of China (nos. 61104222 and 10971256), Natural Science Foundation of Jiangsu Province (no. BK2011205), and Natural Science Foundation of Jiangsu Normal University (no. 11XLR08).

References

  1. H. Deng, M. Krstić, and R. J. Williams, “Stabilization of stochastic nonlinear systems driven by noise of unknown covariance,” IEEE Transactions on Automatic Control, vol. 46, no. 8, pp. 1237–1253, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  2. N. Duan and X.-J. Xie, “Further results on output-feedback stabilization for a class of stochastic nonlinear systems,” IEEE Transactions on Automatic Control, vol. 56, no. 5, pp. 1208–1213, 2011. View at Publisher · View at Google Scholar
  3. N. Duan, X.-J. Xie, and X. Yu, “State feedback stabilization of stochastic nonlinear systems with SiISS inverse dynamics,” International Journal of Robust and Nonlinear Control, vol. 21, no. 16, pp. 1903–1919, 2011. View at Publisher · View at Google Scholar
  4. N. Duan, X. Yu, and X.-J. Xie, “Output feedback control using small-gain conditions for stochastic nonlinear systems with SiISS inverse dynamics,” International Journal of Control, vol. 84, no. 1, pp. 47–56, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  5. W.-Q. Li and X.-J. Xie, “Inverse optimal stabilization for stochastic nonlinear systems whose linearizations are not stabilizable,” Automatica, vol. 45, no. 2, pp. 498–503, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  6. W. Li, X.-J. Xie, and S. Zhang, “Output-feedback stabilization of stochastic high-order nonlinear systems under weaker conditions,” SIAM Journal on Control and Optimization, vol. 49, no. 3, pp. 1262–1282, 2011. View at Publisher · View at Google Scholar
  7. L. Liu and X.-J. Xie, “Output-feedback stabilization for stochastic high-order nonlinear systems with time-varying delay,” Automatica, vol. 47, no. 12, pp. 2772–2779, 2011. View at Publisher · View at Google Scholar
  8. L. Liu and X. J. Xie, “State-feedback stabilization for stochastic high-order nonlinear systems with SISS inverse dynamics,” Asian Journal of Control, vol. 14, no. 4, pp. 1–11, 2012.
  9. S.-J. Liu, J.-F. Zhang, and Z.-P. Jiang, “Decentralized adaptive output-feedback stabilization for large-scale stochastic nonlinear systems,” Automatica, vol. 43, no. 2, pp. 238–251, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  10. S.-J. Liu, J.-F. Zhang, and Z.-P. Jiang, “A notion of stochastic input-to-state stability and its application to stability of cascaded stochastic nonlinear systems,” Acta Mathematicae Applicatae Sinica, vol. 24, no. 1, pp. 141–156, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  11. S.-J. Liu, J.-F. Zhang, and Z.-P. Jiang, “Global output-feedback stabilization for a class of stochastic non-minimum-phase nonlinear systems,” Automatica, vol. 44, no. 8, pp. 1944–1957, 2008. View at Publisher · View at Google Scholar
  12. Y. Liu and J. Zhang, “Minimal-order observer and output-feedback stabilization control design of stochastic nonlinear systems,” Science in China F, vol. 47, no. 4, pp. 527–544, 2004. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  13. Y.-G. Liu and J.-F. Zhang, “Practical output-feedback risk-sensitive control for stochastic nonlinear systems with stable zero-dynamics,” SIAM Journal on Control and Optimization, vol. 45, no. 3, pp. 885–926, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  14. X. Mao, “A note on the LaSalle-type theorems for stochastic differential delay equations,” Journal of Mathematical Analysis and Applications, vol. 268, no. 1, pp. 125–142, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  15. Z. Pan and T. Başar, “Backstepping controller design for nonlinear stochastic systems under a risk-sensitive cost criterion,” SIAM Journal on Control and Optimization, vol. 37, no. 3, pp. 957–995, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  16. Z. Pan, Y. Liu, and S. Shi, “Output feedback stabilization for stochastic nonlinear systems in observer canonical form with stable zero-dynamics,” Science in China F, vol. 44, no. 4, pp. 292–308, 2001. View at Zentralblatt MATH
  17. Y. Shen, Q. Luo, and X. Mao, “The improved LaSalle-type theorems for stochastic functional differential equations,” Journal of Mathematical Analysis and Applications, vol. 318, no. 1, pp. 134–154, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  18. J. Spiliotis and J. Tsinias, “Notions of exponential robust stochastic stability, ISS and their Lyapunov characterization,” International Journal of Robust and Nonlinear Control, vol. 13, no. 2, pp. 173–187, 2003. View at Publisher · View at Google Scholar
  19. C. Tang and T. Basar, “Stochastic stability of singularly perturbed nonlinear systems,” in Proceedings of the 40th IEEE Conference on Decision and Control, pp. 399–404, Orlando, Fla, USA, 2001. View at Publisher · View at Google Scholar
  20. J. Tian and X.-J. Xie, “Adaptive state-feedback stabilization for high-order stochastic non-linear systems with uncertain control coefficients,” International Journal of Control, vol. 80, no. 9, pp. 1503–1516, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  21. J. Tsinias, “Stochastic input-to-state stability and applications to global feedback stabilization,” International Journal of Control, vol. 71, no. 5, pp. 907–930, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  22. J. Tsinias, “The concept of “exponential input to state stability” for stochastic systems and applications to feedback stabilization,” Systems & Control Letters, vol. 36, no. 3, pp. 221–229, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  23. Z. Wu, M. Cui, X. Xie, and P. Shi, “Theory of stochastic dissipative systems,” IEEE Transactions on Automatic Control, vol. 56, no. 7, pp. 1650–1655, 2011. View at Publisher · View at Google Scholar
  24. Z.-J. Wu, X.-J. Xie, and S.-Y. Zhang, “Stochastic adaptive backstepping controller design by introducing dynamic signal and changing supply function,” International Journal of Control, vol. 79, no. 12, pp. 1635–1646, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  25. Z.-J. Wu, X.-J. Xie, and S.-Y. Zhang, “Adaptive backstepping controller design using stochastic small-gain theorem,” Automatica, vol. 43, no. 4, pp. 608–620, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  26. Z.-J. Wu, X.-J. Xie, P. Shi, and Y.-Q. Xia, “Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching,” Automatica, vol. 45, no. 4, pp. 997–1004, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  27. X.-J. Xie, “A robust model reference adaptive control without strictly positive real condition,” International Journal of Control, vol. 75, no. 14, pp. 1136–1144, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  28. X.-J. Xie and N. Duan, “Output tracking of high-order stochastic nonlinear systems with application to benchmark mechanical system,” IEEE Transactions on Automatic Control, vol. 55, no. 5, pp. 1197–1202, 2010. View at Publisher · View at Google Scholar
  29. X.-J. Xie, N. Duan, and X. Yu, “State-feedback control of high-order stochastic nonlinear systems with SiISS inverse dynamics,” IEEE Transactions on Automatic Control, vol. 56, no. 8, pp. 1921–1926, 2011. View at Publisher · View at Google Scholar
  30. X.-J. Xie and W.-Q. Li, “Output-feedback control of a class of high-order stochastic nonlinear systems,” International Journal of Control, vol. 82, no. 9, pp. 1692–1705, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  31. X.-J. Xie and J. Tian, “State-feedback stabilization for high-order stochastic nonlinear systems with stochastic inverse dynamics,” International Journal of Robust and Nonlinear Control, vol. 17, no. 14, pp. 1343–1362, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  32. X.-J. Xie and J. Tian, “Adaptive state-feedback stabilization of high-order stochastic systems with nonlinear parameterization,” Automatica, vol. 45, no. 1, pp. 126–133, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  33. X.-J. Xie and S. Y. Zhang, “A robust adaptive pole-placement controller without strictly positive real condition,” International Journal of Adaptive Control and Signal Processing, vol. 16, no. 1, pp. 39–59, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  34. X. Yu and X.-J. Xie, “Output feedback regulation of stochastic nonlinear systems with stochastic iISS inverse dynamics,” IEEE Transactions on Automatic Control, vol. 55, no. 2, pp. 304–320, 2010. View at Publisher · View at Google Scholar
  35. X. Yu, X.-J. Xie, and N. Duan, “Small-gain control method for stochastic nonlinear systems with stochastic iISS inverse dynamics,” Automatica, vol. 46, no. 11, pp. 1790–1798, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  36. X. Yu, X.-J. Xie, and Y.-Q. Wu, “Further results on output-feedback regulation of stochastic nonlinear systems with SiISS inverse dynamics,” International Journal of Control, vol. 83, no. 10, pp. 2140–2152, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  37. X. Yu, X.-J. Xie, and Y.-Q. Wu, “Decentralized adaptive output-feedback control for stochastic interconnected systems with stochastic unmodeled dynamic interactions,” International Journal of Adaptive Control and Signal Processing, vol. 25, no. 8, pp. 740–757, 2011. View at Publisher · View at Google Scholar
  38. E. D. Sontag, “Smooth stabilization implies coprime factorization,” IEEE Transactions on Automatic Control, vol. 34, no. 4, pp. 435–443, 1989. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  39. E. D. Sontag, “Comments on integral variants of ISS,” Systems & Control Letters, vol. 34, no. 1-2, pp. 93–100, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  40. H. Ito and Z.-P. Jiang, “Necessary and sufficient small gain conditions for integral input-to-state stable systems: a Lyapunov perspective,” IEEE Transactions on Automatic Control, vol. 54, no. 10, pp. 2389–2404, 2009. View at Publisher · View at Google Scholar
  41. H. Ito, “A Lyapunov approach to cascade interconnection of integral input-to-state stable systems,” IEEE Transactions on Automatic Control, vol. 55, no. 3, pp. 702–708, 2010. View at Publisher · View at Google Scholar