Adaptive NN State-Feedback Control for Stochastic High-Order Nonlinear Systems with Time-Varying Control Direction and Delays

Min, Huifang; Duan, Na

doi:https://doi.org/10.1155/2015/723425

Mathematical Problems in Engineering

On this page

Abstract Introduction Conclusions Appendix Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 723425 | https://doi.org/10.1155/2015/723425

Adaptive NN State-Feedback Control for Stochastic High-Order Nonlinear Systems with Time-Varying Control Direction and Delays

Huifang Min¹and Na Duan¹

Academic Editor: Asier Ibeas

Received11 Mar 2015

Accepted14 May 2015

Published25 Oct 2015

Abstract

Nussbaum-type gain function and neural network (NN) approximation approaches are extended to investigate the adaptive state-feedback stabilization problem for a class of stochastic high-order nonlinear time-delay systems. The distinct features of this paper are listed as follows. Firstly, the power order condition is completely removed; the restrictions on system nonlinearities and time-varying control direction are greatly weakened. Then, based on Lyapunov-Krasovskii function and dynamic surface control technique, an adaptive NN controller is constructed to render the closed-loop system semiglobally uniformly ultimately bounded (SGUUB). Finally, a simulation example is shown to demonstrate the effectiveness of the proposed control scheme.

1. Introduction

During the past decades, the control of stochastic nonlinear systems has been an interesting field and received fruitful development based on the stochastic stability theory in [1–3] and other references. However, the existences of nonlinearities and time delays cause the instability of system performance and give rise to much greater design difficulty in the stabilization procedure. To handle nonlinearities, neural network (NN), especially radial basis function neural network (RBF NN), has been successfully extended to stochastic nonlinear systems due to its inherent approximation capacity; see [4–8] and the references therein. To deal with time delays, there are often two ways, namely, Lyapunov-Krasovskii function and Lyapunov-Razumikhin technique. Recently, together with NN and backstepping, Lyapunov-Krasovskii theory was used in [9–13] and Lyapunov-Razumikhin approach was utilized in [14–17] to stabilize stochastic nonlinear systems with time delays, respectively. However, to the best of our knowledge, for stochastic high-order nonlinear time-delay systems, there are still a few results.

In this paper, we further consider the following stochastic high-order time-delay system:where and are system state vectors; , and are system measurable states, control input and output, respectively. For , are time-varying delays, which are Borel measurable functions. Define with initial value . are odd integers called the high-order of the system. is unknown bounded time-varying continuous function called control direction. For , the drift terms and the diffusion terms are assumed to be locally Lipschitz in and piecewise continuous in with and . is an -dimensional standard Wiener process defined on a probability space , where is a sample space, is a -field, is filtration, and is the probability measure.

When , [18–27] investigated different feedback control problems for system (1) with different structures. When , [28] studied the output-feedback control with and under restrictive growth conditions on and . To relax the growth conditions, [29, 30] firstly generalized the homogeneous domination approach proposed by [31] to stochastic high-order time-delay systems. Subsequently, [32–34] further solved the stabilization problems for more general systems based on homogeneous domination approach. However, in [29, 30, 32–34], the nonlinear functions were still assumed to satisfy somewhat restrictive growth conditions. In addition, [29, 30, 32–34] were all achieved with being bounded by positive constants or . For , the Nussbaum-type gain function approach proposed by [35] has been proven to be a useful tool and is frequently used in [11, 12, 36–38] for stochastic nonlinear systems with . Immediately, one raises the following problem:

How does one generalize RBF NN and Nussbaum-type gain function approaches to system (1) to further relax the restrictions on nonlinear functions and and time-varying control direction ?

This paper focuses on solving this problem. The main contributions are listed as follows. (i) Compared with the existing results [29, 30, 32–34], we largely weaken the restrictions on the drift and diffusion terms by extending NN approximation approach to system (1). Furthermore, to handle unknown control direction, we utilize Nussbaum-type gain function approach to allow the sign and the bounds of to be unknown. (ii) By introducing dynamic surface control (DSC), the problem of “explosion of complexity” generalized by the repeated differentiation of virtual controllers is avoided, which greatly simplifies the control algorithm. (iii) An adaptive state-feedback controller is constructed to ensure the closed-loop system to be semiglobally uniformly ultimately bounded (SGUUB) by using backstepping technique and choosing Lyapunov-Krasovskii function skillfully.

The remainder of this paper is organized as follows. Section 2 begins with mathematical preliminaries. The design process and analysis of adaptive state-feedback controller are given in Sections 3 and 4, respectively. In Section 5, a simulation example is shown. Section 6 summarizes the paper. Finally, the necessary proof is provided in the Appendix.

2. Mathematical Preliminaries

The following notations, definitions, and lemmas are to be used.

Notations. denotes the set of all the nonnegative real numbers; denotes the -dimensional Euclidean space. denotes the family of all the functions with continuous th partial derivations; denotes the family of all nonnegative functions on which are in and in . denotes the space of continuous -valued functions on endowed with the norm defined by for ; denotes the Euclidean norm of a vector; denotes the family of all -measurable bounded -valued random variables . denotes the transpose of a given vector or matrix ; denotes its trace when is square. denotes the set of all functions , which are continuous, strictly increasing, and vanishing at zero; denotes the set of all functions which are of class and unbounded. To simplify the procedure, we sometimes denote by for any variable .

Consider the following stochastic time-delay system:with initial data , where is a Borel measurable function; is an -dimensional standard wiener process defined as in (1). and are locally Lipschitz with and . For any given , together with stochastic system (2), the differential operator is defined as

Definition 1 (see [35]). A function is called a Nussbaum-type function if it has the following properties:Many functions satisfy these properties, for example, , , and . Throughout this paper, the Nussbaum function is exploited.

Definition 2 (see [14]). Let ; considering stochastic nonlinear time-delay system (2), the solution with initial condition ( is some compact set containing the origin) is said to be -moment semiglobally uniformly ultimately bounded (SGUUB) if there exists a constant such that , , holds for some .

To facilitate the control design, the following lemmas are applied.

Lemma 3 (Young’s inequality). For , holds, where , , and .

Lemma 4 (see [26]). For real variables and ; then, , where is a real number.

Lemma 5 (see [31]). Let and be real variables; then, for any real numbers and continuous function , one has .

Lemma 6 (see [31]). For , where is a constant, the following inequalities hold: and .

In the sequel, radial basis function neural network (RBF NN) is to be applied to estimate the unknown nonlinear functions. By choosing sufficiently large node number, for any continuous function over a compact set , there is a RBF NN such that, for an ideal level of accuracy (),where is the approximation error and is the known function vector with being the RBF NN node number. The basis functions () are chosen as , where is the width of the function and is the center of the receptive field. is the ideal constant weight vector with the form , where is the value of variable when the objective function is minimum with being the weight vector.

3. Design of State-Feedback Controller

The objective of this paper is to design an adaptive NN state-feedback controller for system (1) under weaker conditions such that the closed-loop system is SGUUB. To achieve the above objective, we need the following assumptions.

Assumption 7. The time-varying delays , , in system (1) satisfy and for positive constants and .

Assumption 8. is unknown sign and takes value in the unknown closed interval with .

Assumption 9. Nonlinear functions and satisfyfor , where , , , and are positive functions with and for .

Remark 10. We emphasize two points. (i) To the best of our knowledge, only [33] consider the unknown control directions for stochastic high-order time-delay systems. However, in [33], the unknown control directions are of known signs and are bounded by positive constants. We allow the sign of to be unknown and remove the bounds limitations in Assumption 8. (ii) Motivated by [14, 15] for stochastic time-delay systems, the restrictions on and are greatly relaxed in Assumption 9 compared with the existing results in [29, 30, 32–34].

To simplify the design process, definewhere are the number of RBF NN nodes and are the ideal constant weight vectors. Before the design procedure, introduce the following coordinate transformation:where are the outputs of the first-order filter with virtual control laws being inputs. Now, we give the backstepping design procedure by utilizing the technique of DSC and RBF NN approximation approach.

Step 1. Choosing the 1st Lyapunov function candidate as and using (1), (3), and (8), one haswhere , , are design constants, is the estimate of , and is the estimation error of .

In the sequel, we estimate the terms of (9) by using Lemmas 4-5 and Assumption 9 aswhere , , , and are positive parameters, , , , and are constants that can be designed. Substituting (10) into (9) and choosing the intermediate variable asone yieldswhere , is a compact set through which the state trajectories may travel, and are continuous functions to be designed later, and .

To proceed further, applying Lemmas 3-4 and RBF NN (5) to estimate as and , this leads towhere is a design constant, , and . Choose the first control law aswhich together with (13) changes (12) intowhere , , and .

In order to avoid the repeated differentiation of virtual control law, we introduce dynamic surface control technique. Let be obtained by a first-order filter with time constant ; then, it has and . Define as the output error of the filter; thus, and , where . Then, by using Lemmas 5-6 and , it holds thatwhere , with and being positive design parameters, ≥ , and . Substituting (16) into (15), one gets

Step i (). A similar result to Step 1 is obtained at this step. We state it in the following proposition.

Proposition 11. For the th Lyapunov functionthere exists a virtual control law in the following form:such thatwhere , , and are positive design constants, , , , , , , and .

Proof. See the Appendix.

Hence, at step , we chooseBy exactly following the design procedure in Proposition 11 and introducing Nussbaum function, one can construct the adaptive control laws asthus, this leads towhere , , are design constants, , , , , , and .

Remark 12. During the design procedure, the drift and diffusion terms are technically handled for more general system (1) by RBF NN approximation approach compared with [29, 30, 32–34]. Furthermore, the repeated differentiation of virtual control laws is avoided and the unknown time-varying control direction is successfully handled by introducing DSC and Nussbaum-type gain function.

4. Stability Analysis

The main result of this paper is stated in the following theorem.

Theorem 13. For stochastic high-order time-delay system (1) satisfying Assumptions 7–9, when the adaptive control laws are chosen as (14), (19), and (22) and the initial condition satisfies , the closed-loop system consisting of (1), (8), (14), (19), and (22) is semiglobally uniformly ultimately bounded (SGUUB), where is the closed-loop Lyapunov-Krasovskii functional and is some constant.

Proof. Choosing Lyapunov-Krasovskii functional asin terms of Assumption 7 and (23)-(24), one obtainsLet and use Lemma 3 to estimate the terms in (25) asone can getwhere is a parameter and .
By estimating as and choosingthis leads towhere is a design constant, , and is a positive parameter to be chosen.
Multiplying (29) by , taking expectations on both sides and integrating it over , one hasthen,It is easy to see that, in (31), for . Let be a new Nussbaum function; according to Definition 1, one has and . Then, it can be obtained that , but this counteracts the fact that ; therefore, and must be bounded by some constant, which shows that must be bounded to some constant.
From the above discussion and Definition 2, one gets that is SGUUB. Thus, from the forms of and in the design procedure, one concludes that all the variables in the closed-system are SGUUB; that is to say the closed-loop system consisting of (1), (8), (14), (19), and (22) is SGUUB. The proof is completed.

5. A Simulation Example

Consider the following stochastic high-order nonlinear system:where , , , , , , , and . It can be verified that Assumptions 7–9 hold true.

By exactly following the design procedure in Section 3, we construct the adaptive control laws where , , , , , and are positive design constants, with being a time constant of a filter, , , , , , and , , , , , and are positive parameters.

In simulation, choose the Nussbaum function as and let the design constants and parameters be , , , , , , , , , , , , and . The initial conditions are given by , , , and . From Figure 1, one can see that system states, control input, adaptive law, and variable converge to the origin uniformly, which means that all the signals of the closed-loop (32)-(33) are SGUUB. Figure 1 demonstrates the effectiveness of the control scheme.

6. Conclusions

This paper considers the unknown time-varying control coefficient by generalizing Nussbaum function to a class of stochastic high-order time-delay systems. Under weaker conditions on the drift and diffusion terms, the adaptive state-feedback control is solved by using RBF NN approximation approach. The control scheme ensures the closed-loop system to be SGUUB. An issue to be investigated is how to further handle the output-feedback problem for system (1).

Appendix

Proof of Proposition 11. We prove this proposition by the frequently used induction method. Assume that, at step , there exist a series of virtual control lawssuch thatholds for , where the parameters and functions are designed as in Proposition 11.
In the sequel, we prove that (A.2) still holds for (18). By using (3), (8), (18), (A.2), and It’s formula, one hasEstimate the terms on the right-hand side of (A.3) with the help of Lemmas 4-5 and Assumption 9 aswhere , , , , and are parameters, , , , , are design constants, and .
Then, substituting (A.4) into (A.3) and constructing the intermediate variable asone getswhere and is a design function.
Utilizing Lemmas 3-4 and RBF NN (5), there exists such that , . Thus, we havewhere , , , and . By applying (A.7) and constructing the th virtual control law as (19), one arrives atwhere , . Now, let be obtained by a first-order filter with time constant ; then, it holds that and . Define as the output error; it is obvious that and , where . With the help of Lemmas 5-6 and , this yieldswhere and with and being positive design parameters, , and ≥ . Substituting (A.9) into (A.8), one obtains (20). The proof is completed.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work is supported by the National Natural Science Foundation of China (nos. 61573172, 61305149, and 61403174), 333 High-Level Talents Training Program in Jiangsu Province (no. BRA2015352), and Program for Fundamental Research of Natural Sciences in Universities of Jiangsu Province (no. 15KJB510011).

References

M. Krstić and H. Deng, Stabilization of Uncertain Nonlinear Systems, Springer, New York, NY, USA, 1998.
H. Deng, M. Krstić, and R. J. Williams, “Stabilization of stochastic nonlinear systems driven by noise of unknown covariance,” IEEE Transactions on Automatic Control, vol. 46, no. 8, pp. 1237–1253, 2001.
View at: Publisher Site | Google Scholar
X. R. Mao, Stochastic Differential Equations and Their Applications, Horwood Publishing, Chichester, UK, 2007.
H. E. Psillakis and A. T. Alexandridis, “NN-based adaptive tracking control of uncertain nonlinear systems disturbed by unknown covariance noise,” IEEE Transactions on Neural Networks, vol. 18, no. 6, pp. 1830–1835, 2007.
View at: Publisher Site | Google Scholar
W. S. Chen, L. C. Jiao, and Z. B. Du, “Output-feedback adaptive dynamic surface control of stochastic non-linear systems using neural network,” IET Control Theory & Applications, vol. 4, no. 12, pp. 3012–3021, 2010.
View at: Publisher Site | Google Scholar
W. S. Chen, “Output-feedback adaptive stochastic nonlinear stabilization using neural networks,” Journal of Systems Engineering and Electronics, vol. 21, no. 1, pp. 81–87, 2010.
View at: Publisher Site | Google Scholar
T. Wang, S. C. Tong, and Y. M. Li, “Adaptive neural network output feedback control of stochastic nonlinear systems with dynamical uncertainties,” Neural Computing and Applications, vol. 23, no. 5, pp. 1481–1494, 2013.
View at: Publisher Site | Google Scholar
H.-Q. Wang, B. Chen, and C. Lin, “Adaptive neural tracking control for a class of stochastic nonlinear systems,” International Journal of Robust and Nonlinear Control, vol. 24, no. 7, pp. 1262–1280, 2014.
View at: Publisher Site | Google Scholar
H. Q. Wang, B. Chen, and C. Lin, “Adaptive neural control for strict-feedback stochastic nonlinear systems with time-delay,” Neurocomputing, vol. 77, no. 1, pp. 267–274, 2012.
View at: Publisher Site | Google Scholar
H. T. Gao, T. P. Zhang, and X. N. Xia, “Adaptive neural control of stochastic nonlinear systems with unmodeled dynamics and time-varying state delays,” Journal of the Franklin Institute, vol. 351, no. 6, pp. 3182–3199, 2014.
View at: Publisher Site | Google Scholar
Z. X. Yu, S. G. Li, and H. B. Du, “Adaptive neural output feedback control for stochastic nonlinear time-delay systems with unknown control directions,” Neural Computing and Applications, vol. 25, no. 7-8, pp. 1979–1992, 2014.
View at: Publisher Site | Google Scholar
Z. X. Yu and S. G. Li, “Neural-network-based output-feedback adaptive dynamic surface control for a class of stochastic nonlinear time-delay systems with unknown control directions,” Neurocomputing, vol. 129, pp. 540–547, 2014.
View at: Publisher Site | Google Scholar
Q. Zhou, P. Shi, Y. S. Xu, and Y. H. Li, “Observer-based adaptive neural network control for nonlinear stochastic systems with time delay,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 1, pp. 71–80, 2013.
View at: Publisher Site | Google Scholar
Z. X. Yu and H. B. Du, “Adaptive neural control for uncertain stochastic nonlinear strict-feedback systems with time-varying delays: a Razumikhin functional method,” Neurocomputing, vol. 74, no. 12-13, pp. 2072–2082, 2011.
View at: Publisher Site | Google Scholar
Z. X. Yu, Z. H. Jin, and H. B. Du, “Adaptive neural control for a class of non-affine stochastic non-linear systems with time-varying delay: a Razumikhin-Nussbaum method,” IET Control Theory & Applications, vol. 6, no. 1, pp. 14–23, 2012.
View at: Publisher Site | Google Scholar
Z.-X. Yu and Z.-S. Yu, “Adaptive neural dynamic surface control for nonlinear pure-feedback systems with multiple time-varying delays: a Lyapunov-Razumikhin method,” Asian Journal of Control, vol. 15, no. 4, pp. 1124–1138, 2013.
View at: Publisher Site | Google Scholar
G. Z. Cui, T. C. Jiao, Y. L. Wei, G. Song, and Y. Chu, “Adaptive neural control of stochastic nonlinear systems with multiple time-varying delays and input saturation,” Neural Computing and Applications, vol. 25, no. 3-4, pp. 779–791, 2014.
View at: Publisher Site | Google Scholar
X.-J. Xie and J. Tian, “Adaptive state-feedback stabilization of high-order stochastic systems with nonlinear parameterization,” Automatica, vol. 45, no. 1, pp. 126–133, 2009.
View at: Publisher Site | Google Scholar
W. Q. Li, Y. W. Jing, and S. Y. Zhang, “State feedback control of a class of high-order stochastic nonlinear systems,” International Journal of Robust and Nonlinear Control, vol. 22, no. 14, pp. 1583–1601, 2012.
View at: Publisher Site | Google Scholar
J.-Y. Zhai and H.-B. Du, “Global output feedback stabilisation for a class of upper triangular stochastic nonlinear systems,” International Journal of Control, vol. 87, no. 10, pp. 2106–2117, 2014.
View at: Publisher Site | Google Scholar
J.-Y. Zhai, “Decentralised output-feedback control for a class of stochastic non-linear systems using homogeneous domination approach,” IET Control Theory & Applications, vol. 7, no. 8, pp. 1098–1109, 2013.
View at: Publisher Site | Google Scholar
W. Q. Li, X.-J. Xie, and S. Y. Zhang, “Output-feedback stabilization of stochastic high-order nonlinear systems under weaker conditions,” SIAM Journal on Control and Optimization, vol. 49, no. 3, pp. 1262–1282, 2011.
View at: Publisher Site | Google Scholar
C.-R. Zhao and X.-J. Xie, “Output feedback stabilization using small-gain method and reduced-order observer for stochastic nonlinear systems,” IEEE Transactions on Automatic Control, vol. 58, no. 2, pp. 523–529, 2013.
View at: Publisher Site | Google Scholar
X.-J. Xie, N. Duan, and X. Yu, “State-feedback control of high-order stochastic nonlinear systems with SiISS inverse dynamics,” IEEE Transactions on Automatic Control, vol. 56, no. 8, pp. 1921–1926, 2011.
View at: Publisher Site | Google Scholar
J.-Y. Zhai, “Finite-time output feedback stabilization for stochastic high-order nonlinear systems,” Circuits, Systems, and Signal Processing, vol. 33, no. 12, pp. 3809–3837, 2014.
View at: Publisher Site | Google Scholar
X.-J. Xie and N. Duan, “Output tracking of high-order stochastic nonlinear systems with application to benchmark mechanical system,” IEEE Transactions on Automatic Control, vol. 55, no. 5, pp. 1197–1202, 2010.
View at: Publisher Site | Google Scholar
X.-J. Xie, N. Duan, and C.-R. Zhao, “A combined homogeneous domination and sign function approach to output-feedback stabilization of stochastic high-order nonlinear systems,” IEEE Transactions on Automatic Control, vol. 59, no. 5, pp. 1303–1309, 2014.
View at: Publisher Site | Google Scholar
L. Liu and X.-J. Xie, “Output-feedback stabilization for stochastic high-order nonlinear systems with time-varying delay,” Automatica, vol. 47, no. 12, pp. 2772–2779, 2011.
View at: Publisher Site | Google Scholar
X.-J. Xie and L. Liu, “Further results on output feedback stabilization for stochastic high-order nonlinear systems with time-varying delay,” Automatica, vol. 48, no. 10, pp. 2577–2586, 2012.
View at: Publisher Site | Google Scholar
X.-J. Xie and L. Liu, “A homogeneous domination approach to state feedback of stochastic high-order nonlinear systems with time-varying delay,” IEEE Transactions on Automatic Control, vol. 58, no. 2, pp. 494–499, 2013.
View at: Publisher Site | Google Scholar
C. J. Qian, “A homogeneous domination approach for global output feedback stabilization of a class of nonlinear systems,” in Proceedings of the American Control Conference, pp. 4708–4715, June 2005.
View at: Google Scholar
X. J. Xie, C. R. Zhao, and N. Duan, “Further results on state feedback stabilization of stochastic high-order nonlinear systems,” Science China Information Sciences, vol. 57, no. 7, pp. 1–14, 2014.
View at: Publisher Site | Google Scholar
F. Z. Gao, Z. Yuan, and F. S. Yuan, “State-feedback stabilization for stochastic high-order nonlinear systems with time-varying delays,” Abstract and Applied Analysis, vol. 2014, Article ID 673869, 11 pages, 2014.
View at: Publisher Site | Google Scholar
W. T. Zha, J. Y. Zhai, and S. M. Fei, “Output feedback control for a class of stochastic high-order nonlinear systems with time-varying delays,” International Journal of Robust and Nonlinear Control, vol. 24, no. 16, pp. 2243–2260, 2013.
View at: Publisher Site | Google Scholar
R. D. Nussbaum, “Some remarks on a conjecture in parameter adaptive control,” Systems and Control Letters, vol. 3, no. 5, pp. 243–246, 1983.
View at: Publisher Site | Google Scholar
Y.-C. Wang, H.-G. Zhang, and Y.-Z. Wang, “Fuzzy adaptive control of stochastic nonlinear systems with unknown virtual control gain function,” Acta Automatica Sinica, vol. 32, no. 2, pp. 170–178, 2006.
View at: Google Scholar
T. S. Li, Z. F. Li, D. Wang, and C. L. P. Chen, “Output-feedback adaptive neural control for stochastic nonlinear time varying delay systems with unknown control directions,” IEEE Transactions on Neural Networks and Learning Systems, vol. 26, no. 6, pp. 1188–1201, 2014.
View at: Publisher Site | Google Scholar
T. Wang, S. C. Tong, and Y. M. Li, “Robust adaptive fuzzy output feedback control for stochastic nonlinear systems with unknown control direction,” Neurocomputing, vol. 106, pp. 31–41, 2013.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Huifang Min and Na Duan. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

692

Downloads

825

Citations