Lyapunov Characterization for the Stability of Stochastic Control Systems

Abedi, Fakhreddin; Leong, Wah June; Abedi, Mohammad

doi:https://doi.org/10.1155/2015/584935

Mathematical Problems in Engineering

On this page

Abstract Introduction Results Conclusions References Copyright Related Articles

Research Article | Open Access

Volume 2015 | Article ID 584935 | https://doi.org/10.1155/2015/584935

Lyapunov Characterization for the Stability of Stochastic Control Systems

Fakhreddin Abedi,^1,2Wah June Leong,¹and Mohammad Abedi³

Academic Editor: Giuseppe Rega

Received20 May 2014

Accepted21 Aug 2014

Published23 Feb 2015

Abstract

Lyapunov-like characterization for the problem of input-to-state stability in the probability of nonautonomous stochastic control systems is established. We extend the well-known Artstein-Sontag theorem to derive the necessary and sufficient conditions for the input-to-state stabilization of stochastic control systems. Illustrating example is provided.

1. Introduction

The stabilization of various types of nonlinear systems has been widely studied in the past years, see, for instance, [1–5]. The necessary and sufficient conditions for input-to-state stability and robust stability at the equilibrium state of nonlinear system are provided by Sontag and Wang [1]. Angeli et al. [2] showed that there exists a positive definite Lyapunov function whose derivative along the system is a negative definite that guarantees a time-varying system satisfying in the integral input-to-state stability property. Later, Grune [3] derived a suitable Lyapunov function and established an input-to-state dynamical stability property for a time-varying system. The necessary and sufficient conditions for input-to-state stability of nonlinear time-varying system have been provided by Karafyllis and Tsinias [4]. Ning et al. [5] employed an indefinite Lyapunov function rather than a negative definite function and established input-to-state stability and integral input-to-state stability of time-varying system.

Tsinias [6], Florchinger [7], Krstic and Deng [8], Deng et al. [9], van Handel [10], and Abedi et al. [11–13] attempted in several directions to cover global asymptotic stability in probability (GASP) and input-to-state stability in probability (ISSP) of stochastic differential systems (SDS) by Lyapunov functions.

The main purpose of this paper is to establish a Lyapunov characterization for the problem of ISSP of nonautonomous stochastic control systems (NSCS). We extend the well-known Artstein-Sontag theorem (see [14, 15]) established in Karafyllis and Tsinias [4] to the concept of stochastic control Lyapunov function (CLF) in order to derive the necessary and sufficient conditions for the ISSP of NSCS. We also establish the existence of an explicit formula of a feedback law exhibiting ISSP property and give some applications to feedback stabilization. The analysis used in this paper is closely related to that of Karafyllis and Tsinias [4].

The paper is organized as follows. In Section 2, we introduce the class of stochastic systems and some basic definitions and results that we are dealing with in this paper. We also describe a wider class of NSCS and we focus on the properties of stochastic CLF which play an important role in ISSP property. Finally, in Section 3, we state and prove the main results of the paper on the ISSP property of NSCS. We also provide a numerical example to illustrate our results.

2. Fundamental Definitions and Results

The purpose of this section is to introduce the notion of robust stability in probability (RSP) and ISSP property for a class of stochastic systems. For a detailed presentation of stochastic stability theory, we refer the reader to the book of Khasminskii [16] and the paper of Abedi et al. [11].

Let be a complete probability space and, for any , denote by a standard -valued Wiener process defined on this space.

We consider the SDS where(i)the functions , , and are locally Lipschitz with respect to with and ; in the sense that for every bounded interval and for every compact subset of , there exists a constant such that where, throughout this paper, denotes the usual Euclidean norm.(ii) is a solution of (1) at time that corresponds to some input , initiated from at time .

Definition 1. A function is(i)a -function if it is continuous, strictly increasing and ,(ii)a -function if it is a -function and also as ,(iii)a positive definite function if for all , and , and(iv)a -function if it is a positive nondecreasing function.

Definition 2. The equilibrium of the system (1) is(i)globally stable in probability, if, for every and input , there exists a class -function such that (ii)globally asymptotically stable in probability, if it is globally stable in probability and

In the following, we recall the stochastic version of La Salle’s invariant theorem established by Kushner [17].

Theorem 3. Suppose that there exists a Lyapunov function defined on such that where is the infinitesimal generator of the stochastic process solution of stochastic system (1) as follows: Then, the equilibrium solution of stochastic system (1) tends to the largest invariant set whose support is contained in the locus for any with probability .

We will now turn the attention to a wider class of NSCS and focus on the properties of stochastic CLF which play an important role in ISSP property in Section 3.

Denote by the stochastic process solution of the NSCS written in the sense of Ito: where the dynamics , , and , are and locally Lipschitz with respect to with and .

We recall the definition of RSP introduced by Abedi and Leong [18] on the neighborhood of the origin as follows.

Definition 4. The NSCS (7) is said to be RSP if there exists a neighborhood of the origin in and a function , with , such that(i)for every remains in , for all , the solution of the resulting closed-loop system where is a standard -valued Wiener process defined on a complete probability space , is uniquely defined with as input and(ii)the equilibrium solution of the resulting closed-loop system (8) is GASP with as input.

Consider the NSCS (7), under a slight change of hypothesis in the notion of ISS property introduced by Karafyllis and Tsinias [4], we obtain the notion of ISSP in terms of Lyapunov functions as follows.

Definition 5. Let be a positive definite function, which is , locally Lipschitz in ; the NSCS (7) satisfies the weak ISSP (wISSP) from the input with gain if each solution of NSCS (7) exists for all and satisfies conditions (3) and (4) of Definition 2 provided that

Definition 6. We say that NSCS (7) satisfies the ISSP from the input with gain if the following conditions hold:(i)the NSCS (7) satisfies wISSP property and(ii)the map is of class function for each .
As in the deterministic case (see [4, 19]), we can easily establish the following elementary result.

Lemma 7. The NSCS (7) satisfies the wISSP property if and only if is RSP for the system

Proof. The proof of this lemma is a direct consequence of Definitions 2, 4, and 5 and the fact that each solution of the NSCS (10) that corresponds to some coincides with the solution of the NSCS (7) with the same initial and and corresponding to , namely, satisfying (9). Conversely, each solution of the NSCS (7) under restriction (9) is a solution of the NSCS (10) with input and the same initial value.

The main results of this paper (Theorems 11 and 12) constitute the extensions of the well-known Artstein-Sontag theorem established in Karafyllis and Tsinias [4] and guarantee the existence of a mapping in such a way that the resulting closed-loop system (8) satisfies ISSP property with as input.

We denote by the infinitesimal generator of the stochastic process solution of NSCS (7); that is, is the second-order differential operator defined for any function in by where and . We also denote by , the first-order differential operator defined for any function in by

The following definition is an extension of Definition 2.4 established in [11] and which described the stochastic CLF that was used for ISSP of NSCS (7) at the origin.

Definition 8. Let be a positive definite function, which is , locally Lipschitz in , the NSCS (7) admits a stochastic CLF, if there exists a function , class functions , , and a positive definite function such that, for all , the following conditions hold:
Since the differential operator appears in the condition (14) stated in Definition 8, the computations in the stochastic case are more tedious than those in the deterministic case introduced by Karafyllis and Tsinias [4]. We extended the concept of CLF introduced by Karafyllis and Tsinias [4] and obtained the notion of stochastic CLF to Definition 8 that was used for ISSP of the NSCS (7) at the equilibrium state. Relationships between the concepts of ISSP given above and their characterization in terms of Lyapunov functions are developed in the next section. In order to establish our main results as in Theorem 11, we need the following technical theorem established in [18]. The proof of this theorem was exposed in [18] and is therefore omitted.

Theorem 9. Consider the NSCS (7). Then the following statements are equivalent:(i)there exists a function with in such a way that the resulting closed-loop system (8) satisfies RSP property;(ii)there exists a function with being locally Lipschitz in , in such a way that the resulting closed-loop system (8) satisfies RSP property;(iii)the NSCS (7) admits a stochastic CLF.

3. Main Results

We study the problem of finding continuous feedback law in order to derive necessary and sufficient conditions for ISSP of NSCS. For the NSCS (7), we extend the well-known Artstein-Sontag theorem established in [4] by introducing the concept of stochastic CLF (Theorem 11). This result is a useful tool for designing an explicit formula of a feedback law that exhibits ISSP of the resulting closed-loop system (8) at the equilibrium state (Theorem 12).

Proposition 10. Consider the system (7) and let be a positive definite function, which is , locally Lipschitz in , and further assume that NSCS (8) satisfies the wISSP property from the input with gain . Then, the NSCS (7) admits a stochastic CLF.

Proof. The proof of this proposition is a direct consequence of Theorem 9 and Lemma 7. Indeed, assume that the resulting closed-loop system (8) satisfies the wISSP property; then, according to Lemma 7, the resulting closed-loop system (8) satisfies the RSP property. Therefore, by Theorem 9, the NSCS (7) admits a stochastic CLF.

The input-to-state stability results proven in this paper use a technique which is a combination of Karafyllis and Tsinias [4] decomposition in deterministic case and Abedi et al. [11] decomposition in stochastic case. We use this decomposition and extend the existing input-to-state stability results. The following theorem is an extension of the well-known Artstein-Sontag theorem established in [4] (Theorem 5.1 of [4]). The proof of this theorem is a stochastic analogue of the deterministic proof of Karafyllis and Tsinias [4]. In the proof of this theorem, we use the stochastic versions of Artstein-Sontag theorem established in Abedi et al. [11] and La Salle’s invariance theorem developed in [17].

Theorem 11. Consider the NSCS (7) and let be a positive definite function, which is , locally Lipschitz in . Then the following statements are equivalent:(i)there exists a function with such that the resulting closed-loop system (8) satisfies the wISSP property with gain from the input . It turns out that the resulting closed-loop system (8) satisfies the ISSP property;(ii)there exists a function with for all , being locally Lipschitz in , such that the resulting closed-loop system (8) satisfies the same property as that in statement (i);(iii)the NSCS (7) admits a stochastic CLF.

Proof. (i → ii) is obvious.
(ii → iii) Suppose that there exists a function , such that the closed-loop system (8) satisfies the wISSP with gain from the input . According to Lemma 7, the resulting closed-loop system (8) satisfies the RSP property. Then, by Proposition 10 and the converse Lyapunov theorem (Theorem 2) established by Kushner [20], which provided the existence of a Lyapunov function in some neighborhoods of the origin, there exists a function and a continuous and positive definite function such that (13) holds and where is the infinitesimal generator of the resulting closed-loop system (8). The latter inequality implies (14) where and the condition . Therefore, the requirement in Definition 8 holds and is a stochastic CLF for the NSCS (7).
(iii → i) Assume that the NSCS (7) admits a stochastic CLF. Consider the functions , , and as defined in (13) and (14). From (13) we have Condition (14) in conjunction with (16) enables us to build, by standard partition of unity arguments, a map with such that From (17) and , is a supermartingale. By a supermartingale inequality established by Rogers and Williams [21], for any class function , we have Let . By using Ito formula for NSCS (7), we obtain By taking into account (17) and (19) we get From (20) we have Invoking (17) and (21) yields Hence, from (18) and (22), we have Thus,
For a given functions , , and , define . Then implies that and so, For a given , choose such that By taking into account (26) and (27), we obtain The latter inequality implies that Thus, from (28) and Definition 4, we have that the equilibrium is globally stable in probability with respect to the resulting closed-loop system (8). On the other hand, from (17) and the stochastic version of La Salle’s invariance Theorem 3, we obtain the stochastic process solution of the resulting closed-loop system (8), which tends to with probability ; that is, Therefore, from (30) and the above global stability in probability and Definition 4, we get the equilibrium is RSP with respect to the resulting closed-loop system (8). The desired wISSP property for the resulting closed-loop system (8) is a consequence of Lemma 7.

The following theorem, which is an immediate consequence of Theorem 11, is a stochastic extension of Proposition 5.2 in [4]. The proof of this theorem is a stochastic analogue of the deterministic proof of Karafyllis and Tsinias [4]. In the proof of this theorem, we use an explicit formula of a feedback law derived by Florchinger and Verriest [7] in exhibiting wISSP property for the resulting closed-loop system (8).

Theorem 12. Let be a positive definite function, which is , locally Lipschitz in , and further assume is a stochastic CLF associated with the NSCS (7), and, for any , denote by and the functions defined by then the feedback law where and are given by (31) and (32), respectively, and guarantees that the resulting closed-loop system (8) satisfies wISSP property with gain from the input .

Proof. Assume that the NSCS (7) admits a stochastic CLF. From (14) and (32), we have Notice that the feedback lawis well defined for all , since the denominator in (33) is strictly positive for all and is of class . Furthermore, according to regularity assumptions made for , , , , , and , the function as defined by (33) is on and locally Lipschitz with respect to , with , for all .
Denoting by the infinitesimal generator of the stochastic process solution of the resulting closed-loop system (8), we get It then follows from (33) and (35) that From (38) and , we can conclude that is a supermartingale and, therefore, the rest of the proof is a straightforward consequence of (38) and Theorem 11 (implication (iii)→(i)). This completes the proof of Theorem 12.

Now, we can make the following summaries on our main results.

Remark 13. (i) The necessary and sufficient ISSP conditions for the NSCS (7) obtained in Theorem 11 (that is an extension of the well-known Artstein-Sontag theorem established in [4]) are different from those stated in [1–5, 19] in deterministic case and [6] in stochastic case.
(ii) We extended the concept of stochastic Lyapunov condition introduced in Definition 2.4 established in [11] and obtained the notion of stochastic CLF to Definition 8 that is used for ISSP of the NSCS (7) at the origin.
(iii) The stabilizability results proven for the stochastic systems in Abedi et al. [11] that established the necessary and sufficient conditions for global asymptotic stability of stochastic system and Tsinias [6] that obtained the sufficient conditions for global stability of triangular stochastic system do not permit us to establish the necessary and sufficient conditions for ISSP of the NSCS (7) at the origin, whereas the results of this paper are still valid. Furthermore, both the results and the proofs used in our paper, however, are different from those in [6, 11].

Finally, in this section, we illustrate our results by designing a numerical example.

Example 14. Denote by the solution of the SCS where is a standard real-valued Wiener process, is a real-valued measurable control law, and is a smooth functional mapping into such that for any . Obviously, the function , defined on by is a stochastic CLF for SCS (39). Indeed, for any with it follows that , and therefore With condition , the latter equality implies . Thus, by Definition 8, the function is a stochastic CLF for SCS (39). Therefore, according to Theorem 11, there exists a -feedback law with such that wISSP property is fulfilled for the resulting closed-loop system deduced from SCS (39).

4. Conclusions

Lyapunov characterization for the problem of ISSP of stochastic control systems is given. Furthermore, we have extended the well-known Artstein-Sontag theorem established by Karafyllis and Tsinias [4] to the concept of stochastic CLF in deriving the necessary and sufficient conditions for ISSP property of stochastic control systems. We have also established the existence of an explicit formula of a feedback law exhibiting ISSP and given some applications to feedback stabilization.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

E. D. Sontag and Y. Wang, “Lyapunov characterizations of input to output stability,” SIAM Journal on Control and Optimization, vol. 39, no. 1, pp. 351–359, 2000.
View at: Publisher Site | Google Scholar | MathSciNet
D. Angeli, E. D. Sontag, and Y. Wang, “A characterization of integral input-to-state stability,” IEEE Transactions on Automatic Control, vol. 45, no. 6, pp. 1082–1096, 2000.
View at: Publisher Site | Google Scholar | MathSciNet
L. Grune, “Input-to-state dynamical stability and its Lyapunov function characterization,” IEEE Transactions on Automatic Control, vol. 47, no. 9, pp. 1499–1504, 2002.
View at: Publisher Site | Google Scholar | MathSciNet
I. Karafyllis and J. Tsinias, “A converse Lyapunov theorem for nonuniform in time global asymptotic stability and its application to feedback stabilization,” SIAM Journal on Control and Optimization, vol. 42, no. 3, pp. 936–965, 2003.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
C. Ning, Y. He, M. Wu, Q. Liu, and J. She, “Input-to-state stability of nonlinear systems based on an indefinite Lyapunov function,” Systems & Control Letters, vol. 61, no. 12, pp. 1254–1259, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
J. Tsinias, “Stochastic input-to-state stability and applications to global feedback stabilization,” International Journal of Control, vol. 71, no. 5, pp. 907–931, 1998.
View at: Publisher Site | Google Scholar | MathSciNet
P. Florchinger and E. I. Verriest, “Application of stochastic Artstein's theorem to feedback stabilization,” Stochastic Analysis and Applications, vol. 18, no. 3, pp. 361–373, 2000.
View at: Publisher Site | Google Scholar | MathSciNet
M. Krstic and H. Deng, Stabilization of Uncertain Nonlinear Systems, Springer, New York, NY, USA, 1998.
H. Deng, M. Krstic, and R. J. Williams, “Stabilization of stochastic nonlinear systems driven by noise of unknown covariance,” IEEE Transactions on Automatic Control, vol. 46, no. 8, pp. 1237–1253, 2001.
View at: Publisher Site | Google Scholar | MathSciNet
R. van Handel, “Almost global stochastic stability,” SIAM Journal on Control and Optimization, vol. 45, no. 4, pp. 1297–1313, 2006.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
F. Abedi, M. A. Hassan, and N. M. Arifin, “Lyapunov function for nonuniform in time global asymptotic stability in probability with application to feedback stabilization,” Acta Applicandae Mathematicae, vol. 116, no. 1, pp. 107–117, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
F. Abedi, W. J. Leong, and S. S. Chaharborj, “Exponential input-to-state stability of composite stochastic systems,” Advances in Difference Equations, vol. 2013, article 208, 10 pages, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
F. Abedi, W. J. Leong, and S. S. Chaharborj, “On the asymptotical and practical stability of stochastic control systems,” Mathematical Problems in Engineering, vol. 2013, Article ID 560647, 10 pages, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Artstein, “Stabilization with relaxed controls,” Nonlinear Analysis: Theory, Methods & Applications, vol. 7, no. 11, pp. 1163–1173, 1983.
View at: Publisher Site | Google Scholar | MathSciNet
E. D. Sontag, “A “universal” construction of Artstein's theorem on nonlinear stabilization,” Systems & Control Letters, vol. 13, no. 2, pp. 117–123, 1989.
View at: Publisher Site | Google Scholar | MathSciNet
R. Z. Khasminskii, Stochastic Stability of Differential Equation, Sijthoff Noordhoff, Alphen aan den Rijn, The Netherlands, 1980.
H. J. Kushner, “Stochastic stability,” in Stability of Stochastic Dynamical Systems, vol. 294 of Lecture Notes in Mathematics, pp. 97–124, Springer, Berlin, Germany, 1972.
View at: Publisher Site | Google Scholar
F. Abedi and W. J. Leong, “Dynamic robust stabilization of stochastic differential control systems,” IMA Journal of Mathematical Control and Information, vol. 30, no. 4, pp. 559–569, 2013.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
E. D. Sontag and Y. Wang, “On characterizations of the input-to-state stability property,” Systems & Control Letters, vol. 24, no. 5, pp. 351–359, 1995.
View at: Publisher Site | Google Scholar | MathSciNet
H. J. Kushner, “Converse theorems for stochastic Liapunov functions,” SIAM Journal on Control and Optimization, vol. 5, pp. 228–233, 1967.
View at: Publisher Site | Google Scholar | MathSciNet
L. C. G. Rogers and D. Williams, Diffusions, Markov Processes and Martingales, vol. 1, Wiley, New York, NY, USA, 2nd edition, 1994.

Copyright

Copyright © 2015 Fakhreddin Abedi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1349

Downloads

926

Citations