Mathematical Problems for Complex NetworksView this Special Issue
Research Article | Open Access
pth Mean Practical Stability for Large-Scale Itô Stochastic Systems with Markovian Switching
Motivated by the study of a class of large-scale stochastic systems with Markovian switching, this correspondence paper is concerned with the practical stability in the pth mean. By investigating Lyapunov-like functions and the basic comparison principle, some criteria are derived for various types of practical stability in the pth mean of nonlinear stochastic systems. The main contribution of these results is to convert the problem of practical stability in the pth mean of stochastic systems into the one of practical stability of the comparative deterministic systems.
The practical dynamical systems in real-world applications, such as engineering, physics, and economics, usually exhibit the stochastic nature due to the uncertain resulting from the external environment. Examples include traffic systems, flexible manufacturing systems, and economic systems. All of these dynamical systems can be modeled by Itô stochastic differential equations. Therefore, it is not surprising that various problems of Itô stochastic differential equations have received considerable attention. As the development of the stochastic theory including stochastic processes, stochastic integral, and stochastic partial differential equations, the theory on the stochastic differential equations in infinite dimensional spaces has advanced greatly, and, so far, a rich body of literature has been reported.
Stability is one of the most important issues in the analysis and synthesis of stochastic systems and often regarded as the first characteristic of the dynamical systems (or models) to be studied. Currently, there have already been many kinds of stability concepts such as asymptotic stability, stability in probability, almost sure exponential stability, and mean-square exponential stability. These stabilities are analyzed in terms of the theory of functional analysis which, however, makes it difficult for a newcomer to enter this interesting and important field. The concepts of stability mentioned above are defined in the sense of Lyapunov. In many real-world applications, however, the systems might not be asymptotically stable in the sense of Lyapunov and stay nearby a state with an acceptable fluctuation. For example, an aircraft or a missile may oscillate around a mathematically unstable course, and its performance may be acceptable yet. To treat with such situations, a new stability concept, that is, the practical stability, has been proposed by LaSalle and Lefschetz  and, subsequently, has been developed in [2–4].
With respect to stochastic systems, the practical stability in the th mean and the stability in probability have been introduced in  and , respectively. In these papers, both the stochastic system and its corresponding auxiliary equation have deterministic initial conditions. By using the powerful comparison theorem, which is developed in [7, 8], these concepts have been extended to a more general class of stochastic systems in , where the resulting auxiliary system has random initial conditions. Recently, stochastic differential equations with Markovian switching have also stirred a great deal of research interests due primarily to their insight into applications. The fundamental theory of existence and uniqueness of the solution of stochastic differential equations with Markovian switching has been studied well in [10, 11], while the stability issues have been investigated in [12–15].
To be more specific, during the research of practical stability, one of the foremost challenges to system theory in the present-day advanced technological world is to overcome the increasing size and complexity of the corresponding mathematical models [9, 16]. This is the so-called large-scale systems, which is more closed to the actual circumstances, and, therefore, it has a wider significance. However, since the computational efforts are enormous, the practical stability of large-scale systems has received relatively little attention. Recently, several important results have been obtained in the area of practical stability for large-scale Itô stochastic systems, see , for example, in which the large amount of computational efforts of a large-scale complex system become simpler and more economical by decomposition into a number of interconnected subsystems; these subsystems, to some extent, can be considered to be independent so that some of the qualitative behaviors of the corresponding subsystems can be combined with interconnection constraints to come up with the qualitative behavior of the overall large-scale systems. Like all other systems, the stability issue should be examined first in the large-scale systems. However, the problem of th mean practical stability for large-scale Itô stochastic systems with Markovian switching has not been addressed properly, which motives the current research.
In this paper, the problem of the th mean practical stability for large-scale Itô stochastic systems with Markovian switching is studied. First, the notion of practical stability in the th mean is introduced and extended for the large-scale stochastic systems with Markovian switching. Then, the concepts of Lyapunov-like vector-valued functions coupled with the decomposition-aggregation techniques are utilized to develop a comparison principle. In addition, some general criteria of practical stability for the large-scale Itô stochastic systems with Markovian switching are obtained. Finally, an example is given to show the usefulness of the developed criteria.
Let be a complete probability space with a filtration satisfying the usual conditions, that is, the filtration is continuous on the right and contains all -zero sets. is an -dimensional Wiener process defined on the probability space. denotes a right-continuous Markov chain on the probability space , taking values in a finite state space with generator given by
where and is the transition rate from to if while . We assume that the Markov chain is independent of Wiener process . It is known that almost every sample path of is a right-continuous step function with a finite number of simple jumps in any finite subinterval of .
Consider the following Itô stochastic differential equations with Markovian switching: with the initial condition . Here is assumed to be independent of . The nonlinear functions and satisfy Lipschitz condition and Linear growth condition.
Now, we decompose (2.2) into interconnected subsystems described by where nonlinear functions , and , and , respectively.
3. Comparison Principle
The comparison principle has proved to be a useful tool in the study of the qualitative and quantitative properties of solution processes of Itô-type stochastic system with Markovian switching. In this section, by employing the concept of Lyapunov vector-valued function coupled with decomposition-aggregation techniques, and together with the theory of differential inequalities, the comparison theorems for the large-scale system (2.3) are developed.
The -operator for the -interconnected subprocedures (2.3) is defined as
Now, consider now the following auxiliary random differential system: where is concave and quasi-monotone nondecreasing in for each fixed and is an -dimensional random vector. Let be any solution of the system (3.3) and the maximal solution process of the system (3.3) through .
We need the following corresponding definitions of practical stability for the auxiliary system (3.3).
Definition 3.1. System (3.3) is said to be practically stable, if for all given with , implies , for some .
Definition 3.2. Set and . If , , one denotes .
In this section, by employing the Lyapunov-like functions and the basic comparison principle of stochastic systems, some results on various types of practical stability in the th mean are obtained for the interconnected system (2.3).
Theorem 3.3. Assume that there exist functions and satisfying the following conditions: (i) for every , and exist and are continuous for , and holds for all , , ;(ii) is a quasi-monotone nondecreasing concave function in for each , and satisfies ;(iii) the maximal solution of the auxiliary differential system (3.3), that is, exists for all , where is an -dimensional random vector;(iv) for the solution process of system (2.3), if exists for all , then whenever and , where
Proof. By applying generalized Itô formula, we have
Setting , we obtain
based on which, letting , it can be obtained that
That is, for each , we have where denotes the upper right Dini-derivative operator and .
Denoting , we have
According to comparison theorem in , it immediately follows that whenever and , and hence the proof is complete.
4. Practical Stability Criteria
In this section, by employing Lyapunov-like functions and basic comparison principles for interconnected systems developed in the previous section, we give various types of practical stability in the th mean of the interconnected system (2.3).
Definition 4.1. System (2.3) is said to be practically stable in the th mean, if for all given with , implies for all .
Definition 4.2. A function is said to belong to the class , if satisfies ; is said to belong to the class , if is continuous, concave, and strictly increasing in for each and satisfies ; is said to belong to the class , if is continuous, convex, and strictly increasing for each and satisfies .
The following theorem gives the criteria of practical stability.
Theorem 4.3. Assume that(i) all the hypotheses of Theorem 3.3 hold;(ii) for , the following inequality holds: where and satisfy and , respectively;(iii) the maximal solutions of the auxiliary differential system (3.3) on , that is, and both exist;(iv) for the given and (), system (3.3) is practically stable with .
Then, the interconnected system (2.3) is practically stable in the th mean.
Proof. Let () be any solution process of system (2.3). It can be obtained from Theorem 3.3 that
whenever and , where is the maximal solution of system (3.3) on , and thus,
Considering that is practically stable, we have which implies that
We claim that implies , for some , where is any solution of system (2.3) with . Suppose that this claim is not true, then there exists a and a solution of system (2.3) with satisfying Then, it follows from assumption (ii) that
Choosing such that and , we have Therefore, we arrive at the following contradiction: This completes the proof.
Theorem 4.4. Assume the following: (i) all hypotheses of Theorem 3.3 hold; (ii) for , satisfies the following inequality: where and is the collection of all continuous, convex, and increasing functions defined on into itself with ;(iii) the maximal solution of system (3.3) through converges to the zero vector as . Then, the interconnected system (2.3) is practically stable in the th mean.
Proof. An application of Theorem 3.3 gives the following inequality:
where is the maximal solution of system (3.3).
From assumption (ii), it can be seen that for every . Let be a positive real number satisfying . By choosing such that and noting assumption (ii) and the continuity of , there exists such that implies .
From assumption (iii) and the practical stability of of system (3.3), we have which implies that It follows from (4.11) that and from (4.10), we arrive at the following inequality: By noting that is a convex function and using the Tensen's inequality , we have Then, from (4.12)–(4.15), we obtain whenever , which implies Thus the proof is complete.
Consider the following stochastic differential equation with Markovian switching: where is the sate vector, is a normalized scalar wiener process.
The nonlinear vector function satisfies , where .
The nonlinear function is taken as We choose as the Lyapunov function for (5.1). It is not difficult to obtain
Now, consider the following auxiliary random differential system:
where , is given by We obtain let . Obviously, the functions and are both convex and concave. Moreover, it is easy to see that is concave and quasi-monotone nondecreasing in for the fixed , and hence the system (5.1) is uniformly practically stable.
In this paper, the notion of practical stability in the th mean is introduced and extended for the large-scale stochastic systems with Markovian switching. By employing Lyapunov-like functions and the basic comparison principle, sufficient conditions are established for various types of practical stability in the th mean of nonlinear stochastic systems. The advantage of these results is to convert the problem of practical stability in the th mean of stochastic systems into the problem of practical stability of the comparative deterministic systems. Future research topics include the investigation on the filtering and control problems for uncertain nonlinear stochastic systems, see for example, [19–28].
This work is supported by the National Natural Science Foundation of China (No. 60974030) and the Science and Technology Project of Education Department in Fujian Province, China (No. JA11211).
- J. P. LaSalle and S. Lefschetz, Stability Theory by Liapunovs Direct Method with Applications, Academic Press, New York, NY, USA, 1961.
- A. A. Martynyuk, Practical Stability of Motion, Naukav a Dumka, Kiev, Ukraine, 1983.
- A. A. Martynyuk, “Averaging method in the theory of motion stability,” Nonlinear Vibration Problems, vol. 14, pp. 71–79, 1973.
- V. Laksmikantham, S. Leela, and A. A. Martynyuk, Practical Stability of Nonlinear Systems, World Scientific, Singapore, 1990.
- Z. S. Feng, Y. Q. Liu, and F. W. Guo, “Criteria for practical stability in the p-th mean of nonlinear stochastic systems,” Applied Mathematics and Computation, vol. 49, no. 2-3, pp. 251–260, 1992.
- A. H. Tsoi and B. Zhang, “Practical stabilities of Itô type nonlinear stochastic differential systems and related control problems,” Dynamic Systems and Applications, vol. 6, no. 1, pp. 107–124, 1997.
- G. S. Ladde and B. A. Lawrence, “Stability and convergence of large scale stochastic approximation procedures,” International Journal of Systems Science, vol. 26, no. 3, pp. 595–618, 1995.
- L. Shaikhet, “Stability of stochastic differential systems with Markovian Switching,” Stochastic Processes, vol. 2, no. 18, pp. 180–184, 1996.
- S. Sathananthan, Practical Stability Criteria for Nonlinear Ito-Type Stochastic Control Systems, Academic Press, New York, NY, USA, 2000.
- M. A. O. Xuerong, A. Matasov, and A. B. Piunovskiy, “Stochastic differential delay equations with Markovian switching,” Bernoulli, vol. 6, no. 1, pp. 73–90, 2000.
- P. Zhao, “Practical stability, controllability and optimal control of stochastic Markovian jump systems with time-delays,” Automatica, vol. 44, no. 12, pp. 3120–3125, 2008.
- X. Mao, “Robustness of stability of stochastic differential delay equations with Markovian Switching,” Stability and Control: Theory and Applications, vol. 3, no. 1, pp. 48–61, 2000.
- H. Gilsing, “On the stability of the Euler scheme for an affine stochastic delay differential equation with the delay,” Tech. Rep. 20,SFB 373, Humboldt University, Berlin, Germany, 2001.
- A. V. Swishchuk and Y. I. Kazmerchuk, “Stability of stochastic of differential delay Ito's equations with Possion Jumps and with Markovian Switching. Application to Financial Models,” Teoriya Veroyatnostei i Matematicheskaya Statistika, vol. 63 (63), 2001.
- J. Luo, J. Zou, and Z. Hou, “Comparison principle and stability criteria for stochastic differential delay equations with Markovian switching,” Science in China. Series A, vol. 46, no. 1, pp. 129–138, 2003.
- D. D. Šiljak, Large-Scale Dynamic Systems: Stability and Structure, vol. 3 of North-Holland Series in System Science and Engineering, North-Holland, New York, NY, USA, 1979.
- S. Sathananthan and S. Suthaharan, “Practical stability criteria for large-scale nonlinear stochastic systems by decomposition and aggregation,” Dynamics of Continuous, Discrete & Impulsive Systems. Series A, vol. 8, no. 2, pp. 227–248, 2001.
- G. S. Ladde and V. Lakshmikantham, Random Differential Inequalities, vol. 150 of Mathematics in Science and Engineering, Academic Press, New York, NY, USA, 1980.
- H. Dong, Z. Wang, D. W.C. Ho, and H. Gao, “Robust H∞ filtering for Markovian jump systems with randomly occurring nonlinearities and sensor saturation: the finite-horizon case,” IEEE Transactions on Signal Processing, vol. 59, no. 7, pp. 3048–3057, 2011.
- Y. Tang, Z. Wang, W. K. Wong, J. Kurths, and J. Fang, “Multiobjective synchronization of coupled systems,” Chaos, vol. 21, no. 2, Article ID 025114, 2011.
- Z. Wang, J. Lam, L. Ma, Y. Bo, and Z. Guo, “Variance-constrained dissipative observer-based control for a class of nonlinear stochastic systems with degraded measurements,” Journal of Mathematical Analysis and Applications, vol. 377, no. 2, pp. 645–658, 2011.
- B. Shen, Z. Wang, Y. S. Hung, and G. Chesi, “Distributed H∞ filtering for polynomial nonlinear stochastic systems in sensor networks,” IEEE Transactions on Industrial Electronics, vol. 58, no. 5, pp. 1971–1979, 2011.
- J. Liang, Z. Wang, and X. Liu, “Distributed state estimation for discrete-time sensor networks with randomly varying nonlinearities and missing measurements,” IEEE Transactions on Neural Networks, vol. 22, no. 3, pp. 486–496, 2011.
- X. He, Z. Wang, Y. D. Ji, and D. H. Zhou, “Robust fault detection for networked systems with distributed sensors,” IEEE Transactions on Aerospace and Electronic Systems, vol. 47, no. 1, pp. 166–177, 2011.
- B. Shen, Z. Wang, and X. Liu, “Bounded H∞ synchronization and state estimation for discrete time-varying stochastic complex networks over a finite horizon,” IEEE Transactions on Neural Networks, vol. 22, no. 1, pp. 145–157, 2011.
- B. Shen, Z. Wang, H. Shu, and G. Wei, “H∞ filtering for uncertain time-varying systems with multiple randomly occurred nonlinearities and successive packet dropouts,” International Journal of Robust and Nonlinear Control, vol. 21, no. 14, pp. 1693–1709, 2011.
- Z. Wang, D. W. C. Ho, H. Dong, and H. Gao, “Robust H∞ finite-horizon control for a class of stochastic nonlinear time-varying systems subject to sensor and actuator saturations,” IEEE Transactions on Automatic Control, vol. 55, no. 7, pp. 1716–1722, 2010.
- Z. Wang, Y. Liu, and X. Liu, “Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays,” IEEE Transactions on Automatic Control, vol. 55, no. 7, pp. 1656–1662, 2010.
Copyright © 2012 Yan Yun et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.