Mathematical Theories and Applications for Nonlinear Control SystemsView this Special Issue
Research Article | Open Access
A New Stability Criterion for Neutral Stochastic Delay Differential Equations with Markovian Switching
In this short paper, a new stability theorem for neutral stochastic delay differential equations with Markovian switching is investigated by applying stochastic analysis technique and Razumikhin stability approach. A novel criterion of the th moment exponential stability is derived for the related systems. The feature of the criterion shows that the estimated upper bound for the diffusion operator of Lyapunov function is allowed to be indefinite, even if to be unbounded, which can loosen the constraints of the existing results. Last, an example is provided to illustrate the usefulness and significance of the theoretical results.
As is well-known, the stability is very hot topic in deterministic or stochastic dynamic systems (for instance, see [1–37] and references therein). Recently, a class of stochastic hybrid systems (also known as stochastic systems with Markovian switching) has been used to model many practical systems where they may experience abrupt changes in their structure and parameters. In , the author explained that the Markovian switching systems had been emerging as a convenient mathematical framework for the formulation of various design problems in different fields such as target tracking, fault tolerant control, and manufacturing processes, which can be seen as the motivation of wide practical use of the theoretic results for hybrid systems. Owing to their widely real applications, stochastic systems with Markovian switching have received a great deal of attention and many interesting results have been reported in the literature. For example,  considered the stability of stochastic differential equations with infinite Markovian switchings and  studied the stability for stochastic differential equations with semi-Markovian switchings. The results of stochastic hybrid systems are applied in feedback controls and neural networks; please refer to [41–45] and the reference therein.
As an important class of hybrid stochastic system, neutral stochastic delay differential equations with Markovian switching (NSDDEwMS) have been applied in practice, such as traffic control, neutral networks, and chemical process. Due to its wide applications, more and more researchers focus on this system. An important question for such a model is the stability analysis. Lyapunov-Razumikhin functions method and Lyapunov-Krasovskii functionals method are two effective methods that have been exploited for the stability analysis. For example, Mao in [46, 47] applied Razumikhin approach to derive the exponential stability criteria for neutral stochastic delay differential systems with Markovian switching. In [48–53], the authors considered the exponential stability by using Lyapunov-Krasovskii functionals method. Reference  applied some special techniques to study the exponential stability. Besides, Zhu in [55, 56] obtained several novel exponential stability criteria for some more complex systems with impulse control and Lévy noise. In addition,  considered the stability in distribution of neutral stochastic differential delay equations with Markovian switching and [58, 59] studied the almost sure stability for the same system.
Although the above exponential stability criteria can be used to judge the stability for many NSDDEwMS, nevertheless, these conditions in the above literature can be weakened to cover a large collection of NSDDEwMS. In other words, there are some shortcomings in the former criteria. The main is that all the above criteria for exponential stability in the related literature imposed some strict conditions on the diffusion operator of Lyapunov functions. For example, [46, 47] required the estimated upper bound for the diffusion operator of Lyapunov functions to be negative constant numbers. Reference  needed that the estimated upper bound must be a negative value function. Simply speaking, the former results all need that the upper bound for the diffusion operator of the Lyapunov function is negative definite for all . This restriction leads to the criteria having strong conservativeness in practice due to the fact that there are a large number of time-varying systems not satisfying the above conditions. As shown by an example in Section 4, the existing results and methods cannot be applied to analyse the stability for more general time-varying systems.
Motivated by the above discussion, in this short note, we focus on the exponential stability for NSDDEwMS. By using the notions such as uniformly stable function (USF), overshoot of the USF that dated from [60, 61] and then combining the stochastic analysis techniques, we obtain a novel stability criterion for NSDDEwMS. The feature of the criterion is that the coefficients of the estimated upper bound for the diffusion operator of Lyapunov functions can be allowed sign-changing as the time-varying, which can be used more widely than the existing results.
The rest of the paper is organized as follows. In Section 2, we introduce the model of NSDDEwMS and some preliminaries. The main result and its proof will be displayed in Section 3. An example is provided in Section 4. Finally, we conclude this paper with some general remarks in Section 5.
Throughout this short paper, let be a complete probability space with a natural filtration satisfying the usual condition (i.e., it is right continuous and contains all -null sets). denotes the Euclidean norm of . The symbol denotes the family of continuous function from to with the norm . We use to denote the family of all -measurable, valued random variables satisfying . We use to denote the expectation operator with respect to the probability measure . Let be an -dimensional Brownian motion defined on a complete probability space. . denotes the set of positive integers.
Let be a right-continuous Markov chain on the probability space taking values in a finite state space with generator given by where . Here is the transition rate from to if while .
In this short paper, we will consider the following neutral stochastic delay differential system with Markovian switching:with the initial data . We assume that , satisfy the local Lipschitz condition and the linear growth condition. Additionally, we impose the following condition:on to guarantee the existence and uniqueness of solution for system (2) for all . We also assume that , , and , which implies that the trivial solution of system (2) exists. In order to use Lyapunov’s method to study the th moment exponential stability, we need the following definitions.
Definition 1. The trivial solution of (2) is said to be th moment exponentially stable if for all . When , th moment exponential stability is usually called mean square exponentially stable.
Definition 2. The function belongs to class if it is a continuously twice differentiable with respect to and once differentiable with respect to .
Next, we need an operator from to by where
In order to overcome the difficult caused by the neutral item, we need the following inequality.
Lemma 3. Let . Then holds for any .
The following lemma, which is important in the proof of the main result, can be found in Lemma 1 of .
Lemma 4. Let be a constant. Let a function admit a sequence and positive constants and , such that , for all . is continuous on for all and the left limit exist. Assume that there exists a constant such that holds for all . Then holds for all .
The following definitions, which are dated from , are important in the proof of our main result.
Definition 5. A piecewise continuous function is said to be a USF if the following linear time-varying equation is globally uniformly asymptotically stable:
Definition 6. Let be a USF. Then the set is said to be the uniform convergence set of . For any , the overshoot of is defined as follows:
3. Main Results
In this section, we will use stochastic analysis theory, Lyapunov’s method, and Lemmas 3 and 4 to obtain a criterion for th moment exponential stability of system (2). Our main result is the following.
Theorem 7. Let be all positive numbers, and is a USF. If there exist a function and a constant such that the following conditions hold for all ,
(1) for all , , (2) the following Razumikhin-type condition holds:Then, system (2) is th moment exponentially stable; here .
Proof. First of all, we will prove the following fact: if holds for all which implies , then, for any ,In order to prove inequality (14), we consider the following two cases:
(A): holds for all .
(B): does not hold for some .
For (A), we know that holds for any . By using Ito’s formula and the standard stopping times technique, we obtain that which implies that .
For (B), define . Then or . If , then, for all , . So according to the result of (A), we obtain that If , from the definition of , we have Combining the above three inequalities, we can see that inequality (14) holds.
Assume that holds for all , then holds for all . According to condition (2), we know that . Thus, from inequality (14), condition (1), and Lemma 3, we conclude that, for any , By condition (1), we can see that Using Lemma 3 again, we obtain that In order to use Lemma 4, we need to justify that . In fact, on one hand, due to , there exists a constant such that . On the other hand, due to being a USF and , there exists a constant such that . Thus where . By Lemma 4, we derive that which implies that In other words, we have proved that system (2) is th moment exponentially stable.
Remark 8. Here, by using stochastic analysis theory, some notions as uniformly stable function (USF), overshoot of the USF that dated from [60, 61], and some inequality techniques, we obtain a novel exponential stability criterion with respect to the related systems. The method we use here is rather different from the traditional Razumikhin approach. Thus, we provide a new method to investigate the stability analysis for neutral stochastic delayed differential equations with Markovian switchings. In the future, we can develop this approach to study the stability for impulsive neutral stochastic delayed differential equations.
Remark 9. If system (2) has no Markovian switching and , then ; the condition of Theorem 7 becomes , which is the same as the conditions in [46, 47]. If the model we considered has no Markovian switching, stochastic disturbance, and neutral item, then we can obtain the same result as Theorem 1 in . Thus, our result is the generalization of Theorem 1 in  and the main results in [46, 47].
Remark 10. In Theorem 3.1 of , the condition (3.3) ensured that the coefficient of the estimated upper bound for the diffusion operator of Lyapunov function is a negative value, and the condition of Theorem 3.1 in  required that the coefficient function of the estimated upper bound for the diffusion operator of Lyapunov function is a negative definite function, which are very conservative in the practice if the system is time-varying system. But our conditions allow this function to take values on and even allow it to be unbounded. Thus, our result can be used more widely and is less conservative than the existing results. See Example 1 for more details.
4. An Example
In this section, we will give an example to illustrate the validity and significance of our result.
Example 1. Now we will consider the following neutral-type stochastic delay differential system with Markovian switching: whereand is a right-continuous Markov chain on the state space with the generator Theorem 3.1 in  is void in determining the exponential stability for such a system. In fact, taking and , then, by Ito’s formula, and Obviously, the conditions in Theorem 3.1  do not hold. But we can judge the exponential stability for such system by using our result. Take and . By Ito’s formula,
and Choosing , then , where . Here, is an unbounded function, taking values in , so we cannot use any former results to judge the mean-square exponential stability for such system. But, from our result, we can determine its stability. In fact, taking , then holds for all . Thus . Additionally, , and . By Theorem 7, the system is mean square exponentially stable. See Figure 1.
In this paper, we investigate the stability criterion for neutral stochastic delay differential equations with Markovian switching. By using stochastic analysis technique and Razumikhin approach, we overcome the difficulty caused by the neutral item for the related system. Finally, we derive a new and novel Razumikhin exponential stability criterion. The feature of the result is that the estimated upper bound for the diffusion operator of Lyapunov function is allowed to take values on , even if it is allowed to be unbounded. The criterion can reduce some restrictiveness of the related results that are existing in the previous literature. An example is provided to show the superiority of the new exponential stability criterion.
No data were used to support this study.
Conflicts of Interest
The author declares that they have no conflicts of interest.
This work was supported by the China Postdoctoral Science Foundation (2018M632325).
- X. Zheng, Y. Shang, and X. Peng, “Orbital stability of periodic traveling wave solutions to the generalized Zakharov equations,” Acta Mathematica Scientia, vol. 37, no. 4, pp. 998–1018, 2017.
- Y. Guo, “Mean square exponential stability of stochastic delay cellular neural networks,” Electronic Journal of Qualitative Theory of Differential Equations, no. 34, pp. 1–10, 2013.
- Q. Zhu and H. Wang, “Output feedback stabilization of stochastic feedforward systems with unknown control coefficients and unknown output function,” Automatica, vol. 87, pp. 166–175, 2018.
- H. Wang and Q. Zhu, “Finite-time stabilization of high-order stochastic nonlinear systems in strict-feedback form,” Automatica, vol. 54, pp. 284–291, 2015.
- G. Wang, “Existence-stability theorems for strong vector set-valued equilibrium problems in reflexive Banach spaces,” Journal of Inequalities and Applications, vol. 239, pp. 1–14, 2015.
- Y. Bai and X. Mu, “Global asymptotic stability of a generalized SIRS epidemic model with transfer from infectious to susceptible,” Journal of Applied Analysis and Computation, vol. 8, no. 2, pp. 402–412, 2018.
- Q. Zhu, S. Song, and T. Tang, “Mean square exponential stability of stochastic nonlinear delay systems,” International Journal of Control, vol. 90, no. 11, pp. 2384–2393, 2017.
- Y. Guo, “Global asymptotic stability analysis for integro-differential systems modeling neural networks with delays,” Zeitschrift für Angewandte Mathematik und Physik, vol. 61, no. 6, pp. 971–978, 2010.
- L. Gao, D. Wang, and G. Wang, “Further results on exponential stability for impulsive switched nonlinear time-delay systems with delayed impulse effects,” Applied Mathematics and Computation, vol. 268, pp. 186–200, 2015.
- Y. Guo, “Exponential stability analysis of travelling waves solutions for nonlinear delayed cellular neural networks,” Dynamical Systems, vol. 32, no. 4, pp. 490–503, 2017.
- Y. Li, Y. Sun, and F. Meng, “New criteria for exponential stability of switched time-varying systems with delays and nonlinear disturbances,” Nonlinear Analysis: Hybrid Systems, vol. 26, pp. 284–291, 2017.
- B. Wang and Q. Zhu, “Stability analysis of Markov switched stochastic differential equations with both stable and unstable subsystems,” Systems & Control Letters, vol. 105, pp. 55–61, 2017.
- L. G. Wang, K. P. Xu, and Q. W. Liu, “On the stability of a mixed functional equation deriving from additive, quadratic and cubic mappings,” Acta Mathematica Sinica, vol. 30, no. 6, pp. 1033–1049, 2014.
- Q. Zhu, S. Song, and P. Shi, “Effect of noise on the solutions of non-linear delay systems,” IET Control Theory & Applications, vol. 12, no. 13, pp. 1822–1829, 2018.
- G. Liu, S. Xu, Y. Wei, Z. Qi, and Z. Zhang, “New insight into reachable set estimation for uncertain singular time-delay systems,” Applied Mathematics and Computation, vol. 320, pp. 769–780, 2018.
- W. Sun, Y. Wang, and R. Yang, “L2 disturbance attenuation for a class of time delay Hamiltonian systems,” Journal of Systems Science & Complexity, vol. 24, no. 4, pp. 672–682, 2011.
- Q. Zhu, “Asymptotic stability in the pth moment for stochastic differential equations with Lévy noise,” Journal of Mathematical Analysis and Applications, vol. 416, no. 1, pp. 126–142, 2014.
- Y. Guo, “Global stability analysis for a class of Cohen-Grossberg neural network models,” Bulletin of the Korean Mathematical Society, vol. 49, no. 6, pp. 1193–1198, 2012.
- J. Hu and A. Xu, “On stability of F-Gorenstein flat categories,” Algebra Colloquium, vol. 23, no. 2, pp. 251–262, 2016.
- W. W. Sun, “Stabilization analysis of time-delay Hamiltonian systems in the presence of saturation,” Applied Mathematics and Computation, vol. 217, no. 23, pp. 9625–9634, 2011.
- H. Wang and Q. Zhu, “Global Stabilization of Stochastic Nonlinear Systems via C 1 and C ∞ Controllers,” Institute of Electrical and Electronics Engineers Transactions on Automatic Control, vol. 62, no. 11, pp. 5880–5887, 2017.
- Y. Guo, “Mean square global asymptotic stability of stochastic recurrent neural networks with distributed delays,” Applied Mathematics and Computation, vol. 215, no. 2, pp. 791–795, 2009.
- Q. Zhu, “Stability analysis of stochastic delay differential equations with Lévy noise,” Systems & Control Letters, vol. 118, pp. 62–68, 2018.
- W. Sun and L. Peng, “Observer-based robust adaptive control for uncertain stochastic Hamiltonian systems with state and input delays,” Lithuanian Association of Nonlinear Analysts. Nonlinear Analysis: Modelling and Control, vol. 19, no. 4, pp. 626–645, 2014.
- W. Qi, Y. Kao, X. Gao, and Y. Wei, “Controller design for time-delay system with stochastic disturbance and actuator saturation via a new criterion,” Applied Mathematics and Computation, vol. 320, pp. 535–546, 2018.
- L. G. Wang and B. Liu, “Fuzzy stability of a functional equation deriving from additive, quadratic, cubic and quartic functions,” Acta Mathematica Sinica, vol. 55, no. 5, pp. 841–854, 2012.
- Q. Zhu and B. Song, “Exponential stability of impulsive nonlinear stochastic differential equations with mixed delays,” Nonlinear Analysis: Real World Applications, vol. 12, no. 5, pp. 2851–2860, 2011.
- F. Li and Y. Bao, “Uniform stability of the solution for a memory-type elasticity system with nonhomogeneous boundary control condition,” Journal of Dynamical and Control Systems, vol. 23, no. 2, pp. 301–315, 2017.
- Y.-H. Feng and C.-M. Liu, “Stability of steady-state solutions to Navier-Stokes-Poisson systems,” Journal of Mathematical Analysis and Applications, vol. 462, no. 2, pp. 1679–1694, 2018.
- X. Zheng, Y. Shang, and X. Peng, “Orbital stability of solitary waves of the coupled Klein-Gordon-Zakharov equations,” Mathematical Methods in the Applied Sciences, vol. 40, no. 7, pp. 2623–2633, 2017.
- T. Li and Y. F. Yang, “Stability of large steady-state solutions to non-isentropic Euler-Maxwell systems,” Journal of Nanjing Normal University, vol. 40, no. 4, pp. 26–35, 2017.
- Y. Guo, “Globally robust stability analysis for stochastic Cohen-Grossberg neural networks with impulse and time-varying delays,” Ukrainian Mathematical Journal, vol. 69, no. 8, pp. 1049–1060, 2017.
- Q. Zhu, J. Cao, and R. Rakkiyappan, “Exponential input-to-state stability of stochastic Cohen-Grossberg neural networks with mixed delays,” Nonlinear Dynamics, vol. 79, no. 2, pp. 1085–1098, 2015.
- L. G. Wang and B. Liu, “The Hyers-Ulam stability of a functional equation deriving from quadratic and cubic functions in quasi-β-normed spaces,” Acta Mathematica Sinica, vol. 26, no. 12, pp. 2335–2348, 2010.
- M. Li and J. Wang, “Exploring delayed Mittag-Leffler type matrix functions to study finite time stability of fractional delay differential equations,” Applied Mathematics and Computation, vol. 324, pp. 254–265, 2018.
- Y. Guo, “Nontrivial periodic solutions of nonlinear functional differential systems with feedback control,” Turkish Journal of Mathematics, vol. 34, no. 1, pp. 35–44, 2010.
- L. Li, F. Meng, and P. Ju, “Some new integral inequalities and their applications in studying the stability of nonlinear integro-differential equations with time delay,” Journal of Mathematical Analysis and Applications, vol. 377, no. 2, pp. 853–862, 2011.
- M. Mariton, Jump Linear Systems in Automatica Control, Marcel Dekker, 1990.
- R. Song and Q. Zhu, “Stability of linear stochastic delay differential equations with infinite Markovian switchings,” International Journal of Robust and Nonlinear Control, vol. 28, no. 3, pp. 825–837, 2018.
- B. Wang and Q. Zhu, “Stability analysis of semi-Markov switched stochastic systems,” Automatica, vol. 94, pp. 72–80, 2018.
- Q. X. Zhu and Q. Y. Zhang, “Pth moment exponential stabilisation of hybrid stochastic differential equations by feedback controls based on discrete-time state observations with a time delay,” IET Control Theory & Applications, vol. 11, no. 12, pp. 1992–2003, 2017.
- Q. Zhu, R. Rakkiyappan, and A. Chandrasekar, “Stochastic stability of Markovian jump BAM neural networks with leakage delays and impulse control,” Neurocomputing, vol. 136, pp. 136–151, 2014.
- Q. Zhu and J. Cao, “Stability of Markovian jump neural networks with impulse control and time varying delays,” Nonlinear Analysis: Real World Applications, vol. 13, no. 5, pp. 2259–2270, 2012.
- Y. Liu, J. H. Park, B. Guo, F. Fang, and F. Zhou, “Event-triggered dissipative synchronization for Markovian jump neural networks with general transition probabilities,” International Journal of Robust and Nonlinear Control, vol. 28, no. 13, pp. 3893–3908, 2018.
- R. Zhang, D. Zeng, J. H. Park, Y. Liu, and S. Zhong, “A new approach to stochastic stability of markovian neural networks with generalized transition rates,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–12, 2018.
- X. Mao, “Exponential stability in mean square of neutral stochastic differential-functional equations,” Systems & Control Letters, vol. 26, no. 4, pp. 245–251, 1995.
- X. Mao, “Razumikhin-type theorems on exponential stability of neutral stochastic functional-differential equations,” SIAM Journal on Mathematical Analysis, vol. 28, no. 2, pp. 389–401, 1997.
- H. Chen, P. Shi, and C.-C. Lim, “Stability analysis for neutral stochastic delay systems with Markovian switching,” Systems & Control Letters, vol. 110, pp. 38–48, 2017.
- Q. Zhu and J. Cao, “ pth moment exponential synchronization for stochastic delayed Cohen-Grossberg neural networks with Markovian switching,” Nonlinear Dynamics, vol. 67, no. 1, pp. 829–845, 2012.
- Y. Chen, W. X. Zheng, and A. Xue, “A new result on stability analysis for stochastic neutral systems,” Automatica, vol. 46, no. 12, pp. 2100–2104, 2010.
- L. Shaikhet, “Some new aspects of Lyapunov-type theorems for stochastic differential equations of neutral type,” SIAM Journal on Control and Optimization, vol. 48, no. 7, pp. 4481–4499, 2010.
- Q. Zhu and J. Cao, “Stability analysis of markovian jump stochastic BAM neural networks with impulse control and mixed time delays,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 3, pp. 467–479, 2012.
- Y. Xu and Z. He, “Exponential stability of neutral stochastic delay differential equations with Markovian switching,” Applied Mathematics Letters, vol. 52, pp. 64–73, 2016.
- K. Liu and X. Xia, “On the exponential stability in mean square of neutral stochastic functional differential equations,” Systems & Control Letters, vol. 37, no. 4, pp. 207–215, 1999.
- Q. Zhu, “Razumikhin-type theorem for stochastic functional differential equations with Lévy noise and Markov switching,” International Journal of Control, vol. 90, no. 8, pp. 1703–1712, 2017.
- Q. Zhu, “pth moment exponential stability of impulsive stochastic functional differential equations with Markovian switching,” Journal of The Franklin Institute, vol. 351, no. 7, pp. 3965–3986, 2014.
- J. Bao, Z. Hou, and C. Yuan, “Stability in distribution of neutral stochastic differential delay equations with Markovian switching,” Statistics & Probability Letters, vol. 79, no. 15, pp. 1663–1673, 2009.
- X. Li and X. Mao, “A note on almost sure asymptotic stability of neutral stochastic delay differential equations with Markovian switching,” Automatica, vol. 48, no. 9, pp. 2329–2334, 2012.
- X. Mao, Y. Shen, and C. Yuan, “Almost surely asymptotic stability of neutral stochastic differential delay equations with Markovian switching,” Stochastic Processes and Their Applications, vol. 118, no. 8, pp. 1385–1406, 2008.
- B. Zhou and A. V. Egorov, “Razumikhin and Krasovskii stability theorems for time-varying time-delay systems,” Automatica, vol. 71, pp. 281–291, 2016.
- B. Zhou and W. Luo, “Improved Razumikhin and Krasovskii stability criteria for time-varying stochastic time-delay systems,” Automatica, vol. 89, pp. 382–391, 2018.
- F. Mazenc, M. Malisoff, and S.-I. Niculescu, “Stability analysis for systems with time-varying delay: Trajectory based approach,” in Proceedings of the 54th IEEE Conference on Decision and Control (CDC '15), pp. 1811–1816, Osaka, Japan, December 2015.
Copyright © 2018 Wei Hu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.