Stability of Stochastic Discrete-Time Neural Networks with Discrete Delays and the Leakage Delay

Hou, Liyuan; Zhu, Hong

doi:https://doi.org/10.1155/2015/306806

Mathematical Problems in Engineering

On this page

Abstract Introduction Preliminaries Examples Conclusions Acknowledgments References Copyright Related Articles

Special Issue

Analysis and Synthesis of Stochastic Nonlinear Systems

View this Special Issue

Research Article | Open Access

Volume 2015 | Article ID 306806 | https://doi.org/10.1155/2015/306806

Stability of Stochastic Discrete-Time Neural Networks with Discrete Delays and the Leakage Delay

Liyuan Hou¹and Hong Zhu¹

Academic Editor: Yang Tang

Received20 Nov 2014

Accepted30 Jan 2015

Published16 Sept 2015

Abstract

This paper investigates the stability of stochastic discrete-time neural networks (NNs) with discrete time-varying delays and leakage delay. As the partition of time-varying and leakage delay is brought in the discrete-time system, we construct a novel Lyapunov-Krasovskii function based on stability theory. Furthermore sufficient conditions are derived to guarantee the global asymptotic stability of the equilibrium point. Numerical example is given to demonstrate the effectiveness of the proposed method and the applicability of the proposed method.

1. Introduction

Neural networks (NNs) have received much interest owing to their wide application in the areas of signal processing, pattern recognition, and static image processing in [1, 2]. One of the most important and challenging questions in theoretical analysis of neural networks (NNs) is dynamical behaviors of the neural networks, for example, stability, instability, periodic oscillatory, and chaos. Among them analysis of stability has received much attention and various stability conditions have been obtained in [3–10]. The main problem of stability analysis is how to construct appropriate Lyapunov functions which are widely used in various fields [11–18]. Then the construction of Lyapunov functions is determined by the structure of neural networks. The study of neural networks generally considers the following factors.

It is well known that time delay is inherent in various systems, including artificial neural networks, owing to the finite speed of signal transmission [3]. Delays in a system may cause oscillation and divergence and may degrade the performance. Hence, stability analysis of systems with time delay is widespread. Scholars classify the analysis of stability into delay-independent and delay-dependent ones. It has been proved in [4, 5] that the delay-dependent criterion is less conservative than the delay-independent one, especially for smaller values of delay. Delay-dependent stability condition for continuous-time NNs with time-varying delays has been reported in literatures [4–10]. The approaches to handle the time-varying delay in most literatures are based on introducing free weighting matrices [19], model transformation method [20], and linear matrix inequality (LMI) approach and employing the delay partitioning approach in [21, 22].

In the digital life, most of the signals including the continuous-time NNs need to be processed, experimentalized, or computed by the computer, such that we must discretize the continuous-time signals before delivering them to the computer. Therefore, the stability of discrete-time neural networks is necessary, and more and more literature about it was published [22–28].

As pointed out in [29], discrete-time delays were introduced into bidirectional associative memory (BAM) neural networks which were known as leakage (or forgetting) terms. From literatures [30–36] it can be found that the leakage terms had a tendency to destabilize the neural networks. In the literatures [30, 31], the system with leakage delays had been studied. However, different from [29], the leakage delays changed to be time varying. Not only that, different kinds of neural networks with time delays in the leakage terms were studied, especially the effect of leakage term on the dynamical behavior of various kinds of neural networks [32–42]. In [33], passivity analysis of neural networks with time-varying delays and leakage delay was considered. And they used the free-weighting matrix method and stochastic analysis technique. Furthermore, Li and others in [34, 35] researched stability of various differential systems including neural networks in leakage terms, by using contraction mapping theorem, Brouwers fixed point theorem, Lyapunov-Krasovskii functional method, and free weighting matrix technique. Unfortunately, neural networks with the leakage terms in most literatures are continuous systems, and there is not any thesis about discrete neural networks with the leakage delay. On the other hand, it has now been well recognized that stochastic disturbances are mostly inevitable owing to noise in electronic implementations. It has also been revealed that certain stochastic inputs could make a neural network unstable.

In this paper, the stability problem is considered for discrete-time neural networks with time-varying delays in the leakage terms. Firstly, the mathematical models are established. Secondly, a less conservative and new stability criterion is derived by using a novel Lyapunov-Krasovskii functional which depends on the circumstance of the delay partition. Thirdly, a numerical example is provided to show the effectiveness of the main result.

Notation. Throughout this paper, denotes the -dimensional Euclidean space, and denotes the set of all real matrices. The superscript denotes matrix transposition and the notation (, resp.), where and are symmetric matrices, means that is positive semidefinite (positive definite, resp.). In symmetric block matrices, the symbol is used as an ellipsis for terms induced by symmetry. stands for the Euclidean vector norm in . and denote the expectation of and the expectation of conditional on . is a probability space, where is the sample space, is the -algebra of subsets of the sample space, and is the probability measure on .

2. Preliminaries

Discretizing the continuous-time NNs with leakage terms [39], we will consider the following discrete-time systems with time-varying delays in leakage terms:where is the state vector at time ; with is the state feedback coefficient matrix; the matrices and are the connection weight matrix and the discretely delayed connection weight matrix, respectively; , are the neuron activation functions, which satisfy , ; denotes the discrete time-varying delay; means the leakage delays.

Assumption 1. For any , , , the activation functions satisfywhere , , , and are constants.

Remark 2. The condition on the activation functions in Assumption 1 was originally employed in [6, 7] and has been subsequently used in recent papers with the problem of stability of neural networks; see [21–28].

The system (1) has equilibrium points under Assumption 1. Let be the equilibrium point of system (1), and shift it to the origin by letting , and then system (1) with stochastic disturbances can be rewritten aswhere is the state vector of the transformed system, , and the transformed neuron activation functions are , , and is a scalar Wiener process on a probability space with , , (). Then ; can be verified from Remark 2.

Assumption 3. The noise intensity function vector satisfies the Lipschitz condition; that is, the nonlinear function satisfies the following inequality:where is a known scalar constant.

Assumption 4. The time-varying delay is bounded, , and its probability distribution can be observed. Assume that integer is satisfied in , , , which means we divide into parts, and , where , , , and , .
To describe the probability distribution of time-varying delay, we define the following set , . Define mapping functions

Remark 5. Consider , ,

Remark 6. In the literature [21], the delay-partitioning projection technique is used. In [21], they partition into several components, that is, , where is a positive integer, in order to derive some less restrictive stability criteria. Different from the literature [21], we use the knowledge of probability to describe the partition of time delay. This way has the advantage of reducing the amount of calculation.
Then the system (3) can be rewritten as

3. New Stability Criteria

In this section, we will establish new stability criteria for system (1). The following lemma is needed in order to derive our main results.

Lemma 7 (Zhu and Yang [23] discrete Jenson inequality). For any constant matrix , , integers , vector function such that the sums in the following are well defined, and then

The next theorem can be obtained if the stochastic term is removed in the system (6).

Theorem 8. Under Assumptions 1 and 4, the system (6) with is globally asymptotically stable, if there exist positive matrices , , , , , (), , , and free matrix , , , with any appropriate dimensions, such that the following LMI holds:where , denotes a matrix with the th element while the th element is , and other elements are zero matrixes. For example, .

Proof. For convenience, we denote ; that is, , and then systems (6) with can be rewritten as follows:
We construct a new Lyapunov-Krasovskii functional aswhere
Taking the difference of the functional along the solution of (9), we obtainAccording to Remark 5, it is easy to getwhere .
Consider
Using the algebraic expression in and by using Lemma 7, we can get
Let , , , ; then
As is well known, for any vectors , and any symmetric matrix , the following inequality holds:Denoting , , , where is free matrix, then the last inequality can be expressed as follows:which is equal toSimilarly, we can getCombining those inequalities, we obtain
According to the equation in Assumption 1, we haveIt can be deduced that there exist and , such thatwhere denotes the unit column vector having one element on its th row and zeros elsewhere. Derived from , we can get the following equation for any matrices with appropriate dimensions:Combining (12)–(25), we obtainThen ifwe can conclude that is convergent and , which implies that the system (6) is globally asymptotically stable. Using Schur complement and the boundary condition , we can get the inequality in this theorem.
This completes the proof of the theorem.

Remark 9. The stability analysis problem of a general class of discrete-time neural networks with leakage delays is dealt with in Theorem 8. The stability condition can be expressed by a set of LMIs, which can be checked by resorting to MATLAB LMI Toolbox.

Remark 10. A similar study to this paper has been investigated in [21, 22, 33]. We note that our new stability criterion for stochastic discrete system benefits from the idea of delay partitioning. Based on the general assumption of time delay, we represent as parts, such that the condition is not only delay dependent but also dependent on the partitioning number.

Remark 11. From the proof of Theorem 8, it can be easily found that we enlarged , , into . We can get the next theorem in a different way to handle , , .

Corollary 12. Under Assumptions 1 and 4, the system (6) with is globally asymptotically stable, if there exist positive matrices , , , , , (), , , and free matrix , , , , with any appropriate dimensions, such that the following LMI holds:

and the definition of is the same as the definition in Theorem 8, and , , , in inequality (29) are , , , in Theorem 8, respectively.

Proof. in is handled in the following way:
When , , , , the last inequality is equivalent toThen
By solving the convex LMI condition at boundary conditions , we can get the LMIs in Corollary 12. This completes the proof of Corollary 12.

Remark 13. The difference between Theorem 8 and Corollary 12 is obvious. The LMIs in Corollary 12 are derived by property of , which is more simple than the LMIs in Theorem 8.

The next theorem can be obtained if the stochastic term is not removed in (6).

Corollary 14. Under Assumptions 1 and 4, the system (6) with is globally asymptotically stable, if there exist positive matrices , , , (), (), , , and free matrix with any appropriate dimensions, such that the following LMI holds:and the definition of is the same as it in Theorem 8, and , , , are , , , , respectively, in Theorem 8.

Proof. As , , and are different from Theorem 8,Derived from Assumption 3, we can getBased on Theorem 8, the desired condition can be obtained. This is the end of proof.

4. Examples

In this section, a numerical example is given to illustrate the effectiveness and benefits of the developed methods.

Example 1. We consider the delayed stochastic DNNs (6) with the following parameters, which have been considered in [33]:And the activation functions satisfy Assumption 1 withFor the parameters listed above, we can obtain the following feasible solution. Due to the limitation of the length of this paper, we only provide a part of the feasible solution here:

5. Conclusions

The stability analysis of stochastic discrete-time NNs with leakage delay has been investigated in this paper via the Lyapunov functional method. By employing delay partition and introducing a new Lyapunov functional, a delay-dependent stability condition is proposed. What is more, more general LMIs conditions on the stability of the stochastic discrete-time NNs are established by choosing a new novel Lyapunov-Krasovskii functional. Finally, the feasibility and effectiveness of the developed methods have been shown by the numerical simulation example. The foregoing results have the potential to be useful for the study of leakage delay. And the results can be extended to complex networks with mixed time-varying delays.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This research was supported by the National Basic Research Program of China (2010 CB732501) and the Fund of Sichuan Provincial Key Laboratory of Signal and Information processing (SZJJ2009-002).

References

T. Yang, “Fuzzy cellular neural networks and their applications to image processing,” Advances in Imaging and Electron Physics, vol. 109, pp. 265–446, 1999.
View at: Publisher Site | Google Scholar
Y. Yao, W. J. Freeman, B. Burke, and Q. Yang, “Pattern recognition by a distributed neural network: an industrial application,” Neural Networks, vol. 4, no. 1, pp. 103–121, 1991.
View at: Publisher Site | Google Scholar
K. Gu, V. L. Kharitonov, and J. Chen, Stability of Time-Delay Systems, Birkhäuser, Boston, Mass, USA, 2003.
View at: Publisher Site | MathSciNet
H. Shao, “New delay-dependent stability criteria for systems with interval delay,” Automatica, vol. 45, no. 3, pp. 744–749, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
J. Sun, G. P. Liu, J. Chen, and D. Rees, “Improved delay-range-dependent stability criteria for linear systems with time-varying delays,” Automatica, vol. 46, no. 2, pp. 466–470, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,” Neural Networks, vol. 19, no. 5, pp. 667–675, 2006.
View at: Publisher Site | Google Scholar
Z. Wang, H. Shu, Y. Liu, D. W. C. Ho, and X. Liu, “Robust stability analysis of generalized neural networks with discrete and distributed time delays,” Chaos, Solitons & Fractals, vol. 30, no. 4, pp. 886–896, 2006.
View at: Publisher Site | Google Scholar | MathSciNet
D. K. Das, S. Ghosh, and B. Subudhi, “Stability analysis of linear systems with two delays of overlapping ranges,” Applied Mathematics and Computation, vol. 243, pp. 83–90, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
O. M. Kwon, M. J. Park, J. H. Park, S. M. Lee, and E. J. Cha, “On stability analysis for neural networks with interval time-varying delays via some new augmented Lyapunov-Krasovskii functional,” Communications in Nonlinear Science and Numerical Simulation, vol. 19, no. 9, pp. 3184–3201, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J. Xia, J. H. Park, H. Zeng, and H. Shen, “Delay-difference-dependent robust exponential stability for uncertain stochastic neural networks with multiple delays,” Neurocomputing, vol. 140, pp. 210–218, 2014.
View at: Publisher Site | Google Scholar
Y. Liu, S. M. Lee, O. M. Kwon, and J. H. Park, “Delay-dependent exponential stability criteria for neutral systems with interval time-varying delays and nonlinear perturbations,” Journal of the Franklin Institute, vol. 350, no. 10, pp. 3313–3327, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Liu, S. M. Lee, O. M. Kwon, and J. H. Park, “Robust delay-dependent stability criteria for time-varying delayed Lur'e systems of neutral type,” Circuits, Systems, and Signal Processing, 2014.
View at: Publisher Site | Google Scholar
D. Zhang and L. Yu, “Exponential state estimation for Markovian jumping neural networks with time-varying discrete and distributed delays,” Neural Networks, vol. 35, pp. 103–111, 2012.
View at: Publisher Site | Google Scholar
D. Zhang, W. Cai, L. Xie, and Q. Wang, “Non-fragile distributed filtering for T-S fuzzy systems in sensor networks,” IEEE Transactions on Fuzzy Systems, 2014.
View at: Publisher Site | Google Scholar
J. Cheng, H. Zhu, S. Zhong, Q. Zhong, and Y. Zeng, “Finite-time $H_{\infty}$ estimation for discrete-time Markov jump systems with time-varying transition probabilities subject to average dwell time switching,” Communications in Nonlinear Science and Numerical Simulation, vol. 20, no. 2, pp. 571–582, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
C. Yin, S. Zhong, and W. Chen, “Design of sliding mode controller for a class of fractional-order chaotic systems,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 1, pp. 356–366, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
J. Cao, “Improved delay-dependent stability conditions for MIMO networked control systems with nonlinear perturbations,” The Scientific World Journal, vol. 2014, Article ID 196927, 4 pages, 2014.
View at: Publisher Site | Google Scholar
C. Yin, Y. Chen, and S. Zhong, “Fractional-order sliding mode based extremum seeking control of a class of nonlinear systems,” Automatica, vol. 50, no. 12, pp. 3173–3181, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
J. Ma, J. Li, X. Gao, and Z. Wang, “Research on time-delay stability upper bound of power system wide-area damping controllersbased on improved free-weighting matrices and generalized eigenvalue problem,” Electrical Power and Energy Systems, vol. 64, pp. 476–482, 2015.
View at: Publisher Site | Google Scholar
J. Cheng, H. Zhu, S. Zhong, F. Zheng, and Y. Zeng, “Finite-time filtering for switched linear systems with a mode-dependent average dwell time,” Nonlinear Analysis: Hybrid Systems, vol. 15, pp. 145–156, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
J. Duan, M. Hu, Y. Yang, and L. Guo, “A delay-partitioning projection approach to stability analysis of stochastic Markovian jump neural networks with randomly occurred nonlinearities,” Neurocomputing, vol. 128, pp. 459–465, 2014.
View at: Publisher Site | Google Scholar
Y. Shao, X. Liu, X. Sun, and Q. Zhang, “A delay decomposition approach to $H_{\infty}$ admissibility for discrete-time singular delay systems,” Information Sciences, vol. 279, pp. 893–905, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
X.-L. Zhu and G.-H. Yang, “Jensen inequality approach to stability analysis of discrete-time systems with time-varying delay,” in Proceedings of the American Control Conference (ACC '08), pp. 1644–1649, Seattle, Wash, USA, June 2008.
View at: Publisher Site | Google Scholar
R. Geiselhart, R. H. Gielen, M. Lazar, and F. R. Wirth, “An alternative converse Lyapunov theorem for discrete-time systems,” Systems & Control Letters, vol. 70, pp. 49–59, 2014.
View at: Publisher Site | Google Scholar
X. L. Zhu and G. H. Yang, “New delay-dependent stability results for neural networks with time-varying delay,” IEEE Transactions on Neural Networks, vol. 19, no. 10, pp. 1783–1791, 2008.
View at: Publisher Site | Google Scholar
B. Zhang, S. Xu, and Y. Zou, “Improved delay-dependent exponential stability criteria for discrete-time recurrent neural networks with time-varying delays,” Neurocomputing, vol. 72, no. 1–3, pp. 321–330, 2008.
View at: Publisher Site | Google Scholar
C. Song, H. Gao, and W. X. Zheng, “A new approach to stability analysis of discrete-time recurrent neural networks with time-varying delay,” Neurocomputing, vol. 72, no. 10–12, pp. 2563–2568, 2009.
View at: Publisher Site | Google Scholar
Y. Tang, J.-A. Fang, M. Xia, and D. Yu, “Delay-distribution-dependent stability of stochastic discrete-time neural networks with randomly mixed time-varying delays,” Neurocomputing, vol. 72, no. 16–18, pp. 3830–3838, 2009.
View at: Publisher Site | Google Scholar
K. Gopalsamy, “Leakage delays in BAM,” Journal of Mathematical Analysis and Applications, vol. 325, no. 2, pp. 1117–1132, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
R. Sakthivel, P. Vadivel, K. Mathiyalagan, A. Arunkumar, and M. Sivachitra, “Design of state estimator for bidirectional associative memory neural networks with leakage delays,” Information Sciences, vol. 296, pp. 263–274, 2015.
View at: Publisher Site | Google Scholar | MathSciNet
K. Li, L. Yang, and W. Wu, “Anti-periodic solution for impulsive BAM neural networks with time-varying leakage delays ontime scales,” Neurocomputing, vol. 149, pp. 536–545, 2015.
View at: Google Scholar
B. Liu, “Global exponential stability for BAM neural networks with time-varying delays in the leakage terms,” Nonlinear Analysis: Real World Applications, vol. 14, no. 1, pp. 559–566, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Zhao, Q. Song, and S. He, “Passivity analysis of stochastic neural networks with time-varying delays and leakage delay,” Neurocomputing, vol. 125, pp. 22–27, 2014.
View at: Publisher Site | Google Scholar
X. Li, X. Fu, and R. Rakkiyappan, “Delay-dependent stability analysis for a class of dynamical systems with leakage delay and nonlinear perturbations,” Applied Mathematics and Computation, vol. 226, pp. 10–19, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
X. Li and X. Fu, “Effect of leakage time-varying delay on stability of nonlinear differential systems,” Journal of the Franklin Institute. Engineering and Applied Mathematics, vol. 350, no. 6, pp. 1335–1344, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, R. Rakkiyappan, and A. Chandrasekar, “Stochastic stability of Markovian jump BAM neural networks with leakage delays and impulse control,” Neurocomputing, vol. 136, pp. 136–151, 2014.
View at: Publisher Site | Google Scholar
S. Lakshmanan, J. H. Park, T. H. Lee, H. Y. Jung, and R. Rakkiyappan, “Stability criteria for BAM neural networks with leakage delays and probabilistic time-varying delays,” Applied Mathematics and Computation, vol. 219, no. 17, pp. 9408–9423, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
M. J. Park, O. M. Kwon, J. H. Park, S. M. Lee, and E. J. Cha, “Synchronization criteria for coupled stochastic neural networks with time-varying delays and leakage delay,” Journal of the Franklin Institute, vol. 349, no. 5, pp. 1699–1720, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
X. Li and J. Cao, “Delay-dependent stability of neural networks of neutral type with time delay in the leakage term,” Nonlinearity, vol. 23, no. 7, pp. 1709–1726, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
C. Li and T. Huang, “On the stability of nonlinear systems with leakage delay,” Journal of the Franklin Institute. Engineering and Applied Mathematics, vol. 346, no. 4, pp. 366–377, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
L. Duan and L. Huang, “Global exponential stability of fuzzy BAM neural networks with distributed delays and time-varying delays in the leakage terms,” Neural Computing and Applications, vol. 23, pp. 171–178, 2013.
View at: Publisher Site | Google Scholar
S. Haykin, Neural Networks, Prentice Hall, Upper Saddle River, NJ, USA, 1999.

Copyright

Copyright © 2015 Liyuan Hou and Hong Zhu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

706

Downloads

710

Citations