On Stability Analysis for Generalized Neural Networks with Time-Varying Delays

Park, M. J.; Kwon, O. M.; Cha, E. J.

doi:https://doi.org/10.1155/2015/387805

Mathematical Problems in Engineering

On this page

Abstract Introduction Preliminaries Conclusion Appendix Acknowledgments References Copyright Related Articles

Special Issue

Analysis and Synthesis of Stochastic Nonlinear Systems

View this Special Issue

Research Article | Open Access

Volume 2015 | Article ID 387805 | https://doi.org/10.1155/2015/387805

On Stability Analysis for Generalized Neural Networks with Time-Varying Delays

M. J. Park,¹O. M. Kwon,¹and E. J. Cha²

Academic Editor: Jun Cheng

Received20 Aug 2014

Accepted21 Oct 2014

Published25 Oct 2015

Abstract

This paper deals with the problem of stability analysis for generalized neural networks with time-varying delays. With a suitable Lyapunov-Krasovskii functional (LKF) and Wirtinger-based integral inequality, sufficient conditions for guaranteeing the asymptotic stability of the concerned networks are derived in terms of linear matrix inequalities (LMIs). By applying the proposed methods to two numerical examples which have been utilized in many works for checking the conservatism of stability criteria, it is shown that the obtained results are significantly improved comparing with the previous ones published in other literature.

1. Introduction

Neural networks have been successfully applied to various science and engineering problems such as pattern recognition, optimization, medical diagnosis, and image and signal processing [1–4]. In addition to this, the model of neural networks can take a variety of forms such as bidirectional associative memory (BAM) [5] and Cohen-Grossberg [6] neural networks. Therefore, the stability analysis of neural networks has been extensively studied because the application of neural networks heavily depends on the dynamic behavior of its equilibrium points and it is a prerequisite job to check the stability of the concerned networks. Recently, a model of neural networks having time-varying delays has been considered and its asymptotic stability has been extensively investigated due to the fact that the occurrence of time delays, which are caused by the inherent communication time among the neurons and the finite switching speed of amplifiers in hardware implementation of the networks, can harm the system performance and stability. With this regard, a lot of weight has been placed on the stability analysis for local field and static neural networks with time-varying delays. For local field neural networks, a new activation condition which has not been considered was proposed to reduce the conservatism of stability criteria in [7]. Two delay-partitioning approaches were utilized to get further enhanced delay-dependent stability criteria for neural networks with time-varying delays in [8–11]. Very recently, a new augmented Lyapunov-Krasovskii functional was proposed to enhance the feasible region of stability condition of delayed neural networks [12]. For static neural networks, improved delay-dependent stability criteria were presented in [13, 14]. By constructing an augmented Lyapunov-Krasovskii functional, both delay-independent and delay-dependent stability criteria were proposed in [15] with some new techniques. The robust global asymptotic stability of generalized static neural networks with linear fractional uncertainties and time-varying delays was proposed in [16] within a novel input-output framework. Very recently, interval time-varying delays were considered to investigate the problem of delay-dependent stability of static neural networks [17].

The main issue of delay-dependent stability analysis for dynamic systems with time-delays is to enhance the feasible region comparing with the existing results. In delay-dependent stability analysis, maximum delay bounds for guaranteeing the asymptotic stability have been considered as one of the index for checking the conservatism of stability condition. The reduction of conservatism in delay-dependent stability criteria mainly depends on the construction of LKF and the utilization of some techniques to estimate the time-derivative of LKF. In LKF point of view, discretized form [18], triple integral form [19–21], and augmented LKF in [12, 22] and [23, 24] have been proposed to reduce the conservatism of stability condition. In techniques for estimating the time-derivative of LKFs, Park’s inequality [25], Jensen inequality [18], model transformation [26, 27], free-weighting matrices techniques [28, 29], convex combination technique [30], reciprocally convex optimization [31], and the Wirtinger-based integral inequality [32] are remarkable results which promotes the development of delay-dependent stability analysis. Among the techniques in estimating the time-derivative of LKFs, Wirtinger-based integral inequality, which provides more tighter lower bound of integral terms than Jensen's inequality, has been applied to stability analysis of delayed neural networks [33, 34] very recently. However, in stability analysis for neural networks with time-varying delays, the application of the Wirtinger-based integral inequality with an augmented LKF has not been fully investigated yet and thus there is still room for further improvements on the reduction of conservatism.

With the motivation mentioned above, the problem of stability analysis for generalized neural network with time-varying delays is investigated in this paper. Inspired by the works [35, 36], a generalized neural network which contains the static neural networks and the local field neural networks as special cases is considered in this work. Thus, the general model of neural networks used in this work is a superordinate concept to the model utilized in most literature including the works [37–41]. In Lemma 3, a modified Wirtinger-based integral inequality which changes the intervals of integral terms will be introduced as Lemma 3. Then, by constructing a suitable augmented Lyapunov-Krasovskii functional and utilizing Lemma 3, an improved stability condition such that the considered neural networks are asymptotically stable is derived in terms of linear matrix inequalities (LMIs). When the information about the time-derivative of time-varying delays is unknown, a stability condition will be presented as Corollary 10. The advantage and superiority of the main results will be shown via two numerical examples which have been utilized in many previous works to check the conservatism of stability criteria.

Notation. and denote the -dimensional Euclidean space with vector norm and the set of all real matrices, respectively. and are the sets of symmetric and positive definite matrices, respectively. , , and denote identity matrix, and zero matrices, respectively. (<0) means symmetric positive (negative) definite matrix. stands for a basis for the null space of . represents the block diagonal matrix. For any square matrix and any vectors , respectively, we define and . means that the elements of matrix include the scalar value of affinely.

2. Problem Statement and Preliminaries

Consider the following generalized neural networks with time-varying delays: where denotes the number of neurons in a neural network, is the state vector of neuron, denotes the activation function of neuron, is the system matrix, are the interconnection weight matrices, and is a constant input vector.

is the time-varying delay satisfying where is a known positive scalar and is any constant one.

The activation functions of neuron satisfy the following assumption.

Assumption 1. The activation functions of neuron with are continuous, bounded and satisfy where and are known real constants.

Remark 2. In Assumption 1, and can be allowed to be positive, negative, or zero. As mentioned in [40], Assumption 1 describes the class of globally Lipschitz continuous and monotone nondecreasing activation when and . And the class of globally Lipschitz continuous and monotone increasing activation functions can be described when .

For analyzing stability of the neural networks (1), the equilibrium point whose uniqueness has been reported in [41] is shifted to the origin by utilizing the transformation , which leads the system (1) to the following form: where is the state vector of the transformed system, with , , and with .

It should be noted that the activation functions satisfy the following condition [42]:

The aim of this paper is to investigate the delay-dependent stability analysis of system (4) which will be introduced in next section. Before deriving our main results, the following lemmas will be utilized in deriving the main results.

Lemma 3 (Modified Wirtinger-based integral inequality). Consider a given matrix . Then, for all continuous function in , the following inequality holds:

Proof. From the term in the original Wirtinger-based integral inequality [32], since the inequality (7) holds.

Lemma 4 (see [43]). Let , , and such that . Then, the following statements are equivalent:(1),(2), where is a right orthogonal complement of .

Lemma 5 (see [44]). For symmetric appropriately dimensional matrices , , matrix , the following two statements are equivalent:(1),(2)there exists a matrix of appropriate dimension such that

3. Main Results

In this section, two delay-dependent stability criteria for system (4) will be proposed. For the sake of simplicity of matrix and vector representation, which will be used in Theorem 6 and Corollary 10 are defined as block entry matrices. (e.g., ). The other notations for some vectors and matrices are defined in the appendix.

Now, the following theorem is given as a main result.

Theorem 6. For given scalars , , and diagonal matrices and , system (4) is asymptotically stable for and , if there exist matrices , , , , , , , , , , satisfying the following LMIs:

Proof. Let us consider the following candidate for the appropriate Lyapunov-Krasovskii functional: where The results of the time-derivative of are as follows: By applying Leibniz integral rule to , it follows that Considering Leibniz integral rule and the two zero equalities inspired by the work of [45] to leads towhere and are any symmetric matrices.
It should be noted that By applying Lemma 3 and the use of (17), we have With the similar process presented in (18), it can be obtained that With (18) and (19) and utilizing reciprocally convex optimization [31], if , an upper bound of can be obtained as In addition, from (6), for any positive diagonal matrices , the following inequality holds: Also, inspired by the authors’ work of [7], from (5), the following conditions hold: Therefore, for any positive diagonal matrices , the following inequality holds: From (12)–(23) and by application of the S-procedure [46], an upper bound of can be written as By Lemma 4, the condition with is equivalent to Then, by Lemma 5, the condition (26) is equivalent to the following inequality with any matrix :The above condition is affinely dependent on . Therefore, if inequalities (10) and (11) hold, then inequality (27) is satisfied, which means that system (4) is asymptotically stable for and . It should be noted that holds if inequalities (11) and (12) are feasible. This completes our proof.

Remark 7. Theorem 6 utilized which was inspired by the author’s work [22]. In [22], the problem of delay-dependent stability for neural networks with interval time-varying delays was addressed. However, when estimating the time-derivative of value obtained by , Wirtinger-based integral inequality has not been used in [22], which means that there is still room for further improvement in enhancing the feasible region of stability condition. In (18) and (19), the integral terms were estimated by the use of Lemma 3 for the first time. Thus, more cross terms such as were utilized in the stability condition of Theorem 6.

Remark 8. It should be noted that when is larger than one, the condition presented in Theorem 6 is infeasible since the term cannot be negative. When is unknown or larger than 1, then, by not considering of the functional in (12), the following corollary can be obtained.

Remark 9. In Lemma 3, the term is included in (7) instead of in [32]. Thus, the integral terms such as and of Theorem 6 can be utilized as the element of the augmented vector .

Corollary 10. For given scalars , and diagonal matrices and , system (4) is asymptotically stable for , if there exist matrices , , , , , , , , satisfying the following LMIs: where and are defined in the appendix with .

Proof. The proof of Corollary 10 is very similar to the proof of Theorem 6. Thus, it is omitted.

4. Numerical Examples

In this section, two numerical examples are introduced to show the improvements of the proposed methods.

Example 1. Consider the neural networks (4) with the parameters This example has been utilized in many previous works to check the conservatism of delay-dependent stability. In Table 1, the comparison of our results with the previous works of [7–9], and [10–12] are conducted. When is 0.8 or 0.9, Theorem 6 provides significantly larger delay bounds than those listed in Table 1. Also, When is larger than one or unknown, the result of Corollary 10 is the largest value comparing with those in [7, 8, 10–34]. Therefore, the result of Table 1 shows that the proposed Theorem 6 and Corollary 10 effectively reduce the conservatism of stability criteria.

Example 2. Consider the static recurrent neural networks where The maximum delay bounds obtained by Theorem 6 and Corollary 10 and the results of [13–33] are listed in Table 2. From this table, it can be confirmed that the proposed stability condition also gives larger delay bounds, which support the less conservatism of Theorem 6 and Corollary 10.

5. Conclusion

In this paper, two improved delay-dependent stability criteria for generalized neural networks with time-varying delays have been proposed by the use of the augmented Lyapunov stability theorem and Lemma 3. In Theorem 6, by constructing the suitable augmented Lyapunov-Krasovskii functional and utilizing Lemma 3, the delay-dependent sufficient condition for asymptotic stability of the concerned network was derived. When is larger than one or unknown, the stability condition was also presented as Corollary 10 based on the result of Theorem 6. Via two numerical examples which have been dealt with in many previous works to check the conservatism of stability criteria, it was shown that Theorem 6 and Corollary 10 provide larger delay bounds than those of the recent works.

Appendix

Consider

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (2011-0009273). This work was also supported by the Human Resources Development of the Korea Institute of Energy Technology Evaluation and Planning (KETEP) grant funded by the Korea government Ministry of Trade, industry & Energy (no. 20144030200450).

References

S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice-Hall, Englewood Cliffs, NJ, USA, 1998.
G. Ou and Y. L. Murphey, “Multi-class pattern classification using neural networks,” Pattern Recognition, vol. 40, no. 1, pp. 4–18, 2007.
View at: Publisher Site | Google Scholar
S. Xu, J. Lam, and D. W. C. Ho, “Novel global robust stability criteria for interval neural networks with multiple time-varying delays,” Physics Letters Section A, vol. 342, no. 4, pp. 322–330, 2005.
View at: Publisher Site | Google Scholar
L. O. Chua and L. Yang, “Cellular neural networks: applications,” IEEE Transactions on Circuits and Systems, vol. 35, no. 10, pp. 1273–1290, 1988.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu, R. Rakkiyappan, and A. Chandrasekar, “Stochastic stability of Markovian jump BAM neural networks with leakage delays and impulse control,” Neurocomputing, vol. 136, pp. 136–151, 2014.
View at: Publisher Site | Google Scholar
Q. Zhu and J. Cao, “Exponential stability analysis of stochastic reaction-diffusion Cohen-Grossberg neural networks with mixed delays,” Neurocomputing, vol. 74, no. 17, pp. 3084–3091, 2011.
View at: Publisher Site | Google Scholar
O. M. Kwon, J. H. Park, S. M. Lee, and E. J. Cha, “Analysis on delay-dependent stability for neural networks with time-varying delays,” Neurocomputing, vol. 103, pp. 114–120, 2013.
View at: Publisher Site | Google Scholar
X. Zhou, J. Tian, H. Ma, and S. Zhong, “Improved delay-dependent stability criteria for recurrent neural networks with time-varying delays,” Neurocomputing, vol. 129, pp. 401–408, 2014.
View at: Publisher Site | Google Scholar
J. Tian, W. Xiong, and F. Xu, “Improved delay-partitioning method to stability analysis for neural networks with discrete and distributed time-varying delays,” Applied Mathematics and Computation, vol. 233, pp. 152–164, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
H.-B. Zeng, Y. He, M. Wu, and C.-F. Zhang, “Complete delay-decomposing approach to asymptotic stability for neural networks with time-varying delays,” IEEE Transactions on Neural Networks, vol. 22, no. 5, pp. 806–812, 2011.
View at: Publisher Site | Google Scholar
C. Ge, C. Hua, and X. Guan, “New delay-dependent stability criteria for neural networks with time-varying delay using delay-decomposition approach,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 7, pp. 1378–1383, 2014.
View at: Publisher Site | Google Scholar
O. M. Kwon, J. H. Park, S. M. Lee, and E. J. Cha, “New augmented Lyapunov-Krasovskii functional approach to stability analysis of neural networks with time-varying delays,” Nonlinear Dynamics, vol. 76, no. 1, pp. 221–236, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
H. Shao, “Delay-dependent stability for recurrent neural networks with time-varying delays,” IEEE Transactions on Neural Networks, vol. 19, no. 9, pp. 1647–1651, 2008.
View at: Publisher Site | Google Scholar
H. Shao, “Novel delay-dependent stability results for neural networks with time-varying delays,” Circuits, Systems, and Signal Processing, vol. 29, no. 4, pp. 637–647, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Zuo, C. Yang, and Y. Wang, “A new method for stability analysis of recurrent neural networks with interval time-varying delay,” IEEE Transactions on Neural Networks, vol. 21, no. 2, pp. 339–344, 2010.
View at: Publisher Site | Google Scholar
X. Li, H. Gao, and X. Yu, “A unified approach to the stability of generalized static neural networks with linear fractional uncertainties and delays,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 41, no. 5, pp. 1275–1286, 2011.
View at: Publisher Site | Google Scholar
Y.-Q. Bai and J. Chen, “New stability criteria for recurrent neural networks with interval time-varying delay,” Neurocomputing, vol. 121, pp. 179–184, 2013.
View at: Publisher Site | Google Scholar
K. Gu, “A further refinement of discretized Lyapunov functional method for the stability of time-delay systems,” International Journal of Control, vol. 74, no. 10, pp. 967–976, 2001.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Y. Ariba and F. Gouaisbaut, “An augmented model for robust stability analysis of time-varying delay systems,” International Journal of Control, vol. 82, no. 9, pp. 1616–1626, 2009.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. Sun, G. P. Liu, and J. Chen, “Delay-dependent stability and stabilization of neutral time-delay systems,” International Journal of Robust and Nonlinear Control, vol. 19, no. 12, pp. 1364–1375, 2009.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. Sun, G. P. Liu, J. Chen, and D. Rees, “Improved delay-range-dependent stability criteria for linear systems with time-varying delays,” Automatica, vol. 46, no. 2, pp. 466–470, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
O. M. Kwon, M. J. Park, J. H. Park, S. M. Lee, and E. J. Cha, “On stability analysis for neural networks with interval time-varying delays via some new augmented Lyapunov-Krasovskii functional,” Communications in Nonlinear Science and Numerical Simulation, vol. 19, no. 9, pp. 3184–3201, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
Y. He, Q.-G. Wang, C. Lin, and M. Wu, “Augmented Lyapunov functional and delay-dependent stability criteria for neutral systems,” International Journal of Robust and Nonlinear Control, vol. 15, no. 18, pp. 923–933, 2005.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
M. N. Alpaslan Parlakçi, “Extensively augmented Lyapunov functional approach for the stability of neutral time-delay systems,” IET Control Theory & Applications, vol. 2, no. 5, pp. 431–436, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
P. Park, “A delay-dependent stability criterion for systems with uncertain time-invariant delays,” IEEE Transactions on Automatic Control, vol. 44, no. 4, pp. 876–877, 1999.
View at: Publisher Site | Google Scholar
D. Yue, S. Won, and O. Kwon, “Delay dependent stability of neutral systems with time delay: an LMI approach,” IEE Proceedings: Control Theory and Applications, vol. 150, no. 1, pp. 23–27, 2003.
View at: Publisher Site | Google Scholar
O. M. Kwon and J. H. Park, “On improved delay-dependent robust control for uncertain time-delay systems,” IEEE Transactions on Automatic Control, vol. 49, no. 11, pp. 1991–1995, 2004.
View at: Publisher Site | Google Scholar | MathSciNet
X.-G. Liu, M. Wu, R. Martin, and M.-L. Tang, “Stability analysis for neutral systems with mixed delays,” Journal of Computational and Applied Mathematics, vol. 202, no. 2, pp. 478–497, 2007.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Y. He, G. P. Liu, D. Rees, and M. Wu, “Stability analysis for neural networks with time-varying interval delay,” IEEE Transactions on Neural Networks, vol. 18, no. 6, pp. 1850–1854, 2007.
View at: Publisher Site | Google Scholar
P. Park and J. W. Ko, “Stability and robust stability for systems with a time-varying delay,” Automatica, vol. 43, no. 10, pp. 1855–1858, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
P. Park, J. W. Ko, and C. Jeong, “Reciprocally convex approach to stability of systems with time-varying delays,” Automatica, vol. 47, no. 1, pp. 235–238, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
A. Seuret and F. Gouaisbaut, “Wirtinger-based integral inequality: application to time-delay systems,” Automatica, vol. 49, no. 9, pp. 2860–2866, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
M. D. Ji, Y. He, C. K. Zhang, and M. Wu, “Novel stability criteria for recurrent neural networks with time-varying delay,” Neurocomputing, vol. 138, pp. 383–391, 2014.
View at: Publisher Site | Google Scholar
O. M. Kwon, M. J. Park, J. H. Park, S. M. Lee, and E. J. Cha, “On less conservative stability criteria for neural networks with time-varying delays utilizing Wirtinger-based integral inequality,” Mathematical Problems in Engineering, vol. 2014, Article ID 859736, 13 pages, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
X.-M. Zhang and Q.-L. Han, “Global asymptotic stability for a class of generalized neural networks with interval time-varying delays,” IEEE Transactions on Neural Networks, vol. 22, no. 8, pp. 1180–1192, 2011.
View at: Publisher Site | Google Scholar
C. K. Zhang, Y. He, L. Jiang, Q. H. Wu, and M. Wu, “Delay-dependent stability criteria for generalized neural networks with two delay components,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 7, pp. 1263–1276, 2013.
View at: Google Scholar
X. Li and S. Song, “Impulsive control for existence, uniqueness, and global stability of periodic solutions of recurrent neural networks with discrete and continuously distributed delays,” IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 6, pp. 868–877, 2013.
View at: Publisher Site | Google Scholar
X. Li and X. Fu, “Effect of leakage time-varying delay on stability of nonlinear differential systems,” Journal of the Franklin Institute, vol. 350, no. 6, pp. 1335–1344, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Q. Zhu and J. Cao, “Stability of Markovian jump neural networks with impulse control and time varying delays,” Nonlinear Analysis. Real World Applications, vol. 13, no. 5, pp. 2259–2270, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
T. Li, W. X. Zheng, and C. Lin, “Delay-slope-dependent stability results of recurrent neural networks,” IEEE Transactions on Neural Networks, vol. 22, no. 12, pp. 2138–2143, 2011.
View at: Publisher Site | Google Scholar
S. Xu, J. Lam, D. W. C. Ho, and Y. Zou, “Delay-dependent exponential stability for a class of neural networks with time delays,” Journal of Computational and Applied Mathematics, vol. 183, no. 1, pp. 16–28, 2005.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,” Neural Networks, vol. 19, no. 5, pp. 667–675, 2006.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
R. E. Skelton, T. Iwasaki, and K. M. Grigoradis, A Unified Algebraic Approach to Linear Control Design, Taylor & Francis, New York, NY, USA, 1997.
T. Wang, C. Zhang, S. Fei, and T. Li, “Further stability criteria on discrete-time delayed neural networks with distributed delay,” Neurocomputing, vol. 111, pp. 195–203, 2013.
View at: Publisher Site | Google Scholar
S. H. Kim, P. Park, and C. Jeong, “Robust $H_{\infty}$ stabilisation of networked control systems with packet analyser,” IET Control Theory and Applications, vol. 4, no. 9, pp. 1828–1837, 2010.
View at: Publisher Site | Google Scholar
S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, Philadelphia, Pa, USA, 1994.

Copyright

Copyright © 2015 M. J. Park et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

911

Downloads

906

Citations