Research Article | Open Access

Shu Lv, Junkang Tian, Shouming Zhong, "Delay-Dependent Stability Analysis for Recurrent Neural Networks with Time-Varying Delays", *Mathematical Problems in Engineering*, vol. 2012, Article ID 910140, 14 pages, 2012. https://doi.org/10.1155/2012/910140

# Delay-Dependent Stability Analysis for Recurrent Neural Networks with Time-Varying Delays

**Academic Editor:**Zhan Shu

#### Abstract

This paper concerns the problem of delay-dependent stability criteria for recurrent neural networks with time varying delays. By taking more information of states and activation functions as augmented vectors, a new class of the Lyapunov functional is proposed. Then, some less conservative stability criteria are obtained in terms of linear matrix inequalities (LMIs). Finally, two numerical examples are given to illustrate the effectiveness of the proposed method.

#### 1. Introduction

In the past few decades, the stability analysis for recurrent neural networks has been extensively investigated because of their successful applications in various scientific fields, such as pattern recognition, image processing, associative memories, and fixed-point computations. It is well known that time delay is frequently encountered in neural networks, and it is often a major cause of instability and oscillation. Thus, much more attention has been paid to recurrent delayed neural networks. Many interesting stability conditions, including delay-independent results [1, 2] and delay-dependent results [3–41], have been obtained for neural networks with time delays. Generally speaking, the delay-dependent stability criteria are less conservative than delay-independent ones when the size of time delay is small. For the delay-dependent case, some criteria have been derived by using Lyapunov-Krasovskii functional (LKF). It is well known that the construction of an appropriate LKF is crucial for obtaining less conservative stability conditions. Thus, some new methods have been developed for reducing conservatism, such as free-weighting matrix method [4–8], augmented LKF [9], discretized LKF [10], delay-partitioning method [12–18], and delay-slope-dependent method [19]. Some less conservative stability criteria were proposed in [6] by considering some useful terms which have been usually neglected in the previous literature and using the free-weighting matrices method. Recently, a novel method was proposed for Hopfield neural networks in [12], which divides the constant time delay interval into subintervals with the same size. This method utilizes more information about the delay interval to reduce the conservativeness. Very recently, by proposing the idea of dividing the delay interval with the weighted parameters, the weighting-delay-based stability criteria for neural networks with time-varying delay were investigated in [15]. The delay-partitioning method proved to be less conservative than most of the previous results, and the conservatism can be notably reduced by thinning the delay partitioning. However, the above methods suffer two common shortcomings. First, many matrix variables are introduced in the obtained results, which brings a large computational burden. Second, the information of neuron activation function is not adequately considered, which may lead to much conservatism.

In this paper, the problem of delay-dependent stability analysis for neural networks with time-varying delays is investigated. Different from the previous methods of [4–8, 12–18], no delay-partitioning methods or free-weighting matrix methods are utilized. Instead, by taking more information of states and activation functions as augmented vectors, an augmented Lyapunov-Krasovskii functional is proposed. Then, inspired by the results of [19, 42], a less conservative condition is derived to guarantee the asymptotical stablity of the considered systems. Finally, two numerical examples are given to indicate significant improvements over some existing results.

#### 2. Problem Formulation

Consider the following neural networks with time-varying delay: where is the neuron state vector, denotes the neuron activation function, and is a constant input vector. are the connection weight matrix and the delayed connection weight matrix, respectively. with . is a time-varying continuous function that satisfies , , where and are constants. In addition, it is assumed that each neuron activation function in (2.1), , is bounded and satisfies the following condition: where are constants.

Assuming that is the equilibrium point of (2.1) whose uniqueness has been given in [29] and using the transformation , system (2.1) can be converted to the following system: where , and . According to the inequality (2.2), one can obtain that Thus, under this assumption, the following inequality holds for any diagonal matrix , where , .

Lemma 2.1 (see[43]). *For any constant matrix , scalars , such that the following integrations are well defined, then
*

#### 3. Main Results

In this section, a new Lyapunov functional is constructed and a less conservative delay-dependent stability criterion is obtained.

Theorem 3.1. *For given scalars , diagonal matrices , , the system (2.3) is globally asymptotically stable if there exist symmetric positive matrices , positive diagonal matrices , and any matrices with appropriate dimensions, such that the following LMIs hold:
**
where
*

*Proof. *Construct a new Lyapunov functional as follow:
where

*Remark 3.2. * Since the terms in and are taken into account, it is clear that the Lyapunov functional candidate in this paper is more general than that in [5, 6, 8, 9]. So the stability criteria in this paper may be more applicable.

The time derivative of along the trajectory of system (2.4) is given by: where By the use of Lemma 2.1 and Theorem 3.1 in [42], one can obtain where should be satisfied. Similar to (3.12), one can obtain where should be satisfied.

Consider the following: Furthermore, there exist positive diagonal matrices , such that the following inequalities hold based on (2.4): From (3.8)–, one can obtain that where

If , then there exists a scalar , such that Thus, according to [44], system (2.1) is globally asymptotically stable. By Schur complement, is equivalent to (3.3), this completes the proof.

*Remark 3.3. *By taking the states , as augmented variables, the stability condition in Theorem 3.1 utilizes more information about on state variables, which may lead to less conservative results.

*Remark 3.4. *Recently, the reciprocally convex optimization technique [42] is used to reduce the conservatism of stability criteria for systems with time-varying delays. Motivated by this work, the proposed method of [42] was utilized in (3.12) and (3.14), which have potential to yield less conservative conditions. However, an augmented vector with was used, which is different from the method of [42].

In many cases, is unknown. Considering this situation, a rate-independent corollary for the delay satisfying is derived by setting in the proof of Theorem 3.1.

Corollary 3.5. *For given scalar , diagonal matrices , , the system (2.3) is globally asymptotically stable if there exist symmetric positive matrices , positive diagonal matrices , and any matrices with appropriate dimensions, such that (3.1), (3.2) and the following LMI hold:
**
where
**
The other is defined in Theorem 3.1. *

#### 4. Numerical Examples

In this section, two numerical examples are given to demonstrate the effectiveness of the proposed method.

*Example 4.1. *Consider the system (2.3) with the following parameters:
The upper bounds of for different are derived by Theorem 3.1 in our paper and the results in [13–16] are listed in Table 1. According to Table 1, this example shows that the stability condition in this paper gives much less conservative results than those in the literature. For , the global asymptotic stability with the initial state is shown in Figure 1.

*Example 4.2. *Consider the system (2.3) with the following parameters:

Our purpose is to estimate the allowable upper bounds delay under different such that the system (2.3) is globally asymptotically stable. According to the Table 2, this example is given to indicate significant improvements over some existing results.

#### 5. Conclusions

In this paper, a new Lyapunov functional was proposed to investigate the stability of neural networks with time-varying delays. Some improved generalized delay-dependent stability criteria have been established. The obtained criteria are less conservative because a convex optimization approach is considered. Finally, two numerical examples have shown that these new stability criteria are less conservative than some existing ones in the literature.

#### Acknowledgments

The authors would like to thank the editors and the reviewers for their valuable suggestions and comments which have led to a much improved paper. This work was supported by the Fundamental Research Funds for the Central Universities under Grant ZYGX2011YB029.

#### References

- S. Arik, “Global asymptotic stability of a larger class of neural networks with constant time delay,”
*Physics Letters A*, vol. 311, no. 6, pp. 504–511, 2003. View at: Publisher Site | Google Scholar - J. D. Cao, “Global asymptotic stability of neural networks with transmission delays,”
*International Journal of Systems Science*, vol. 31, no. 10, pp. 1313–1316, 2000. View at: Google Scholar - C. Hua, C. Long, and X. Guan, “New results on stability analysis of neural networks with time-varying delays,”
*Physics Letters A*, vol. 352, no. 4-5, pp. 335–340, 2006. View at: Publisher Site | Google Scholar - Y. He, M. Wu, and J. H. She, “Delay-dependent exponential stability of delayed neural networks with time-varying delay,”
*IEEE Transactions on Circuits and Systems II*, vol. 53, no. 7, pp. 553–557, 2006. View at: Publisher Site | Google Scholar - Y. He, G. Liu, and D. Rees, “New delay-dependent stability criteria for neural networks with yime-varying delay,”
*IEEE Transactions on Neural Networks*, vol. 18, no. 1, pp. 310–314, 2007. View at: Publisher Site | Google Scholar - Y. He, G. P. Liu, D. Rees, and M. Wu, “Stability analysis for neural networks with time-varying interval delay,”
*IEEE Transactions on Neural Networks*, vol. 18, no. 6, pp. 1850–1854, 2007. View at: Publisher Site | Google Scholar - C. Song, H. Gao, and W. Xing Zheng, “A new approach to stability analysis of discrete-time recurrent neural networks with time-varying delay,”
*Neurocomputing*, vol. 72, no. 10–12, pp. 2563–2568, 2009. View at: Publisher Site | Google Scholar - J. Tian and S. Zhong, “New delay-dependent exponential stability criteria for neural networks with discrete and distributed time-varying delays,”
*Neurocomputing*, vol. 77, no. 1, pp. 114–119, 2011. View at: Publisher Site | Google Scholar - T. Li and X. L. Ye, “Improved stability criteria of neural networks with time-varying delays: an augmented LKF approach,”
*Neurocomputing*, vol. 73, no. 4–6, pp. 1038–1047, 2010. View at: Publisher Site | Google Scholar - W. H. Chen, X. Lu, Z. H. Guan, and W. X. Zheng, “Delay-dependent exponential stability of neural networks with variable delay: an LMI approach,”
*IEEE Transactions on Circuits and Systems II*, vol. 53, no. 9, pp. 837–842, 2006. View at: Publisher Site | Google Scholar - T. Li, L. Guo, C. Sun, and C. Lin, “Further results on delay-dependent stability criteria of neural networks with time-varying delays,”
*IEEE Transactions on Neural Networks*, vol. 19, no. 4, pp. 726–730, 2008. View at: Publisher Site | Google Scholar - S. Mou, H. Gao, J. Lam, and W. Qiang, “A new criterion of delay-dependent asymptotic stability for Hopfield neural networks with time delay,”
*IEEE Transactions on Neural Networks*, vol. 19, no. 3, pp. 532–535, 2008. View at: Publisher Site | Google Scholar - L. Hu, H. Gao, and P. Shi, “New stability criteria for Cohen-Grossberg neural networks with time delays,”
*IET Control Theory & Applications*, vol. 3, no. 9, pp. 1275–1282, 2009. View at: Publisher Site | Google Scholar - R. Yang, H. Gao, and P. Shi, “Novel robust stability criteria for stochastic Hopfield neural networks with time delays,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 39, no. 2, pp. 467–474, 2009. View at: Publisher Site | Google Scholar - H. Zhang, Z. Liu, G. B. Huang, and Z. Wang, “Novel weighting-delay-based stability criteria for recurrent neural networks with time-varying delay,”
*IEEE Transactions on Neural Networks*, vol. 21, no. 1, pp. 91–106, 2010. View at: Publisher Site | Google Scholar - S. P. Xiao and X. M. Zhang, “New globally asymptotic stability criteria for delayed cellular neural networks,”
*IEEE Transactions on Circuits and Systems II*, vol. 56, no. 8, pp. 659–663, 2009. View at: Publisher Site | Google Scholar - X. M. Zhang and Q. L. Han, “New Lyapunov-Krasovskii functionals for global asymptotic stability of delayed neural networks,”
*IEEE Transactions on Neural Networks*, vol. 20, no. 3, pp. 533–539, 2009. View at: Publisher Site | Google Scholar - H. B. Zeng, Y. He, M. Wu, and C. F. Zhang, “Complete delay-decomposing approach to asymptotic stability for neural networks with time-varying delays,”
*IEEE Transactions on Neural Networks*, vol. 22, no. 5, pp. 806–812, 2011. View at: Publisher Site | Google Scholar - T. Li, W. Zheng, and C. Lin, “Delay-slope-dependent stability results of recurrent neural networks,”
*IEEE Transactions on Neural Networks*, vol. 22, no. 12, pp. 2138–2143, 2011. View at: Google Scholar - D. Yue, Y. Zhang, E. Tian, and C. Peng, “Delay-distribution-dependent exponential stability criteria for discrete-time recurrent neural networks with stochastic delay,”
*IEEE Transactions on Neural Networks*, vol. 19, no. 7, pp. 1299–1306, 2008. View at: Publisher Site | Google Scholar - J. H. Park and O. M. Kwon, “Further results on state estimation for neural networks of neutral-type with time-varying delay,”
*Applied Mathematics and Computation*, vol. 208, no. 1, pp. 69–75, 2009. View at: Publisher Site | Google Scholar - X. Zhu and Y. Wang, “Delay-dependent exponential stability for neural networks with discrete and distributed time-varying delays,”
*Physics Letters A*, vol. 373, no. 44, pp. 4066–4072, 2009. View at: Publisher Site | Google Scholar - Z. Wang, Y. Liu, M. Li, and X. Liu, “Stability analysis for stochastic Cohen-Grossberg neural networks with mixed time delays,”
*IEEE Transactions on Neural Networks*, vol. 17, no. 3, pp. 814–820, 2006. View at: Publisher Site | Google Scholar - J. Sun, G. P. Liu, J. Chen, and D. Rees, “Improved stability criteria for neural networks with time-varying delay,”
*Physics Letters A*, vol. 373, no. 3, pp. 342–348, 2009. View at: Publisher Site | Google Scholar - J. Tian and X. Xie, “New asymptotic stability criteria for neural networks with time-varying delay,”
*Physics Letters A*, vol. 374, no. 7, pp. 938–943, 2010. View at: Publisher Site | Google Scholar - Q. Song and Z. Wang, “A delay-dependent LMI approach to dynamics analysis of discrete-time recurrent neural networks with time-varying delays,”
*Physics Letters A*, vol. 368, no. 1-2, pp. 134–145, 2007. View at: Publisher Site | Google Scholar - X. Liao, G. Chen, and E. N. Sanchez, “Delay-dependent exponential stability analysis of delayed neural networks: an LMI approach,”
*Neural Networks*, vol. 15, no. 7, pp. 855–866, 2002. View at: Publisher Site | Google Scholar - Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,”
*Neural Networks*, vol. 19, no. 5, pp. 667–675, 2006. View at: Publisher Site | Google Scholar - C. D. Zheng, L. B. Lu, and Z. S. Wang, “New LMT-based delay-dependent criterion for global asymptotic stability of cellular neural networks,”
*Neurocomputing*, vol. 72, no. 13–15, pp. 3331–3336, 2009. View at: Publisher Site | Google Scholar - S. Xu and J. Lam, “A new approach to exponential stability analysis of neural networks with time-varying delays,”
*Neural Networks*, vol. 19, no. 1, pp. 76–83, 2006. View at: Publisher Site | Google Scholar - H. Zhao and J. Cao, “New conditions for global exponential stability of cellular neural networks with delays,”
*Neural Networks*, vol. 18, no. 10, pp. 1332–1340, 2005. View at: Publisher Site | Google Scholar - O. M. Kwon, J. H. Park, S. M. Lee, and E. J. Cha, “A new augmented Lyapunov-Krasovskii functional approach to exponential passivity for neural networks with time-varying delays,”
*Applied Mathematics and Computation*, vol. 217, no. 24, pp. 10231–10238, 2011. View at: Publisher Site | Google Scholar - G. B. Zhang, T. Li, and S. M. Fei, “Further stability criterion on delayed recurrent neural networks based on reciprocal convex technique,”
*Mathematical Problems in Engineering*, vol. 2012, Article ID 829037, 14 pages, 2012. View at: Publisher Site | Google Scholar - Y. Y. Ge, T. Li, and S. M. Fei, “Master-slave synchronization of stochastic neural networks with mixed time-varying delays,”
*Mathematical Problems in Engineering*, vol. 2012, Article ID 730941, 18 pages, 2012. View at: Publisher Site | Google Scholar - H. Wu, N. Li, K. Wang, G. Xu, and Q. Guo, “Global robust stability of switched interval neural networks with discrete and distributed time-varying delays of neural type,”
*Mathematical Problems in Engineering*, vol. 2012, Article ID 361871, 18 pages, 2012. View at: Publisher Site | Google Scholar - H. Zhang, T. Li, and S. Fei, “Synchronization for an array of coupled Cohen-Grossberg neural networks with time-varying delay,”
*Mathematical Problems in Engineering*, vol. 2011, Article ID 831695, 22 pages, 2011. View at: Publisher Site | Google Scholar - H. Li, H. Gao, and P. Shi, “New passivity analysis for neural networks with discrete and distributed delays,”
*IEEE Transactions on Neural Networks*, vol. 21, no. 11, pp. 1842–1847, 2010. View at: Publisher Site | Google Scholar - H. Li, B. Chen, Q. Zhou, and W. Qian, “Robust stability for uncertain delayed fuzzy Hopfield neural networks with Markovian jumping parameters,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 39, no. 1, pp. 94–102, 2009. View at: Publisher Site | Google Scholar - S. Mou, H. Gao, W. Qiang, and K. Chen, “New delay-dependent exponential stability for neural networks with time delay,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 38, no. 2, pp. 571–576, 2008. View at: Publisher Site | Google Scholar - S. Mou, H. Gao, W. Qiang, and Z. Fei, “State estimation for discrete-time neural networks with time-varying delays,”
*Neurocomputing*, vol. 72, no. 1–3, pp. 643–647, 2008. View at: Publisher Site | Google Scholar - S. Mou, H. Gao, Y. Zhao, and W. Qiang, “Further improvement on synchronization stability of complex networks with coupling delays,”
*International Journal of Computer Mathematics*, vol. 85, no. 8, pp. 1255–1263, 2008. View at: Publisher Site | Google Scholar - P. G. Park, J. W. Ko, and C. Jeong, “Reciprocally convex approach to stability of systems with time-varying delays,”
*Automatica*, vol. 47, no. 1, pp. 235–238, 2011. View at: Publisher Site | Google Scholar - S. Boyd, V. Balakrishnan, E. Feron, and L. El Ghaoui,
*Linear Matrix Inequalities in Systems and Control*, SIMA, Philadelphia, Pa, USA, 1994. - J. Hale,
*Theory of Functional Differential Equations*, Springer, New York, NY, USA, 1977.

#### Copyright

Copyright © 2012 Shu Lv et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.