Dynamics of Delay Differential Equations with Its ApplicationsView this Special Issue
Research Article | Open Access
Peng Wang, Haijun Hu, Zheng Jun, Yanxiang Tan, Li Liu, "Delay-Dependent Dynamics of Switched Cohen-Grossberg Neural Networks with Mixed Delays", Abstract and Applied Analysis, vol. 2013, Article ID 826426, 11 pages, 2013. https://doi.org/10.1155/2013/826426
Delay-Dependent Dynamics of Switched Cohen-Grossberg Neural Networks with Mixed Delays
This paper aims at studying the problem of the dynamics of switched Cohen-Grossberg neural networks with mixed delays by using Lyapunov functional method, average dwell time (ADT) method, and linear matrix inequalities (LMIs) technique. Some conditions on the uniformly ultimate boundedness, the existence of an attractors, the globally exponential stability of the switched Cohen-Grossberg neural networks are developed. Our results extend and complement some earlier publications.
In recent years, much attention has been devoted to the study of neural networks due to the fact that they have been fruitfully applied in classification of patterns and associative memories, image processing, parallel computation, optimization, and so on [1–3]. These applications rely crucially on the analysis of the dynamical behavior [4–7]. Various neural networks, such as Hopfield neural networks, cellular neural networks, bidirectional associative neural networks, and Cohen-Grossberg neural networks, have been successfully applied. Among them, the Cohen-Grossberg neural network (CGNN)  is an important one, which can be described as follows: where , ; corresponds to the number of units in a neural network; denotes the potential (or voltage) of cell at time ; denotes a nonlinear output function; represents an amplification function; represents an appropriately behaved function; the connection matrix denotes the strengths of connectivity between cells, and if the output from neuron excites (resp., inhibits) neuron , (resp., ); denotes an external input source.
Neural network is nonlinearity; in the real world, nonlinear problems are not exceptional, but regular phenomena. Nonlinearity is the nature of matter and its development [9, 10]. In many practical cases, time delays are common phenomenon encountered in the implementation of neural networks, and they may cause the undesirable dynamic behaviors such as oscillation, divergence, or other poor performances. Time delay exists due to the finite speeds of the switching and transmission of signals in a network, which is degenerate to the instability of networks furthermore. For model (1), Ye et al.  introduced delays by considering the following differential equation: Then, the dynamics of delayed neural networks has been widely studied; see [1, 11–18] for some recent results concerning mixed delays. The CGNN models with discrete delays and distributed delays can be characterized as follows:
System (3) for convenience can be rewritten as the following compact matrix form: where is the neural state vector, , , are appropriate dimensions functions, , , and is the constant external input.
With the rapid development of intelligent control, hybrid systems have been investigated extensively for their significance, which is in theory and application. As one of the most important classes of hybrid systems, switched systems have drawn increasing attention in the last decade [19–21]. A typical switched systems are composed of a set of subsystems and a logical switching rule whose subsystem will be activated at each instant of time and orchestrates the switching among the subsystems . In general, the switching rule is a piecewise constant function dependent on the state or time. The logical rule that orchestrates switching between these subsystems generates switching signals . Recently, many results on the stability of switched system with time delay and parametric uncertainties have been reported [24, 25]. Switched system in which all subsystems are stable was studied in , and Hu and Michel used dwell time approach to analyse the local asymptotic stability of non-linear switched systems in . Hespanha and Morse  extended this concept to develop the average dwell time approach subsequently. Furthermore, in , the stability results of switched system extended to the case when subsystems are both stable and unstable have been reported, and therefore we derive less conservative results. So, average dwell time (ADT) approach turns out to be an effective tool to study the stability of switched systems  and specially when not all subsystems are stable .
Meanwhile, neural networks as a special kind of complex networks, the connection topology of networks may change frequently and often lead to link failure or new link creation during the hardware implemtation. Hence, the abrupt changes in the network structure often occur, and switchings between some different topologies are inevitable . Thus, the switched neural network was proposed and has successful applications in the field of high-speed signal processing and artificial intelligence [31, 32], and switched neural networks are also used to perform the gene selection in a DNA microarray analysis in . Thus, it is of great meaning to discuss the switched neural networks. Recently, the stability of switching neural networks has been intensively investigated [34–36]. Robust exponential stability and control for switched neutral-type neural networks were discussed in .
In , delay-dependent stability analysis for switched neural networks with time-varying delay was analyzed. In , by employing nonlinear measure and LMI techniques, some new sufficient conditions were obtained to ensure global robust asymptotical stability and global robust exponential stability of the unique equilibrium for a class of switched recurrent neural networks with time-varying delay.
By combining the theories of switched systems and Cohen-Grossberg neural networks, the mathematical model of the switched Cohen-Grossberg neural networks is discussed in detail, which can be written as follows:
The function is a piece-wise constant function of time, called a switching signal, which specifies that subsystem will be activated. denotes the number of subsystems. The switched sequence can be described as , where denotes the initial time and is the th switching instant. Moreover, means that the th subsystem is activated. For any , this means that the matrices can taken values in the finite set . Meanwhile, we assume that the state of the switched CGNN does not jump at the switching instants; that is, the trajectory is everywhere continuous.
However, these available literatures mainly consider the stability property of switching neural networks. In fact, except for stability property, boundedness and attractor are also foundational concepts of dynamical neural networks, which play an important role in investigation of the uniqueness of equilibrium point (periodic solutions), stability and synchronization and so on [13, 14]. To the best of the author’s knowledge, few authors have considered the uniformly ultimate boundedness and attractors for switched CGNN with discrete delays and distributed delays.
As is well known, compared with linear matrix inequalities (LMIs) result, algebraic result is more conservative, and criteria in terms of LMI can be easily checked by using the powerful Matlab LMI toolbox. This motivates us to investigate the problems of the uniformly ultimate boundedness and the existence of an attractor for switched CGNN in this paper. The illustrative examples are given to demonstrate the validity of the theoretical results.
The paper is organized as follows. In Section 2, preliminaries and problem formulation are introduced. Section 3 gives the sufficient conditions of uniformly ultimate boundedness (UUB) and the existence of an attractor for switched CGNN. It is the main result of this paper. In Section 4, an example is given to illustrate the effectiveness of the proposed approach. The conclusions are summarized in Section 5.
2. Problem Formulation
Throughout this paper, we use the following notations. The superscript “” stands for matrix transposition; denotes the -dimensional Euclidean space; the notation means that is real symmetric and positive definite; and represent the identity matrix and a zero matrix; stands for a block-diagonal matrix; denotes the minimum eigenvalue of symmetric matrix ; in symmetric block matrices or long matrix expressions, “” is used to represent a term that is induced by symmetry. Matrices, if their dimensions are not explicitly stated, are assumed to be compatible for algebraic operations.
Consider the following Cohen-Grossberg neural network model with mixed delays (discrete delays and distributed delays): where
The discrete delays and distributed delays are bounded as follows: where , , are scalars.
As usual, the initial conditions associated with system (6) are given in the form where is a differentiable vector-valued function.
Throughout this paper, we make the following assumptions. For any , there exist constants and , such that
Remark 1. The constants and can be positive, negative, or zero. Therefore, the activation functions are more general than the forms , , . For continuously bounded function , there exist positive constants , , such that There exist positive constants , such that So, to obtain main results of this paper, the following definitions and lemmas are introduced.
Definition 4 (see ). For a switching signal and each , let denote the number of discontinuities of in the interval . If there exist and such that holds, then is called the average dwell time. is the chatter bound.
Remark 5. In Definition 4, it is obvious that there exists a positive number such that a switched signal has the ADT property, which means that the average dwell time between any two consecutive switchings is no less than a specified constant , Hespanha and Morse have proved that if is sufficiently large, then the switched system is exponentially stable. In addition, in , one can choose , but in our paper, we assume that , this is more preferable.
Lemma 6 (see ). For any positive definite constant matrix , scalar , and vector function , , then
Lemma 7 (see ). For any given symmetric positive definite matrix and scalars , , if there exists a vector function such that the following integration is well defined, then
3. Main Results
Theorem 8. For a given constant , if there is positive definite matrix , , , such that the following condition holds: where the symbol “” within the matrix represents the symmetric term of the matrix, and then system (6) is uniformly ultimately bounded.
Proof. Let us consider the following Lyapunov-Krasovskii functional:
We proceed to evaluate the time derivative of along the trajectory of system (6), and one can get
According to assumption (), we obtain the following inequality:
From assumption () and inequality (21), we obtain
Similarly, taking the time derivative of along the trajectory of system (6), we obtain According to Lemma 6, we can conclude that
Computing the derivative of along the trajectory of system (6) turns out to be where .
Denoting that , we obtain
Using Lemma 7, the following inequality is easily obtained:
From assumption , it follows that, for , Then, let So,
Using (20)–(27) and adding (29), we can derive Denote that
By integrating both sides of (31) in time interval , then we can obtain which implies that where , and
If one chooses , then for any constant and , there is , such that for all . According to Definition 2, we have for all . That is to say, system (6) is uniformly ultimately bounded. This completes the proof.
From (18), we know that there is a positive constant , such that
Proof. If one chooses , Theorem 8 shows that for any , there is , such that for all . Let . Clearly, is closed, bounded, and invariant. Furthermore, . Therefore, is an attractor for the solutions of system (6).
Corollary 10. In addition to the fact that all of the conditions of Theorem 8 hold, if , and , then system (6) has a trivial solution , and the trivial solution of system (6) is globally exponentially stable.
Proof. If , and , then it is obvious that system (6) has a trivial solution . From Theorem 8, one has
Therefore, the trivial solution of system (6) is globally exponentially stable. This completes the proof.
In this section, we will present conditions for uniformly ultimate boundedness and the existence of an attractor of the switching CGNN by applying the average dwell time.
Now, we can consider the switched Cohen-Grossberg neural networks with discrete delays and distributed delays as follows:
Theorem 11. For a given constant , if there is positive definite matrix , , , such that the following condition holds: where Then, system (39) is uniformly ultimately bounded for any switching signal with average dwell time satisfying where , , .
Proof. Define the Lyapunov functional candidate of the form
When , the th subsystem is activated, and from Theorem 8 and (34), we can conclude that there is a positive constant , such that
The system state is continuous. Therefore, it follows that If one chooses , then for any constant and , there is , such that for all . According to Definition 2, we have for all . That is to say, the switched Cohen-Grossberg neural networks system (39) is uniformly ultimately bounded. This completes the proof.
Proof. If we choose , Theorem 11 shows that for any , there is , such that for all . Let . Clearly, is closed, bounded, and invariant. Furthermore, .
Therefore, is an attractor for the solutions of system (39).
Corollary 13. In addition to the fact that all of the conditions of Theorem 8 hold, if and , then system (39) has a trivial solution , and the trivial solution of system (39) is globally exponentially stable.
Proof. If and , then it is obvious that the switched system (39) has a trivial solution . From Theorem 8, one has
It means that the trivial solution of the switched Cohen-Grossberg neural networks (39) is globally exponentially stable. This completes the proof.
Remark 14. It is noted that common Lyapunov function method requires all the subsystems of the switched system to share a positive definite radially unbounded common Lyapunov function. Generally speaking, this requirement is difficult to achieve. So, in this paper, we select a novel multiple Lyapunov function to study the uniformly ultimate boundedness and the existence of an attractor for switched Cohen-Grossberg neural networks. furthermore, this type of Lyapunov function enables us to establish less conservative results.
Remark 15. When , we have , , , , , then the switched Cohen-Grossberg neural networks (4) degenerates into a general Cohen-Grossberg neural networks with time-delay [15, 17]. Obviously, our result generalizes the previous result.
Remark 16. It is easy to see that is equivalent to existence of a common function for all subsystems, which implies that switching signals can be arbitrary. Hence, the results reported in this paper are more effective than arbitrary switching signal in the previous literature .
Remark 17. The constants , in assumption are allowed to be positive, negative, or zero, whereas the constant is restricted to be the zero in [1, 15], and the non-linear output function in [5, 18, 34–37] is required to satisfy . However, in our paper, the assumption condition was deleted. Therefore, assumption of this paper is weaker than those given in [1, 5, 15, 18, 34–37].
4. Illustrative Examples
In this section, we present an example to show the effectiveness and advantages of the proposed method and consider the switched neural networks with two subsystems.
Example. Consider the following switched Cohen-Grossberg neural network with discrete delays and distributed delays: where the behaved function is described by , and ; let Take the parameters as follows:
From assumptions , , we can gain , , , , , , , , and and .
In this paper, the dynamics of switched Cohen-Grossberg neural networks with average dwell time is investigated. A novel multiple Lyapunov-Krasovskii functional is designed to get new sufficient conditions guaranteeing the uniformly ultimate boundedness, the existence of an attractor, and the globally exponential stability. The derived conditions are expressed in terms of LMIs, which are more relaxed than algebraic formulation and can be easily checked by the effective LMI toolbox in Matlab in practice. Based on the method provided in this paper, stochastic disturbance, impulse, and reaction diffusion for switched systems will be considered in the future works.
This work was jointly supported by the National Natural Science Foundation of China under Grant no. 11101053 and 11101435, the Key Project of Chinese Ministry of Education under Grant no. 211118, the Excellent Youth Foundation of Educational Committee of Hunan Provincial no. 10B002, the Hunan Provincial NSF no. 11JJ1001, and National Science and Technology Major Projects of China no. 2012ZX10001001-006, the Scientific Research Fund of Hunan Provincial Education Department of China no. 12C0028.
- Z. Yuan, L. Huang, D. Hu, and B. Liu, “Convergence of nonautonomous Cohen-Grossberg-type neural networks with variable delays,” IEEE Transactions on Neural Networks, vol. 19, no. 1, pp. 140–147, 2008.
- X. Luan, F. Liu, and P. Shi, “Neural network based stochastic optimal control for nonlinear Markov jump systems,” International Journal of Innovative Computing, Information and Control, vol. 6, no. 8, pp. 3715–3723, 2010.
- D. Liu and A. Michel, “Cellular neural networks for associative memories,” IEEE Transactions on Circuits and Systems II, vol. 40, pp. 119–121, 1993.
- P. Venetianer and T. Roska, “Image compression by delayed CNNs,” IEEE Transactions on Circuits and Systems I, vol. 45, no. 3, pp. 205–215, 1998.
- T. Chen, “Global exponential stability of delayed Hopfield neural networks,” Neural Networks, vol. 14, no. 8, pp. 977–980, 2001.
- K. Lu, D. Xu, and Z. Yang, “Global attraction and stability for Cohen-Grossberg neural networks with delays,” Neural Networks, vol. 19, no. 10, pp. 1538–1549, 2006.
- H.-C. Chen, Y.-C. Hung, C.-K. Chen, T.-L. Liao, and C.-K. Chen, “Image-processing algorithms realized by discrete-time cellular neural networks and their circuit implementations,” Chaos, Solitons & Fractals, vol. 29, no. 5, pp. 1100–1108, 2006.
- M. A. Cohen and S. Grossberg, “Absolute stability of global pattern formation and parallel memory storage by competitive neural networks,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 13, no. 5, pp. 815–826, 1983.
- F. Wen and X. Yang, “Skewness of return distribution and coefficient of risk premium,” Journal of Systems Science & Complexity, vol. 22, no. 3, pp. 360–371, 2009.
- F. Wen, Z. Li, C. Xie, and S. David, “Study on the fractal and chaotic features of the Shanghai composite index,” Fractals-Complex Geometry Patterns and Scaling in Nature and Society, vol. 20, pp. 133–140, 2012.
- H. Ye, A. N. Michel, and K. Wang, “Qualitative analysis of Cohen-Grossberg neural networks with multiple delays,” Physical Review E, vol. 51, no. 3, pp. 2611–2618, 1995.
- J. Cao, K. Yuan, and H. X. Li, “Global asymptotical stability of recurrent neural networks with multiple discrete delays and distributed delays,” IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1646–1651, 2006.
- H. Zhang and Y. Wang, “Stability analysis of Markovian jumping stochastic Cohen-Grossberg neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 19, no. 2, pp. 366–370, 2008.
- C. Huang and L. Huang, “Dynamics of a class of Cohen-Grossberg neural networks with time-varying delays,” Nonlinear Analysis. Real World Applications, vol. 8, no. 1, pp. 40–52, 2007.
- J. Cao and J. Liang, “Boundedness and stability for Cohen-Grossberg neural network with time-varying delays,” Journal of Mathematical Analysis and Applications, vol. 296, no. 2, pp. 665–685, 2004.
- K. Yuan, J. Cao, and H. X. Li, “Robust stability of switched Cohen-Grossberg neural networks with mixed time-varying delays,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 36, no. 6, pp. 1356–1363, 2006.
- M. Jiang, Y. Shen, and X. Liao, “Boundedness and global exponential stability for generalized Cohen-Grossberg neural networks with variable delay,” Applied Mathematics and Computation, vol. 172, no. 1, pp. 379–393, 2006.
- J. Lian and K. Zhang, “Exponential stability for switched Cohen-Grossberg neural networks with average dwell time,” Nonlinear Dynamics, vol. 63, no. 3, pp. 331–343, 2011.
- D. Liberzon and A. S. Morse, “Basic problems in stability and design of switched systems,” IEEE Control Systems Magazine, vol. 19, no. 5, pp. 59–70, 1999.
- M. S. Branicky, “Multiple Lyapunov functions and other analysis tools for switched and hybrid systems,” IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 475–482, 1998.
- H. Lin and P. J. Antsaklis, “Stability and stabilizability of switched linear systems: a survey of recent results,” IEEE Transactions on Automatic Control, vol. 54, no. 2, pp. 308–322, 2009.
- D. Liberzon, Switching in Systems and Control, Systems & Control: Foundations & Applications, Birkhäuser, Boston, Mass, USA, 2003.
- X.-M. Sun, J. Zhao, and D. J. Hill, “Stability and -gain analysis for switched delay systems: a delay-dependent method,” Automatica, vol. 42, no. 10, pp. 1769–1774, 2006.
- X. M. Sun, W. Wang, G. P. Liu, and J. Zhao, “Stability analysis for linear switched systems with time-varying delay,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 38, no. 2, pp. 528–533, 2008.
- K. Gu, “An integral inequality in the stability problem of time-delay systems,” in Proceedings of the 39th IEEE Confernce on Decision and Control, pp. 2805–2810, Sydney, Australia, December 2000.
- C.-H. Lien, K.-W. Yu, Y.-J. Chung, Y.-F. Lin, L.-Y. Chung, and J.-D. Chen, “Exponential stability analysis for uncertain switched neutral systems with interval-time-varying state delay,” Nonlinear Analysis. Hybrid Systems, vol. 3, no. 3, pp. 334–342, 2009.
- B. Hu and A. N. Michel, “Stability analysis of digital feedback control systems with time-varying sampling periods,” Automatica, vol. 36, no. 6, pp. 897–905, 2000.
- J. P. Hespanha and A. S. Morse, “Stability of switched systems with average dwell-time,” in Proceedings of the 38th IEEE Conference on Decision and Control (CDC '99), pp. 2655–2660, December 1999.
- G. Zhai, B. Hu, K. Yasuda, and A. N. Michel, “Stability analysis of switched systems with stable and unstable subsystems: an average dwell time approach,” International Journal of Systems Science, vol. 32, no. 8, pp. 1055–1061, 2001.
- J. Zhao, D. J. Hill, and T. Liu, “Synchronization of complex dynamical networks with switching topology: a switched system point of view,” Automatica, vol. 45, no. 11, pp. 2502–2511, 2009.
- Y. Tsividis, “Switched neural networks,” US Patent, 1989.
- T. X. Brown, “Neural networks for switching,” IEEE Communications Magazine, vol. 27, no. 11, pp. 72–81, 1989.
- M. Muselli, “Gene selection through switched neural networks,” in Proceedings of the NETTAB Workshop on Bioinformatics for Microarrays, CINECA, Bologna, Italy, 2003.
- K. Mathiyalagan, R. Sakthivel, and S. M. Anthoni, “Robust exponential stability and control for switched neutral-type neural networks,” International Journal of Adaptive Control and Signal Processing, 2012.
- Z.-G. Wu, P. Shi, H. Su, and J. Chu, “Delay-dependent stability analysis for switched neural networks with time-varying delay,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 41, no. 6, Article ID 5872072, pp. 1522–1530, 2011.
- P. Li and J. Cao, “Global stability in switched recurrent neural networks with time-varying delay via nonlinear measure,” Nonlinear Dynamics, vol. 49, no. 1-2, pp. 295–305, 2007.
- L. Wan and Q. Zhou, “Attractor and ultimate boundedness for stochastic cellular neural networks with delays,” Nonlinear Analysis. Real World Applications, vol. 12, no. 5, pp. 2561–2566, 2011.
- Z. Wu, P. Shi, H. Su, and J. Chu, “Delay-dependent stability analysis for switched neural networks with time-varying delay,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 41, pp. 1522–1530, 2011.
Copyright © 2013 Peng Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.