Advances in Artificial Neural Systems

Volume 2012 (2012), Article ID 397146, 11 pages

http://dx.doi.org/10.1155/2012/397146

## Dynamical Behavior in a Four-Dimensional Neural Network Model with Delay

^{1}Guizhou Key Laboratory of Economics System Simulation, School of Mathematics and Statistics, Guizhou College of Finance and Economics, Guiyang 550004, China^{2}Department of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471003, China

Received 9 October 2011; Revised 29 November 2011; Accepted 30 November 2011

Academic Editor: Songcan Chen

Copyright © 2012 Changjin Xu and Peiluan Li. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

A four-dimensional neural network model with delay is investigated. With the help of the theory of delay differential equation and Hopf bifurcation, the conditions of the equilibrium undergoing Hopf bifurcation are worked out by choosing the delay as parameter. Applying the normal form theory and the center manifold argument, we derive the explicit formulae for determining the properties of the bifurcating periodic solutions. Numerical simulations are performed to illustrate the analytical results.

#### 1. Introduction

The interest in the periodic orbits of a delay neural networks has increased strongly in recent years and substantial efforts have been made in neural network models, for example, Wei and Zhang [1] studied the stability and bifurcation of a class of -dimensional neural networks with delays, Guo and Huang [2] investigated the Hopf bifurcation behavior of a ring of neurons with delays, Yan [3] discussed the stability and bifurcation of a delayed trineuron network model, Hajihosseini et al. [4] made a discussion on the Hopf bifurcation of a delayed recurrent neural network in the frequency domain, and Liao et al. [5] did a theoretical and empirical investigation of a two-neuron system with distributed delays in the frequency domain. For more information, one can see [6–23]. In 1986 and 1987, Babcock and Westervelt [24, 25] had analyzed the stability and dynamics of the following simple neural network model of two neurons with inertial coupling: where denotes the input voltage of the th neuron, is the output of the th neuron, is the damping factor and is the overall gain of the neuron which determines the strength of the nonlinearity. For a more detailed interpretation of the parameters, one can see [24, 25]. In 1997, Lin and Li [26] made a detailed investigation on the bifurcation direction of periodic solution for system (1).

Considering that there exists a time delay (we assume that it is ) in the response of the output voltages to changes in the input, then system (1) can be revised as follows: As is known to us that the research on the Hopf bifurcation, especially on the stability of bifurcating periodic solutions and direction of Hopf bifurcation is very critical. When delays are incorporated into the network models, stability, and Hopf bifurcation analysis become much complex. To obtain a deep and clear understanding of dynamics of neural network model with delays, we will make a investigation on system (2), that is, we study the stability, the local Hopf bifurcation for system (2).

The remainder of the paper is organized as follows. In Section 2, local stability for the equilibrium state of system (2) is discussed. We investigate the existence of the Hopf bifurcations for system (2) choosing time delay as the bifurcation parameter. In Section 3, the direction and stability of the local Hopf bifurcation are analyzed by using the normal form theory and the center manifold theorem by Hassard et al. [27]. In Section 4, numerical simulations for justifying the theoretical results are illustrated.

#### 2. Stability of the Equilibrium and Local Hopf Bifurcations

The object of this section is to investigate the stability of the equilibrium and the existence of local Hopf bifurcations for system (2). It is easy to see that if the following condition:(H1)

holds, then (2) has a unique equilibrium . To investigate the local stability of the equilibrium state we linearize system (2). We expand it in a Taylor series around the orgin and neglect the terms of higher order than the first order. The linearization of (2) near can be expressed as: whose characteristic equation has the form namely, In order to investigate the distribution of roots of the transcendental equation (5), the following Lemma is necessary.

Lemma 1 (see [28]). *For the transcendental equation:
**
as vary, the sum of orders of the zeros of in the open right half plane can change, and only a zero appears on or crosses the imaginary axis.*

For , (5) becomes In view of the Routh-Hurwitz criteria, we know that all roots of (7) have a negative real part if the following condition:(H2)

is satisfied.

For is a root of (5) if and only if Separating the real and imaginary parts gives It follows from (9) that which is equivalent to where Without loss of generality, we assume that (11) has eight positive roots, denoted by . Then by (9), we derive where , then are a pair of purely imaginary roots of (5) when . Define The above analysis leads to the Lemma as follows.

Lemma 2. *If (H1) and (H2) hold, then all roots of (5) have a negative real part when and (5) admits a pair of purely imaginary roots when .*

Let be a root of (5) near , and , and . Due to functional differential equation theory, for every , there exists such that is continuously differentiable in for . Substituting into the left hand side of (5) and taking derivative with respect to , we have Then where We assume that the following condition holds:(H3).

According to above analysis and the results of Kuang [29] and Hale [30], we have the following theorem

Theorem 3. *If (H1) and (H2) hold, then the equilibrium of system (2) is asymptotically stable for . Under the conditions (H1) and (H2), if the condition (H3) holds, then system (2) undergoes a Hopf bifurcation at the equilibrium when .*

#### 3. Direction and Stability of the Hopf Bifurcation

In this section, we discuss the direction, stability and the period of the bifurcating periodic solutions. The used methods are based on the normal form theory and the center manifold theorem introduced by Hassard et al. [27]. From the previous section, we know that if . any root of (5) of the form satisfies and .

For convenience, let and , where is defined by (13) and , drop the bar for the simplification of notations, then system (3) can be written as an FDE in as where and , , , and are given by respectively, where .

From the discussion in Section 2, we know that if , then system (18) undergoes a Hopf bifurcation at the equilibrium and the associated characteristic equation of system (18) has a pair of simple imaginary roots .

By the representation theorem, there is a matrix function with bounded variation components such that In fact, we can choose where is the Dirac delta function.

For , define Then (18) is equivalent to the abstract differential equation where . For , define For and , define the bilinear form where , the and are adjoint operators. By the discussions in Section 2, we know that are eigenvalues of , and they are also eigenvalues of corresponding to and respectively. By direct computation, we can obtain where Furthermore, and .

Next, we use the same notations as those in Hassard et al. [27] and we first compute the coordinates to describe the center manifold at . Let be the solution of (18) when .

Define on the center manifold , and we have where and and are local coordinates for center manifold in the direction of and . Noting that is also real if is real, we consider only real solutions. For solutions of (18), That is, where Hence we have and we obtain Therefore, we can compute the following values: which determine the quantities of bifurcation periodic solutions on the center manifold at the critical value , determines the direction of the Hopf bifurcation: If , then the Hopf bifurcation is supercritical (subcritical); determines the stability of the bifurcating periodic solutions: the periodic solutions are stable (unstable) if ; and determines the period of the bifurcating periodic solutions: the period is increases (decreases) if .

#### 4. Numerical Examples

To illustrate the analytical results found, let , then system (2) becomes which has a unique equilibrium and satisfies the conditions indicated in Theorem 3. The equilibrium is asymptotically stable for . For , using the software Matlab, we derive . Thus by the algorithm (36) derived in Section 3, we get . Thus the equilibrium is stable when . Figures 1(a)–1(j) show that the equilibrium is asymptotically stable when . When passes through the critical value , the equilibrium loses its stability and a Hopf bifurcation occurs, that is, a family of periodic solutions bifurcate from the equilibrium . Since and , the direction of the Hopf bifurcation is , and these bifurcating periodic solutions from at are stable. Figures 1(j)–2(d) suggest that Hopf bifurcation occurs from the equilibrium when .

#### Acknowledgments

This work is supported by National Natural Science Foundation of China (no. 60902044), the Doctoral Foundation of Guizhou College of Finance and Economics (2010), and the Science and Technology Program of Hunan Province (no. 2010FJ6021).

#### References

- J. Wei and C. Zhang, “Bifurcation analysis of a class of neural networks with delays,”
*Nonlinear Analysis: Real World Applications*, vol. 9, no. 5, pp. 2234–2252, 2008. View at Publisher · View at Google Scholar · View at Scopus - S. Guo and L. Huang, “Hopf bifurcating periodic orbits in a ring of neurons with delays,”
*Physica D*, vol. 183, no. 1-2, pp. 19–44, 2003. View at Publisher · View at Google Scholar · View at Scopus - X. P. Yan, “Hopf bifurcation and stability for a delayed tri-neuron network model,”
*Journal of Computational and Applied Mathematics*, vol. 196, no. 2, pp. 579–595, 2006. View at Publisher · View at Google Scholar · View at Scopus - A. Hajihosseini, G. R. Rokni Lamooki, B. Beheshti, and F. Maleki, “The Hopf bifurcation analysis on a time-delayed recurrent neural network in the frequency domain,”
*Neurocomputing*, vol. 73, no. 4–6, pp. 991–1005, 2010. View at Publisher · View at Google Scholar · View at Scopus - X. Liao, S. Li, and G. Chen, “Bifurcation analysis on a two-neuron system with distributed delays in the frequency domain,”
*Neural Networks*, vol. 17, no. 4, pp. 545–561, 2004. View at Publisher · View at Google Scholar · View at Scopus - B. Zheng, Y. Zhang, and C. Zhang, “Global existence of periodic solutions on a simplified BAM neural network model with delays,”
*Chaos, Solitons and Fractals*, vol. 37, no. 5, pp. 1397–1408, 2008. View at Publisher · View at Google Scholar · View at Scopus - S. Guo, X. Tang, and L. Huang, “Stability and bifurcation in a discrete system of two neurons with delays,”
*Nonlinear Analysis: Real World Applications*, vol. 9, no. 4, pp. 1323–1335, 2008. View at Publisher · View at Google Scholar · View at Scopus - S. Guo, “Equivariant Hopf bifurcation for functional differential equations of mixed type,”
*Applied Mathematics Letters*, vol. 24, no. 5, pp. 724–730, 2011. View at Publisher · View at Google Scholar - J. Wei and C. Zhang, “Bifurcation analysis of a class of neural networks with delays,”
*Nonlinear Analysis: Real World Applications*, vol. 9, no. 5, pp. 2234–2252, 2008. View at Publisher · View at Google Scholar · View at Scopus - J. Wei and M. Y. Li, “Global existence of periodic solutions in a tri-neuron network model with delays,”
*Physica D*, vol. 198, no. 1-2, pp. 106–119, 2004. View at Publisher · View at Google Scholar · View at Scopus - S. Li, X. Liao, C. Li, and K. W. Wong, “Hopf bifurcation of a two-neuron network with different discrete time delays,”
*International Journal of Bifurcation and Chaos*, vol. 15, no. 5, pp. 1589–1601, 2005. View at Publisher · View at Google Scholar · View at Scopus - W. Yu and J. Cao, “Stability and hopf bifurcation on a two-neuron system with time delay in the frequency domain,”
*International Journal of Bifurcation and Chaos*, vol. 17, no. 4, pp. 1355–1366, 2007. View at Publisher · View at Google Scholar · View at Scopus - Y. Song, M. Han, and J. Wei, “Stability and Hopf bifurcation analysis on a simplified BAM neural network with delays,”
*Physica D*, vol. 200, no. 3-4, pp. 185–205, 2005. View at Publisher · View at Google Scholar · View at Scopus - C. Zhang, B. Zheng, and L. Wang, “Multiple Hopf bifurcations of symmetric BAM neural network model with delay,”
*Applied Mathematics Letters*, vol. 22, no. 4, pp. 616–622, 2009. View at Publisher · View at Google Scholar · View at Scopus - H. Zhao and L. Wang, “Hopf bifurcation in Cohen-Grossberg neural network with distributed delays,”
*Nonlinear Analysis: Real World Applications*, vol. 8, no. 1, pp. 73–89, 2007. View at Publisher · View at Google Scholar · View at Scopus - C. Xu, X. Tang, and M. Liao, “Frequency domain analysis for bifurcation in a simplified tri-neuron BAM network model with two delays,”
*Neural Networks*, vol. 23, no. 7, pp. 872–880, 2010. View at Publisher · View at Google Scholar · View at Scopus - C. Xu, X. Tang, and M. Liao, “Stability and bifurcation analysis of a six-neuron BAM neural network model with discrete delays,”
*Neurocomputing*, vol. 74, no. 5, pp. 689–707, 2011. View at Publisher · View at Google Scholar · View at Scopus - W. Yu and J. Cao, “Stability and Hopf bifurcation analysis on a four-neuron BAM neural network with time delays,”
*Physics Letters A*, vol. 351, no. 1-2, pp. 64–78, 2006. View at Publisher · View at Google Scholar · View at Scopus - P. D. Gupta, N. C. Majee, and A. B. Roy, “Stability, bifurcation and global existence of a Hopf-bifurcating periodic solution for a class of three-neuron delayed network models,”
*Nonlinear Analysis: Theory, Methods and Applications*, vol. 67, no. 10, pp. 2934–2954, 2007. View at Publisher · View at Google Scholar · View at Scopus - R. Curtu, “Singular Hopf bifurcations and mixed-mode oscillations in a two-cell inhibitory neural network,”
*Physica D*, vol. 239, no. 9, pp. 504–514, 2010. View at Publisher · View at Google Scholar · View at Scopus - H. Zhao, L. Wang, and C. Ma, “Hopf bifurcation and stability analysis on discrete-time Hopfield neural network with delay,”
*Nonlinear Analysis: Real World Applications*, vol. 9, no. 1, pp. 103–113, 2008. View at Publisher · View at Google Scholar · View at Scopus - S. A. Campbell, S. Ruan, and J. Wei, “Qualitative analysis of a neural network model with multiple time delays,”
*International Journal of Bifurcation and Chaos*, vol. 9, no. 8, pp. 1585–1595, 1999. View at Google Scholar · View at Scopus - L. Olien and J. Bélair, “Bifurcations, stability, and monotonicity properties of a delayed neural network model,”
*Physica D*, vol. 102, no. 3-4, pp. 349–363, 1997. View at Google Scholar - K. L. Babcock and R. M. Westervelt, “Dynamics of simple electronic neural networks,”
*Physica D*, vol. 28, no. 3, pp. 305–316, 1987. View at Google Scholar · View at Scopus - K. L. Babcock and R. M. Westervelt, “Stability and dynamics of simple electronic neural networks with added inertia,”
*Physica D*, vol. 23, no. 1–3, pp. 464–469, 1986. View at Google Scholar · View at Scopus - Y. P. Lin and J. B. Li, “The Hopf bifurcation direction of a four dimensional electronic neural network system,”
*System Science and Mathematical Sciences*, vol. 10, no. 4, pp. 337–343, 1997. View at Google Scholar - B. Hassard, D. Kazarino, and Y. Wan,
*Theory and Applications of Hopf Bifurcation*, Cambridge University Press, Cambridge, UK, 1981. - S. Ruan and J. Wei, “On the zeros of transcendental functions with applications to stability of delay differential equations with two delays,”
*Dynamics of Continuous, Discrete and Impulsive Systems Series A: Mathematical Analysis*, vol. 10, no. 6, pp. 863–874, 2003. View at Google Scholar · View at Scopus - Y. Kuang,
*Delay Differential Equations With Applications in Population Dynamics*, Academic Press, New York, NY, USA, 1993. - J. Hale,
*Theory of Functional Differential Equation*, Springer, New York, NY, USA, 1977.