ISRN Applied Mathematics

Volume 2011, Article ID 636732, 6 pages

http://dx.doi.org/10.5402/2011/636732

## Hopf Bifurcation Analysis in a Tabu Learning Neuron Model with Two Delays

School of Mathematics and Computer Science, Fujian Normal University, Fuzhou, Fujian 350007, China

Received 10 March 2011; Accepted 29 March 2011

Academic Editors: C.-C. Chiu and A. El-Sayed

Copyright © 2011 Yingguo Li. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We consider the nonlinear dynamical behavior of a tabu leaning neuron model with two delays. By choosing the sum of the two delays as a bifurcation parameter, we prove that Hopf bifurcation occurs in the neuron. Some numerical examples are also presented to verify the theoretical analysis.

#### 1. Introduction

Starting with the work of Hopfield [1] on neural networks, the dynamical behaviors (including stability, instability, periodic oscillatory, bifurcation, and chaos) of the continuous-time neural networks have received increasing interest due to their promising potential applications in many fields, such as signal processing, pattern recognition, optimization, and associative memories.

Tabu learning [2, 3] applies the concept of tabu search [4–7] to neural networks for solving optimization problems. By continuously increasing the energy surface in a neighborhood of the current network state, it penalizes those states that have already been visited. This enables the state trajectory to climb out of local minima while tending toward those areas that have not yet been visited, thus performing an efficient search through the problem’s solution space. Note that, unlike most existing neural-network-based methods for optimization, the goal of the tabu learning method is not to force the network state to converge to an optimal or nearly optimal solution, but rather, the network conducts an efficient search through the solution space. As pointed out in [8], it is very natural for one to ask what the state trajectory of the tabu learning neural network is like. In [8], the authors found and analyzed the Hopf bifurcation behavior in a tabu learning single-neuron model and also found chaotic behaviors in a tabu learning two-neuron model with both linear and quadratic proximity functions. In [9], the authors found and analyzed the Hopf bifurcation behavior in a discrete-time tabu learning single-neuron model.

It is well known that there exist time delays in the information processing of neurons. The delayed axonal signal transmissions in the neural network models make the dynamical behaviors become more complicated and may destabilize the stable equilibria and admit periodic oscillation, bifurcation, and chaos. Therefore, the delay is an important control parameter in living nervous system: different ranges of delays correspond to different patterns of neural activities (see, e.g., [10, 11]).

In the present paper, we study the bifurcation behavior of a tabu leaning neuron models with two delays. By choosing the sum of the two delays as a bifurcation parameter, we prove that Hopf bifurcation occurs in the neuron.

The organization of this paper is as follows. In the next section, we present the tabu learning neuron model with two delays that will be studied in this paper. In Section 3, we shall study the stability and the existence of bifurcation. To verify the theoretic analysis, numerical simulations are given in Section 4.

#### 2. The Tabu Learning Neuron Model with Two Delays

Recently, Li et al. [8] have studied the following tabu learning single neuron model: is the state of neuron, where is the activation function and represents the strength of the connection from neuron to itself, and cannot be a negative value in Hopfield-type neural network. satisfied the second equation of system (2.1) which is a learning equation, where is the memory decay rate and is the learning rate. Both and are positive constants. In the tabu learning model, , should be carefully chosen [12] for they heavily influence the behavior of system (2.1).

In order to describe the model more clearly, we introduce two time delays in model (2.1) In the next section, we first consider the stability of equilibrium and then study the existence and conditions of bifurcation at the equilibrium by choosing as the bifurcation parameter for system (2.2).

#### 3. Stability and Existence of Hopf Bifurcation

For most of the models in the literature, including the ones in [13–15], the activation function is . However, we only make the following assumption on function : and .

Clearly, is equilibrium of system (2.2). Linearization of (2.2) at the zero equilibrium yields whose characteristic equation is where .

In [16, 17], the second-degree transcendental polynomial equation has been extensively studied. In particular, we introduce the following results stated in [17] about the distributions of the roots of the characteristic (3.3).

Let , , either and or , either or and , , and .

Lemma 3.1 (see [17]). *For (3.3), we have the following *(1)*if hold, then all roots of (3.3) have negative real parts for all ; *(2)*if , , and hold and , then (3.3) has a pair of purely imaginary roots . When, then all roots of (3.3) except have negative real parts;*(3)*if , , and hold and (, resp.), then (3.3) has a pair of purely imaginary roots (, resp.). Furthermore, when(, resp.), then all roots of (3.3) except (, resp.) have negative real parts.**Here,
*

From Lemma 3.1, the following theorem about stability and Hopf bifurcation of (2.2) are immediately obtained.

Theorem 3.2. *For System (2.2), we have the following *(1)*if and , then the equilibrium of the system (2.2) is asymptotically stable for all ; *(2)*if , , and , then is asymptotically stable when and unstable when . System (2.2) undergoes Hopf bifurcations at when . **Here
*

Corollary 3.3. *When we set the activation function , notice that , then from Theorem 3.2 we get the following *(1)*if and , then the equilibrium of the system (2.2) is asymptotically stable for all ;*(2)*if either and or , and , then is asymptotically stable when and unstable when . System (2.2) undergoes Hopf bifurcations at when . **Here and are the same as (3.5).*

#### 4. Numerical Simulation

In this section, we give an example of system (2.2) with , , and . Then and . The system (2.2) becomes In system (4.1), the case (2) of Corollary 3.3 is satisfied.

From the formulae (3.5), it follows that . Thus, equilibrium is stable when . Choose , ; then . Figure 1(a)(A1)–(A3) shows that the origin is asymptotically stable. When passes through the critical value, , loses its stability and a Hopf bifurcation occurs. Choose , ; then . Figure 1(b)(B1)–(B3) shows that a family of periodic solutions bifurcate from .

#### Acknowledgment

The authors are very grateful to the referees for their valuable suggestions, which helped in improving the paper significantly.

#### References

- J. J. Hopfield, “Neurons with graded response have collective computational properties like those of two-state neurons,”
*Proceedings of the National Academy of Sciences of the United States of America*, vol. 81, no. 10, pp. 3088–3092, 1984. View at Google Scholar · View at Scopus - D. A. Beyer and R. G. Ogier, “Tabu learning: a neural network search method for solving nonconvexoptimization problems,” in
*Proceedings of the International Joint Conference on Neural Networks (IJCNN '91)*, pp. 953–961, Singapore, July 1991. - C. Li, X. Liao, and J. Yu, “Tabu learning method for multiuser detection in CDMA systems,”
*Neurocomputing*, vol. 49, pp. 411–415, 2002. View at Publisher · View at Google Scholar · View at Scopus - F. Glover, “Tabu search, part I,”
*ORSA Journal on Computing*, vol. 1, pp. 190–206, 1989. View at Google Scholar - F. Glover, “Tabu search, part II,”
*ORSA Journal on Computing*, vol. 2, pp. 4–32, 1990. View at Google Scholar - C. Li, H. Xu, X. Liao, and J. Yu, “Tabu search for CNN template learning,”
*Neurocomputing*, vol. 51, pp. 475–479, 2003. View at Publisher · View at Google Scholar · View at Scopus - C. Li, X. Liao, and J. Yu, “Tabu search for fuzzy optimization and applications,”
*Information Sciences*, vol. 158, no. 1–4, pp. 3–13, 2004. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - C. Li, G. Chen, X. Liao, and J. Yu, “Hopf bifurcation and chaos in tabu learning neuron models,”
*International Journal of Bifurcation and Chaos in Applied Sciences and Engineering*, vol. 15, no. 8, pp. 2633–2642, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - M. Xiao and J. Cao, “Bifurcation analysis on a discrete-time tabu learning model,”
*Journal of Computational and Applied Mathematics*, vol. 220, no. 1-2, pp. 725–738, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - C. Huang, Y. He, L. Huang, and Y. Zhaohui, “Hopf bifurcation analysis of two neurons with three delays,”
*Nonlinear Analysis: Real World Applications*, vol. 8, no. 3, pp. 903–921, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - C. Huang, L. Huang, J. Feng, M. Nai, and Y. He, “Hopf bifurcation analysis for a two-neuron network with four delays,”
*Chaos, Solitons and Fractals*, vol. 34, no. 3, pp. 795–812, 2007. View at Publisher · View at Google Scholar · View at MathSciNet - D. A. Beyer and R. G. Ogier, “Tabu learning: a neural network search method for solving nonconvex optimization problems,” in
*Proceedings of the International Joint Conference on Neural Networks (IJCNN '91)*, pp. 953–961, Singapore, July 1991. - K. Gopalsamy and I. Leung, “Delay induced periodicity in a neural netlet of excitation and inhibition,”
*Physica D*, vol. 89, no. 3-4, pp. 395–426, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Olien and J. Bélair, “Bifurcations, stability, and monotonicity properties of a delayed neural network model,”
*Physica D*, vol. 102, no. 3-4, pp. 349–363, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - J. Wei and S. Ruan, “Stability and bifurcation in a neural network model with two delays,”
*Physica D*, vol. 130, no. 3-4, pp. 255–272, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - K. L. Cooke and Z. Grossman, “Discrete delay, distributed delay and stability switches,”
*Journal of Mathematical Analysis and Applications*, vol. 86, no. 2, pp. 592–627, 1982. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Ruan, “Absolute stability, conditional stability and bifurcation in Kolmogorov-type predator-prey systems with discrete delays,”
*Quarterly of Applied Mathematics*, vol. 59, no. 1, pp. 159–173, 2001. View at Google Scholar · View at Zentralblatt MATH