`Journal of Applied MathematicsVolume 2013 (2013), Article ID 436254, 13 pageshttp://dx.doi.org/10.1155/2013/436254`
Research Article

## Hopf Bifurcation Analysis for a Four-Dimensional Recurrent Neural Network with Two Delays

1Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Jiangnan University, Wuxi 214122, China
2School of Management Science and Engineering, Anhui University of Finance and Economics, Bengbu 233030, China

Received 22 July 2013; Accepted 14 October 2013

Academic Editor: Carlos J. S. Alves

Copyright © 2013 Zizhen Zhang and Huizhong Yang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

A four-dimensional recurrent neural network with two delays is considered. The main result is given in terms of local stability and Hopf bifurcation. Sufficient conditions for local stability of the zero equilibrium and existence of the Hopf bifurcation with respect to both delays are obtained by analyzing the distribution of the roots of the associated characteristic equation. In particular, explicit formulae for determining the direction of the Hopf bifurcation and the stability of the bifurcating periodic solutions are established by using the normal form theory and center manifold theory. Some numerical examples are also presented to verify the theoretical analysis.

#### 1. Introduction

In recent years, neural networks have attracted many scholars’ attention all over the world and have been applied in different areas such as signal processing [1], pattern recognition [24], optimization [5], and automatic control [68]. In particular, the appearance of a cycle bifurcating from an equilibrium of an ordinary or a delayed neural network with a single parameter has been widely investigated [917]. In [18], Ruiz et al. studied the following recurrent neural network for the first time: where is the state, , are the network parameters or weights, is the input, is the output, and is the transfer function of the neurons. The three-node network of system (1) in the feedback configuration, with , has been studied in [12, 18, 19]; that is

It is well known that time delays can play a complicated role on neural networks. They can be the source of instabilities and bifurcation in neural networks. Based on this fact, Hajihosseini et al. [11] considered system (2) with distributed delays and . It is shown that a Hopf bifurcation takes place in the delayed system as the mean delay passes a critical value where a family of periodic solutions bifurcate from the equilibrium. The existence and stability of such solutions are determined by the Hopf bifurcation theorem in the frequency domain and the generalized Nyquist stability criterion.

As far as we know, there are some papers on the bifurcations of neural network with two or multiple delays [2022]. Motivated by the work in [11, 2022] and considering that when the number of neurons is large, the simplified model can reflect the really large neural networks more closely, we consider the following four-dimensional recurrent neural network with two discrete delays that occur in the interaction between the neurons: where , are time delays that occur in the interaction between the neurons.

This paper is organized as follows. In Section 2, the stability of the zero equilibrium of system (3) and the existence of local Hopf bifurcation with respect to possible combinations of the two delays are investigated. In Section 3, the properties of the Hopf bifurcation such as the direction and the stability are determined by using the normal form theory and center manifold theory. Some numerical simulations are also included in Section 4 to illustrate the validity of the main results.

#### 2. Stability of the Zero Equilibrium and Local Hopf Bifurcation

Throughout this paper we make the following assumption on the transfer function :(H),  ,   .

Clearly, is the zero equilibrium of system (3). Linearization of system (3) at the zero equilibrium is The characteristic equation of the linearized system (4) is where

In order to study the local stability of the zero equilibrium of system (3), we investigate the distribution of the roots of (5) in the following.

Case 1 (). Equation (5) reduces to where
Obviously, . Therefore, by the Routh-Hurwitz criterion, the zero equilibrium of system (3) is locally asymptotically stable if the following condition holds:

Case 2 (, ). On substituting , (5) becomes Multiplying on both sides of (10), it is easy to obtain Let be a root of (11). Then, we can get where Squaring both sides of the two equations in (12) and adding them up we obtain According to , we consider the two cases:
(I) if , then (14) takes the following form: which is equivalent to where Let , and denote that Thus, Let Let . Then, (20) becomes where Define Then, we can get Then, we can get the expression of and we denote . Substituting into (12), we can get the expression of and we denote . Thus, a function with respect to can be established by We assume that , (25), has finite positive roots, which are denoted by . For every fixed , the corresponding critical value of time delay is Then, are a pair of purely imaginary roots of (11) with . Let
(II) If , then (14) can be transformed into the following form:

Thus, similar as the process in case (I), we can get the expression of and . Let Therefore,

Then, we can get the critical value of time delay corresponding to every fixed positive root of (30): Let Next, we verify the transversality. Taking the derivative of with respect to in (11), we obtain Thus, where

Obviously, if the condition : holds, then . Namely, if the condition holds, then the transversality condition is satisfied. By the discussion above and the Hopf bifurcation theorem in [23], it is easy to obtain the following results.

Theorem 1. If the condition means that (25) has finite positive roots and means that holds, then the zero equilibrium of system (3) is asymptotically stable for , system (3) undergoes a Hopf bifurcation at when , and a branch of periodic solutions bifurcates from the zero equilibrium near .

Case 3 (,  ). When , (5) becomes the following form: Let be a root of (36). Substituting it into (36) and separating the real and imaginary parts, we obtain It follows that where Let , then (38) can be transformed into Next, we make the following assumption.(H31) means that (40) has at least one positive root.

Without loss of generality, we assume that (40) has four positive roots, which are denoted by , , , and . Thus, (38) has four positive roots ,  . The corresponding critical value of time delay is

Then, are a pair of purely imaginary roots of (36) with . Let Taking the derivative of with respect to in (36), we can get Then, we can get From (38), we have Thus, where Therefore, if the condition : , then Re. From the analysis above and by the Hopf bifurcation theorem in [23], we have the following results.

Theorem 2. If the condition means that (40) has at least one positive root and means that holds, then the zero equilibrium of system (3) is asymptotically stable for , system (3) undergoes a Hopf bifurcation at when , and a branch of periodic solutions bifurcates from the zero equilibrium near .

Case 4 (). For , (5) can be transformed into the following form: Multiplying on both sides of (48), we obtain Let be a root of (49); then we have where Then, we get

Similar as in Case 2, we can obtain the expression of and , which is denoted as and , respectively. Further we can get a function with respect to

Next, we make the following assumption. : Equation (53) has finite positive real roots, which are denoted by , respectively. For every fixed positive root of (53), the corresponding critical value of time delay is Then, are a pair of purely imaginary roots of (49) with . Let Differentiating both sides of (49) with respect to , we can obtain Thus, where

Obviously, if the condition : holds, then . Namely, if the condition holds, the transversality condition is satisfied. Thus, by the Hopf bifurcation theorem in [23] we have the following results.

Theorem 3. If the condition means that (53) has finite positive real roots and means that holds, then the zero equilibrium of system (3) is asymptotically stable for , system (3) undergoes a Hopf bifurcation at when , and a branch of periodic solutions bifurcates from the zero equilibrium near .

Case 5 ( and ). We consider (5) with in its stable interval and is considered as a parameter. Without loss of generality, we consider (5) under Case 2.

Let be a root of (5). Then, we can get Suppose that means that (59) has finite positive real roots, which are denoted as . For every positive real root , their exists a sequence , such that (59) has a pair of purely imaginary roots when .

Let , and when (59) has a pair of purely imaginary roots . In the following, we make the following assumption.(H52): .

Through the analysis above and by the Hopf bifurcation theorem in [23], we have the following results.

Theorem 4. If the condition means that (59) has finite positive real roots and means that holds, and , then the zero equilibrium of system (3) is asymptotically stable for , system (3) undergoes a Hopf bifurcation at when , and a branch of periodic solutions bifurcates from the zero equilibrium near .

#### 3. Stability of Bifurcated Periodic Solutions

In this section, the formulae for determining the direction of Hopf bifurcation and the stability of bifurcating periodic solutions of system (3) with respect to for are derived by using the normal form method and center manifold theorem introduced by Hassard et al. [23]. Throughout this section, it is considered that system (3) undergoes Hopf bifurcation at and . Without loss of generality, we assume that , where .

For convenience, let ,  . Drop the bars for simplification of notations. Then system (3) becomes where and , are given, respectively, by with

Therefore, according to the Riesz representation theorem, there exists a matrix function whose elements are of bounded variation such that In fact, we choose For , we define Then system (60) can be transformed into the following operator equation: where for .

For , where is the 4-dimensional space of row vector, we define the adjoint operator of : and a bilinear inner product where .

Then and are adjoint operators. From the discussion above, we know that are eigenvalues of and they are also eigenvalues of . Let be the eigenvector of corresponding to the eigenvalue , and let be the eigenvector of corresponding to the eigenvalue . Then, we have By a simple computation, we can obtain and , .

From (68), we can get

Following the algorithms given in [23] and using similar computation process in [24], we can get the coefficients which can be used to determine direction of the Hopf bifurcation and stability of the bifurcating periodic solutions: with where and can be computed by the following equations, respectively: with

Therefore, we can calculate the following values:

Based on the discussion above, we can obtain the following results.

Theorem 5. For system (3),(i) determines the direction of the Hopf bifurcation. If ; then the Hopf bifurcation is supercritical (subcritical);(ii) determines the stability of the bifurcating periodic solutions. If ; then the bifurcating periodic solutions are stable (unstable);(iii) determines the period of the bifurcating periodic solutions. If ; then the period of the bifurcating periodic solutions increases (decreases).

#### 4. Numerical Simulation

In this section, we present some numerical simulations to support the theoretical analysis in Sections 2 and 3. As an example, we consider the following special case of system (3) with the parameters , , , and . Then , , and system (3) becomes

Obviously, is the equilibrium of system (77). By a simple computation, we get , , and . That is, the condition holds.

For . We can obtain by some complicated computations. From Theorem 1, we know that is asymptotically stable when as illustrated by Figures 1 and 2. When passes through, the critical value , becomes unstable and a Hopf bifurcation occurs and a branch of periodic solutions bifurcate from , which can be seen from Figures 3 and 4. Similarly, we have for . The corresponding waveforms and the phase plots are shown in Figures 5, 6, 7, and 8.

Figure 1: The trajectory of , , , and when .
Figure 2: The phase plot of , , and when .
Figure 3: The trajectory of , , , and when .
Figure 4: The phase plot of , , and when .
Figure 5: The trajectory of , , , and when .
Figure 6: The phase plot of , , and when .
Figure 7: The trajectory of , , , and when .
Figure 8: The phase plot of , , and when .

For , we obtain . From Theorem 3, when increases from zero to the critical value , is asymptotically stable, then it will lose its stability and a Hopf bifurcation occurs once . These properties can be shown in Figures 9, 10, 11, and 12.

Figure 9: The trajectory of , , , and when .
Figure 10: The phase plot of , , and when .
Figure 11: The trajectory of , , , and when .
Figure 12: The phase plot of , , and when .

Lastly, for and , we get , . By Theorem 4, is asymptotically stable when , and is unstable when and a Hopf bifurcation occurs, which can be illustrated by Figures 13, 14, 15, and 16.

Figure 13: The trajectory of , , , and when and .
Figure 14: The phase plot of , , and when and .
Figure 15: The trajectory of , , , and when and .
Figure 16: The phase plot of , , and when and .

#### 5. Conclusion

In this paper, we have investigated a four-dimensional recurrent neural network with two discrete delays. Compared with the literature [11], we consider the neural network model which can reflect the really large neural networks more closely. By regarding the possible combinations of the two delays as the bifurcation parameter, sufficient conditions for the local stability of the zero equilibrium and the existence of Hopf bifurcation are obtained. If the conditions are satisfied, then there exists a critical value of the time delay below which the system is stable and above which the system is unstable. The results have shown that the two delays can play a complicated role on the model. And from the numerical simulations, we find that is marked in the model because the critical value of is much smaller than that of when we only consider them, respectively. Furthermore, the direction of the Hopf bifurcation and the stability of the bifurcating periodic solutions are discussed by the normal form theory and center manifold theory. Finally, some numerical simulations are also presented to support the theoretical analysis.

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### Acknowledgments

The authors are grateful to the two anonymous reviewers for their helpful comments and valuable suggestions on improving the paper. This work was supported by the National Natural Science Foundation of China (61273070), a project funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions.

#### References

1. C. Yao, H. J. Chen, and J. P. Li, “Analysis of dynamic behaviors of improved pulse coupled neural network in image processing,” Acta Automatica Sinica, vol. 34, no. 10, pp. 1291–1297, 2008 (Chinese).
2. R. S. Toqeer and N. S. Bayindir, “Speed estimation of an induction motor using Elman neural network,” Neurocomputing, vol. 55, no. 3-4, pp. 727–730, 2003.
3. W.-M. Qi, Y.-C. Cheng, Q.-L. Ji, and W.-Y. Cai, “PID Elman neural network and its application to dynamical system identification,” Control and Decision, vol. 20, no. 10, pp. 1197–1200, 2005 (Chinese).
4. J. Yang, Y. Wen, and P. Li, “Feature extraction and identification of leak acoustic signal in water distribution pipelines using correlation analysis and approximate entropy,” Chinese Journal of Scientific Instrument, vol. 30, no. 2, pp. 272–279, 2009 (Chinese).
5. B. Luitel and G. K. Venayagamoorthy, “Quantum inspired PSO for the optimization of simultaneous recurrent neural networks as MIMO learning systems,” Neural Networks, vol. 23, no. 5, pp. 583–586, 2010.
6. L. Y. Wang, T. Y. Chai, and Z. Fang, “Neural network control and application of robotic manipulators including actuator dynamics,” Acta Automatica Sinica, vol. 35, no. 5, pp. 622–626, 2009 (Chinese).
7. Y. X. Wu and C. Wang, “Deterministic learning based adaptive network control of robot in task space,” Acta Automatica Sinica, vol. 39, no. 1, pp. 1–10, 2013 (Chinese).
8. J. Chen, Z. P. Li, and G. Z. Zhang, “Variable structure neural network adaptive robust control,” Acta Automatica Sinica, vol. 36, no. 1, pp. 174–178, 2010 (Chinese).
9. J. Wei and S. Ruan, “Stability and bifurcation in a neural network model with two delays,” Physica D, vol. 130, no. 3-4, pp. 255–272, 1999.
10. B. Wang and J. Jian, “Stability and Hopf bifurcation analysis on a four-neuron BAM neural network with distributed delays,” Communications in Nonlinear Science and Numerical Simulation, vol. 15, no. 2, pp. 189–204, 2010.
11. A. Hajihosseini, G. R. Rokni Lamooki, B. Beheshti, and F. Maleki, “The Hopf bifurcation analysis on a time-delayed recurrent neural network in the frequency domain,” Neurocomputing, vol. 73, no. 4–6, pp. 991–1005, 2010.
12. F. Maleki, B. Beheshti, A. Hajihosseini, and G. R. R. Lamooki, “The bogdanov-takens bifurcation analysis on a three dimensional recurrent neural network,” Neurocomputing, vol. 73, no. 16–18, pp. 3066–3078, 2010.
13. J. Wei and C. Zhang, “Bifurcation analysis of a class of neural networks with delays,” Nonlinear Analysis, vol. 9, no. 5, pp. 2234–2252, 2008.
14. C. Xu and X. He, “Stability and bifurcation analysis in a class of two-neuron networks with resonant bilinear terms,” Abstract and Applied Analysis, vol. 2011, Article ID 697630, 21 pages, 2011.
15. M. Xiao, W. X. Zheng, and J. D. Cao, “Bifurcation and control in a neural network with small and large delays,” Neural Networks, vol. 44, pp. 132–142, 2013.
16. C. Feng and R. Plamondon, “An oscillatory criterion for a time delayed neural ring network model,” Neural Networks, vol. 29-30, pp. 70–79, 2012.
17. X. Yang, M. Yang, H. Liu, and X. Liao, “Bautin bifurcation in a class of two-neuron networks with resonant bilinear terms,” Chaos, Solitons & Fractals, vol. 38, no. 2, pp. 575–589, 2008.
18. A. Ruiz, D. H. Owens, and S. Townley, “Existence, learning, and replication of periodic motions in recurrent neural networks,” IEEE Transactions on Neural Networks, vol. 9, no. 4, pp. 651–661, 1998.
19. S. Townley, A. Ilchmann, M. G. Weiss et al., “Existence and learning of oscillations in recurrent neural networks,” IEEE Transactions on Neural Networks, vol. 11, no. 1, pp. 205–214, 2000.
20. H. Hu and L. Huang, “Stability and Hopf bifurcation analysis on a ring of four neurons with delays,” Applied Mathematics and Computation, vol. 213, no. 2, pp. 587–599, 2009.
21. E. Javidmanesh, Z. Afsharnezhad, and S. Effati, “Existence and stability analysis of bifurcating periodic solutions in a delayed five-neuron BAM neural network model,” Nonlinear Dynamics, vol. 72, no. 1-2, pp. 149–164, 2013.
22. C. Xu, X. Tang, and M. Liao, “Stability and bifurcation analysis of a six-neuron BAM neural network model with discrete delays,” Neurocomputing, vol. 74, no. 5, pp. 689–707, 2011.