Table of Contents
Advances in Artificial Neural Systems
Volume 2014, Article ID 369230, 8 pages
http://dx.doi.org/10.1155/2014/369230
Research Article

Global Stability, Bifurcation, and Chaos Control in a Delayed Neural Network Model

Department of Mathematics, Indian Institute of Engineering Science and Technology, Shibpur, Howrah 711103, India

Received 29 May 2014; Accepted 15 September 2014; Published 8 October 2014

Academic Editor: Matt Aitkenhead

Copyright © 2014 Amitava Kundu and Pritha Das. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Conditions for the global asymptotic stability of delayed artificial neural network model of n (≥3) neurons have been derived. For bifurcation analysis with respect to delay we have considered the model with three neurons and used suitable transformation on multiple time delays to reduce it to a system with single delay. Bifurcation analysis is discussed with respect to single delay. Numerical simulations are presented to verify the analytical results. Using numerical simulation, the role of delay and neuronal gain parameter in changing the dynamics of the neural network model has been discussed.

1. Introduction

In recent years, neural networks (especially Hopfield type, cellular, bidirectional, and recurrent neural networks) have been applied successfully in many areas such as signal processing, pattern recognition, and associative memories. In most of the research works, stability of the designed neural network is an important step of analyzing the dynamics. Chaos plays an important role in human brain cognitive functions related to memory process. For example, chaotic behavior has been observed in nerve membranes by electrophysiological experiments on squid giant axons [13] and in measurements of brain electroencephalograms (EEG) [4, 5]. At first, Aihara et al. [6] introduced chaotic neural network models in order to simulate the chaotic behavior of biological neurons. Both the network and its component neuron are responsible for chaotic dynamics if suitable parameter values are chosen [6, 7]. The investigation of chaotic neural networks is of practical importance and many interesting results have been obtained so far (see [811] and the references therein). The control of chaotic behavior in chaotic neural networks is an important problem to apply them in information processing [12]. The first chaos control was proposed by Ott et al. (the OGY method) [13]. Since this pioneer work of OGY, various methods such as the occasional proportional feedback (OPF) method [14], continuous feedback control [15], and pinning method [16] have been proposed for chaos control.

Many research works have been done to know the effect of time delays in neural system [1719]. The malfunctioning of the neural system is often related to changes in the delay parameter causing unmanageable shifts in the phases of the neural signals. In the olfactory system, the phase transition has the appearance of a change in the EEG from a chaotic, aperiodic fluctuation to a more regular nearly periodic oscillation. In fact, neural network with delay can actually synchronize more easily controlling chaotic behavior of the system [10, 20]. Besides, change of neuronal gain parameter causes a change of all connectivity weights and therefore affects the dynamical behavior of the network [21].

For this reason, we are motivated to study effectiveness of time delay as well as neuronal gain parameters in changing the dynamics of an artificial neural network model. Using Lyapunov functional method, we studied the global stability analysis of the system and obtained sufficient criteria involving synaptic weights. We investigated the system numerically without time delay and with time delay. Chaotic behavior of the system without delay is controlled as the interconnection transmission delay is introduced in the model. Hopf-bifurcation analysis of the system with respect to time delay as parameter is discussed. Analytical results are verified using numerical simulations to show the reliability and effectiveness of the model. Numerical simulations of the model (using time series, phase portraits, and bifurcation diagrams) are presented showing changes of dynamics of the system. Chaotic behavior is observed when a gradual increase of slope of activation functions is made. Finally, some concluding remarks have been drawn on the implication of our results in the context of related work mentioned above.

2. Mathematical Model with Time Delay and Global Stability

We consider an artificial -neural network model of time delayed connections between the neurons using system of delay differential equations: where is the response functions and and are the threshold and the slope (neuronal gain parameter) of the response function of the neuron , respectively. The value of this sigmoidal type of response function is always nonnegative, bounded by 0 and 1. denotes the weight of the synaptic connection from the first neuron to theth neuron, is the decay or degradation rate parameter, and is the signal transmission delay and nonnegative constant.

In the following, we assume that each of the relations between the output of the cell and the state of the cell possesses the following properties.(H1) is bounded function in ;(H2) is continuous and differentiable nonlinear function.

To clarify our main results, we present the following lemma and proof under more general conditions.

Lemma 1. For the delayed nonlinear system (1), suppose that the output of the cell satisfies the hypotheses (H1) and (H2) above. Then all solutions of (1) remain bounded for .

Proof. It is easy to verify that all solutions of (1) satisfy differential inequalities of the form where , ; and Using (3), one can easily prove that solutions of (1) remain bounded on . This completes the proof.

By coordinate translation , , and assuming , (1) can be written as where Clearly, is an equilibrium of (5). To prove the global asymptotic stability of of (1), it is sufficient to prove global asymptotic stability of the trivial solution of (5).

This section derives the criteria for the global asymptotic stability of the trivial equilibrium of the network by constructing a suitable Lyapunov functional.

Theorem 2. If (i) and (ii) , then the trivial solution of (5) is globally asymptotically stable for any delay.

Proof. We consider Lyapunov functional defined by As and satisfy the propositions on and , we have the following expressions: where , where , and there exist , such that , , .
Therefore Similarly, .
Thus So if and , then when ; hence the trivial solution of (5) is globally asymptotically stable.

3. Bifurcation Analysis

As it is very difficult to study the dynamics of the proposed model analytically, we will study bifurcation analysis for only with three distinct delays. Hence our mathematical model will take the form as For simplicity, the following set of new state variables are introduced: Also, let .

Now, system (12) takes the following equivalent form with single delay as Linearizing the system about the steady state , we get where , , and .

The characteristic equation associated with the linearized system (14) is where and so , , and .

Let be a root of (16); then Eliminating the harmonic terms in (18), we have The existence of unique is given by So for different values of , we will get different values of . For simplicity, we will denote the minimum value of by and let be the positive and simple root of (18). By differentiating with respect to at in (16), we will get Next, based on the above results, a theorem is established.

Theorem 3. is asymptotically stable for , and it is impossible that it remains stable for all . Hence, there exists a , such that, for , is asymptotically stable and, for , is unstable and as increases through , bifurcates into small amplitude periodic solutions of Hopf type [22].

4. Numerical Simulation

In this section, the network consisting of five neurons with connections as depicted in Figure 1 will be considered. For bifurcation results, we assume . Similar results can be obtained also for . We used Matlab 7.10.0.499 for simulation of numerical examples.

369230.fig.001
Figure 1: Structure of the five neural networks investigated.
4.1. Chaos Control

We consider the system without any time delay (see Example 1). This system (22) shows chaotic nature (see Figure 2(a)) which is controlled as transmission delay is introduced (see Example 2). Here, we have considered time delay as system parameter keeping other system parameter values as in system (22). Figure 2(b) shows periodic behavior in presence of delay (). Bifurcation diagram with respect to time delay is also illustrated in Figure 3.

fig2
Figure 2: Time series (a) of the system (22) without delay showing chaotic behavior; (b) control of chaos of the system (23) can be seen in solution trajectory with showing periodic behavior when delay .
369230.fig.003
Figure 3: Bifurcation diagram with respect to time delay showing control of chaos of system (22).

Example 1. Consider

Example 2. Consider

4.2. Verification of Global Stability Criteria

Here, we consider the model (5) when and the parameter values are so chosen () which satisfy the global stability criteria independent of delay. Considering , we observe stable behavior of the system in Figure 4. But considering the same time delay (), the numerical simulation of Example 3 violating the conditions of global stability criteria shows the chaotic behavior in Figure 5.

fig4
Figure 4: Time series and corresponding phase portrait showing stable behavior satisfying global stability conditions when delay .
fig5
Figure 5: Time series and corresponding phase portrait showing chaotic behavior when delay violating global stability conditions.

Example 3. Consider

4.3. Bifurcation Results
4.3.1. Bifurcation with Respect to Total Time Delay

We consider model (14) with total time delay ) in the following example.

Example 4. Consider Substituting the system parameters into (19) and (20) for , we obtain , , and and the system has a positive equilibrium . When , the positive equilibrium is asymptotically stable and it remains stable when as is illustrated by the computer simulations (see Figure 6(a)) and system (25) is unstable for all (see Figure 6(b)). Bifurcation diagram with respect to time delay showing critical value is illustrated in Figure 7(a).

fig6
Figure 6: Solution trajectory showing (a) asymptotic stable behavior when ; (b) periodic behavior with .
fig7
Figure 7: Bifurcation diagram (a) of the system (25) with respect to time delay showing critical value ; (b) of the system (26) with respect to when .
4.3.2. Bifurcation with Respect to Neuronal Gain Parameter

We consider model (12) with the same time delay in the following example.

Example 5. Consider Bifurcation diagram with respect to is demonstrated in Figure 7(b). Gradual increase of slope of the activation function causes periodic oscillation and then chaos through period doubling of the system (26).

5. Conclusion

In this paper, we studied the global stability of artificial neural network model of -neurons with time delay and obtained the criteria of involving the synaptic weight and decay parameters, independent of delay. The system shows chaotic behavior without delay and introduction of delay plays a vital role in controlling chaos in the system. Also bifurcation analysis of the model with respect to time delay shows transition from stable to unstable (i.e., resting to rhythmic) behavior increasing the value of delay. We have also illustrated the effect of changing slope of the sigmoidal activation function (gain parameter ) in the dynamics of the neural network. Neural gain can be thought of as an amplifier of neural communication. When gain is increased, excited neurons become more active and inhibited neurons become less active [21]. The numerical simulation shows that the system dynamics undergo changes from stable to periodic and then to chaotic behavior through period doubling as the gain parameter is increased. A similar kind of behavior can be observed also for other neuronal gain parameters. The network with very small gain and small delay may not be very useful for implementation in models of oscillation generators and associative memories.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

  1. K. Aihara and G. Matsumoto, “Chaotic oscillations and bifurcations in squid giant axons,” in Chaos, A. V. Holden, Ed., pp. 257–269, 1986. View at Google Scholar · View at MathSciNet
  2. G. Matsumoto, K. Aihara, Y. Hanyu, N. Takahashi, S. Yoshizawa, and J.-I. Nagumo, “Chaos and phase locking in normal squid axons,” Physics Letters A, vol. 123, no. 4, pp. 162–166, 1987. View at Publisher · View at Google Scholar · View at Scopus
  3. D. T. Kaplan, J. R. Clay, T. Manning, L. Glass, M. R. Guevara, and A. Shrier, “Subthreshold dynamics in periodically stimulated squid giant axons,” Physical Review Letters, vol. 76, no. 21, pp. 4074–4077, 1996. View at Publisher · View at Google Scholar · View at Scopus
  4. A. Babloyantz and A. Destexhe, “Low-dimensional chaos in an instance of epilepsy,” Proceedings of the National Academy of Sciences of the United States of America, vol. 83, no. 10, pp. 3513–3517, 1986. View at Publisher · View at Google Scholar · View at Scopus
  5. W. J. Freeman, “Simulation of chaotic EEG patterns with a dynamic model of the olfactory system,” Biological Cybernetics, vol. 56, no. 2-3, pp. 139–150, 1987. View at Publisher · View at Google Scholar · View at Scopus
  6. K. Aihara, T. Takabe, and M. Toyoda, “Chaotic neural networks,” Physics Letters A, vol. 144, no. 6-7, pp. 333–340, 1990. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  7. M. Adachi and K. Aihara, “Associative dynamics in a chaotic neural network,” Neural Networks, vol. 10, no. 1, pp. 83–98, 1997. View at Publisher · View at Google Scholar · View at Scopus
  8. A. Das, A. B. Roy, and P. Das, “Chaos in a three-dimensional general model of neural network,” International Journal of Bifurcation and Chaos in Applied Sciences and Engineering, vol. 12, no. 10, pp. 2271–2281, 2002. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  9. X. Li and M. Bohner, “Exponential synchronization of chaotic neural networks with mixed delays and impulsive effects via output coupling with delay feedback,” Mathematical and Computer Modelling, vol. 52, no. 5-6, pp. 643–653, 2010. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  10. P. Das and A. Kundu, “Bifurcation and chaos in delayed cellular neural network model,” Journal of Applied Mathematics and Physics, vol. 2, pp. 219–224, 2014. View at Publisher · View at Google Scholar
  11. A. Kundu, P. Das, and A. B. Roy, “Complex dynamics of a four neuron network model having a pair of short-cut connections with multiple delays,” Nonlinear Dynamics, vol. 72, no. 3, pp. 643–662, 2013. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  12. G. He, Z. Cao, P. Zhu, and H. Ogura, “Controlling chaos in a chaotic neural network,” Neural Networks, vol. 16, no. 8, pp. 1195–1200, 2003. View at Publisher · View at Google Scholar · View at Scopus
  13. E. Ott, C. Grebogi, and J. A. Yorke, “Controlling chaos,” Physical Review Letters, vol. 64, no. 11, pp. 1196–1199, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  14. E. R. Hunt, “Stabilizing high-period orbits in a chaotic system: the diode resonator,” Physical Review Letters, vol. 67, no. 15, pp. 1953–1955, 1991. View at Publisher · View at Google Scholar · View at Scopus
  15. H. Gang and Q. Zhilin, “Controlling spatiotemporal chaos in coupled map lattice systems,” Physical Review Letters, vol. 72, no. 1, pp. 68–71, 1994. View at Publisher · View at Google Scholar · View at Scopus
  16. L. Chen and K. Aihara, “Global searching ability of chaotic neural networks,” IEEE Transactions on Circuits and Systems. I. Fundamental Theory and Applications, vol. 46, no. 8, pp. 974–993, 1999. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  17. R. C. Hilborn, Chaos and Nonlinear Dynamics, Oxford University Press, Oxford, UK, 2000. View at MathSciNet
  18. M. Xiao, W. X. Zheng, and J. Cao, “Bifurcation and control in a neural network with small and large delays,” Neural Networks, vol. 44, pp. 132–142, 2013. View at Publisher · View at Google Scholar · View at Scopus
  19. Y. Song, M. Han, and J. Wei, “Stability and Hopf bifurcation analysis on a simplified BAM neural network with delays,” Physica D, vol. 200, no. 3-4, pp. 185–204, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  20. F. M. Atay, J. Jost, and A. Wende, “Delays, connection topology, and synchronization of coupled chaotic maps,” Physical Review Letters, vol. 92, no. 14, 2004. View at Publisher · View at Google Scholar · View at Scopus
  21. E. Eldar, J. D. Cohen, and Y. Niv, “The effects of neural gain on attention and learning,” Nature Neuroscience, vol. 16, no. 8, pp. 1146–1153, 2013. View at Publisher · View at Google Scholar · View at Scopus
  22. B. D. Hassard, N. D. Kazarinoff, and Y. H. Wan, Theory and Applications of Hopf Bifurcation, Cambridge University Press, Cambridge, UK, 1981. View at MathSciNet