Advanced Topics in Fractional DynamicsView this Special Issue
Research Article | Open Access
Nonlinear Dynamics and Chaos in Fractional-Order Hopfield Neural Networks with Delay
A fractional-order two-neuron Hopfield neural network with delay is proposed based on the classic well-known Hopfield neural networks, and further, the complex dynamical behaviors of such a network are investigated. A great variety of interesting dynamical phenomena, including single-periodic, multiple-periodic, and chaotic motions, are found to exist. The existence of chaotic attractors is verified by the bifurcation diagram and phase portraits as well.
Fractional calculus, which mainly deals with derivatives and integrals of arbitrary order, was firstly introduced 300 years ago. However, it is only in recent decades that fractional calculus is applied to physics and engineering [1–3]. The main advantage of fractional-order models in comparison with its integer-order counterparts is that fractional derivatives provide an excellent tool in the description of memory and hereditary properties of various processes. In fractional calculus, a generalized capacitor, called “fractance,” is often considered to be the main operator. It is actually an electrical circuit in which its voltage and current are related by the fractional-order differential equation .
Chaos theory has been extensively investigated in various fields of research after the first observation of chaotic attractors in Lorenz system. Recently, study on the complex dynamical behaviors of fractional-order systems has become a hot research topic due to the fact that fractional-order systems show higher nonlinearity and more degrees of freedom in the models, and therefore fractional-order chaotic systems are considered to have the potential ability of improving the security of chaotic communication systems . It has been known that chaos in many well-known integer-order chaotic systems will remain when the orders become fractional, and a great number of fractional-order chaotic systems have been proposed as a consequence [6–14]. Moreover, chaotic behaviors have also been found to exist in some discontinuous systems with fractional derivatives . However, it is worthwhile to note that none of the aforementioned fractional-order chaotic systems are time-delayed systems.
On the other hand, the dynamics of delayed neural networks (DNNs) with traditional integer-order derivatives have been extensively studied both in theory and applications. [16–25]. It has been reported that DNNs can really display quite rich dynamical behaviors. For instance, Lu studied the complex dynamics of a DNN of Hopfield-type with two neurons and concluded that for a certain set of system parameters such a network does exhibit chaotic attractors . The complex dynamics of a delay-free neural network of Hopfield-type with four neurons have been investigated in , and hyperchaotic attractors are found to exist for some particular set of weight matrices. Chaotic attractors are also known to exist in delayed cellular neural networks .
However, the dynamical analysis of fractional-order neural networks is a very recent and promising research topic. Actually, if we replace the common capacitor in the integer-order Hopfield neural networks (HNNs) by the aforementioned “fractance,” we obtain the model of fractional-order HNNs. The incorporation of fractional derivatives into the network is a great improvement in modeling. It has been pointed out that fractional differentiation provides neurons with a fundamental and general computation that can contribute to efficient information processing . More recently, efforts have been made to investigate the complex dynamics of fractional-order neural networks. In , Arena et al. firstly introduced a cellular neural network (CNN) with fractional-order cells. In , Petráš presented a fractional three-cell CNN which exhibits limit cycle and stable orbit for different parameter values. A fractional two-cell chaotic CNN was reported in  and the corresponding strange attractor was shown. In , a fractional-order four-cell CNN has been presented and hyperchaotic attractors have been displayed. In , the dynamics of fractional-order delay-free HNNs, including stability and multistability, bifurcations, and chaos, have been investigated.
Time-delay is ubiquitous in physical systems, control systems, and biological systems due to finite switching speeds of amplifiers, finite signal propagation time in biological networks, and so on. Chaotic attractors in a fractional-order CNN with time-delay have been observed when the fractional-order . The analysis of delay dynamics in networked control systems has been made in . Unfortunately, little effort has been devoted to the complex dynamics of delayed fractional-order neural networks of Hopfield-type so far. This is a new subject and needs to be explored in depth. The main aim of this paper is to investigate the complex dynamics of fractional-order HNNs with time delay; a great variety of interesting dynamical behaviors, such as periodic and chaotic will be observed and the effect of the time delay will also be discovered. The existence of chaotic attractors is verified by bifurcation diagram and phase portraits, respectively.
The rest of this paper is organized as follows. In Section 2, definition for fractional derivatives and a modified numerical algorithm for solving delayed fractional-order differential equations are presented. In Section 3, a delayed fractional-order HNN with two neurons is proposed. Bifurcation analysis is made in Section 4. The lowest order, as well as the highest order, for chaos to exist is determined and the effect of the time delay is revealed. Finally, some concluding remarks are reported in Section 5.
2. Preliminaries and Notations
There are three most frequently used definitions for fractional derivatives, that is, Riemann-Liouville, Grünwald-Letnikov, and Caputo’s definitions. The main advantage of Caputo definition is that the initial conditions for fractional-order differential equations with Caputo derivatives take on the same form as for integer-order differential equations . And therefore, this paper is based on Caputo’s definition.
Definition 1 (see ). The Caputo fractional derivative of order of a continuous function is defined as follows: where is -function, and
The numerical calculation of fractional-order differential equations (FDEs) is not as simple as that of ordinary differential equations (ODEs). Due to the nonlocal character of fractional derivative operator, the numerical methods for solving ODEs have to be modified to cater for solving FDEs. In [34, 35], a method to numerically solve FDEs has been proposed based on the Adams-Bashforth-Moulton predictor-corrector scheme. Furthermore, an algorithm for solving fractional-order delayed differential equations (FDDEs) in the form of is presented in . We modify the predictor-corrector algorithm proposed in  such that it is appropriate to solve FDDEs in the form of (3) as below.
Consider the FDDEs described by
It should be noted that is assumed to satisfy the Lipschitz condition with respect to its second and third variables, respectively, and is assumed to be continuous in (3) in order to ensure the existence of solutions. For more details, the reader can consult  and the references cited therein.
Applying fractional integration on both sides of (3), we obtain
Discretizing (4) for uniform grid, , in which and are integers and satisfy and . Let and denote
Suppose that we have obtained the approximations for , and now we wish to calculate by using
We use approximations for in (7). Thus, the modified predictor-corrector algorithm can be presented as follows: where and is the predicted value of which can be determined by where
Remark 2. It should be noticed that the algorithm proposed in  can be used to calculate the FDDEs in the form of , where the variable does not explicitly appear in the right-hand side function . However, when is also a function of , that is, the FDDEs described by , the algorithm proposed in  fails to be used in this case. For this reason, we modify the algorithm such that it is appropriate to solve FDDEs in the form of (3). Note that (10) is used indispensably to predict the value of as . This is the main difference between the modified algorithm and the algorithm proposed in .
3. Description of the Delayed Fractional-Order HNNs
In this paper, we consider the fractional-order HNNs with time delay described by
where denotes the Caputo fractional derivative of order , , and are real numbers, represents the time delay, and are external inputs. The activation function is chosen as , and , , is the initial condition.
It should be noted that when , (12) is reduced to the classical integer-order delayed HNNs. The complex dynamical behaviors of such a network with two neurons have been investigated in  and single-periodic, multiple-periodic, and chaotic motions have been revealed. In this paper, we study the fractional-order case, that is, the complex dynamics of system (12) with two neurons.
Rewrite (12) into a compact form where , , , , , and
It should be noticed that we always assume that in the remainder of this paper.
4. Bifurcation and Chaos in Delayed Fractional-Order HNN
We firstly fix the values of system parameters of (13) as and the time delay . The initial condition is always chosen as the constant function on . The equilibrium points are calculated numerically as , and . In this section, we employ the numerical method proposed in Section 2 to solve (13). The step size is chosen as , and the simulation time is chosen as 1000.
When the fractional order , Figure 1(a) shows the two separate period-one orbits with two groups of initial conditions , and , for , respectively. It can be easily found from Figure 1(a) that one period orbit oscillates around the equilibrium point ; the other oscillates around the equilibrium point . With the increase of the derivative order, period-two orbits and period-four orbits appear. Figure 1(b) shows two separate period-two orbits with order and Figure 1(c) shows two separate period-four orbits with order . If we continue to increase the derivative order, then system (13) begins to exhibit chaotic behavior. Figure 1(d) shows two separate coexisting single-scroll chaotic attractors with order . It should be noted that Figures 1(b), 1(c), and 1(d) take on the same initial values as those in Figure 1(a).
If we further increase the derivative order to 0.92, two separate single-scroll chaotic attractors merge into a double-scroll chaotic attractor. Figure 2(a) shows a fully developed double-scroll chaotic attractor with order and the initial condition is set as , for . When the derivative order is increased to , Figure 2(b) shows a periodic orbit with the initial condition , for . That is to say, for fractional-order nonlinear system with time delay, there is a chance to be periodic after it has already entered the chaotic domain.
We summarize the considered cases in Figures 1 and 2 in Table 1. We can find from Table 1 that when keeping the values of and fixed, system (13) firstly undergoes the process of period-doubling bifurcation with the increase of to some extent and then tends from disorder to order when the value of continues to increase. This indicates that the dynamical characteristics of fractional-order nonlinear systems with delays are completely different from fractional-order nonlinear systems without delays.
Remark 3. It is generally known that chaotic behavior in fractional-order nonlinear systems without time delays is preserved when the derivative order is greater than a certain value (called as the lowest order). However, an interesting phenomenon for delayed fractional-order nonlinear system is observed in the simulation; different from fractional-order system without time delay, chaotic phenomena exist only for a certain interval of derivative order, that is to say, a lowest order as well as a highest order has been found to exist in order to ensure the occurrence of chaos. As long as the derivative order is beyond these two bounds, the chaotic attractor will vanish.
In order to confirm the period-doubling bifurcation process, we draw the bifurcation diagrams of with respect to the derivative order . Figure 3 shows a bifurcation process when ranges from to with . It can be determined from Figure 3 that a periodic window is found when is about . It confirms what we have observed in Figures 1 and 2.
In what follows, we modify only the values of and into to investigate the dynamics of system (13). Obviously, the equilibrium points of system (13) do not change. It can be easily seen that with the increase of the system order, system (13) undergoes a similar process of period-doubling bifurcation.
When the system order , Figure 4(a) shows two separate period-one orbits with two groups of initial conditions , and , for , respectively. Figures 4(b) and 4(c) show two separate period-two and period-four orbits with system order and , respectively. Figure 4(d) shows two separate single-scroll chaotic attractors with derivative order . It should be noted that Figures 4(b), 4(c), and 4(d) take on the same initial values as those in Figure 4(a).
It should also be noted that another interesting phenomenon is observed; that is, even when the system enters the chaotic domain and if we continue to increase the fractional order, now the system will exhibit different patterns of chaotic attractors. Figure 5 shows different fully developed double-scroll chaotic attractors with parameters , when system order is further increased. Figure 5(a) shows a double-scroll chaotic attractor with fractional order and initial condition , for . Figures 5(b) and 5(c) show two chaotic attractors which are symmetric about the origin with fractional order and initial conditions , and , for , respectively. Figure 5(d) shows another fully developed double-scroll chaotic attractor with fractional order and initial conditions , for .
Similarly, we summarize the considered cases in Figures 4 and 5 in Table 2. We can see from Table 2 that when keeping the values of and fixed, system (13) undergoes the process of period-doubling bifurcation with the increase of and then the chaotic behavior is preserved although the patterns of the chaotic attractors are different.
Similarly, in order to confirm the period-doubling bifurcation process, we draw the bifurcation diagrams of with respect to derivative order . Figure 6 demonstrates bifurcation process when ranges from to with , , which confirms what we have observed in Figures 4 and 5.
In this paper, the complex dynamical behaviors of delayed fractional-order Hopfield-type neural networks with two neurons are detailedly investigated with the aid of numerical simulations. Different varieties of interesting dynamical behaviors, including single-periodic, multiple-periodic, and double-scroll chaotic attractors, have been discovered. It should be pointed out that different from fractional-order nonlinear systems without time delay, a lowest order as well as a highest order has been found to exist in order to ensure the emergence of chaos. The existence of chaotic attractors is verified with bifurcation diagram and phase portraits. The novel fractional-order chaos provides a new chaos generator and can be applied in many engineering applications, especially in the secure communication.
This work was supported by the National Natural Science Foundation of China (nos. 61004078 and 61273012), China Postdoctoral Science Foundation funded project, and Special Funds for Postdoctoral Innovative Projects of Shandong Province.
- I. Podlubny, Fractional Differential Equations, Academic Press, New York, NY, USA, 1999.
- P. L. Butzer and U. Westphal, An Introduction to Fractional Calculus, World Scientific, Singapore, 2000.
- R. Hilfer, Applications of Fractional Calculus in Physics, World Scientific, Hackensack, NJ, USA, 2001.
- M. Nakagava and K. Sorimachi, “Basic characteristic of a fractance device,” IEICE Transactions on Fundamentals of Electronics, vol. 75, no. 12, pp. 1814–1818, 1992.
- A. Kiani-B, K. Fallahi, N. Pariz, and H. Leung, “A chaotic secure communication scheme using fractional chaotic systems based on an extended fractional Kalman filter,” Communications in Nonlinear Science and Numerical Simulation, vol. 14, no. 3, pp. 863–879, 2009.
- T. T. Hartley, C. F. Lorenzo, and H. K. Qammer, “Chaos in a fractional order Chua's system,” IEEE Transactions on Circuits and Systems I, vol. 42, no. 8, pp. 485–490, 1995.
- Y. Yu, H.-X. Li, S. Wang, and J. Yu, “Dynamic analysis of a fractional-order Lorenz chaotic system,” Chaos, Solitons and Fractals, vol. 42, no. 2, pp. 1181–1189, 2009.
- C. Li and G. Peng, “Chaos in Chen's system with a fractional order,” Chaos, Solitons and Fractals, vol. 22, no. 2, pp. 443–450, 2004.
- C. Li and G. Chen, “Chaos and hyperchaos in the fractional-order Rössler equations,” Physica A, vol. 341, no. 1–4, pp. 55–61, 2004.
- C. P. Li and Y. T. Ma, “Fractional dynamical system and its linearization theorem,” Nonlinear Dynamics, vol. 71, no. 4, pp. 621–633, 2013.
- C. Li, Z. Gong, D. Qian, and Y. Chen, “On the bound of the Lyapunov exponents for the fractional differential systems,” Chaos, vol. 20, no. 1, Article ID 013127, 2010.
- V. Daftardar-Gejji and S. Bhalekar, “Chaos in fractional ordered Liu system,” Computers and Mathematics with Applications, vol. 59, no. 3, pp. 1117–1127, 2010.
- J. G. Lu, “Chaotic dynamics and synchronization of fractional-order Arneodo's systems,” Chaos, Solitons and Fractals, vol. 26, no. 4, pp. 1125–1133, 2005.
- W.-C. Chen, “Nonlinear dynamics and chaos in a fractional-order financial system,” Chaos, Solitons and Fractals, vol. 36, no. 5, pp. 1305–1314, 2008.
- M.-F. Danca, “Chaotic behavior of a class of discontinuous dynamical systems of fractional-order,” Nonlinear Dynamics, vol. 60, no. 4, pp. 525–534, 2010.
- J. H. Park, “On global stability criterion for neural networks with discrete and distributed delays,” Chaos, Solitons and Fractals, vol. 30, no. 4, pp. 897–902, 2006.
- S. Xu, J. Lam, and D. W. C. Ho, “A new LMI condition for delay-dependent asymptotic stability of delayed Hopfield neural networks,” IEEE Transactions on Circuits and Systems II, vol. 53, no. 3, pp. 230–234, 2006.
- X. Liao, K.-W. Wong, Z. Wu, and G. Chen, “Novel robust stability criteria for interval-delayed Hopfield neural networks,” IEEE Transactions on Circuits and Systems I, vol. 48, no. 11, pp. 1355–1359, 2001.
- S. Mou, H. Gao, J. Lam, and W. Qiang, “A new criterion of delay-dependent asymptotic stability for Hopfield neural networks with time delay,” IEEE Transactions on Neural Networks, vol. 19, no. 3, pp. 532–535, 2008.
- H. Hu, H. Jiang, and Z. Teng, “The boundedness of high-order Hopfield neural networks with variable delays,” Neurocomputing, vol. 73, no. 13–15, pp. 2589–2596, 2010.
- X. X. Liao, J. Wang, and Z. Zeng, “Global asymptotic stability and global exponential stability of delayed cellular neural networks,” IEEE Transactions on Circuits and Systems II, vol. 52, no. 7, pp. 403–409, 2005.
- J. L. Qiu, “Dynamics of high-order Hopfield neural networks with time delays,” Neurocomputing, vol. 73, no. 4–6, pp. 820–826, 2010.
- H. T. Lu, “Chaotic attractors in delayed neural networks,” Physics Letters A, vol. 298, no. 2-3, pp. 109–116, 2002.
- Q. Li, X.-S. Yang, and F. Yang, “Hyperchaos in Hopfield-type neural networks,” Neurocomputing, vol. 67, no. 1–4, pp. 275–280, 2005.
- M. Gilli, “Strange attractors in delayed cellular neural networks,” IEEE Transactions on Circuits and Systems I, vol. 40, no. 11, pp. 849–853, 1993.
- B. N. Lundstrom, M. H. Higgs, W. J. Spain, and A. L. Fairhall, “Fractional differentiation by neocortical pyramidal neurons,” Nature Neuroscience, vol. 11, no. 11, pp. 1335–1342, 2008.
- P. Arena, R. Caponetto, L. Fortuna, and D. Porto, “Bifurcation and chaos in noninteger order cellular neural networks,” International Journal of Bifurcation and Chaos in Applied Sciences and Engineering, vol. 8, no. 7, pp. 1527–1539, 1998.
- I. Petráš, “A note on the fractional-order cellular neural networks,” in Proceedings of the International Joint Conference on Neural Networks, pp. 1021–1024, Sheraton Vancouver Wall Centre Hotel, Vancouver, Canada, July 2006.
- P. Arena, L. Fortuna, and D. Porto, “Chaotic behavior in noninteger-order cellular neural networks,” Physical Review E, vol. 61, no. 1, pp. 776–781, 2000.
- X. Huang, Z. Zhao, Z. Wang, and Y. Li, “Chaos and hyperchaos in fractional-order cellular neural networks,” Neurocomputing, vol. 94, pp. 13–21, 2012.
- E. Kaslik and S. Sivasundaram, “Nonlinear dynamics and chaos in fractional-order neural networks,” Neural Networks, vol. 32, pp. 245–256, 2012.
- V. Çelik and Y. Demir, “Chaotic fractional order delayed cellular neural network,” New Trends in Nanotechnology and Fractional Calculus Applications, vol. 4, pp. 313–320, 2010.
- I. Tejado, S. H. Hosseinnia, B. M. Vinagre, X. Song, and Y. Chen, “Dealing with fractional dynamics of IP network delays,” International Journal of Bifurcation and Chaos, vol. 22, no. 4, Article ID 1250089, 2012.
- K. Diethelm, N. J. Ford, and A. D. Freed, “A predictor-corrector approach for the numerical solution of fractional differential equations,” Nonlinear Dynamics, vol. 29, no. 1–4, pp. 3–22, 2002.
- K. Diethelm, N. J. Ford, and A. D. Freed, “Detailed error analysis for a fractional Adams method,” Numerical Algorithms, vol. 36, no. 1, pp. 31–52, 2004.
- S. Bhalekar, V. Daftardar-Gejji, D. Baleanu, and R. Magin, “Fractional Bloch equation with delay,” Computers and Mathematics with Applications, vol. 61, no. 5, pp. 1355–1365, 2011.
- S. Abbas, “Existence of solutions to fractional order ordinary and delay differential equations and applications,” Electronic Journal of Differential Equations, vol. 2011, no. 9, pp. 1–11, 2011.
Copyright © 2013 Xia Huang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.