Research Article | Open Access
Multistability in a Multidirectional Associative Memory Neural Network with Delays
This paper focuses on the multidirectional associative memory (MAM) neural networks with m fields which is more advanced to realize associative memory. Based on the Brouwer fixed point theorem and Dini upper right derivative, it is confirmed that the multidirectional associative memory neural network can have equilibria and equilibria of them are stable, where l is a parameter associated with the number of neurons. Furthermore, an example is given to illustrate the effectiveness of the results.
The Hopfield neural network was introduced by Hopfield in 1982, which introduced the climax of the research on the neural networks. This network was extended to bidirectional associative memory (BAM) neural network by Kosko in 1987  and to multidirectional associative memory (MAM) neural network by Hagiwara in 1990 . They all can realize associative memory. But by using the MAM neural networks, one can achieve the many-to-many association which is a very advanced function of human brain. The many-to-many association has found wide applications in image denoising, speech recognition, pattern recognition, and intelligent information processing [2–6]. For example, it was shown that today most Indians are derived from the two-ancestor group gene by DNA analyzing . If we need to distinguish which category an Indian belongs to, then this is a many-to-many associative problem.
In the designing of the associative memory neural networks to achieve associative memory, it is necessary to ensure their stability. The stability of Hopfield neural networks and BAM neural networks is discussed in a lot of recently published literature works [8–12], but the researchers about MAM neural networks are mainly focused on learning algorithms, fault tolerance, and retrieval efficiency of MAM neural networks [3–6]. To the best of our knowledge, the research on the theory of MAM neural networks was reported only in a few papers [13–18]. Chen et al. proved the stability of some specific types of MAM neural networks in [13, 14]. We studied the existence and global exponential stability of equilibrium for MAM neural networks with constant delays or time-varying delays in [15, 16]. We also obtained a sufficient condition for the global exponential stability of the discrete-time multidirectional associative memory neural network with variable delays in .
The multistability of a neural network describes coexistence of multiple stable patterns such as equilibria or periodic orbits. In recent years, the multistability issue of neural networks is discussed in some papers [18–32]. In , we discussed the existence and the exponential stability of multiple periodic solutions for an MAM neural network. The neural networks with a class of nondecreasing piecewise linear activation functions with corner points were investigated in . It was proposed that the -neuron dynamical systems can have and only have equilibria under some conditions, of which are locally exponentially stable and others are unstable. A class of neural networks with Mexican-hat-type activation functions was discussed in . A set of new sufficient conditions were presented to ensure the multistability of the neural networks. The cellular neural networks with time-varying unbounded delays (DCNNs) were discussed in . Under some conditions, it showed that the DCNNs can exhibit equilibrium points. In , Huang and Cao found that the -dimensional networks can have equilibria and of them are locally exponentially stable. In , with perturbation techniques and the Floquet theory, Campbell et al. discussed the multistability and stable asynchronous periodic oscillations for a network of three identical neurons with multiple discrete signal transmission delays. The possible codimension one bifurcations which occur in the system were determined. In , Cheng et al. presented the existence of stationary solutions for a general -dimensional delayed neural network with several classes of activation functions. It was shown that a two-dimensional neural network has isolated equilibria points which are locally stable, where the activation function has segments. Furthermore, evoked by periodic external input, periodic orbits which are locally exponentially attractive were found . Some similar results were found on -neuron Cohen-Grossberg neural networks (CGNNs) with time-varying delays and a general class of activation functions . In [29, 30], the multistability and multiperiodicity issues were discussed for competitive neural networks and high-order competitive neural networks. In , the stability of multiple equilibria of neural networks with time-varying delays and concave-convex characteristics was studied. Some sufficient conditions were obtained to ensure that an -neuron neural network with concave-convex characteristics can have a fixed point located in the appointed region. By partitioning the state space, sufficient conditions were established which ensure that -dimensional Cohen-Grossberg neural networks with -level discontinuous activation functions can have equilibrium points or periodic orbits .
Generally, the existence of a globally stable equilibrium point or periodic solutions is necessary in solving optimization problems, but to achieve many-to-many associative memory by using MAM neural network, the system which has a globally stable equilibrium point or a globally stable periodic solution can only associate less information. So we should study the multistability of MAM neural network in order to make it achieve many-to-many associative memory. It is necessary to explore the existence, stability, and convergence speed of multiple equilibria or periodic solutions of MAM neural network. Motivated by the above, in this paper, we study the multistability issue for a delayed MAM neural network with fields and neurous in the field as follows: where , , denotes the membrane voltage of the th neuron in the field at time , denotes the decay rate of the th neuron in the field , is the neuronal activation function of the th neuron in the field , is the connection weight from the th neuron in the field to the th neuron in the field , is the external input of the th neuron in the field , and is the time delay of the synapse from the neuron in the field to the th neuron in the field .
Set . The initial conditions with (1) are of the forms where , , and are continuous functions.
This paper is organized as follows. In the next section, we discuss the existence of multiple equilibria by using the Brouwer fixed point theorem. In Section 3, we analyze the exponential stability of every equilibrium. An example is given to illustrate the effectiveness of our results in Section 4. Finally, conclusions are given in Section 5.
2. Existence of Multiple Equilibria
In this section, we consider the existence of multiple equilibria by using the Brouwer fixed point theorem. Since the existence and stability of stationary patterns for neural networks certainly depend on the characteristics of activation functions, we assume the activation functions () satisfy the following condition: (H1) are continuous, increasing and there exist such that for .
For convenience, we give some notations as follows:
For any , , define
We consider the second parameter condition which is used to establish existence of multiple equilibria for systems (1). (H2) For any , the weights , and there exist two points , , where , such that(1)if , then , , , ;(2)if , then , , , .
The configuration that motivates (H2) is depicted in Figure 1. Under the above assumptions, if , then there are three crossing points , , and of the curves , , and there are three crossing points , , and of the curves , (see Figure 1(a)), where
If , then there are three crossing points , , and of the curves , , and there are three crossing points , , and of the curves , (see Figure 1(b)), where
Furthermore, it is easy to confirm that , for any , , and .
Theorem 1. Under conditions (H1) and (H2), there are at least equilibria of the multidirectional associative memory neural network (1).
where , , , or , and
Obviously, they are disjoint closed regions, and for any , , .
For any fixed and a given , we study this problem on the following two cases.
Case 1 (). Consider the following equations: It follows from (10) that Similarly, from (10), we also can obtain that So the curve of (10) is between the curves of and .
Under similar analysis we can obtain that the curve of (11) is between the curves of and . So we can affirm that there are at least three solutions of (10) and (11); each solution lies separately in , , and . Get one that is in , and denote it by .
Case 2 (). Let Then
From the two cases above, we can obtain for any given . Set . It is obvious that . Set mapping as follows: Because are continuous mappings, so is continuous mapping. By the Brouwer fixed point theorem, there is at least one fixed point of , that is, zero point of (1) in . Therefore, there are at least equilibria of the multidirectional associative memory neural network (1).
3. Stability Analysis
In this section, the stability of the equilibria is considered. Set with or .
We consider the following subsets of : where
Lemma 2. Under assumptions (H1) and (H2), each is a positive invariant set with respect to the solution flow generated by system (1).
Proof. For any given and any initial condition , let be the solution of (1) with initial condition .
For any , and any , from (1), we obtain that Multiplying both sides of (20) by , we have Integrating (21) over , we obtain Hence it follows that, for , Therefore, for any given initial condition , we have, for , That is, for .
We claim that remains in for any . If it is not true, there exist and that firstly (or one of the first) escapes from .
Case 1 (). If , then exists , such that is on the edges of , and for any , , . If , , then Therefore, cannot escape from through the edge of , . With similar proof, we can obtain that cannot escape from through the other three edges. Hence cannot escape from . We can also prove that cannot escape from .
Case 2 . The proof is similar to that of Case 1.
This completes the proof.
We give the criterions concerning the stability for the multiple equilibria of system (1). (H3) There exist constants ( and ) such that for each in a subset , where is defined as follows: (H4) For any , it is satisfied that
Theorem 3. There are exponential stability equilibria of the multidirectional associative memory neural network (1), if the conditions (H1)–(H4) hold.
Proof. According to Theorem 1, for any , the multidirectional associative memory neural network (1) has an equilibrium in ; let it be . According to Lemma 2, for any , the solution of the multidirectional associative memory neural network (1) is in under initial condition . Let
System (1) becomes
According to condition , there exists such that Define that , for and . It is obvious that . Denote Let be an arbitrary real number. For any , , , it is easy to obtain that . We shall prove that for , , and any . Suppose this is not the case; then there exist , , and a time such that for . From (30), we derive that Hence, from (31) and (34), which is contradicting . Hence the inequality (33) holds. Since is arbitrary, by allowing , we have . Therefore, is exponentially convergent to .
Remark 4. The dynamic system (1) studied in this paper is different from the system in . First, the coefficients of system (1) are constants, which are -periodic functions in . Second, the delays of system (1) are constant delays while they are distributed delays in . Above all, our conclusions in this paper are different from those in , and the proof methods are different. In , we obtained the existence of exponentially stable -periodic solutions, where if is an even number or if is an odd number. But we obtain the existence of equilibria by Theorem 1 and the exponential stability of equilibria of them by Theorem 3. Because , so . It follows that . Therefore, the number of equilibria obtained in this paper is more than that of  if the conclusions of  are used to the constant coefficient system (1).
4. Numerical Example
In this section, a numerical example is given to illustrate the validity of results. Consider an MAM neural network with three fields as follows: where , , the neuronal signal decay rates , the external input , , , , , the connection weights and the delays
The neuronal activation functions are continuous, increasing, and bounded functions, and there are such that . Hence condition (H1) is satisfied.
Obviously, , , , and . Through calculations, we have There exist four points, , and , where , , such that Hence condition (H2) holds. The curves , have three crossing points , , and , and the curves , have three crossing points , , and . The curves have three crossing points , , and , and the curves , have three crossing points , , and . From (27), we obtain the subsets
Because the activation functions are differentiable, we can let ; then , , , , and . By Lagrange's mean value theorem, condition (H3) holds. Through calculations we have Hence condition (H4) holds. Then by Theorems 1 and 3, the MAM neural network (36) has equilibria, and of these equilibria are exponentially stable.
The dynamics of the MAM neural network system (36) are illustrated in Figures 2 and 3. Evolutions of sixty initial conditions of the MAM neural network system (36) have been tracked in Figure 2, which clearly displays that there exist four stable equilibria of the dynamical system, as confirmed by our theorems. Figure 3 shows the phases of the evolutions from time 5 to time 60 with sixty initial conditions, which shows that each evolution has converged to one of the four stable equilibria at time 60.
In this paper, the multistability has been studied for MAM neural networks. Sufficient conditions are obtained which ensure the existence of equilibria. It is proved that of the equilibria are exponentially stable. In , we have discussed the existence and the exponential stability of multiple periodic solutions for an MAM neural network. Furthermore, the coexistence of multiple stable equilibria and periodic solutions of an MAM neural network is an interesting topic. It will be investigated in the near future.
- B. Kosko, “Adaptove bidirectional associate memories,” Applied Optics, vol. 26, no. 23, pp. 4947–4960, 1987.
- M. Hagiwara, “Multidirectional associative memory,” in Proceedings of the International Joint Conference on Neural Networks, vol. 1, pp. 3–6, Washington, DC, USA, 1990.
- M. Hattori, M. Hagiwara, and M. Nakagawa, “Improved multidirectional associative memories for training sets including common terms,” in Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 172–177, Baltimore, Md, USA, 1992.
- M. Hattori and M. Hagiwara, “Multimodule associative memory for many-to-many associations,” Neurocomputing, vol. 19, no. 1–3, pp. 99–119, 1998.
- M. Hattori and M. Hagiwara, “Associative memory for intelligent control,” Mathematics and Computers in Simulation, vol. 51, no. 3-4, pp. 349–374, 2000.
- J. Huang and M. Hagiwara, “A combined multi-winner multidirectional associative memory,” Neurocomputing, vol. 48, no. 1–4, pp. 369–389, 2002.
- D. Reich, K. Thangaraj, N. Patterson, A. L. Price, and L. Singh, “Reconstructing Indian population history,” Nature, vol. 461, no. 7263, pp. 489–494, 2009.
- P. van den Driessche and X. Zou, “Global attractivity in delayed Hopfield neural network models,” SIAM Journal on Applied Mathematics, vol. 58, no. 6, pp. 1878–1890, 1998.
- H. Zhao, “Global asymptotic stability of Hopfield neural network involving distributed delays,” Neural Networks, vol. 17, no. 1, pp. 47–53, 2004.
- Y. Song, M. Han, and J. Wei, “Stability and Hopf bifurcation analysis on a simplified BAM neural network with delays,” Physica D, vol. 200, no. 3-4, pp. 185–204, 2005.
- A. Chen, J. Cao, and L. Huang, “Exponential stability of BAM neural networks with transmission delays,” Neurocomputing, vol. 57, no. 1–4, pp. 435–454, 2004.
- Q. Song, Z. Zhao, and Y. Li, “Global exponential stability of BAM neural networks with distributed delays and reaction-diffusion terms,” Physics Letters A, vol. 335, no. 2-3, pp. 213–225, 2005.
- S. Chen and H. Gao, “Multivalued exponential multidirectional associative memory,” Chinese Journal Software, vol. 9, pp. 397–400, 1998.
- L. Chen, S.-C. Chen, and D.-Q. Zhang, “Small world structure inspired many to many kernel associative memory models and their application,” Journal of Software, vol. 17, no. 2, pp. 223–231, 2006.
- T. Zhou, M. Wang, H. Fang, and X. Li, “Global exponential stability of MAM neural network with time delays,” in Proceedings of the 5th International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA '10), pp. 6–10, Changsha, China, September 2010.
- M. Wang, T. Zhou, and H. Fang, “Global exponential stability of MAM neural network with time-varying delays,” in Proceedings of the International Conference on Computational Intelligence and Software Engineering (CiSE '10), pp. 1–4, Wuhan, China, December 2010.
- M. Wang, T. Zhou, and X. Zhang, “Global exponential stability of discretetime multidirectional associative memory neural network with variable delays,” ISRN Discrete Mathematics, vol. 2012, Article ID 831715, 10 pages, 2012.
- T. Zhou, M. Wang, and M. Long, “Existence and exponential stability of multiple periodic solutions for a multidirectional associative memory neural network,” Neural Processing Letters, vol. 34, no. 2, pp. 187–202, 2012.
- L. Wang and T. Chen, “Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions,” Neural Networks, vol. 23, no. 2, pp. 189–200, 2010.
- L. Wang, W. Lu, and T. Chen, “Multistability of neural networks with Mexican-hat-type activation functions,” IEEE Transactions Neural Networks Learning Systems, vol. 23, no. 11, pp. 1816–1826, 2012.
- T. Chen and L. Wang, “Complete stability of cellular neural networks with unbounded time-varying delays,” Neural Networks, vol. 36, pp. 11–17, 2012.
- G. Huang and J. Cao, “Multistability in bidirectional associative memory neural networks,” Physics Letters A, vol. 372, no. 16, pp. 2842–2854, 2008.
- Y. Huang, H. Zhang, and Z. Wang, “Dynamical stability analysis of multiple equilibrium points in time-varying delayed recurrent neural networks with discontinuous activation functions,” Neurocomputing, vol. 91, pp. 21–28, 2012.
- S. A. Campbell, I. Ncube, and J. Wu, “Multistability and stable asynchronous periodic oscillations in a multiple-delayed neural system,” Physica D, vol. 214, no. 2, pp. 101–119, 2006.
- C.-Y. Cheng, K.-H. Lin, and C.-W. Shih, “Multistability and convergence in delayed neural networks,” Physica D, vol. 225, no. 1, pp. 61–74, 2007.
- G. Huang and J. Cao, “Multistability of neural networks with discontinuous activation function,” Communications in Nonlinear Science and Numerical Simulation, vol. 13, no. 10, pp. 2279–2289, 2008.
- J. Cao, G. Feng, and Y. Wang, “Multistability and multiperiodicity of delayed Cohen-Grossberg neural networks with a general class of activation functions,” Physica D, vol. 237, no. 13, pp. 1734–1749, 2008.
- L. Chandrasekaran, V. Matveev, and A. Bose, “Multistability of clustered states in a globally inhibitory network,” Physica D, vol. 238, no. 3, pp. 253–263, 2009.
- X. Nie and J. Cao, “Multistability of competitive neural networks with time-varying and distributed delays,” Nonlinear Analysis: Real World Applications, vol. 10, no. 2, pp. 928–942, 2009.
- X. Nie and Z. Huang, “Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions,” Neurocomputing, vol. 82, pp. 1–13, 2012.
- Z. Zeng and W. Zheng, “Multistability of neural networks with time-varying delays and concave-convex characteristics,” IEEE Transactions on Neural Networks and Learning System, vol. 23, no. 2, pp. 293–305, 2012.
- Y. Du, Y. Li, and R. Xu, “Multistability and multiperiodicity for a general class of delayed Cohen-Grossberg neural networks with discontinuous activation functions,” Discrete Dynamics in Nature and Society, Article ID 917835, 11 pages, 2013.
Copyright © 2013 Min Wang and Tiejun Zhou. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.