## Stability Analysis Including Monostability and Multistability in Dynamical System and Applications

View this Special IssueResearch Article | Open Access

# Dynamical Behaviors of the Stochastic Hopfield Neural Networks with Mixed Time Delays

**Academic Editor:**Kelin Li

#### Abstract

This paper investigates dynamical behaviors of the stochastic Hopfield neural networks with mixed time delays. The mixed time delays under consideration comprise both the discrete time-varying delays and the distributed time-delays. By employing the theory of stochastic functional differential equations and linear matrix inequality (LMI) approach, some novel criteria on asymptotic stability, ultimate boundedness, and weak attractor are derived. Finally, a numerical example is given to illustrate the correctness and effectiveness of our theoretical results.

#### 1. Introduction

The well-known Hopfield neural networks were firstly introduced by Hopfield [1, 2] in early 1980s. Since then, both the mathematical analysis and practical applications of Hopfield neural networks have gained considerable research attention. The Hopfield neural networks have already been successfully applied in many different areas such as combinatorial optimization, knowledge acquisition, and pattern recognition, see, for example, [3–5]. In both the biological and artificial neural networks, the interactions between neurons are generally asynchronous, which give rise to the inevitable signal transmission delays. Also, in electronic implementation of analog neural networks, time delay is usually time-varying due to the finite switching speed of amplifiers. Note that continuously distributed delays have gained particular attention, since a neural network usually has a spatial nature due to the presence of an amount of parallel pathways of a variety of axon sizes and lengths.

Recently, it has been well recognized that stochastic disturbances are ubiquitous and inevitable in various systems, ranging from electronic implementations to biochemical systems, which are mainly caused by thermal noise and environmental fluctuations as well as different orders of ongoing events in the overall systems [6, 7]. Therefore, considerable attentions have been paid to investigate the dynamics of stochastic neural networks, and many results on stochastic neural networks with delays have been reported in the literature, see, for example, [8–30] and references therein. Among which, some sufficient criteria on the stability of uncertain stochastic neural networks were derived in [8–10]. Almost sure exponential stability of stochastic neural networks was discussed in [11–15]. In [16–22], mean square exponential stability and pth moment exponential stability of stochastic neural networks were investigated; Some sufficient criteria on the exponential stability for impulsive stochastic neural networks were established in [23–26]. In [27], the stability of discrete-time stochastic neural networks was analyzed, while exponential stability of stochastic neural networks with Markovian jump parameters is investigated in [28–30]. These references mainly considered the stability of equilibrium point of stochastic neural networks. What do we study when the equilibrium point does not exist?

Except for stability property, boundedness and attractor are also foundational concepts of dynamical systems. They play an important role in investigating the uniqueness of equilibrium, global asymptotic stability, global exponential stability, the existence of periodic solution, its control and synchronization [31, 32], and so on. Recently, ultimate boundedness and attractor of several classes of neural networks with time delays have been reported. Some sufficient criteria were derived in [33, 34], but these results hold only under constant delays. Following, in [35], the globally robust ultimate boundedness of integrodifferential neural networks with uncertainties and varying delays was studied. After that, some sufficient criteria on the ultimate boundedness of neural networks with both varying and unbounded delays were derived in [36], but the concerned systems are deterministic ones. In [37, 38], a series of criteria on the boundedness, global exponential stability, and the existence of periodic solution for nonautonomous recurrent neural networks were established. In [39–41], the ultimate boundedness and attractor of the stochastic Hopfield neural networks with time-varying delays were discussed. To the best of our knowledge, for stochastic neural networks with mixed time delays, there are few published results on the ultimate boundedness and weak attractor. Therefore, the arising questions about the ultimate boundedness, weak attractor, and asymptotic stability of the stochastic Hopfield neural networks with mixed time delays are important yet meaningful.

The left of the paper is organized as follows and some preliminaries are in Section 2, Section 3 presents our main results, a numerical example and conclusions will be in Sections 4 and 5, respectively.

#### 2. Preliminaries

Consider the following stochastic Hopfield neural networks with mixed time delays: where is the state vector associated with the neurons, , represents the rate with which the th unit will reset its potential to the resting state in isolation when being disconnected from the network and the external stochastic perturbation; , and represent the connection weight matrix; , denotes the external bias on the th unit; and denote activation functions, , ; are the diffusion coefficient matrices; is one-dimensional Brownian motion defined on a complete probability space with a natural filtration generated by ; there exists a positive constant such that the transmission delay satisfies

The initial conditions are given in the following form: where is -valued function, -measurable -valued random variable satisfying is the Euclidean norm, and is the space of all continuous -valued functions defined on .

Let , , where Then system (1) can be written by Throughout this paper, the following assumption will be considered.

(A1) There exist constants , , and such that

*Remark 1. *It follows from [42] that under the assumption (A1), system (1) has a global solution on . Moreover, under assumption 1, it is not difficult to prove that and satisfy the local Lipschitz condition in [43].

*Remark 2. *We note that assumption (A1) is less conservative than that in [8, 9, 39], since the constants , , and are allowed to be positive, negative numbers, or zeros.

The notation (resp., ) means that matrix is symmetric positive definite (resp., positive semidefinite). denotes the transpose of the matrix . represents the minimum eigenvalue of matrix . Denote by the family of continuous functions from to . Let be the family of all continuous nonnegative functions defined on such that they are continuously twice differentiable in and once in . Given , we define the functional by where and .

The following lemmas will be used in establishing our main results.

Lemma 3 (see [44]). *For any positive definite matrix , scalar , vector function such that the integrations concerned are well defined, and the following inequality holds:
*

Lemma 4 (see [43]). *Suppose that system (5) satisfies the local Lipschitz condition and the following assumptions hold. *(A2)* There are two functions and and two probability measures and on such that
* *while for all ,
* *where , and . *(A3) *If there is a pair of positive constants and such that
* *Then the unique global solution to system (5) obeys
* *where while and is the unique root to the following equation:
**
If, furthermore, , then
*

#### 3. Main Results

Theorem 5. *Suppose that there exist some matrices , and positive constants , , such that and
**
where , , , , , , , , , means the symmetric terms.**Then, the following results hold.*(i)* System (1) is stochastically ultimately bounded; that is, for any , there exists a positive constant such that the solution of system (1) satisfies
*(ii)*If , where is the same as defined in Lemma 4,
**
then
*

*Proof. *Let the Lyapunov function . Applying Itô’s formula in [42] to along with system (1), one may obtain the following:
where
From Lemma 3, it follows that
From (A1), it follows that for ,
Similarly, one derives that

Further from (20)–(23), one derives
where , , , , , , ,
Let , , , , . Then it follows from Lemma 4 that
where is the same as defined in Lemma 4,
Therefore, for any , it follows from Chebyshev’s inequality that
If, furthermore, , then it follows from Lemma 4 that (ii) holds.

Theorem 5 shows that there exists such that for any , . Let denote by Clearly, is closed, bounded, and invariant. Moreover, with no less than probability , which means that attracts the solutions infinitely many times with no less than probability , so we may say that is a weak attractor for the solutions.

Theorem 6. *Suppose that all conditions of Theorem 5 hold, then there exists a weak attractor for the solutions of system (1).*

*Remark 7. *Compared with [39–41], assumption (A1) is less conservative than that in [39] and system (1) includes mixed time delays, which is more complex than that in [39–41]. In addition, Lemma 4 is firstly used to investigate the dynamical behaviors of stochastic neural networks with mixed time delays. The bound for may be in a much weaker form. Our results do not only deal with the asymptotic moment estimation but also the path wise (almost sure) estimation.

#### 4. Numerical Example

In this section, a numerical example is presented to demonstrate the validity and effectiveness of our theoretical results.

*Example 8. *Consider the following stochastic Hopfield neural networks with mixed time delays:
where , ,
and , is one-dimensional Brownian motion. Then , . By using the Matlab LMI Control Toolbox [45], for , , based on Theorem 5, such system is stochastically ultimately bounded when , , and are chosen as follows:

For , , , we obtain and constant . Then , . For the system in Example 8 (color online), Figure 1(a) shows time trajectories, and Figure 1(b) shows the set and several typical phase portraits, where initial value for is chosen as . In Figure 1(b), only phase portraits for are shown. From Figure 1, one can easily find that these trajectories are almost all attracted by the set .

**(a)**

**(b)**

#### 5. Conclusion

In this paper, by using the theory of stochastic functional differential equations and linear matrix inequality, new results and sufficient criteria on the asymptotic stability, ultimate boundedness, and attractor of stochastic Hopfield neural networks with mixed time delays are established. A numerical example is also presented to demonstrate the correctness of our theoretical results.

#### Acknowledgments

The authors thank the Editor and the Reviewers for their detailed comments and valuable suggestions. This work was supported by the National Natural Science Foundation of China (no. 11271295, 10926128, and 11047114), Science and Technology Research Projects of Hubei Provincial Department of Education (no. Q20111607, Q20111611, D20131602, and D20131604), and Young Talent Cultivation Projects of Guangdong (LYM09134).

#### References

- J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,”
*Proceedings of the National Academy of Sciences of the United States of America*, vol. 79, no. 8, pp. 2554–2558, 1982. View at: Publisher Site | Google Scholar | MathSciNet - J. J. Hopfield, “Neurons with graded response have collective computational properties like those of two-state neurons,”
*Proceedings of the National Academy of Sciences of the United States of America*, vol. 81, no. 10, part 1, pp. 3088–3092, 1984. View at: Google Scholar - W. J. Li and T. Lee, “Hopfield neural networks for affine invariant matching,”
*IEEE Transactions on Neural Networks*, vol. 12, no. 6, pp. 1400–1410, 2001. View at: Publisher Site | Google Scholar - Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,”
*Neural Networks*, vol. 19, no. 5, pp. 667–675, 2006. View at: Publisher Site | Google Scholar - S. S. Young, P. D. Scott, and N. M. Nasrabadi, “Object recognition using multilayer Hopfield neural network,”
*IEEE Transactions on Image Processing*, vol. 6, no. 3, pp. 357–372, 1997. View at: Google Scholar - M. Kærn, T. C. Elston, W. J. Blake, and J. J. Collins, “Stochasticity in gene expression: from theories to phenotypes,”
*Nature Reviews Genetics*, vol. 6, no. 6, pp. 451–464, 2005. View at: Publisher Site | Google Scholar - K. Sriram, S. Soliman, and F. Fages, “Dynamics of the interlocked positive feedback loops explaining the robust epigenetic switching in
*Candida albicans*,”*Journal of Theoretical Biology*, vol. 258, no. 1, pp. 71–88, 2009. View at: Publisher Site | Google Scholar - H. Huang and G. Feng, “Delay-dependent stability for uncertain stochastic neural networks with time-varying delay,”
*Physica A*, vol. 381, no. 1-2, pp. 93–103, 2007. View at: Publisher Site | Google Scholar - W. H. Chen and X. M. Lu, “Mean square exponential stability of uncertain stochastic delayed neural networks,”
*Physics Letters A*, vol. 372, no. 7, pp. 1061–1069, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q. T. Gan and R. Xu, “Global robust exponential stability of uncertain neutral high-order stochastic hopfield neural networks with time-varying delays,”
*Neural Processing Letters*, vol. 32, no. 1, pp. 83–96, 2010. View at: Publisher Site | Google Scholar - H. Y. Zhao, N. Ding, and L. Chen, “Almost sure exponential stability of stochastic fuzzy cellular neural networks with delays,”
*Chaos, Solitons and Fractals*, vol. 40, no. 4, pp. 1653–1659, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. Y. Zhao and N. Ding, “Dynamic analysis of stochastic bidirectional associative memory neural networks with delays,”
*Chaos, Solitons and Fractals*, vol. 32, no. 5, pp. 1692–1702, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - C. Huang and J. D. Cao, “Almost sure exponential stability of stochastic cellular neural networks with unbounded distributed delays,”
*Neurocomputing*, vol. 72, no. 13–15, pp. 3352–3356, 2009. View at: Publisher Site | Google Scholar - C. Huang, P. Chen, Y. He, L. Huang, and W. Tan, “Almost sure exponential stability of delayed Hopfield neural networks,”
*Applied Mathematics Letters*, vol. 21, no. 7, pp. 701–705, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. P. Chen, Y. Chai, and R. C. Wu, “Covergence of stochastic fuzzy Cohen-Grossberg neural networks with reaction-diffusion and distributed delays,”
*Expert Systems with Applications*, vol. 39, no. 5, pp. 5767–5773, 2012. View at: Publisher Site | Google Scholar - C. Huang and J. D. Cao, “On $p$th moment exponential stability of stochastic Cohen-Grossberg neural networks with time-varying delays,”
*Neurocomputing*, vol. 73, no. 4-6, pp. 986–990, 2010. View at: Publisher Site | Google Scholar - C. Huang, Y. He, and H. Wang, “Mean square exponential stability of stochastic recurrent neural networks with time-varying delays,”
*Computers & Mathematics with Applications*, vol. 56, no. 7, pp. 1773–1778, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - R. Rakkiyappan and P. Balasubramaniam, “Delay-dependent asymptotic stability for stochastic delayed recurrent neural networks with time varying delays,”
*Applied Mathematics and Computation*, vol. 198, no. 2, pp. 526–533, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Ma and F. P. Da, “Mean-square exponential stability of stochastic Hopfield neural networks with time-varying discrete and distributed delays,”
*Physics Letters A*, vol. 373, no. 25, pp. 2154–2161, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y. Sun and J. D. Cao, “$p$th moment exponential stability of stochastic recurrent neural networks with time-varying delays,”
*Nonlinear Analysis: Real World Applications*, vol. 8, no. 4, pp. 1171–1185, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q. Song and Z. Wang, “Stability analysis of impulsive stochastic Cohen-Grossberg neural networks with mixed time delays,”
*Physica A*, vol. 387, no. 13, pp. 3314–3326, 2008. View at: Publisher Site | Google Scholar - Z. Wang, J. Fang, and X. Liu, “Global stability of stochastic high-order neural networks with discrete and distributed delays,”
*Chaos, Solitons and Fractals*, vol. 36, no. 2, pp. 388–396, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. D. Li and X. L. Fu, “Global asymptotic stability of stochastic Cohen-Grossberg-type BAM neural networks with mixed delays: an LMI approach,”
*Journal of Computational and Applied Mathematics*, vol. 235, no. 12, pp. 3385–3394, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. D. Li, “Existence and global exponential stability of periodic solution for delayed neural networks with impulsive and stochastic effects,”
*Neurocomputing*, vol. 73, no. 4-6, pp. 749–758, 2010. View at: Publisher Site | Google Scholar - X. L. Fu and X. D. Li, “LMI conditions for stability of impulsive stochastic Cohen-Grossberg neural networks with mixed delays,”
*Communications in Nonlinear Science and Numerical Simulation*, vol. 16, no. 1, pp. 435–454, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - C. H. Wang, Y. G. Kao, and G. W. Yang, “Exponential stability of impulsive stochastic fuzzy reactiondiffusion Cohen-Grossberg neural networks with mixed delays,”
*Neurocomputing*, vol. 89, pp. 55–63, 2012. View at: Publisher Site | Google Scholar - Y. Ou, H. Y. Liu, Y. L. Si, and Z. G. Feng, “Stability analysis of discrete-time stochastic neural networks with time-varying delays,”
*Neurocomputing*, vol. 73, no. 4–6, pp. 740–748, 2010. View at: Publisher Site | Google Scholar - Q. Zhu and J. Cao, “Exponential stability of stochastic neural networks with both Markovian jump parameters and mixed time delays,”
*IEEE Transactions on Systems, Man, and Cybernetics B*, vol. 41, no. 2, pp. 341–353, 2011. View at: Publisher Site | Google Scholar - Q. Zhu, C. Huang, and X. Yang, “Exponential stability for stochastic jumping BAM neural networks with time-varying and distributed delays,”
*Nonlinear Analysis: Hybrid Systems*, vol. 5, no. 1, pp. 52–77, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - J. K. Tian, Y. M. Li, J. Z. Zhao, and S. M. Zhong, “Delay-dependent stochastic stability criteria for Markovian jumping neural networks with mode-dependent time-varying delays and partially known transition rates,”
*Applied Mathematics and Computation*, vol. 218, no. 9, pp. 5769–5781, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - P. Wang, D. Li, and Q. Hu, “Bounds of the hyper-chaotic Lorenz-Stenflo system,”
*Communications in Nonlinear Science and Numerical Simulation*, vol. 15, no. 9, pp. 2514–2520, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - P. Wang, D. Li, X. Wu, J. Lü, and X. Yu, “Ultimate bound estimation of a class of high dimensional quadratic autonomous dynamical systems,”
*International Journal of Bifurcation and Chaos*, vol. 21, no. 9, article 2679, 2011. View at: Publisher Site | Google Scholar - X. Liao and J. Wang, “Global dissipativity of continuous-time recurrent neural networks with time delay,”
*Physical Review E*, vol. 68, no. 1, Article ID 016118, 7 pages, 2003. View at: Publisher Site | Google Scholar | MathSciNet - S. Arik, “On the global dissipativity of dynamical neural networks with time delays,”
*Physics Letters A*, vol. 326, no. 1-2, pp. 126–132, 2004. View at: Publisher Site | Google Scholar - X. Y. Lou and B. T. Cui, “Global robust dissipativity for integro-differential systems modeling neural networks with delays,”
*Chaos, Solitons and Fractals*, vol. 36, no. 2, pp. 469–478, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q. Song and Z. Zhao, “Global dissipativity of neural networks with both variable and unbounded delays,”
*Chaos, Solitons and Fractals*, vol. 25, no. 2, pp. 393–401, 2005. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. Jiang and Z. Teng, “Global eponential stability of cellular neural networks with time-varying coefficients and delays,”
*Neural Networks*, vol. 17, no. 10, pp. 1415–1425, 2004. View at: Publisher Site | Google Scholar - H. Jiang and Z. Teng, “Boundedness, periodic solutions and global stability for cellular neural networks with variable coefficients and infinite delays,”
*Neurocomputing*, vol. 72, no. 10–12, pp. 2455–2463, 2009. View at: Publisher Site | Google Scholar - L. Wan and Q. H. Zhou, “Attractor and ultimate boundedness for stochastic cellular neural networks with delays,”
*Nonlinear Analysis: Real World Applications*, vol. 12, no. 5, pp. 2561–2566, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Wan, Q. H. Zhou, and P. Wang, “Ultimate boundedness of stochastic Hopfield neural networks with time-varying delays,”
*Neurocomputing*, vol. 74, no. 17, pp. 2967–2971, 2011. View at: Publisher Site | Google Scholar - L. Wan, Q. H. Zhou, P. Wang, and J. Li, “Ultimate boundedness and an attractor for stochastic Hopfield neural networks with time-varying delays,”
*Nonlinear Analysis: Real World Applications*, vol. 13, no. 2, pp. 953–958, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. Mao,
*Stochastic Differential Equations and Applications*, Horwood Limited, Chichester, UK, 1997. View at: MathSciNet - Q. Luo, X. R. Mao, and Y. Shen, “Generalised theory on asymptotic stability and boundedness of stochastic functional differential equations,”
*Automatica*, vol. 47, no. 9, pp. 2075–2081, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - K. Gu, “An integral inequality in the stability problem of time-delay systems,” in
*Proceedings of the 39th IEEE Confernce on Decision and Control*, pp. 2805–2810, Sydney, Australia, December 2000. View at: Google Scholar - P. Gahinet, A. Nemirovski, A. J. Laub, and M. Chilali,
*LMI Control Toolbox User'S Guide*, MathWorks, 1995.

#### Copyright

Copyright © 2013 Li Wan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.