Discrete Dynamics in Nature and Society

Volume 2011 (2011), Article ID 713502, 20 pages

http://dx.doi.org/10.1155/2011/713502

## Synchronization of Discrete-Time Stochastic Neural Networks with Random Delay

Department of Mathematics, Southeast University, Nanjing 210096, China

Received 2 December 2010; Accepted 25 January 2011

Academic Editor: Recai Kilic

Copyright © 2011 Haibo Bao and Jinde Cao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

By using a Lyapunov-Krasovskii functional method and the stochastic analysis technique, we investigate the problem of synchronization for discrete-time stochastic neural networks (DSNNs) with random delays. A control law is designed, and sufficient conditions are established that guarantee the synchronization of two identical DSNNs with random delays. Compared with the previous works, the time delay is assumed to be existent in a random fashion. The stochastic disturbances are described in terms of a Brownian motion and the time-varying delay is characterized by introducing a Bernoulli stochastic variable. Two examples are given to illustrate the effectiveness of the proposed results. The main contribution of this paper is that the obtained results are dependent on not only the bound but also the distribution probability of the time delay. Moreover, our results provide a larger allowance variation range of the delay, and are less conservative than the traditional delay-independent ones.

#### 1. Introduction

Synchronization is one of the most important dynamic behavior of complex networks, which means if two or more systems have something in common, they will adjust each other to give rise to a common dynamical behavior. It has been found applications in many fields such as synchronous information exchange in the Internet WWW, crickets chirping in synchrony, rhythmic applause, and synchronous transfer of digital or analog signals in the communication networks.

Since the pioneering works of Pecora and Carroll [1, 2], the control and synchronization problems have become an active topic that attracts a lot of researchers' interest, including general complex dynamical networks [3–8], and the array of coupled neural networks with or without delays [6, 9–11]. Several different approaches have been proposed for the synchronization of chaotic systems, such as linear and nonlinear feedback control [12, 13], adaptive control [14], impulsive control [15], and intermittent linear state feedback [16].

Itô-type stochastic systems are well known for their important impact on practical applications such as chemistry, biology, ecology, control, and information systems. In real complex networks, the signal transmission could be a noisy process brought by random fluctuations from the release of probabilistic causes such as neurotransmitters. Stochastic neural networks, as a special case of complex networks, have gained much more researchers' interests; see for example, [4, 5, 13, 15, 17, 18] and the references therein.

Discrete-time neural networks play a more and more important role in engineering application. As pointed out in [19–21], the discretization cannot preserve the dynamics of continuous-time counterpart even for a small sampling period. Recently, the synchronization problem for discrete-time networks has received more attention [4, 5, 15, 22].

Time delays occur frequently in practical situations, it can cause undesirable dynamic network behaviors such as oscillation and instability. Therefore, dynamical behavior [23, 24], especially synchronization problem for discrete-time neural networks with constant and time-varying delays has gained interesting research attention; see, for example, [4, 5, 15, 22]. It is worth mentioning that as a particular kind of time delays, random delays have also received much researchers' attention [25–31]. This is mainly because in many real systems, some values of the delay are very large, but the variation range of time delay taking such large values are very small. In this case, if only the variation range of time delay is employed to derive the criteria, the results may be somewhat more conservative.

Inspired by the above discussion, the aim of this paper is to study the synchronization problem for a class of DSNNs with random delay. The effect of both variation range and distribution probability of the time delay are taken into account in the proposed approach. The stochastic disturbances are described in terms of a Brownian motion, and the time-varying delay is characterized by introducing a Bernoulli stochastic variable. By employing a Lyapunov-Krasovskii functional, sufficient delay-distribution-dependent conditions are established in terms of linear matrix inequalities (LMIs) that guarantee the exponentially mean square synchronization of two identical DSNNs with random delays, which can be checked readily by Matlab toolbox.

This paper is organized as follows. In Section 2, the model formulation and some preliminaries are given. The main results are stated in Section 3. Two illustrative examples are given to demonstrate the effectiveness of the proposed results in Section 4. Finally, the conclusions are made in Section 5.

##### 1.1. Notation

Throughout this paper, and , respectively, denote the -dimensional Euclidean and the set of all matrices. is the identity matrix of appropriate dimensions. The superscript “” denotes matrix transposition. The notation (resp., ), where is a real symmetric matrix, means is positive definite (resp., positive semidefinite). is the Euclidean norm in . If is a matrix, denotes its operator norm. That is, , where (resp., ) means the largest (resp., smallest) eigenvalue of . denotes the set including zero and positive integers. The asterisk in a matrix is used to denote term that is induced by symmetry. denotes the expectation. Moreover, let be a complete probability space with a filtration satisfying the usual conditions. Denote by the family of all -measurable -valued random variables with the norm .

#### 2. Problem Formulation

Consider the following -neuron DSNNs with time delay where is the state vector associated with the neurons, with ; , denote the connection weights matrix and the delayed connection weights matrix, respectively, and denote the neuron activation functions; denotes the time-varying delay.

In this paper, we consider the model (2.1) as the drive system, and the noise-perturbed response system is given as where is the state feedback controller given to achieve the global exponental synchronization between the drive-response system; is a continuous function, is a scalar Wiener process on a probability space with

Throughout this paper, the following assumptions are made.

*Assumption 2.1. *For , the neuron activation functions and are continuous and bounded and satisfy the following conditions:
As first discussed in [32], for brevity of the following representation, we denote

*Assumption 2.2. * is a continuous function satisfying and
where is a known constant scalar.

*Assumption 2.3. *The time delay is bounded, , and its probability distribution can be observed; that is, suppose that takes values in or and Prob, where , and .

*Remark 2.4. *It is noted that the introduction of binary stochastic variable was first introduced in [25] and then successfully used in [26–31]. Under the Assumption 2.3, we know that is dependent on the values of , , . In addition, Prob.

In order to describe the probability distribution of the time delay, we define two sets where is an integer satisfying . Define two mapping functions It follows from (2.7) that and . From (2.8), it can be seen that implies the event occurs and implies the event occurs. Defining a stochastic variable as

then system (2.1) and (2.2) can be equivalently rewritten as

It is further assumed that the variables and are mutually independent.

*Remark 2.5. *Under the Assumption 2.3 and the definition of , it can be seen that is a Bernoulli distributed white sequence with Prob and Prob. Furthermore, we can show that and .

Letting be the synchronization error, we can derive error system as follows: where

The initial condition associated with (2.12) is given as

where , and .

Let be the state trajectory of system (2.12) under the initial condition. It is obvious that is a trivial solution of DSNNs (2.12).

*Definition 2.6. *The drive system (2.10) and the response system (2.11) are said to be exponentially synchronized if, for a suitably designed feedback controller, the trivial solution of the error system (2.12) is globally exponentially stable in the mean square. That is, there exist constants , and such that for sufficiently integer , the inequality
holds for all .

For brevity of the following analysis, we denote , , , , , by , , , , , , respectively. Then, (2.12) can be rearranged as

#### 3. Main Results

In order to realize the synchronization between the drive system (2.10) and the noise-perturbed response system (2.11) with different initial conditions, we will design a suitable feedback controller and develop theoretical results of the synchronization scheme. In fact, if the trivial solution of the controlled error system (2.12) is exponentially stable in the mean square, (2.10) and (2.11) can achieve globally synchronization.

For the noised-perturbed response system (2.11), the feedback controller is designed as where and are the feedback gains to be determined.

Theorem 3.1. *Suppose that Assumptions 2.1–2.3 hold, and let the state-feedback controller (3.1) be given. The noised-perturbed response system (2.11) is globally exponentially synchronized with the drive model (2.10) if there exist three positive definite matrices , , , three diagonal matrices , two real matrices , and a scalar such that the following two LMIs hold:
**
where, , .**And then the feedback gains can be designed as
*

*Proof. *See the Appendix B.

*Remark 3.2. *We would like to point out that there is still enough room to improve the result. Because of (1) in real-time systems, time delays always exist in a stochastic fashion, so we also can consider the time delays satisfy other distributions. (2) And we can also extend this method to the dynamics of discrete-time stochastic complex networks. (3) The results can be improved by combining with delay-fractioning method to reduce conservatism.

*Remark 3.3. *Our results are less conservative than some other existed results because they are dependent on not only the bound but also the distribution probability of the time delays, and we obtain a larger allowance variation range of the delay, while the delay-fractioning or delay-partitioning approach [22] can reduce conservatism lie in the methods increase the number of fraction of the time delay. The delay-fractioning approach is a very effective approach to reduce conservatism. And we will combine with the free-weighting methods or delay partitioning approaches to reduce the conservativeness of the results in the future.

*Remark 3.4. *When , which means , (2.10) reduces to (2.1). By setting , in Theorem 3.1 and deleting the third and sixth rows and the corresponding third and sixth columns of (3.2), we can obtain the following results.

Now, (2.11) reduces to Equation (2.16) reduces to

Corollary 3.5. *Suppose that Assumptions 2.1-2.2 hold, and let the state-feedback controller (3.1) be given. The noised-perturbed response system (3.5) is globally exponentially synchronized with the drive model (2.1) if there exist two positive definite matrices , two diagonal matrices , a real matrix , and a scalar , such that the following two LMIs hold:
**
where , .**And then the feedback gains can be designed as
*

*Remark 3.6. *The model proposed in this paper takes some well-studied models as special cases such as the model given in [4].

If we neglect the effect of the stochastic term in (2.11), then (2.11) reduces to Equation (2.16) reduces to In this case, we have the following results.

Corollary 3.7. *Suppose that Assumptions 2.1 and 2.3 hold, and let the state-feedback controller (3.1) be given. The response system (3.10) is globally exponentially synchronized with the drive model (2.10) if there exist three positive definite matrices , three diagonal matrices , two real matrices , such that the following LMI holds:
**
where , , .**And then the feedback gains can be designed as
*

#### 4. Two Numerical Examples

Two numerical examples are presented to demonstrate the effectiveness of our results.

*Example 4.1. *Consider the DSNNs (2.10) with the following parameters:
It is easy to verify that
Setting , , , and , in Theorem 3.1, we can verify by Matlab toolbox that LMIs (3.2) and (3.3) are solved and the solutions are given as follows:

Therefore, it can be seen from Theorem 3.1, the response system (2.11) is globally exponentially synchronized with the drive system (2.10). The result is further verified by the simulation results given by Figures 1 and 2. Figures 1(a), 1(b), and 1(c) represent the trajectories of , , , , and , , respectively, and the red line represents the drive system state, the blue line stands for the response system state, and the initial conditions are taken as , . Figure 2 shows that the error state goes to zero after a short period time. Furthermore, if we increase , the maximum allowance value of will increase subsequently. Specially, if , we get the maximum allowance value of .

*Example 4.2. *Consider the DSNNs (2.10) with the following parameters:
It is easy to verify that
Setting , , , and in Theorem 3.1, we can verify by Matlab toolbox that LMIs (3.2) and (3.3) are solved and the solutions are given below:

Therefore, it can be seen from Theorem 3.1, the response system (2.11) is globally exponentially synchronized with the drive system (2.10). The result is further verified by the simulation results given by Figures 3 and 4. Figures 3(a) and 3(b) represent the trajectories of , and , , respectively, and the red line represents the drive system state, the blue line stands for the response system state, the initial conditions are taken as , . Figure 4 shows that the error state goes to zero after a short period time.

#### 5. Conclusions

In recent years, synchronization in networks has become a hot research subject. However, the corresponding results are none for DSNNs with random delay. This paper has addressed the problem of exponential synchronization for the drive-response systems, where the drive system describes a class of discrete-time stochastic neural networks (DSNNs) with random delays and the response system is disturbed by some stochastic motions. Sufficient conditions have been established in terms of LMIs, which can be checked readily by Matlab toolbox. Two examples have been given to illustrate the effectiveness of the proposed results.

It is worth noting that the following two interesting and important issues should be addressed in our future work. Firstly, within the same LMI framework, it is not difficult to extend our main results to the synchronization problem for DSNNs with randomly mixed time-varying delays. Another future work may be how to extend the obtained results to DSNNs with Markovian jump and so on.

#### Appendices

#### A. Preliminary Lemmas

To obtain our main results, we need the following lemmas.

Lemma A.1 (see [33]). *Let , , , then we have
*

Lemma A.2 (Schur Complement [34]). *For a given matrix,
**
is equivalent to any one of the following conditions: **(i) , **(ii) .*

#### B. Proof of Theorem 3.1

For notation convenience, in the sequel, we denote

Now, in order to ensure that (2.11) is globally exponentially synchronized with (2.10), we just need to show that the error system (2.12) or (2.16) is globally exponentially stable in the mean square. To this end, we construct the following Lyapunov-Krasovskii functional by

where

where , , .

Calculating the difference of along the solution of DSNN (2.16) and taking the mathematical expectation, we have where It can be easily seen from Assumption 2.2 and (3.3) that

Combining (B.4)–(B.8), we obtain where where , , .

From (2.4), we can conclude that It can be conclude from (B.11) that there exists , where denote a column vector having “1” element on its th row and zeros elsewhere. In a similar way, from (B.12) and (B.13), we get where , .

Since implies , combing (B.10) and (B.14)–(B.16), we can deduce where By applying Lemma A.2 (in the Appendix A) to (3.2), we get . Let , then , and from (B.17), we get From the definition of , it can be easily derived that where , . For any scalar , (B.20) together with (B.19), implies that where , . Furthermore, for any integer , summing up both sides of (B.21) from 0 to with respect to , we get Note that for , Then, from (B.22) and (B.23) we have Let , and . Obviously, we have It also follows easily from (B.20) that In addition, we can verify that there exists a scalar such that Substituting (B.25)–(B.27) into (B.24), we obtain Since is an any positive integer, it can be concluded from (B.28) and Definition 2.6 that the response system (2.11) can be globally exponentially synchronized with the drive model (2.10), and this completes the proof of the theorem.

#### Acknowledgments

The authors appreciate the editor's work and the reviewer's helpful comments and suggestions. This work was jointly supported by the National Natural Science Foundation of China under Grant no. 11072059 and the Natural Science Foundation of Jiangsu Province of China under Grant no. BK2009271.

#### References

- L. M. Pecora and T. Carroll, “Synchronization in chaotic systems,”
*Physical Review Letters*, vol. 64, no. 8, pp. 821–824, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - T. L. Carroll and L. M. Pecora, “Synchronizing chaotic circuits,”
*IEEE Transactions on Circuits and Systems*, vol. 38, no. 4, pp. 453–456, 1991. View at Publisher · View at Google Scholar · View at Scopus - J. Lü and G. Chen, “A time-varying complex dynamical network model and its controlled synchronization criteria,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 6, pp. 841–846, 2005. View at Publisher · View at Google Scholar - J. Liang, Z. Wang, and X. Liu, “Exponential synchronization of stochastic delayed discrete-time complex networks,”
*Nonlinear Dynamics*, vol. 53, no. 1-2, pp. 153–165, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Liang, Z. Wang, Y. Liu, and X. Liu, “Global synchronization control of general delayed discrete-time networks with stochastic coupling and disturbances,”
*IEEE Transactions on Systems, Man, and Cybernetics, Part B*, vol. 38, no. 4, pp. 1073–1083, 2008. View at Publisher · View at Google Scholar · View at Scopus - C. W. Wu, “Synchronization in arrays of coupled nonlinear systems with delay and nonreciprocal time-varying coupling,”
*IEEE Transactions on Circuits and Systems II*, vol. 52, no. 5, pp. 282–286, 2005. View at Publisher · View at Google Scholar · View at Scopus - J. Zhou and T. Chen, “Synchronization in general complex delayed dynamical networks,”
*IEEE Transactions on Circuits and Systems. I*, vol. 53, no. 3, pp. 733–744, 2006. View at Publisher · View at Google Scholar - H. Gao, J. Lam, and G. Chen, “New criteria for synchronization stability of general complex dynamical networks with coupling delays,”
*Physics Letters, Section A*, vol. 360, no. 2, pp. 263–273, 2006. View at Publisher · View at Google Scholar · View at Scopus - J. Cao, P. Li, and W. Wang, “Global synchronization in arrays of delayed neural networks with constant and delayed coupling,”
*Physics Letters, Section A*, vol. 353, no. 4, pp. 318–325, 2006. View at Publisher · View at Google Scholar · View at Scopus - W. Lu and T. Chen, “Synchronization of coupled connected neural networks with delays,”
*IEEE Transactions on Circuits and Systems. I*, vol. 51, no. 12, pp. 2491–2503, 2004. View at Publisher · View at Google Scholar - T. Huang, C. Li, and X. Liao, “Synchronization of a class of coupled chaotic delayed systems with parameter mismatch,”
*Chaos*, vol. 17, no. 3, article 033121, p. 5, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Cao, H. X. Li, and Daniel W. C. Ho, “Synchronization criteria of Lur'e systems with time-delay feedback control,”
*Chaos, Solitons and Fractals*, vol. 23, no. 4, pp. 1285–1298, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - W. Yu and J. Cao, “Synchronization control of stochastic delayed neural networks,”
*Physica A*, vol. 373, pp. 252–260, 2007. View at Publisher · View at Google Scholar · View at Scopus - J. Cao and J. Lu, “Adaptive synchronization of neural networks with or without time-varying delay,”
*Chaos*, vol. 16, no. 1, article 013133, p. 6, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Y. Tang, S. Y. S. Leung, W. K. Wong, and J. A. Fang, “Impulsive pinning synchronization of stochastic discrete-time networks,”
*Neurocomputing*, vol. 73, no. 10–12, pp. 2132–2139, 2010. View at Publisher · View at Google Scholar · View at Scopus - T. Huang, C. Li, W. Yu, and G. Chen, “Synchronization of delayed chaotic systems with parameter mismatches by using intermittent linear state feedback,”
*Nonlinearity*, vol. 22, no. 3, pp. 569–584, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Y. Sun, J. Cao, and Z. Wang, “Exponential synchronization of stochastic perturbed chaotic delayed neural networks,”
*Neurocomputing*, vol. 70, no. 13–15, pp. 2477–2485, 2007. View at Publisher · View at Google Scholar · View at Scopus - W. Lin and Y. He, “Complete synchronization of the noise-perturbed Chua's circuits,”
*Chaos*, vol. 15, no. 2, Article ID 023705, pp. 1–9, 2005. View at Publisher · View at Google Scholar · View at Scopus - S. Mohamad and K. Gopalsamy, “Exponential stability of continuous-time and discrete-time cellular neural networks with delays,”
*Applied Mathematics and Computation*, vol. 135, no. 1, pp. 17–38, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - Z. Toroczkai, “Complex networks: the challenge of interaction topology,”
*Los Alamos Science*, vol. 29, pp. 94–109, 2005. View at Google Scholar - Y. Liu, Z. Wang, J. Liang, and X. Liu, “Synchronization and state estimation for discrete-time complex networks with distributed delays,”
*IEEE Transactions on Systems, Man, and Cybernetics, Part B*, vol. 38, no. 5, pp. 1314–1325, 2008. View at Publisher · View at Google Scholar · View at Scopus - Z. Wang, Y. Wang, and Y. Liu, “Global synchronization for discrete-time stochastic complex networks with randomly occurred nonlinearities and mixed time delays,”
*IEEE Transactions on Neural Networks*, vol. 21, no. 1, pp. 11–25, 2010. View at Publisher · View at Google Scholar · View at Scopus - Z. Zhang, S. Mou, J. Lam, and H. Gao, “New passivity criteria for neural networks with time-varying delay,”
*Neural Networks*, vol. 22, no. 7, pp. 864–868, 2009. View at Publisher · View at Google Scholar · View at Scopus - S. Mou, H. Gao, J. Lam, and W. Qiang, “A new criterion of delay-dependent asymptotic stability for Hopfield neural networks with time delay,”
*IEEE Transactions on Neural Networks*, vol. 19, no. 3, pp. 532–535, 2008. View at Publisher · View at Google Scholar · View at Scopus - A. Ray, “Output feedback control under randomly varying distributed delays,”
*Journal of Guidance, Control, and Dynamics*, vol. 17, no. 4, pp. 701–711, 1994. View at Google Scholar · View at Scopus - K. Hirasawa, S. Mabu, and J. Hu, “Propagation and control of stochastic signals through universal learning networks,”
*Neural Networks*, vol. 19, no. 4, pp. 487–499, 2006. View at Publisher · View at Google Scholar · View at Scopus - Z. Wang, F. Yang, D. W. C. Ho, and X. Liu, “Robust ${\text{H}}_{\infty}$ filtering for stochastic time-delay systems with missing measurements,”
*IEEE Transactions on Signal Processing*, vol. 54, no. 7, pp. 2579–2587, 2006. View at Publisher · View at Google Scholar · View at Scopus - Z. Wang, D. W. C. Ho, and X. Liu, “Robust filtering under randomly varying sensor delay with variance constraints,”
*IEEE Transactions on Circuits and Systems II*, vol. 51, no. 6, pp. 320–326, 2004. View at Publisher · View at Google Scholar · View at Scopus - D. Yue, Y. Zhang, E. Tian, and C. Peng, “Delay-distribution-dependent exponential stability criteria for discrete-time recurrent neural networks with stochastic delay,”
*IEEE Transactions on Neural Networks*, vol. 19, no. 7, pp. 1299–1306, 2008. View at Publisher · View at Google Scholar · View at Scopus - Y. Zhang, D. Yue, and E. Tian, “Robust delay-distribution-dependent exponential stability criteria of discrete-time stochastic neural networks with time-varying delays,”
*Neurocomputing*, vol. 72, pp. 1265–1273, 2009. View at Google Scholar - Y. Zhao, H. Gao, J. Lam, and KE. Chen, “Stability analysis of discrete-time recurrent neural networks with stochastic delay,”
*IEEE Transactions on Neural Networks*, vol. 20, no. 8, pp. 1330–1339, 2009. View at Publisher · View at Google Scholar · View at Scopus - Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,”
*Neural Networks*, vol. 19, no. 5, pp. 667–675, 2006. View at Publisher · View at Google Scholar · View at Scopus - E. N. Sanchez and J. P. Perez, “Input-to-state stability (ISS) analysis for dynamic neural networks,”
*IEEE Transactions on Circuits and Systems. I*, vol. 46, no. 11, pp. 1395–1398, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan,
*Linear Matrix Inequalities in System and Control Theory*, vol. 15 of*SIAM Studies in Applied Mathematics*, SIAM, Philadelphia, Pa, USA, 1994.