Neural Plasticity

Volume 2009, Article ID 704075, 12 pages

http://dx.doi.org/10.1155/2009/704075

## Comparison and Regulation of Neuronal Synchronization for Various STDP Rules

Institute of Complex Bio-dynamics, Jiangxi Blue Sky University, Nanchang, Jiangxi 330098, China

Received 22 August 2008; Revised 28 January 2009; Accepted 5 May 2009

Academic Editor: Menahem Segal

Copyright © 2009 Yanhua Ruan and Gang Zhao. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

We discuss effects of various experimentally supported STDP learning rules on frequency synchronization of two unidirectional coupled neurons systematically. First, we show that synchronization windows for all STDP rules cannot be enhanced compared to constant connection under the same model. Then, we explore the influence of learning parameters on synchronization window and find optimal parameters that lead to the widest window. Our findings indicate that synchronization strongly depends on the specific shape and the parameters of the STDP update rules. Thus, we give some explanations by analyzing the synchronization mechanisms for various STDP rules finally.

#### 1. Introduction

Synchronous activity is a basic characteristic in the brain. It exists in many regions of the brain, such as CA1 of the hippocampus [1], visual cortex [2] and cortical areas correlating with conscious perception [3]. It is known that synchronization is very important for information processing, such as predicting sensory input [4], and information codes [5]. Moreover, synchronous activity plays a crucial role in epileptic activity [6, 7], modulation of neurons about attention [8], memory and learning [9, 10], and cognitive functions [11].

Since the discovery of long term potentiation (LTP) and LTD (long term depression) [12–14], it has been debated how synaptic modifications are correlated to neuron activities. Spike timing-dependent plasticity (STDP) is a form of synaptic modification discovered relatively recently, which depends on the relative timing of pre- and post-synaptic action potentials at a millisecond time scale [15, 16]. Many experiments have proved the existence of STDP, such as in neocortical slices [17], hippocampus slice [18], hippocampal cell cultures [19], and tadpole rectum in vivo [20]. In addition, STDP provides powerful mechanisms for models of temporal pattern recognition [21], temporal sequence learning [22, 23], a continuous-time associative memory [24], coincidence detection [16, 25], navigation [26, 27] and direction selectivity [28].

The interaction among neurons relies much on synaptic modification in which STDP is the only one that greatly expands the capability of Hebbian learning to address temporally sensitive computational tasks. STDP in synchronization has attracted wide interests. For example, the result of learning-induced synchronization of a neural network at various developing stages using STDP rule is consistent with recent experimental observations [29]. Furthermore, the comparison of synchronization between discontinuous anti-STDP(dc-aSTDP, see Section 2) and constant connection has been investigated [30]. Following it, the continuous STDP(c-STDP, see Section 2) has also been studied [31] by the same authors. They suggest that a functional role of STDP might be enhancing synchronization. Motivated by their work, we systemically discuss the roles of four types of STDP rules(c-STDP, dc-STDP, dc-aSTDP and in-STDP, see Section 2) in frequency synchronization in the present paper, employing the same model [31] with only values of some parameters different, such as , , , (see Section 3).

We find, however, not all STDP rules facilitate synchronization. It encourages us to trace the reason. We then consider if the learning curves, which characterize the STDP rule, have certain effects on synchronization. Results indicate that synchronization strongly depends on the specific shape and the parameters of the STDP rule. However, the optimal synchronization ranges for dc-STDP and in-STDP, got from regulating learning parameters, are not wider than those for the corresponding strongest constant connection respectively. As a result, when we seek the reason, we discover that the synchronization mechanisms of above four STDP rules can be classified into two categories: (i) c-STDP and dc-aSTDP rules; (ii) dc-STDP and in-STDP rules. The synchronization mechanisms of the two categories are different. For c-STDP and dc-aSTDP rules, two neurons’ synchronization either relies on the balancing out potentiation and depression during one cycle consistent with the perspective of Nowotny et al. or relies on the maximal synaptic conductance. However, for dc-STDP and in-STDP rules, the synchronization windows are completely provided by the respective maximal synaptic conductance. As regards this finding, we offer an intuitive explanation finally.

#### 2. Models and Method

We consider two HH neurons with unidirectional activity-dependent excitatory or inhibitory synaptic coupling. Although such a configuration is too simple to find applications in brain information processing, it serves as a staring point for many model researches. The neurons are modeled with standard Na, K, and “leak” currents [32],

where .

Each of the activation and inactivation variables , satisfies first-order kinetics,

The parameters in these equations are given in [31],

is a constant input current forcing each neuron to spike with a constant, -dependent period, labeled as and . The postsynaptic neuron would show another firing period , when it is driven by the synaptic current, which is dependent on the postsynaptic potential , the reversal potential , the activation variable and its maximal conductance ,

where

The time-dependent synaptic coupling strength is

Therefore always have values between 0 and . The bound imposed on is artificially set to avoid unrealistically high synaptic conductance and negative conductance. In order to obtain biologically plausible synaptic conductance, several methods have been employed to limit the synaptic strength in literature, such as a negative total integral [33], artificial bounds [34], and self-limitation [31]. Unless otherwise stated, we employ the self-limitation method which is characterized by a function “tanh” in our simulation.

is modified by STDP rules that are introduced in the next paragraph. The initial value of is 20 . The parameters of the model are

The time-dependent synaptic coupling strength is determined by the spike-timing of pre- and postsynaptic spikes. We consider four types of activity-dependent couplings that have been found in experiments: () an excitatory synapse with continuous STDP (c-STDP). There are two forms of c-STDP from two different experiments. One (Figure 1(a)) is from the recording of the neocortex-layer 5 Xenopus tectum hippocampus [31, 35], and the other is from the neocortex-layer 4 spiny stellates [36]. The latter form will not be considered here, because it introduces persistent decrease to synaptic strength that would result in none synchronization if two neurons have different inherent periods. () an excitatory synapse with discontinuous STDP (dc-STDP, Figure 1(b)) [17, 36]; () an excitatory synapse with discontinuous anti-STDP [36, 37] (dc-aSTDP, Figure 1(c)); () an inhibitory synapse with STDP (in-STDP, Figure 1(d)) [18, 19, 36].

is a function of , time difference between the times of postsynaptic and presynaptic spikes. The learning rules corresponding to Figures 1(a), 1(b), 1(c), 1(d)) are provided as follows

Synchronization of pre- and post-synaptic neurons occurs when is limited in an acceptable range. We set the criteria of synchronization as milliseconds. Although there is some arbitrariness in setting the criteria of synchronization, there is no qualitative change in our results if the criteria change in two folds. Each simulation runs 20 seconds, average is taken in the final 4000 milliseconds. We have observed that simulations from different initial values of , could result in different outputs, that is, the post-synaptic neuron sometimes synchronizes with the pre-synaptic one, sometimes keep its original period, or sometimes fires with an oscillating period (see Figure 2(c)). We therefore carry out 40 times of simulations, from randomly selected initial values, for every . The standard deviation of , indicating how precisely the neurons are synchronized, represents the quality of synchronization. Range of , in which post-synaptic neuron is successfully entrained by the pre-synaptic neuron, that is, in all 40 simulations, is defined as the synchronization window.

#### 3. Results

##### 3.1. Comparison of Synchronization Windows of Different Types of STDP

We investigate the width of synchronization window of various STDP curves, with the same set of parameters. The period of the pre-synaptic neuron is chosen to be 171 milliseconds, which falls into the range of theta waves. Several reasons make us choose such a long period. First, it has fairly wide synchronization windows which allow comparisons in a relative precise manner and can provide clearer information about synchronization windows of various STDP learning rules. Second, the slow theta waves always involve many neurons that fire synchronously [38, 39]. Also, theta waves have many interesting implications. For example, theta waves are normally absent in healthy awake adults, but appear during the state of meditation [40]. During emotional arousal and various types of rhythmic activities during sleep, neurons in the amygdala produce theta activity [41, 42]. And it is known that coherent theta activity (4–8 Hz) in amygdala-hippocampal circuits is deeply involved in fear memory [43].

With fixed period of the pre-synaptic neuron , we evaluate the coupled period of postsynaptic neuron when it is driven by the pre-synaptic neuron. The values of learning parameters used in c-STDP, dc-STDP, dc-aSTDP are nS, nS, milliseconds, milliseconds, *additionally * *milliseconds in c-STDP *, and in in-STDP are nS, milliseconds, milliseconds. Our model and most values of parameters are from the model of Nowotny for c-STDP, except , , , are different [31]. Especially, is fixed at 171 milliseconds in our simulations while is set to constant value 300 milliseconds of Nowotny’s work.

The window of synchronization (upper panel) and quality (middle panel) of dc-STDP are presented in Figure 2 as an example. We scan from 150 milliseconds to 320 milliseconds. The upper panel shows the number of synchronization times in 40 simulations, for each . It is clear that, in certain range of , simulations from different initial values may have different results. Only when falls into the segment from 194 to 221, the post-synaptic neuron can synchronize with the pre-synaptic neuron from any initial value. It is easily found that there are some corresponding to the number of synchronization times between 1 and 39. In this situation, we present the three possible states of post-synaptic neuron’s firing in Figure 2 (lower panel)—keeping the initial period (squares), oscillating (circles), and synchronizing with the pre-synaptic neuron (dots). Obviously, these states are independent of the synchronization criteria we set.

For the purpose of discussing the function role of STDP rules in synchronization, the synchronization windows of various type of STDP are plotted in Figure 3, in which the case of constant synaptic conductance is also included as a comparative tool. The same parameter values used in simulations ensure a fair comparison. In our simulation studies, the synapse strength is between 0 nS and 25 nS. We choose the maximal synaptic strength and the middle synaptic strength of STDP synapse as the synaptic strength of constant synapse in this study. Interestingly, because the synchronization windows for STDP rules are narrower than synchronization window for constant synapse nS in Figure 3, these results, opposite to previous reports, indicate that all STDP rules do not enhance synchronization comparing with the constant synapse under the chosen parameters.

Several other points are worthy of detailed describing. First, increasing the excitatory constant synaptic connections from 12.5 nS to 25 nS, leads to a wider synchronization window. However, the wider window could not totally contain the smaller one. It extends toward larger , but loses a portion of smaller . The case of increasing inhibitory constant synaptic connections is alike. Second, the widest ranges of synchronization window are achieved by the excitatory constant connection nS and c-STDP rules. However, the lower boundary of the synchronization window of c-STDP is much nearer to than that of excitatory constant synapse. Thirdly, although c-STDP and dc-STDP are fitted from the same set of experimental data, c-STDP has a much wider synchronization window than dc-STDP.

We conclude that all STDPs do not give rise to enhanced synchronization and the window of dc-STDP is surprisingly narrow under the chosen parameters in Figure 3. Therefore, the questions about what bring about these results inspire us to study further. At the same time, Figure 2 shows a large part of probabilistic synchronization, whose range is a subset of the synchronization window of constant synaptic connection with nS. We are interested in if the probabilistic synchronization could be enhanced into absolute synchronization by modulation of learning curves. These are the theme of the next section.

##### 3.2. The Effect of Learning Parameters on Synchronization

In order to establish the functional role of STDP clearly, we consider if the learning parameters for each STDP rule have important effect on synchronization. In addition, synchrony-asynchrony transition plays important role in the brain. An increase in the degree of synchrony of a uniform input can cause transitions between memorized activity patterns in the order presented during learning. However, if synchronous input is at a low level, transitions cannot occur [44]. The synchrony-asynchrony transition have also been implemented in controlling winner-take-all competition [45], the next recalled time of associative memory [46] and the fine structure of cell assemblies [47].

In this section, we will discuss the flexibility of the synchronization window, by exploring regulation of width of the synchronization window, whose boundary indicates the synchrony-asynchrony transition. We take the modulation of learning parameters as the method to regulate the synchronization window. There are four parameters that determine a learning rule , , , . With three of them fixed and only one parameter changing, we could explore its influence on the width of the synchronization window. For example, increases from an adequately small value 1 nS to 20 nS with a step of 1 nS. We have also scanned values that are beyond 20 nS, but find that the effect of increasing is saturated around 20 nS. Further increasing brings no more effect. Other parameters are fixed as: = 6 nS, = 100 milliseconds, = 200 milliseconds, milliseconds. In these conditions, we present the effect of on the location of the synchronization window with the dc-STDP rule. We carry out simulations 40 times, each from different initial values.

Figure 4(a) shows the value of ARP (average change of relative period ratio) = for different . Some points have value 0 or 1, which means post-synaptic neuron keeping initial period or achieving synchronization with the pre-synaptic one, respectively. Some points have values other than 0 or 1. Figure 4(b) gives an explanation that these points correspond to probabilistic synchronizations with fixed .

We find that the absolute synchronization range is from 10 nS to 20 nS in Figure 4(b). According to the definition of synchronization window of , we can similarly define 10 nS to 20 nS as the synchronization window of , with dc-STDP rule and other fixed parameters. The boundary of this synchronization window indicates where synchrony-asynchrony transition happens when changing .

From the results of Figure 4, the reason why synchronization window of constant synapse is wider than that of STDP rules (Figure 3) may be explained by learning parameters. To figure out a global picture of the effect of on synchronization for c-STDP rule, we then determine the synchronization window of with different . increases from 1 nS to 20 nS with a step of 1 nS while other three parameters keep initial values: nS, milliseconds, = 200 milliseconds. We choose some typical values of to character the global picture. The points in Figure 5(a) show the synchronization range of with divided by the chosen values of . The lower boundaries, as well as those upper boundaries that are other than 20 nS, indicate the position of synchrony-asynchrony transitions. For example, when is 177 milliseconds equivalent to / = 0.966, outside of the points range from 8 nS to 11 nS cannot lead to synchronization between the two neurons. In addition, for those points marked on the horizontal axis, synchronization could not be established no matter what values take.

According to this global picture, the intersection of those synchronization ranges of , which is from 10 nS to 11 nS, identifies the range of that would lead to the widest synchronization window which is from 177 to 289. This optimal synchronization window for c-STDP is wider than constant synapse *g* = 25 nS. Thus, the learning parameters strongly influence the role of STDP on synchronization.

Taking the same method as , we study the effects of other three parameters on synchronization. Figure 5 presents the situation of varying from 1 nS to 20 nS with the step 1 nS (circles, Figure 5(a)), (points, Figure 5(b)) and (circles, Figure 5(b)) both varying from 10 milliseconds to 400 milliseconds with the step 10 milliseconds. When changing one parameter to explore how the range of synchrony evolves with , other three parameters keep their initial values as in Figure 3. Similarly, the global modulation picture of four learning parameters for other learning rules can be got. We only give the situation for c-STDP rule in Figure 5.

The optimal synchronization windows for various learning rules are presented in Figure 6 comparing with previous synchronization windows obtained in Figure 3. The parameters used for optimal synchronization windows are presented in Table 1. The parameters are derived according to regulating one parameter while other three parameters keep initial values. Under the optimal parameters, the synchronization windows for STDP rules are not narrower than constant synapse *g* = 25 nS. Consequently, the reported important role of STDP in synchronization should be dependent on learning parameters.

For the first three STDP rules, the optimal synchronization windows are got by regulating while other three fixed learning parameters keep initial values. For the last STDP rule, the initial values are the optimal parameters.

##### 3.3. The Synchronization Mechanism

It is important to understand the properties which neural synchronization depends on. We take into account this problem from two aspects.

On the one hand, synchronization correlates with the chosen STDP rules. For excitatory synapse, we find that the optimal synchronization windows for c-STDP rule and dc-aSTDP rule are almost equal, and are wider than constant synapses. However, comparing with these two rules, the optimal synchronization window for dc-STDP rule is much narrower. For inhibitory STDP, the synchronization window is the same as that for constant synapse under connection strength nS.

Accordingly, what makes the optimal synchronization windows for various STDP rules different deserves an explanation. The stationary synaptic conductance is a necessary condition for stationary synchronized state [31]. We find that the mechanisms of synchronization caused by c-STDP (or dc-aSTDP) and dc-STDP (or in-STDP) are different in our model.

Figures 7(a) and 7(b) show the average , and synaptic strength after an episode of coupling time for c-STDP rule. Parameters in Figure 7 are same as those in Figure 3. There are two types of behavior for when synchronization occurs (Figure 7(a)). In a section of constant , the synaptic strength does not achieve the maximal value. Apparently, in this situation, postsynaptic neuron achieves synchronization with the pre-synaptic neuron depending on the balance between potentiation and depression of synaptic conductance. In the rest part of synchronization window, the synaptic strength achieves the maximal value (Figure 7(b)). It indicates that for larger , postsynaptic neuron achieves synchronization depending on the effect of maximal synaptic conductance. For dc-aSTDP rule, the synchronization mechanisms are similar to c-STDP rule. When the post-synaptic neuron synchronizes with the pre-synaptic neuron under small , the change of synaptic potentiation and depression cancel each other. However, for the small portion of synchronization window at the right side, synaptic conductance gets the maximum at the stationary synchronized state.

For dc-STDP and in-STDP rules, the synchronization mechanisms may be different with the above two STDP rules. Because the potentiation and depression of synaptic conductance cancel each other, must be a fixed value for the selected STDP rule. However, for the dc-STDP rule (Figures 7(c) and 7(d)), keeps varying which means that the potentiation and depression of synaptic conductance do not cancel each other at the synchronization state. But, it is easily found that the synaptic conductance is at the stationary maximum for dc-STDP rule. Thus, postsynaptic neuron achieves synchronization completely depending on the effect of the maximal synaptic conductance for dc-STDP rule. The state of in-STDP rule is similar to dc-STDP rule.

As a result, neural synchronization mechanism can be different for various STDP rules. For the few at the right side of the synchronization window, the synaptic conductance achieves the maximum with c-STDP and dc-aSTDP rules. This result is obvious. Because the frequency mismatch is larger, the synapse needs to be stronger to entrain the post-synaptic neuron. But for most part of synchronization window at the left, c-STDP and dc-aSTDP rules rely on the balance of potentiation and depression. Instead of balancing out potentiation and depression during one cycle, dc-STDP and in-STDP rules depend on synaptic strength achieving its maximum. It is important to understand why c-STDP and dc-aSTDP rely on the balance of potentiation and depression while dc-STDP and in-STDP do not.

Nowotny et al. have introduced the mechanisms behind the enhancement of neural synchronization by c-STDP rule which rely on the balance of potentiation and depression. The synapse strength remains stable regardless of postsynaptic neuron firing later or earlier attributed to the specific shape of c-STDP curve. The situation of c-STDP is similar to dc-aSTDP. We adopt the similar analysis method [31] here for the dc-aSTDP and dc-STDP. The time lags are recorded as and , where and (Figure 8) at this state. If post-synaptic neuron fires faster, becomes smaller. Synaptic strength will be depressed, due to for dc-aSTDP rule, so that the post-synaptic neuron is less excited and goes back into the synchronized state (Figure 8(b)). The other direction can be analyzed in the same way for dc-aSTDP. But for dc-STDP, when post-synaptic neuron fires faster, synaptic strength will be increased due to in this case. The post-synaptic neuron is more excited and cannot go back into the synchronized state (Figure 8(c)). The opposite direction is the same case for dc-STDP and cannot go back into the synchronized state. Therefore, the synchronization mechanisms between these two rules are different.

For in-STDP rule, we can easily find that is always positive, where and values of parameters are the same as Figure 3. It means that the potentiation and depression of synaptic conductance during one period cannot achieve balance. The synaptic strength must achieve the maximum resulting from .

On the other hand, learning parameters also play important role in neural synchronization. We try to explain the role of a learning parameter by considering how it influences the synapse conductance, which is a major factor for synchronizing neurons with a given mismatch of intrinsic frequencies.

It is obvious that if synaptic conductance becomes stronger, it can make larger to achieve the same period with pre-synaptic neuron for various STDP rules. Thus, with other three learning parameters fixed, larger values, which are corresponding to the stronger stable synaptic strength for c-STDP rule, can cause larger synchronization. Similarly, smaller values will give rise to larger synchronization for c-STDP (Figure 5(a)). Moreover, from Figure 5(b), moderate values can also make larger synchronized to because these values bring about stronger synaptic strength. We can prove this perspective by simple calculus reasoning. Based on the expression of c-STDP rule in Section 2, let be variable and let other parameters keep constant. is viewed as the function of variable . By calculating the derivative of , we can find that is a first increasing and then decreasing function when increases gradually. Thus, medial values of can result in stronger synaptic strength. By the same reasoning for *, *we can conclude that smaller or larger can make larger synchronization for c-STDP (Figure 5(b)).

The effects of learning parameters on synchronization about other learning rules are similar to the c-STDP rule for larger . However, smaller values leading to synchrony are only related to c-STDP and dc-aSTDP, because they rely on the balance of depression and potentiation which could lead to an appropriate low stable synaptic strength. Therefore, only proper learning parameters got by regulating the effect of learning parameters on synchronization are required for smaller achieved synchronization.

Finally, we conclude why the widest synchronization windows for some STDP rules are different. From the above statements, we find that two aspects affect synchronization. One is the maximum synaptic strength which can make larger synchronize. The other is the balance of depression and potentiation which can make smaller and moderate synchronize. For c-STDP and dc-aSTDP, they can achieve the widest synchronization windows through modulating the two aspects. However, dc- STDP and in- STDP rules, due to their specific shape, can only make use of the first one. This implies that the widest synchronization windows for dc-STDP and in-STDP rules cannot exceed the synchronization windows for the maximum constant connection strength under the same model respectively. Therefore, the optimal synchronization windows for c-STDP and dc-aSTDP are wider than those for dc-STDP and in-STDP.

#### 4. Conclusion

STDP plays important functional role in neural synchronization. The mechanism of STDP in neuronal synchronization is still not completely clear. Inspired by previous experiments and theoretical researches, we study the important aspects of STDP-induced synchronization in this paper, such as the role of various STDP rule in synchronization, the widest synchronization window through regulating learning parameters, and synchronization mechanism.

In order to explore the functional role of STDP in synchronization, we compare synchronization windows of different types of STDP rules with that of constant synapse under the same model parameters. For the given parameters, not all synchronization windows are enhanced by STDP rules.

Synchronized responses have a stronger influence on cells at subsequent processing stages than nonsynchronized responses [48–50]. And the enhanced precise synchronization is important in improving a rapid and reliable transmission of information about sensory changes [2, 51]. Recent researches have reported various methods to enhance synchronization, such as, selective attention [52] and time delay [53]. Here, we present the effect of modulation of learning parameters on synchronization and optimal synchronization window which are not narrower than constant synapse. The optimal synchronization windows by c-STDP and dc-aSTDP rules are much wider than constant synapse. It indicates that the function role of STDP rule in synchronization depends on the learning parameters.

The synchronization mechanism is also described here. Different shapes of STDP rule can cause different optimal synchronization windows. The optimal synchronization windows of c-STDP and dc-aSTDP are wider than that of dc-STDP for excitatory synapse. For c-STDP rule and dc-aSTDP rule, a stationary synchronized state completely depends on the balance between potentiation and depression or the maximal synaptic conductance. However, for dc-STDP and in-STDP rule, the stable synchronized state depends on the maximal synaptic conductance under the self-limitation of synaptic strength. If we change the type of bound of synaptic strength for dc-STDP rule from self-limitation to artificial bounds, we find that the synchronization mechanism does not change. In a word, on one hand, the synchronization range of dc-aSTDP and c-STDP can achieve the optimal synchronization window of dc-STDP, depending on the maximal synaptic conductance. On the other hand, dc-aSTDP and c-STDP can extend the synchronization windows to include smaller by the balance between potentiation and depression.

The firing pattern of neurons is regular in this paper. Many neurons in brain areas present regular firing. For example, neurons in cat area 17 can be grouped in 4 different electrophysiological cell classes, including regular spiking [54]. And spontaneous, regular action potentials were observed both with cell-attached patch recordings as well as with whole cell current-clamp recordings for cholinergic neurons in the parabigeminal nucleus of the rat midbrain [55]. Neuronal synchronization properties with regular firing neurons have been studied. For example, whether pyramidal neurons in different cortical layers exhibit similar tendencies to synchronize is studied [56]. Based on this point and the functional role of STDP in synchronization, we explore the synchronization windows of various STDP rules from the view of neurons’ regular firing.

STDP-mediated synchronization is a remarkably robust phenomenon against strong noise [30, 31]. Although our simulation is not under the noise environment, our results may represent some predictions for STDP-mediated synchronization in noisy environment. In addition, from Figure 2(a), we can clearly see that some synchronization number is between 1 and 39. We estimate that it may be related to phase.

Our results present that the range of values leading to synchrony increases strongly if the constant synaptic connection is increased from 12.5 nS to 25 nS. Nowotny et al. find that the extent of synchrony does not change considerably by doubling the synaptic conductance [31]. Their result is not conflict with our result. There are three parameters that are different, , , and . Furthermore, is fixed at 171 milliseconds in our simulation while is fixed at 300 milliseconds in theirs. When is fixed, the range of values leading to synchrony is limited from 0 to no matter how the strength of constant connection changes. However, when is fixed, the range of values leading to synchrony can vary from to very large value due to the increase of the constant connection. At the same time, if we adopt the same parameters with Nowotny’s paper, the similar result can be got. Furthermore, when constant synaptic connection is 0 nS, it is clear that two neurons with different initial periods cannot synchronize. This situation means that the length of synchronization window is 0. Along with the increase of strength of constant connection, some must cause the synchronization. Thus, it is easily found that synchronization window must become wider by increasing the constant connection to some degree.

We mainly discuss synchronization for different STDP rules in this paper. The question of how the time windows of various STDP rules are biophysically regulated remains relatively unexplored. There are some experiments using neuromodulators to study the time window for STDP [57]. We are interested in building molecular kinetic equations for STDP to explain our results.

It has been proposed that conscious perception depends on the transient synchronization of widely distributed neural assemblies [58]. And long-distance synchronization plays a role in triggering the cognitive processes associated with conscious awareness [59]. The changed learning parameters by neuromodulators may influence the cognitive processes. In addition, some diseases and the function of brain are related with synchronization mentioned above, especially in theta (4–8 Hz) rhythm synchronization during fear memory retrieval [43] which is consistent with what we considered here. Therefore, our work may advance understanding of synchronization to some extent. And we expect that our simulation results will provide some help for related diseases treatment.

#### Acknowledgments

This research is supported by the Educational Department of Jiangxi Province of China (GJJ08475) and Jiangxi Blue Sky University (XYKJ08YB05).

#### References

- J. Fell, P. Klaver, K. Lehnertz et al., “Human memory formation is accompanied by rhinal-hippocampal coupling and decoupling,”
*Nature Neuroscience*, vol. 4, no. 12, pp. 1259–1264, 2001. View at Publisher · View at Google Scholar - T. Womelsdorf, P. Fries, P. P. Mitra, and R. Desimone, “Gamma-band synchronization in visual cortex predicts speed of change detection,”
*Nature*, vol. 439, no. 7077, pp. 733–736, 2006. View at Publisher · View at Google Scholar - L. Melloni, C. Molina, M. Pena, D. Torres, W. Singer, and E. Rodriguez, “Synchronization of neural activity across cortical areas correlates with conscious perception,”
*Journal of Neuroscience*, vol. 27, no. 11, pp. 2858–2865, 2007. View at Publisher · View at Google Scholar - T. Womelsdorf and P. Fries, “Neuronal coherence during selective attentional processing and sensory-motor integration,”
*Journal of Physiology*, vol. 100, no. 4, pp. 182–193, 2006. View at Publisher · View at Google Scholar - J. Biederlack, M. Castelo-Branco, S. Neuenschwander, D. W. Wheeler, W. Singer, and D. Nikolić, “Brightness induction: rate enhancement and neuronal synchronization as complementary codes,”
*Neuron*, vol. 52, no. 6, pp. 1073–1083, 2006. View at Publisher · View at Google Scholar - M. Chavez, M. Le Van Quyen, V. Navarro, M. Baulac, and J. Martinerie, “Spatio-temporal dynamics prior to neocortical seizures: amplitude versus phase couplings,”
*IEEE Transactions on Bio-Medical Engineering*, vol. 50, no. 5, pp. 571–583, 2003. View at Google Scholar - C. M. T. Queiroz and L. E. Mello, “Synaptic plasticity of the CA3 commissural projection in epileptic rats: an in vivo electrophysiological study,”
*European Journal of Neuroscience*, vol. 25, no. 10, pp. 3071–3079, 2007. View at Publisher · View at Google Scholar - H. Liang, S. L. Bressler, M. Ding, R. Desimone, and P. Fries, “Temporal dynamics of attention-modulated neuronal synchronization in macaque V4,”
*Neurocomputing*, vol. 52–54, pp. 481–487, 2003. View at Publisher · View at Google Scholar - A. D. Wagner, “Synchronicity: when you're gone I'm lost without a trace?”
*Nature Neuroscience*, vol. 4, no. 12, pp. 1159–1160, 2001. View at Publisher · View at Google Scholar - N. Axmacher, F. Mormann, G. Fernández, C. E. Elger, and J. Fell, “Memory formation by neuronal synchronization,”
*Brain Research Reviews*, vol. 52, no. 1, pp. 170–182, 2006. View at Publisher · View at Google Scholar - F. Varela, J.-P. Lachaux, E. Rodriguez, and J. Martinerie, “The brainweb: phase synchronization and large-scale integration,”
*Nature Reviews Neuroscience*, vol. 2, no. 4, pp. 229–239, 2001. View at Publisher · View at Google Scholar - T. V. P. Bliss and T. Lomo, “Long lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path,”
*The Journal of Physiology*, vol. 232, no. 2, pp. 331–356, 1973. View at Google Scholar - D. J. Linden and J. A. Connor, “Long-term synaptic depression,”
*Annual Review of Neuroscience*, vol. 18, no. 1, pp. 319–357, 1995. View at Google Scholar - R. A. Nicoll and R. C. Malenka, “Contrasting properties of two forms of long-term potentiation in the hippocampus,”
*Nature*, vol. 377, no. 6545, pp. 115–118, 1995. View at Google Scholar - W. Gerstner and J. L. van Hemmen, “Coding and information processing in neural networks,” in
*Models of Neural Networks II: Temporal Aspects of Coding and Information Processing in Biological Systems*, 1994. View at Google Scholar - W. Gerstner, R. Kempter, J. L. Van Hemmen, and H. Wagner, “A neuronal learning rule for sub-millisecond temporal coding,”
*Nature*, vol. 383, no. 6595, pp. 76–78, 1996. View at Publisher · View at Google Scholar - H. Markram, J. Lübke, M. Frotscher, and B. Sakmann, “Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs,”
*Science*, vol. 275, no. 5297, pp. 213–215, 1997. View at Publisher · View at Google Scholar - D. Debanne, B. H. Gahwiler, and S. M. Thompson, “Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures,”
*The Journal of Physiology*, vol. 507, no. 1, pp. 237–247, 1998. View at Publisher · View at Google Scholar - G.-Q. Bi and M.-M. Poo, “Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type,”
*Journal of Neuroscience*, vol. 18, no. 24, pp. 10464–10472, 1998. View at Google Scholar - L. I. Zhang, H. W. Tao, C. E. Holt, W. A. Harris, and M.-M. Poo, “A critical window for cooperation and competition among developing retinotectal synapses,”
*Nature*, vol. 395, no. 6697, pp. 37–44, 1998. View at Publisher · View at Google Scholar - W. Gerstner, R. Ritz, and J. L. van Hemmen, “Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns,”
*Biological Cybernetics*, vol. 69, no. 5-6, pp. 503–515, 1993. View at Publisher · View at Google Scholar - A. A. Minai and W. B. Levy, “Sequence learning in a single trial,” in
*Proceedings of the INNS World Congress on Neural Networks II*, pp. 505–508, 1993. - L. F. Abbott and K. I. Blum, “Functional significance of long-term potentiation for sequence learning and prediction,”
*Cerebral Cortex*, vol. 6, no. 3, pp. 406–416, 1996. View at Publisher · View at Google Scholar - H. Watanabe, M. Watanabe, K. Aihara, and S. Kondo, “Change of memory formation according to STDP in a continuous-time neural network model,”
*Systems and Computers in Japan*, vol. 35, no. 12, pp. 57–66, 2004. View at Publisher · View at Google Scholar - W. Gerstner, R. Kempter et al., “A developmental learning rule for coincidence tuning in the barn owl auditory system,” in
*Proceedings of the annual conference on Computational Neuroscience: Trends in Research*, J. Bower, Ed., vol. 665, pp. 665–669, Plenum Presss, New York, NY, USA, 1997. View at Google Scholar - K. I. Blum and L. F. Abbott, “A model of spatial map formation in the hippocampus of the rat,”
*Neural Computation*, vol. 8, no. 1, pp. 85–93, 1996. View at Publisher · View at Google Scholar - M. R. Mehta, M. C. Quirk, and M. A. Wilson, “Experience-dependent asymmetric shape of hippocampal receptive fields,”
*Neuron*, vol. 25, no. 3, pp. 707–715, 2000. View at Google Scholar - M. R. Mehta and M. A. Wilson, “From hippocampus to V1: effect of LTP on spatio-temporal dynamics of receptive fields,”
*Neurocomputing*, vol. 32-33, pp. 905–911, 2000. View at Publisher · View at Google Scholar - T.-C. Chao and C.-M. Chen, “Learning-induced synchronization and plasticity of a developing neural network,”
*Journal of Computational Neuroscience*, vol. 19, no. 3, pp. 311–324, 2005. View at Publisher · View at Google Scholar - V. P. Zhigulin, M. I. Rabinovich, R. Huerta, and H. D. I. Abarbanel, “Robustness and enhancement of neural synchronization by activity-dependent coupling,”
*Physical Review E*, vol. 67, no. 2, Article ID 021901, 4 pages, 2003. View at Google Scholar - T. Nowotny, V. P. Zhigulin, A. I. Selverston, H. D. I. Abarbanel, and M. I. Rabinovich, “Enhancement of synchronization in a hybrid neural circuit by spike-timing dependent plasticity,”
*Journal of Neuroscience*, vol. 23, no. 30, pp. 9776–9785, 2003. View at Google Scholar - R. D. Traub and R. Miles,
*Neuronal Networks of the Hippocampus*, Cambridge University Press, Cambridge, UK, 1991. - R. Kempter, W. Gerstner, and J. L. Van Hemmen, “Intrinsic stabilization of output rates by spike-based Hebbian learning,”
*Neural Computation*, vol. 13, no. 12, pp. 2709–2741, 2001. View at Publisher · View at Google Scholar - S. Song and L. F. Abbott, “Cortical development and remapping through spike timing-dependent plasticity,”
*Neuron*, vol. 32, no. 2, pp. 339–350, 2001. View at Publisher · View at Google Scholar - P. D. Roberts and C. C. Bell, “Spike timing dependent synaptic plasticity in biological systems,”
*Biological Cybernetics*, vol. 87, no. 5-6, pp. 392–403, 2002. View at Publisher · View at Google Scholar - L. F. Abbott and S. B. Nelson, “Synaptic plasticity: taming the beast,”
*Nature Neuroscience*, vol. 3, supplement, pp. 1178–1183, 2000. View at Publisher · View at Google Scholar - C. C. Bell, V. Z. Han, Y. Sugawara, and K. Grant, “Synaptic plasticity in a cerebellum-like structure depends on temporal order,”
*Nature*, vol. 387, no. 6630, pp. 278–281, 1997. View at Publisher · View at Google Scholar - D. K. Bilkey and U. Heinemann, “Intrinsic theta-frequency membrane potential oscillations in layer III/V perirhinal cortex neurons of the rat,”
*Hippocampus*, vol. 9, no. 5, pp. 510–518, 1999. View at Publisher · View at Google Scholar - H.-C. Pape, R. T. Narayanan, J. Smid, O. Stork, and T. Seidenbecher, “Theta activity in neurons and networks of the amygdala related to long-term fear memory,”
*Hippocampus*, vol. 15, no. 7, pp. 874–880, 2005. View at Publisher · View at Google Scholar - L. Aftanas and S. Golosheykin, “Impact of regular meditation practice on EEG activity at rest and during evoked negative emotions,”
*International Journal of Neuroscience*, vol. 115, no. 6, pp. 893–909, 2005. View at Publisher · View at Google Scholar - D. Paré and D. R. Collins, “Neuronal correlates of fear in the lateral amygdala: multiple extracellular recordings in conscious cats,”
*Journal of Neuroscience*, vol. 20, no. 7, pp. 2701–2710, 2000. View at Google Scholar - D. Paré, D. R. Collins, and J. G. Pelletier, “Amygdala oscillations and the consolidation of emotional memories,”
*Trends in Cognitive Sciences*, vol. 6, no. 7, pp. 306–314, 2002. View at Publisher · View at Google Scholar - T. Seidenbecher, T. R. Laxmi et al., in
*Amygdalar and Hippocampal Theta Rhythm Synchronization during Fear Memory Retrieval*, vol. 301, pp. 846–850, American Association for the Advancement of Science, 2003. - T. Aoki and T. Aoyagi, “Synchrony-induced switching behavior of spike pattern attractors created by spike-timing-dependent plasticity,”
*Neural Computation*, vol. 19, no. 10, pp. 2720–2738, 2007. View at Publisher · View at Google Scholar - E. D. Lumer,
*Effects of Spike Timing on Winner-Take-All Competition in Model Cortical Circuits*, vol. 12, MIT Press, Cambridge, Mass, USA, 2000. - T. Aoyagi and T. Aoki, “Possible role of synchronous input spike trains in controlling the function of neural networks,”
*Neurocomputing*, vol. 58–60, pp. 259–264, 2004. View at Publisher · View at Google Scholar - T. Akimitsu, Y. Okabe, and A. Hirose, “Self-organization through spike-timing dependent plasticity using localized synfire-chain patterns,”
*Neural Processing Letters*, vol. 25, no. 1, pp. 79–89, 2007. View at Publisher · View at Google Scholar - J.-M. Alonso, W. M. Usrey, and R. C. Reid, “Precisely correlated firing in cells of the lateral geniculate nucleus,”
*Nature*, vol. 383, no. 6603, pp. 815–819, 1996. View at Publisher · View at Google Scholar - M. Brecht, W. Singer, and A. K. Engel, “Correlation analysis of corticotectal interactions in the cat visual system,”
*Journal of Neurophysiology*, vol. 79, no. 5, pp. 2394–2407, 1998. View at Google Scholar - W. Singer, “Neuronal synchrony: a versatile code for the definition of relations?”
*Neuron*, vol. 24, no. 1, pp. 49–65, 1999. View at Publisher · View at Google Scholar - M. Diesmann, M.-O. Gewaltig, and A. Aertsen, “Stable propagation of synchronous spiking in cortical neural networks,”
*Nature*, vol. 402, no. 6761, pp. 529–533, 1999. View at Publisher · View at Google Scholar - P. Fries, T. Womelsdorf, R. Oostenveld, and R. Desimone, “The effects of visual stimulation and selective visual attention on rhythmic neuronal synchronization in macaque area V4,”
*Journal of Neuroscience*, vol. 28, no. 18, pp. 4823–4835, 2008. View at Publisher · View at Google Scholar - Q.-Y. Wang and Q.-S. Lu, “Time delay-enhanced synchronization and regularization in two coupled chaotic neurons,”
*Chinese Physics Letters*, vol. 22, no. 3, pp. 543–546, 2005. View at Publisher · View at Google Scholar - L. G. Nowak, M. V. Sanchez-Vives, and D. A. McCormick, “Lack of orientation and direction selectivity in a subgroup of fast-spiking inhibitory interneurons: cellular and synaptic mechanisms and comparison with other electrophysiological cell types,”
*Cerebral Cortex*, vol. 18, no. 5, pp. 1058–1078, 2008. View at Publisher · View at Google Scholar - C. A. Goddard, E. I. Knudsen, and J. R. Huguenard, “Intrinsic excitability of cholinergic neurons in the rat parabigeminal nucleus,”
*Journal of Neurophysiology*, vol. 98, no. 6, pp. 3486–3493, 2007. View at Publisher · View at Google Scholar - Y. Tsubo, M. Takada, A. D. Reyes, and T. Fukai, “Layer and frequency dependencies of phase response properties of pyramidal neurons in rat motor cortex,”
*European Journal of Neuroscience*, vol. 25, no. 11, pp. 3429–3441, 2007. View at Publisher · View at Google Scholar - G. H. Seol, J. Ziburkus, S. Huang, L. Song, I. T. Kim, and K. Takamiya, “Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity,”
*Neuron*, vol. 55, no. 6, pp. 919–929, 2007. View at Publisher · View at Google Scholar - E. Thompson and F. J. Varela, “Radical embodiment: neural dynamics and consciousness,”
*Trends in Cognitive Sciences*, vol. 5, no. 10, pp. 418–425, 2001. View at Publisher · View at Google Scholar - S. Dehaene, J.-P. Changeux, L. Naccache, J. Sackur, and C. Sergent, “Conscious, preconscious, and subliminal processing: a testable taxonomy,”
*Trends in Cognitive Sciences*, vol. 10, no. 5, pp. 204–211, 2006. View at Publisher · View at Google Scholar