Abstract

Obtaining the computational models for the functioning of the brain gives us a chance to understand the brain functionality thoroughly. This would help the development of better treatments for neurological illnesses and disorders. We created a cortical model using Python language using the Brian simulator. The Brian simulator is specialized in simulating the neuronal connections and synaptic interconnections. The dynamic connection model has multiple parameters in order to ensure an accurate simulation (Bowman, 2016). We concentrated on the connection weights and studied their effect on the interactivity and connectivity of the cortical neurons in the same cortical layer and across multiple layers. As synchronization helps us to measure the degree of correlation between two or more neuronal groups, the synchronization between the neuronal groups, which are connected across layers, is considered. Despite its obvious importance, there are no sufficient studies concerned about the synchronization in the simulated cortical models. Such studies can help in examining the hypothesis and the dynamical behavior of the simulated model. In this paper, we simulated a cortical model and dynamical behavior and then studied the effect of input noise on its internal neuronal networks and their synchronization.

1. Introduction

In the last decade, the work on obtaining computational models for the brain has been increased tremendously. To understand the connectivity and functionality of the neuronal groups, models at different levels have been proposed. Especially, modeling the cortex has been the most studied subject among the computational neuroscientist. Mostly, the focus is on improving the measurement and imaging techniques like EEG (electroencephalogram) and fMRI (functional magnetic resonance imaging) and collecting and processing data with these techniques. These modern brain imaging techniques are valuable as they provide data for the approval of the computational models focusing on understanding the relationship between cognition and the brain [13]. The models developed for the cortex are ranging from a detailed single neuron model [4] to the mass models where the collective activity of a population of the neuron is considered [3].

Still, the field of brain modeling is in development and needs more ideas to improve the already available models and theories. The most accurate modeling of the human brain occurred in a Japanese university; using a Japanese supercomputer, it took 40 minutes to simulate 1 percent of the human brain neuronal connectivity working for 1 second [2]. The modeling of the brain, at different levels, would provide means to understand the cognitive processes and improve new approaches for diagnosis and treatment of neurological diseases and disorders. Of course, as nature inspires engineers, work on the brain would provide new ideas to develop intelligent agents and systems. New approaches in machine learning already are due to work on the brain as Barto et al.’s reinforcement learning [5, 6] and Grossberg’s adaptive resonance theory [7]. The spiking neuron models are also considered in developing new machine learning methods [8], and working on the spiking neural network models would improve these approaches.

In this work, the activities of a cortical population will be considered, and the model will be constructed using the Izhikevich neuron model; it has been recorded in all mammal brains in a band starting from as low as one wave every forty seconds (0.025 Hz) to as high as six hundred waves per second (600 Hz) [9]. Since the synchronization of neuronal activity is considered to give rise to brain oscillations observed in EEG [10, 11], synchronization of the neuronal groups will be investigated. Synchronization is the degree of correlation between two or more spiking neuron activities in the same time interval and it depends on many chemical and electrical spiking interactions [12].

The measurement of synchronization has many applications in monitoring the activity of the brain and the degree of interaction between different brain parts, which gives us a thorough idea about brain functionality both normal and deficiency, where synchronization can give us a right indication about the degree of the engagement of two or more neuronal groups in some mental task, and the more coherence between the firing patterns of these neuronal groups, and the physiological interactivity between them [4].

In this way, we can state that the degree of synchronization can be an indication of how good the mental activities of a person are and also can be used as an indication of the spreading of some mental diseases such as epilepsy, Parkinson’s disease, autism, and Alzheimer’s disease (AD) [1315].

From the engineering point of view, the synchronization index is an important indication of the dynamical behavior of nonlinear large network systems, since in the case of computational modeling, we are more interested in the overall behavior of the entire system. On the other hand, as we know the brain consists of anatomically separated parts called lobes. Physiologically, it is found that these lobes can be engaged together to do a certain mental task [16].

Although of the obvious importance of synchronization, there are no studies about the synchronization of the simulated neuronal models. In this paper, we simulated the brain cortex and its dynamical behavior and calculated the occurred synchronization between the internal neuronal groups due to implying thalamic noise as a stimulus. Calculating the synchronization between the internal neuronal groups of our model will not just ensure the stability of the model [17] but will also ensure the right interconnectivity and dynamical behavior of the simulated model. This latter property can be helpful when using this model to study cortical behavior through different types of learning and other applications.

In this work, we are inspired by Izhikevich’s and Edelman’s work on a large-scale brain model [18], and we simulated 10000 neuron activities where 22 different types of multicompartmental neurons are considered. The model is constructed with the Brian (v1.4) simulator, and this work gives an example of realizing a large-scale model of the brain using a computer with ordinary computational properties [5]. The results obtained with the model are similar to neuronal activity observed with EEG measurements of the normal human brain cortex. Using this model, we investigated the effect of changing the connection weights on synchronization. It is claimed that the relation between synchrony and the neuronal code aroused from the activation of a group of neurons will inspire new learning techniques [7]. This model can be used also to study the role of short-term plasticity and STDP (spike timing-dependent plasticity) on learning as in [5, 19], where the Brian simulator has a library that is related to STDP, by defining the pre- and postsynaptic neuronal groups, which can be applied to our model [20].

2. Firing Patterns in the Cortex and Simple Neuron Model

The cortex has an important role in the functionality of the brain. It includes the sensory areas, motor areas, and the association areas, and has interactions with the subcortical areas. All these make the cortex responsible for most of the activities of our daily life. Association areas are especially important, in combining different sensory inputs with the processing of subcortical areas to give rise to high-order cognitive tasks. The association functions include generally everything related to language, analyzing information, memorizing, planning, and conscious thinking (creativity) [21].

The cortex consists of six layers; each one of these layers has different cell types with its own firing type which are listed in Table 1; we worked to simulate the brain cortex both anatomically (by using the same rate of the existence of neurons of the cortex and simulated number of synapsis between them) and physiologically (by simulating their group behavior) [22, 23]. On the other hand, spiking in the cortical layers can be divided functionally into excitatory and inhibitory groups. While the excitatory groups work to increase the sympathetic activity in the body, the inhibitory groups work to increase the parasympathetic actions in the body [24].

To model the different behaviors of different cell types in the cortex, we used Izhikevich’s neuron model, which is expressed mathematically through the use of the following nonlinear dynamical equations [23].

There is a reset condition: where and are dimensionless variables, with representing the membrane potential and representing the membrane recovery variable.

The Izhikevich model is capable of expressing different firing types due to chance in the parameter values; so for a large-scale model of the cortex, it provides a suitable model of neuron behavior. Equations (2) and (3) include also other parameters (, and ); these parameters are responsible on giving the spike its characteristic shape and can be found in Table 2 for each spiking type.

3. Creating the Cortical Layers

As we mentioned previously, the cortical brain neurons can be classified functionally to excitatory and inhibitory neurons. The distribution of these two different functional groups of cells is 80% excitatory and 20% inhibitory [25]. In the cortex model which we proposed, the excitatory cells are pyramidal and spiny cells, and their distribution with the spiking type is illustrated in Table 3, according to the level considered. The cortex also has two types of inhibitory cells which are called GABA cells due to the effective neurotransmitter. Like excitatory neurons, they are also distributed in all six layers [16]; the way they are considered in the proposed model is illustrated in Table 3. From Tables 3 and 4, we can see that the percentage of excitatory and inhibitory neurons considered in the model matches the human cortex [25].

Up to this point, we have discussed the neuron types that are considered in the proposed model where pyramidal and spiny cells are taken as excitatory neurons, and GABAergic neurons represent the inhibitory. Now, to simulate this cortical model, these neurons in the different layers should be connected according to connection weights and their sparseness. In Brian environment, the connections are defined with certain weight and sparseness values as dynamic variables and this connection is defined as follows [26]:

Connection (RS_p2, LTS_nb2,’ g_ampa’,

structure =’ sparse’, sparseness = 0.1,

weight = 10)

where denotes the group from which spikes will be propagated, denotes the group to which spikes will be propagated.

With this structure, it is possible to define the types of connections between the connected layers to be either sparse or dense. Sparse which means a spike will either occur or not between the connected layers compared to the dense which means a spike will certainly occur between all the connected layers; it will be the default choice in our case since it is more suitable for modifying the dynamical connections [27, 28]. The dynamical part of the synaptic connections (here for the groups, in our example it is ) is represented by another differentiation equation, Equation (5), where denotes the dynamic variable corresponding to synaptic connection and it is initialized with random values. is the recovery time, which is the time required by the membrane to return to its rest potential; each neuronal group has its own dynamical variable and recovery time (). The whole types of dynamic variables () used in our model are listed in Table 5.

Returning to the example of connection we mentioned, sparseness denotes the probability of a connection between two groups of neurons to occur and its value is taken to be between 0.1 and 0.2 in our model [25]. The synaptic weight between the neurons can also be changed dynamically, where the weight here denotes the values added to the dynamical variable () of each connection in order to increase or decrease the strength of the connection as in Equation (6).

Once connected, neurons start to fire; the strength of the synaptic connections between them will either increase or decrease according to the functional property of the neurons considered (excitatory neurons or inhibitory neurons). While excitatory neurons increase the synaptic connections, the inhibitory neurons decrease them. These changes in the synaptic connections due to firing of neurons are called Hebbian rule and it is specified by changing the weights of connections. Where according to the definition of Hebbian learning and according to general Equation (7), STDP is a good choice for long-term synaptic plasticity exploiting, where spike timing-dependent plasticity (STDP) is a Hebbian synaptic learning rule in which the millisecond timing of pre- and postsynaptic-paired activities induces either synaptic long-term potentiation (LTP) or long-term depression (LTD) [29]. where is the change in synaptic weight, is the learning rate, is the presynaptic neuron, and is the postsynaptic neural response.

Also about the weight values, it has been taken from 0 to 100 for statistical purposes. In our model, the weight will be changed throughout iterations to investigate its role in synchronization. We took the weight values to be between 1 and 100. Now, as we defined our neuron structures and connections, we are ready to form the neuronal groups that compromise the activity of the cortex.

4. Creating Neuronal Groups

In order to model the behavior of the cortex and corticothalamic connections, the most effective firing pattern for each layer is considered and parameters of the Izhikevich neuron model are chosen to create the relative firing pattern. The neurons in each group are not only connected to the neurons in the group but also to the neurons in other groups. Even though the connection between and in groups has different properties, still the establishment of connections is done in such a manner that with the parameters defining connections in Brian, the biologically plausible model is obtained.

The thalamic model was also built, where it consists of both the excitatory and inhibitory groups. While the excitatory groups consist of regular spiking (RS) and bursting (IB), the inhibitory groups consist of the GABA groups (see Tables 3 and 4). The connections of the thalamic groups were targeted towards cortical layers of L2/3, L4, and L6. The effect of the corticothalamic connections was introduced as a noise input to the cortical model at the mentioned layers.

The entire network proposed for the cortex with connections properties and different cortical neuronal groups is shown in Figure 1. Here, each one of the five blocks represents a neuronal group; inside each block is the name of the group and its connection sparseness is given as a percentage. One can notice that the names of the blocks are the same as the names of spiking types mentioned in Table 1. The circles inside each block stand for the subgroups of the main group, which represents the percentage of distribution of the neurons. The main group in each layer in the cortex can be realized from the name of each circle which coincides with Tables 3 and 4; each subgroup has its own connection properties defined with the parameters of dynamic variable as illustrated in Table 4.

The three upper blocks (RS, CH, IB) are the excitatory groups, while the lower two (FS, LTS) are the inhibitory ones, with the sum of total percentage of 80% for the excitatory groups and 20% for the inhibitory groups, respectively, as shown in Tables 3 and 4. Arrows represent connections, and as we can see, the connections are established in such a way that every single neuron has the ability to connect to its own followers in the same group and the neurons in other groups via bidirectional connections. The arrows are colored as red for excitatory and blue for inhibitory. In this way, we can make a model that is capable of simulating the behavior of microcolumns in the cortex, even in its learning capabilities [30].

The results obtained from the simulation of the model are given in Figures 2 and 3, where the title of each figure ( in Figure 2 for example) illustrates the spiking type which is also the name of the neuronal group, while (p2) means pyramidal cells located in layer (2) in the cortex (see Tables 3 and 4). In Figures 2 and 3, some of the excitatory and inhibitory groups are plotted, where the first row is the raster plot of the firing neurons which shows us the overall activity of the groups by showing the number and temporal location of the firing neuron in each unit time (in our model 1 ms), the second row is the single spike (the membrane voltage of one neuron) which in our case is (RS) type in Figure 2, the third row is variable of this neuronal group which is the time recovery after each spike, the fourth row is the dynamic variable , and finally, the fifth row is the firing rate which represents the number of spiking neurons per unit time which in our case milliseconds (ms). So, from Figures 2 and 3, we can get the overall activity of the groups which is given by raster plots; the behavior of single neuron, the dynamics of the connections, and the firing rate illustrate activeness in the neuronal population which are also shown.

If we take a second look at Figures 2 and 3 and by examining the first and fifth rows, we can see that the spiking of the group has a random behavior compared to the single spiking behavior shown in the second row of the same figures. This behavior is a sign of existence of an interaction between different groups in the model, i.e., this kind of randomness in rows (1 and 5) means that the spiking of this group of neurons has been affected by the spikes of other groups since normally these two rows were to show more rhythmic spiking behavior that match with the single spike behavior shown in the second rows of the figures if there was no synchrony at all. This interaction between this group and the other groups can be measured then by measuring the degree of synchrony that occurred between them. In the next section, we will calculate how much each group of neurons has been affected by other groups and by the weight of the connections and this will be done by calculating the synchrony measuring factor. The obtained results represent both the cortical model, the thalamic model, and their connection dynamical behavior.

5. Measuring Synchrony

Finally, in order to ensure the biological postulate of our model, one way is to monitor its dynamical behavior through the synchronization measurement. To decide on the level of synchronization, a synchronization measurement has to be considered. Especially, to see the synchronization between groups, the interactivity of each one of the neuronal groups created with other groups is considered while changing the connection weights between the groups. This will help us to understand the effect of connection weights on the whole model, the degree of effectiveness of each layer by the action of the other layers. The synchronization measurement can be considered as the estimator of connectivity in the cortex [18]. Measuring the interactivity between cortical layers is important especially in the case of cognitive acts, which need a harmonic and cooperative action from most of the cortical layers [31]; it is important also in many applications like detecting and measuring the degree of brain disorders [32]. The synchrony measurement of the neuronal groups increases the ability to predict the behavior for long-term neuronal interaction. It can also give us a prediagnostic about the availability of specific mental diseases [33]. Furthermore, it helps the investigation of the active brain areas during some activities like movement or cognition [26, 34]. The synchrony measure for neuronal activity of neurons is given as follows [34]:

In Equation (8), is the variance of the activity of all neurons; so to calculate it, the mean of neuron behavior is considered and the signal is defined as follows:

So, the behavior of averaged over is calculated first; then, is obtained as follows:

The variance of each neuron is calculated in a similar way:

The synchrony measure is calculated while changing the connection weights in an interval of 1 to 100 incrementing each time by 10 mV for the inhibitory and excitatory groups. Regular spiking (RS) and chattering (CH) have neuron behavior in the excitatory group, while the inhibitory group has fast spiking (FS) neurons. The simulation results are given in Figures 4 and 5.

Figures 4 and 5 show the results of synchronization measurement of each group. In Figure 4, we plotted the synchrony measurements of the excitatory groups (, and ), while in Figure 5, we plotted the synchrony measurements of the inhibitory groups (, and ). The -axis is the degree of synchronization which is normally between 0 and 1, where 0 means no synchrony at all and 1 means total synchronization between this group (under study) and the other groups in the model. The -axis is the value of weight of connection; it changes during the run in each iteration.

Generally, the figures show good synchronization between the neuronal groups in our model, which means there is good connectivity between them.

6. Conclusion

In this simulated model, we worked to simulate the brain cortex both anatomically (by using the same rate of the existence of neurons of the cortex and simulated number of synapsis between them) and physiologically (by simulating their group behavior). The effect of connection weights over the strength of the connection is investigated. The degree of connectivity was tested thoroughly by calculating the synchronization between the connected neuronal groups. The synchronization can give us a right indication and a thorough idea about brain functionality both in normal and deficiency cases, and about the degree of the engagement of two or more neuronal groups in some mental task, it also serves as an index to indication of the dynamical behavior of nonlinear large network systems, since in the case of computational modeling, we are more interested in the overall behavior of the entire system, which here can justify the simulated model and ensures its, biological-like, dynamical behavior. Even though synchronization within a group has been considered in previous works, the synchronization between groups is considered for the first time in this work up to our knowledge. The result shows that there is an increase in the synchronization factor with the increase occurs in the connection weights, which shows that there is an increase in the connectivity between neurons. This conclusion can be used in multiple applications especially in machine learning and cognitive research fields. As a future work, this model can be improved and used in the field of AI learning, especially the STDP method.

Data Availability

No data were used to support this study.

Conflicts of Interest

The author declares that there are no conflicts of interest.

Acknowledgments

The author thanks Prof. Dr. Neslihan Serap Sengor from Istanbul Technical University for her valuable support.