Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2018, Article ID 3689487, 10 pages
https://doi.org/10.1155/2018/3689487
Research Article

A New Computational Model for Astrocytes and Their Role in Biologically Realistic Neural Networks

Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, USA

Correspondence should be addressed to Sébastien Hélie; ude.eudrup@eilehs

Received 23 April 2018; Accepted 14 June 2018; Published 5 July 2018

Academic Editor: Paolo Massobrio

Copyright © 2018 Zahra Sajedinia and Sébastien Hélie. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Recent studies in neuroscience show that astrocytes alongside neurons participate in modulating synapses. It led to the new concept of “tripartite synapse”, which means that a synapse consists of three parts: presynaptic neuron, postsynaptic neuron, and neighboring astrocytes. However, it is still unclear what role is played by the astrocytes in the tripartite synapse. Detailed biocomputational modeling may help generate testable hypotheses. In this article, we aim to study the role of astrocytes in synaptic plasticity by exploring whether tripartite synapses are capable of improving the performance of a neural network. To achieve this goal, we developed a computational model of astrocytes based on the Izhikevich simple model of neurons. Next, two neural networks were implemented. The first network was only composed of neurons and had standard bipartite synapses. The second network included both neurons and astrocytes and had tripartite synapses. We used reinforcement learning and tested the networks on categorizing random stimuli. The results show that tripartite synapses are able to improve the performance of a neural network and lead to higher accuracy in a classification task. However, the bipartite network was more robust to noise. This research provides computational evidence to begin elucidating the possible beneficial role of astrocytes in synaptic plasticity and performance of a neural network.

1. Introduction

Neurons and glia cells are building blocks of the human brain. Neurons are defined based on their ability to produce action potentials; the other cells in the human brain, which do not support this ability, are called glia cells [1]. By the early 1990s, it was widely believed that glia cells only performed passive functions, such as providing nutrition and removing waste. They were referred to as housekeeping cells [2, 3]. In 1999, for the first time, the term “tripartite synapse” was introduced by Araque et al. to describe the bidirectional communication between neurons and glia cells [4]. Since then, each year new evidence supports the hypothesis that glia cells, alongside neurons, communicate with synapses and modulate them [418]. One consequence of these findings is that glia cells are responsible for processing information in the human brain.

These findings are important because glia cells are up to 50 times more numerous than neurons [19]. They come in different shapes and at different locations in the nervous system [1]. So far, only two types of glia cells, named Schwann cells, in the neuromuscular junctions, and astrocytes, in the central nervous system (CNS), have been shown to be associated with synapses and participate in synaptic modulation [4, 18]. In this article, we focus on CNS tripartite synapses, and, therefore, we only consider astrocytes.

1.1. What Is the Role of Astrocytes in Neural Computation?

Given the mounting evidence that astrocytes contribute to neural computation, a follow–up question is what roles do astrocytes play in neural computation? One intriguing possibility is that astrocytes could contribute to learning and memory [20]. For example, astrocyte disruption impairs later formation of long-term memory. In addition, evidence has been gathered that astrocytes affect the dynamics of neural populations [21], which could modulate neural plasticity [22]. One possible explanation for these observations is that astrocytes can operate at slower timescales than neurons [23, 24] and thus could possibly maintain activity in postsynaptic neurons after stimulation of the presynaptic neurons has stopped. This in turn could facilitate consolidation by facilitating long-term potentiation (LTP) and long-term depression (LTD) [25]. However, another possibility is that this extended neural activity alongside other noise sources adds noise in the system, which could affect the network’s robustness and performance [26]. One way to test for these possibilities is through computer simulation. Because this hypothesis is related to rhythms and timing, the present research used biologically realistic spiking neuron models and developed a dynamical model of astrocyte activation. Below we present minimum criteria that a dynamical model of astrocyte activation should meet and review previous attempts at computational models of astrocytes.

1.2. Previous Modeling Effort

Many computational neuroscience models of astrocytes have been proposed to account for the many differences between neurons and astrocytes [15]. However, in this project we propose a new approach by using an existing neural model to implement astrocytes, namely, the Izhikevich simple model of neurons [27]. An important advantage of the proposed approach is that it allows researchers to simply model astrocytes as a type of neuron, without sacrificing the two key characteristics of astrocyte dynamics. First, as suggested by the absence of action potentials, astrocytes show a linear current-voltage relationship (I–V curve) [28]. In contrast, the I–V curve is nonlinear in most neurons (and often N–shaped) [27]. Second, the effect of astrocyte modulating synapses can be slower than neurons, as studies show that astrocytes can be in a slow or fast mode. The slow and fast modes target NMDA and mGluR receptors, respectively [29]. In this article, we study the behavior of networks by using reinforcement learning rules. Since LTP in reinforcement learning relies on NMDA receptors [25], this article focuses on the slow mode of astrocyte dynamics [23, 24].

Note that many existing astrocyte models do not account for one or both these characteristics. For example, some existing models are not presenting a linear I–V curve in astrocytes [30, 31]. As a result, astrocytes spike in the model proposed by Haghiri et al. [32]. Other models focus on the tripartite synapse and are not capturing the intercellular characteristics of astrocytes [24, 33, 34]. In the present work, we attempt to propose a simple biologically realistic model of astrocyte dynamics that meets these minimum requirements.

1.3. Organization of This Article

This research aimed to study the role of astrocytes in the performance of neural networks. More specifically, we intended to test whether astrocytes are capable of improving the performance of a spiking neural network. The reminder of this article is organized as follows. First, Section 2 describes a new model for astrocytes by using the Izhikevich model of neurons. Second, Section 3 describes the design and implementation of two networks of neurons. The first network had only bipartite synapses and the second network also included astrocytes and thus tripartite synapses. These networks are referred to as bipartite and tripartite networks (respectively). Third, by applying reinforcement learning rules, we studied the classification accuracy of both networks in noisy and non-noisy conditions. The results in Section 3.2 show that in non-noisy environments, adding astrocytes can lead to a higher accuracy in classifying randomly generated stimuli. Lastly, Section 4 discusses the results and explores future directions for studying astrocytes in both healthy and nonhealthy brains as well as in artificial intelligence.

2. Cell Models

Although astrocytes recently received much attention in neurophysiology [3538], their computational model remain underdeveloped when compared to their neural counterparts [15]. In this section, we introduce a new model of astrocytes based on the Izhikevich model of neurons [27]. The proposed model is aimed at reproducing the linear I–V curve observed in astrocytes [28]. The timing of tripartite synaptic modulation is addressed in Section 3.1.2.

2.1. Izhikevich’s Simple Neuron Model

The Izhikevich model is a computationally efficient, biologically plausible, model of neurons that allows for real-time simulation of networks of spiking neurons on a desktop PC [39]. Each neuron in the Izhikevich model is implemented as follows [27]:where represents the membrane capacitance, is the membrane potential, is the resting membrane potential, is the instantaneous spiking threshold, is the input, is the recovery current, and is a recovery time constant. Rheobase and input resistance jointly determine the constants and . and represent the voltage reset value and the total difference between the outward currents and inward currents during a spike (respectively). These parameters can be set to different values to accurately model many types of neurons [27]. In this article, neurons were modeled by using the parameter values provided by Izhikevich to simulate cortical pyramidal neurons (Table 1).

Table 1: Parameter values used to model neurons and astrocytes based on the Izhikevich simple model of neurons. The neuron parameters represent a pyramidal neuron in neocortex [27].
2.2. Dynamic Model of Astrocyte Activation

The Izhikevich model of neurons is flexible in modeling different types of neurons. However, the Izhikevich model has never been used to model astrocytes, and no parameter values were previously available. As shown in Figure 1(a), the relation between voltage and current in astrocytes is approximately linear [28, 40]. We used the IV relationship in Figure 1(a) to estimate the parameters of the Izhikevich model that could emulate the astrocyte voltage-current curve. The parameters of the Izhikevich model were optimized (using mean square error) to values that give an approximate linear voltage-current relation. Table 1 shows the estimated values of an Izhikevich neuron that represent an astrocyte. It should be noted that the parameters in the astrocyte model do not have the same physiological interpretation as in the neuron model. The values of , and the other parameters were estimated to represent the linear I–V relation in astrocytes and they do not correspond to the astrocyte’s capacitance, voltage, and so on. Also, mostly represents in the Izhikevich model of neurons, whereas it represents   in the proposed astrocyte model. Hence, the astrocyte model parameter values should be interpreted as scale–free.

Figure 1: The current/voltage relationship (IV curve) for a biological astrocyte (a) Pannasch et al. [28] (Supplementary Material), the model (b).
2.3. Results

Figure 1 shows the current/voltage (IV) curves of a biological astrocyte on the left and the new astrocyte model on the right. between the data and model is , which indicates a near-perfect fit. Both curves show a linear relation between current and voltage. Also, Figure 2 shows the membrane potential of a simulated astrocyte with a stable input current of from to . Biological astrocytes do not spike in these conditions [40]. Similarly, the astrocyte model did not produce any spike. Note, however, that injecting strong currents in the astrocyte model would eventually result in spikes. However, we did not have biological information on astrocyte behavior in those current ranges. Hence, the model is compatible with the available biological data in Dallérac et al. [40].

Figure 2: Membrane potential of the astrocyte model by injecting the current of I=4mA from t=100ms to t=1000ms.
2.4. Discussion

This section proposed a new biologically realistic astrocyte model that accurately represent the linear IV relationship and does not spike. Given that the natural shape of the IV relationship in the Izhikevich model is nonlinear, the reader may wonder why we chose not to use a linear equation to model astrocytes instead of Izhikevich neuron’s equations. Our choice was motivated by the fact that the Izhikevich model is popular and well-defined. Hence, the proposed model allows for modeling astrocytes simply by modifying the values of the parameters of available neurons. This makes the inclusion of astrocytes convenient in neural networks using the Izhikevich model, as astrocytes can be modeled as just another type of neurons.

The change in the membrane potential is studied by simulating the injection of the current of to the astrocyte model (Figure 2). The reason that we chose the current is that the biological results in Dallérac et al. [40] were based on the same condition. Therefore, to make the comparison possible, we kept the conditions equivalent. The results show that there are no spikes in both the biological and simulated astrocytes. The new astrocyte model thus satisfies the first key characteristic of biological astrocytes.

3. Modeling and Testing Bipartite and Tripartite Networks

Section 3.1 presents the design, implementation, and test procedure of the bipartite and tripartite networks. Then, results and discussion are provided in Sections 3.2 and 3.3, respectively.

3.1. Method

To study how astrocytes affect synaptic plasticity and the network’s overall performance, we implemented two networks: the first network contained neurons and bipartite synapses (Section 3.1.1), while the second network contained neurons, astrocytes, and tripartite synapses (Section 3.1.2). Both of these networks were trained with reinforcement learning, as described in Section 3.1.3. Finally, Section 3.1.4 details the learning task implementation method for comparing the results.

3.1.1. Bipartite Network

Architecture. The network of neurons had 10 presynaptic neurons, 2 postsynaptic neurons, and 20 fully connected plastic synapses (Figure 3). The neurons were modeled based on the Izhikevich simple model of neurons, as described in Section 2.1.

Figure 3: The architecture of the bipartite network. This model consists of 10 presynaptic neurons, 2 postsynaptic neurons, and 20 plastic synapses. represents the synaptic weight from presynaptic neuron to postsynaptic neuron .

Modeling Synapses. The simulated synapse can be simplified by modeling the delays of spike propagation through the synaptic cleft. One standard and widely accepted method is to use an -function [25, 41]:where is the time since the cell voltage reached and is the time at which the cell voltage reached . is a constant that determines the duration of signal propagation in the synapse. Greater values result in longer synaptic transmission. The -function delivers the neurotransmitter from the presynaptic neuron to the postsynaptic neuron gradually. If is reached again by the presynaptic neuron or an astrocyte while the propagation of the neurotransmitter is still in process, then a new -function related to reaching the second is added to the first -function. The latency in a typical synapse is generally less than 0.5 ms [42]. This delay was approximated by using .

3.1.2. Tripartite Network

In the tripartite network, astrocytes were modeled as proposed in Section 2.2. Neurons were identical to the Izhikevich simple model of neurons, which are presented in Section 2.1. However, synapses were different and designed as follows.

Modeling Tripartite Synapses. The process of synaptic neurotransmission is typically initiated by the release of neurotransmitters by the presynaptic neurons. These neurotransmitters can reach adjacent astrocytes and increase concentration inside the cell. This increase of can cause astrocytes to release glutamate. This glutamate then feeds back to the synapse and neurons [4]. Figure 4 shows a simplified model of this process.

Figure 4: Simplified signaling pathways in a tripartite synapse. The astrocyte receives from the presynaptic neuron and from the postsynaptic neuron. The astrocyte sends glutamate to the synapse and the postsynaptic neuron as shown by and .

To model the signaling pathways of , and glutamate, we used an –function with for astrocyte’s glutamate and and for the pathway. These values approximately reproduce the greater latency in tripartite synapses.

Architecture. The architecture of the tripartite network is similar to the bipartite network except that, in addition to neurons, 2 astrocytes were included (one for each postsynaptic neuron) and the resulting synapses were tripartite. Astrocytes and their relation to synapses and neurons are depicted in Figure 5. As can be seen in the figure, each astrocyte contributed to 10 synapses and received input from all presynaptic neurons as well as its associated postsynaptic neuron.

Figure 5: Architecture of the tripartite network. Astrocytes are shown as stars. The neurotransmitter associated with each synapse is indicated on top of each line. G stands for glutamate and k stands for . represents the weight of a synapse. Red lines show the inputs to the first postsynaptic neuron; orange lines show the inputs to the second postsynaptic neuron. Green lines and black lines represent inputs to, and output from, astrocytes (respectively). Connections between neurons (red and orange) were plastic, while the rest of the connections were fixed. Connections with the same symbol had the same constant weight values.
3.1.3. Synaptic Plasticity

Synaptic plasticity can be presented in terms of different learning models. In this research, we used the reinforcement learning algorithm described by [25]. In this model, LTP is triggered by strong presynaptic activation, strong postsynaptic activation, and dopamine levels above baseline. In contrast, LTD is triggered by strong pre- and postsynaptic activation with dopamine below baseline or weak postsynaptic activation. This learning process is described by the following:where is the strength of the synapse on trial . represents the input from the presynaptic neuron (i.e., , which is the integrated -function output of the presynaptic neuron). is the integral over the positive voltage of postsynaptic neuron , is a constant that shows the baseline dopamine level, denotes the amount of dopamine released following feedback on trial , and , , and are constants that work similar to standard learning rates. and are the activation thresholds for postsynaptic and glutamate receptors (numerically should be greater than [25]). represent a function that returns 0 for negative values and keeps the same value for positive values. Note that weights are not modified when the postsynaptic activation is below (see last term of (3)). Finally, is the maximum allowable weight.

To calculate , we used the following formula:where RPE isPredicted reward, , is

Obtained Reward is if the network is correct, if the network is incorrect, and 0 if no feedback is received [25]. Table 2 shows the values assigned to the constant parameters of the above equations.

Table 2: Parameter values used to implement reinforcement learning.
3.1.4. Networks in Action and Comparisons

To test for the learning ability of the bipartite and tripartite networks, a simple classification experiment was designed. To generate classification stimuli, the input layer of the networks was used as a 1–dimensional input grid with Gaussian filters. Specifically, each input neuron was located at coordinate 5, 15, 25,..., 95 in a arbitrary 1D space. The location of the neuron was the mean of the Gaussian filter, and all Gaussian filters had a standard deviation of 30. In each simulated trial, the location of one of the input neurons was randomly selected and a current of 70 mV was injected through the Gaussian filter. Because the Gaussian filters overlap, surrounding neurons also received current, but to a lesser extend based on the Gaussian filter. The exact timing of the injected current (and trial) is shown in Algorithm 1. Because the pre- and postsynaptic neuron layers were fully connected, the current was propagated to the two postsynaptic neurons according to the connection weights. The postsynaptic neuron with the most activation was selected as the winner and constituted the model response.

Algorithm 1: The working network.

All plastic connections were initially random, and the network needed to learn to associate the first 5 presynaptic neurons with the first postsynaptic neuron and the last five presynaptic neurons with the second postsynaptic neuron using reinforcement learning. For example, if the first presynaptic neuron had received the most current and the winner was the first postsynaptic neuron, positive feedback was provided (in the form of dopamine release). In contrast, if the seventh presynaptic neuron had received the most current and the first postsynaptic neuron was the winner, negative feedback was provided (in the form of a dip in dopamine).

The simulation methodology is described in Algorithm 1. It should be noted that the simulation is exactly the same for both tripartite and bipartite networks. For example, if the first presynaptic neuron receives the current ‘I’ as input in the first trial of the tripartite network, then the same neuron will receive the same amount of current in the first trial of the bipartite network. Also, the initial weights were exactly the same for the two networks.

3.2. Results

In this section, first, we present the results of implementing one single synapse. Next, the classification results of the bipartite and tripartite networks are provided.

Synapse. To compare tripartite synapses with bipartite synapses, we simulated the injection of a current to the presynaptic neuron for . Then, we studied the changes in the voltage and spikes of neurons in both bipartite and tripartite synapses.

The result of implementing a bipartite synapse, which consist of presynaptic and postsynaptic neurons, is presented in Figure 6. Figure 6(a) shows from top to bottom the spikes of the presynaptic neuron, the output of the presynaptic neuron, and the spikes of the postsynaptic neuron. Figure 6(b) presents the same results for the tripartite synapse introduced in Figure 4. The results show that adding an astrocyte in a tripartite synapse results in additional spikes after regular spikes (from the bipartite synapse) have ended in the postsynaptic neuron.

Figure 6: Behavior of neurons in a bipartite synapse (a) and tripartite synapse (b). The top and bottom panels show spikes in the presynaptic and postsynaptic neurons (respectively), while the middle panels show the input to the postsynaptic neuron.

Networks. Figure 7 presents the accuracy results of classifying randomly selected inputs in a non-noisy condition (following Algorithm 1). As can be seen in the figure, the tripartite network was more accurate in classifying stimuli throughout learning. Final accuracy of the tripartite network was (compared with for the bipartite network). Hence, the performance of the tripartite network was superior in a noiseless environment.

Figure 7: Classification accuracy for the tripartite (top) and bipartite (bottom) networks in a non-noisy condition.

Next, a small amount of noise, , was added to the voltage of the neurons. Figure 8 shows that the tripartite network was less robust to noise in comparison to the bipartite network. The drop in accuracy caused by the added noise was larger in the tripartite network when compared to the bipartite network [66% to 66% (bipartite) versus 77% to 69% (tripartite); see Figure 8(a)]. Adding moderate noise (Figure 8(b)), however, reduced the accuracy difference between the networks (65% versus 67% for the bipartite and tripartite networks, respectively). Finally, the accuracy difference all but disappeared with higher levels of noise (Figure 8(c)). As can be seen in all three panels of Figure 8, the bipartite network was more robust and not much affected by the noisy conditions.

Figure 8: Accuracy in the classification task for the tripartite (circle) and bipartite (square) networks in noisy conditions.
3.3. Discussion

The results presented in this section provide an answer to the question that was first asked: Are astrocytes capable of enhancing the performance of a neural network? The answer is ‘yes’ (in the noiseless environment), although this result clearly does not mean that the tripartite network always work better than the bipartite network. To be more specific, our goal here was not to show that tripartite networks had an advantage over bipartite networks for all parameter values in all conditions. We only tried to show that astrocytes can be considered as a candidate for improving the performance of a neural network in specific conditions, and the role of astrocytes in improving the performance of a neural network is plausible. Further, we showed that the effect of astrocytes is to increase the length of activation (or number of spikes) in postsynaptic neurons.

4. General Discussion and Future Work

In this research we tried to answer the following questions:

Is there a potential role for astrocytes in enhancing the performance of a neural network?

The answer is yes, the computational result in this research suggest that there are conditions in which astrocytes improve synaptic plasticity and the performance of a neural network.

Is reinforcement learning a good candidate for adjusting synaptic weights of tripartite networks? The answer is yes, as shown in Figure 7, the tripartite network reaches the accuracy of more than in classifying input stimuli. This suggests that reinforcement learning is successful in adjusting the synaptic weights.

Are tripartite networks more robust to noise in comparison to bipartite networks? Figure 8 shows the opposite. Injecting a small amount of noise to the voltage of neurons produced a dramatic drop in the accuracy of categorization in the tripartite network. In contrast, a bipartite network with the same parameters and noise almost kept the same performance.

4.1. Future Work

This research opens up possibilities for many future directions. First, by having a simple biologically realistic dynamical model of astrocytes, different theories about the roles of astrocytes can be tested more easily. For example, research in physiology shows that the number of astrocytes increases in neurodegenerative diseases [43, 44]. To explore how this increase would affect synaptic plasticity, spikes, and more generally the behavior of the network, one can implement a tripartite network with numerous astrocytes and test if the predicted behavior of the computational model matches the symptoms of these diseases. Second, more realistic models of tripartite networks can be developed. For example, some studies show that astrocytes also form a network and communicate through calcium waves [9, 45]. This calcium signaling in astrocytes is controlled by synaptically evoked neurotransmitters such as ATP, GABA, and glutamate [9, 46]. Astrocytes can also release these neurotransmitters into the synaptic cleft, a phenomenon called gliotransmission [9, 17, 46, 47]. As we learn more about gliotransmission, these additional processes can also be added to the tripartite network model to obtain more physiologically accurate results. A third possibility is related to artificial intelligence. In the past few years, very simple models of astrocytes were successfully added to artificial neural networks [24, 33, 34, 48]. The astrocyte model proposed in this research could provide new insights on designing more biologically accurate models of artificial astrocytes in artificial neural networks. Overall, it is our hope that providing a simple astrocyte model to the research community will contribute to increasing research about the roles of these cells in information processing.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This research was supported, in part, by Grant no. 2R01MH063760 from the National Institute of Mental Health to Sébastien Hélie. Some of this work has been presented in the Mathematical and Computational Cognitive Science weekly colloquium in the Department of Psychological Sciences at Purdue University by Zahra Sajedinia.

References

  1. N. J. Allen and B. A. Barres, “Neuroscience: glia—more than just brain glue,” Nature, vol. 457, no. 7230, pp. 675–677, 2009. View at Publisher · View at Google Scholar · View at Scopus
  2. M. K. Temburni and M. H. Jacob, “New functions for glia in the brain,” Proceedings of the National Acadamy of Sciences of the United States of America, vol. 98, no. 7, pp. 3631-3632, 2001. View at Publisher · View at Google Scholar · View at Scopus
  3. F. He and Y. E. Sun, “Glial cells more than support cells?” The International Journal of Biochemistry & Cell Biology, vol. 39, pp. 661–665.
  4. A. Araque, V. Parpura, R. P. Sanzgiri, and P. G. Haydon, “Tripartite synapses: glia, the unacknowledged partner,” Trends in Neurosciences, vol. 22, no. 5, pp. 208–215, 1999. View at Publisher · View at Google Scholar · View at Scopus
  5. L. Pasti, A. Volterra, T. Pozzan, and G. Carmignoto, “Intracellular calcium oscillations in astrocytes: a highly plastic, bidirectional form of communication between neurons and astrocytes in situ,” The Journal of Neuroscience, vol. 17, no. 20, pp. 7817–7830, 1997. View at Publisher · View at Google Scholar · View at Scopus
  6. A. Araque, G. Carmignoto, and P. G. Haydon, “Dynamic signaling between astrocytes and neurons,” Annual Review of Physiology, vol. 63, pp. 795–813, 2001. View at Publisher · View at Google Scholar · View at Scopus
  7. G. Perea and A. Araque, “Communication between astrocytes and neurons: A complex language,” Journal of Physiology-Paris, vol. 96, no. 3-4, pp. 199–207, 2002. View at Publisher · View at Google Scholar · View at Scopus
  8. G. Perea and A. Araque, “Properties of synaptically evoked astrocyte calcium signal reveal synaptic information processing by astrocytes,” The Journal of Neuroscience, vol. 25, no. 9, pp. 2192–2203, 2005. View at Publisher · View at Google Scholar · View at Scopus
  9. G. Perea, M. Navarrete, and A. Araque, “Tripartite synapses: astrocytes process and control synaptic information,” Trends in Neurosciences, vol. 32, no. 8, pp. 421–431, 2009. View at Publisher · View at Google Scholar · View at Scopus
  10. G. Perea and A. Araque, “Astrocytes potentiate transmitter release at single hippocampal synapses,” Science, vol. 317, no. 5841, pp. 1083–1086, 2007. View at Publisher · View at Google Scholar · View at Scopus
  11. G. Perea and A. Araque, “GLIA modulates synaptic transmission,” Brain Research Reviews, vol. 63, no. 1-2, pp. 93–102, 2010. View at Publisher · View at Google Scholar · View at Scopus
  12. C. Bonansco, A. Couve, G. Perea, C. Á. Ferradas, M. Roncagliolo, and M. Fuenzalida, “Glutamate released spontaneously from astrocytes sets the threshold for synaptic plasticity,” European Journal of Neuroscience, vol. 33, no. 8, pp. 1483–1492, 2011. View at Publisher · View at Google Scholar · View at Scopus
  13. D. A. Rusakov, K. Zheng, and C. Henneberger, “Astrocytes as regulators of synaptic function: A quest for the Ca2+ master Key,” The Neuroscientist, vol. 17, no. 5, pp. 513–523, 2011. View at Publisher · View at Google Scholar · View at Scopus
  14. P. G. Haydon, “Glia: listening and talking to the synapse,” Nature Reviews Neuroscience, vol. 2, no. 3, pp. 185–193, 2001. View at Publisher · View at Google Scholar · View at Scopus
  15. F. Oschmann, H. Berry, K. Obermayer, and K. Lenk, “From in silico astrocyte cell models to neuron-astrocyte network models: A review,” Brain Research Bulletin, 2016. View at Google Scholar · View at Scopus
  16. M. M. Halassa, T. Fellin, and P. G. Haydon, “The tripartite synapse: roles for gliotransmission in health and disease,” Trends in Molecular Medicine, vol. 13, no. 2, pp. 54–63, 2007. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Volterra, P. J. Magistretti, and P. G. Haydon, “The tripartite synapse: glia in synaptic transmission,” in 1em plus 0.5em minus 0.4em Oxford University Press, 2002. View at Google Scholar
  18. C. Eroglu and B. A. Barres, “Regulation of synaptic connectivity by glia,” Nature, vol. 468, no. 7321, pp. 223–231, 2010. View at Publisher · View at Google Scholar · View at Scopus
  19. G. I. Hatton and V. Parpura, “Glial neuronal signaling. 1em plus 0.5em minus 0,” 4em Springer, vol. 1, 2004. View at Google Scholar
  20. R. D. Fields, A. Araque, H. Johansen-Berg et al., “Glial Biology in Learning and Cognition,” The Neuroscientist, vol. 20, no. 5, pp. 426–431, 2014. View at Publisher · View at Google Scholar
  21. M. López-Hidalgo and J. Schummers, “Cortical maps: a role for astrocytes?” Current Opinion in Neurobiology, vol. 24, no. 1, pp. 176–189, 2014. View at Publisher · View at Google Scholar · View at Scopus
  22. S. HÉlie and P. J. Fleischer, “Simulating the effect of reinforcement learning on neuronal synchrony and periodicity in the striatum,” Frontiers in Computational Neuroscience, vol. 10, 2016. View at Google Scholar · View at Scopus
  23. V. Parpura, A. Schousboe, and A. Verkhratsky, “Glutamate and ATP at the Interface of Metabolism and Signaling in the Brain,” 1em plus 0.5em minus 0.4em Springer, 2014.
  24. Z. Sajedinia, “Artificial Astrocyte Networks, as Components in Artificial Neural Networks,” in Unconventional Computation and Natural Computation, vol. 8553 of Lecture Notes in Computer Science, pp. 316–326, Springer International Publishing, Cham, 2014. View at Publisher · View at Google Scholar
  25. F. Gregory Ashby and S. Helie, “A tutorial on computational cognitive neuroscience: modeling the neurodynamics of cognition,” Journal of Mathematical Psychology, vol. 55, no. 4, pp. 273–289, 2011. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  26. W. Maass, “Noise as a resource for computation and learning in networks of spiking neurons,” Proceedings of the IEEE, vol. 102, no. 5, pp. 860–880, 2014. View at Publisher · View at Google Scholar · View at Scopus
  27. E. M. Izhikevich, Dynamical Systems in Neuroscience: the Geometry of Excitability And Bursting, MIT Press, Cambridge, Mass, USA, 2007. View at MathSciNet
  28. U. Pannasch, L. Vargová, J. Reingruber et al., “Astroglial networks scale synaptic activity and plasticity,” Proceedings of the National Acadamy of Sciences of the United States of America, vol. 108, no. 20, pp. 8467–8472, 2011. View at Publisher · View at Google Scholar · View at Scopus
  29. D. H. Woo, K.-S. Han, J. W. Shim et al., “TREK-1 and Best1 channels mediate fast and slow glutamate release in astrocytes upon GPCR activation,” Cell, vol. 151, no. 1, pp. 25–40, 2012. View at Publisher · View at Google Scholar · View at Scopus
  30. S. Nadkarni and P. Jung, “Dressed neurons: modeling neural-glial interactions.,” Physical Biology, vol. 1, no. 1-2, pp. 35–41, 2004. View at Publisher · View at Google Scholar · View at Scopus
  31. G. Valenza, L. Tedesco, A. Lanata, D. De Rossi, and E. P. Scilingo, “Novel Spiking Neuron-Astrocyte Networks based on nonlinear transistor-like models of tripartite synapses,” in Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6559–6562, Osaka, July 2013. View at Publisher · View at Google Scholar
  32. S. Haghiri, A. Ahmadi, M. Nouri, and M. Heidarpur, “An investigation on neuroglial interaction effect on Izhikevich neuron behaviour,” in Proceedings of the 22nd Iranian Conference on Electrical Engineering, ICEE 2014, pp. 88–92, irn, May 2014. View at Scopus
  33. A. B. Porto-Pazos, N. Veiguela, P. Mesejo et al., “Artificial astrocytes improve neural network performance,” PLoS ONE, vol. 6, no. 4, Article ID e19109, 2011. View at Publisher · View at Google Scholar · View at Scopus
  34. A. Alvarellos-González, A. Pazos, and A. B. Porto-Pazos, “Computational models of neuron-astrocyte interactions lead to improved efficacy in the performance of neural networks,” Computational and Mathematical Methods in Medicine, vol. 2012, Article ID 476324, 2012. View at Publisher · View at Google Scholar · View at Scopus
  35. N. Bazargani and D. Attwell, “Astrocyte calcium signaling: the third wave,” Nature Neuroscience, vol. 19, no. 2, pp. 182–189, 2016. View at Publisher · View at Google Scholar
  36. R. Srinivasan, B. S. Huang, S. Venugopal et al., “Ca2+ signaling in astrocytes from Ip3r2 -/- mice in brain slices and during startle responses in vivo,” Nature Neuroscience, vol. 18, no. 5, pp. 708–717, 2015. View at Publisher · View at Google Scholar · View at Scopus
  37. L. Ben Haim and D. H. Rowitch, “Functional diversity of astrocytes in neural circuit regulation,” Nature Reviews Neuroscience, vol. 18, no. 1, pp. 31–41, 2016. View at Publisher · View at Google Scholar · View at Scopus
  38. A. Mishra, J. P. Reynolds, Y. Chen, A. V. Gourine, D. A. Rusakov, and D. Attwell, “Astrocytes mediate neurovascular signaling to capillary pericytes but not to arterioles,” Nature Neuroscience, vol. 19, no. 12, pp. 1619–1627, 2016. View at Publisher · View at Google Scholar · View at Scopus
  39. E. M. Izhikevich, “Simple model of spiking neurons,” IEEE Transactions on Neural Networks and Learning Systems, vol. 14, no. 6, pp. 1569–1572, 2003. View at Publisher · View at Google Scholar · View at Scopus
  40. G. Dallérac, O. Chever, and N. Rouach, “How do astrocytes shape synaptic transmission? Insights from electrophysiology,” Frontiers in Cellular Neuroscience, vol. 7, article 159, 2013. View at Publisher · View at Google Scholar · View at Scopus
  41. W. Rall, “Distinguishing theoretical synaptic potentials computed for different soma-dendritic distributions of synaptic input.,” Journal of Neurophysiology, vol. 30, no. 5, pp. 1138–1168, 1967. View at Publisher · View at Google Scholar · View at Scopus
  42. W. Winlow, “Proceedings of the 22th Annual Newfoundland Electrical and Computer Engineering Conference (NECEC 2013),” 1em plus 0.5em minus 0.4em Manchester University Press, 1990.
  43. S. A. Liddelow, K. A. Guttenplan, L. E. Clarke et al., “Neurotoxic reactive astrocytes are induced by activated microglia,” Nature, vol. 541, no. 7638, pp. 481–487, 2017. View at Publisher · View at Google Scholar
  44. N. J. Maragakis and J. D. Rothstein, “Mechanisms of Disease: astrocytes in neurodegenerative disease,” Nature Clinical Practice Neurology, vol. 2, no. 12, pp. 679–689, 2006. View at Publisher · View at Google Scholar · View at Scopus
  45. Z. Sajedinia, Glia-augmented artificial neural networks: foundations and applications [Master, thesis], Memorial University of Newfoundland, 2015.
  46. G. Perea and A. Araque, “Glial calcium signaling and neuron-glia communication,” Cell Calcium, vol. 38, no. 3-4, pp. 375–382, 2005. View at Publisher · View at Google Scholar · View at Scopus
  47. S. B. Achour and O. Pascual, “Astrocyte-neuron communication: functional consequences,” Neurochemical Research, vol. 37, no. 11, pp. 2464–2473, 2012. View at Publisher · View at Google Scholar · View at Scopus
  48. Z. Sajedinia, “Artificial glia astrocytes; a new element in adaptive neuro fuzzy systems,” in Proceedings of the 22th Annual Newfoundland Electrical and Computer Engineering Conference (NECEC 2013), 2013.