Chaotic Oscillators: Theory, Experiments, Control, and ApplicationsView this Special Issue
Synchronous Behavior for Memristive Synapse-Connected Chay Twin-Neuron Network and Hardware Implementation
Synchronous behavior can be responsible for the function or dysfunction of a neural network. To employ a memristor with threshold memductance as a bidirectional synapse, a memristive synapse-connected Chay twin-neuron network is constructed. This paper numerically presents the synchronous behavior for four representative firing activities in the memristive twin-neuron network by utilizing time-domain waveforms, synchronized transition states (STSs), and mean synchronization errors (MSEs). Indeed, the synchronous behaviors are truly related to the coupling strength and initial condition of the memristor. Besides, utilizing the powerful XC7Z020 FPGA, a digitally circuit-implemented electro-neuron and the memristive synapse-connected Chay twin-neuron network are made. Thereafter, the four representative firing activities and their STSs are experimentally captured to further confirm the numerical simulations.
Biological system propagates and handles neural signal via abundant collective behaviors [1–5]. As one of the most outstanding collective behaviors in neuronal network, synchronous behavior is important for the realization of signal propagation, information handling, and other activities [6–8]. Synchronous behavior for neuron-coupled models abstracted from the biological system has attracted much interest due to their simplicity and without loss of generality [9–15]. Numerous investigations of synchronous behavior in gap junction-coupled Huber–Braun neurons , gap junction-coupled or noise-sustained FitzHugh–Nagumo neurons [10–12], feedback unidirectional-coupled Hindmarsh–Rose neurons [7, 13], and chemical synaptic-coupled Hindmarsh–Rose neurons  have been explored in theoretical and numerical levels. Besides, excessive synchronization can be achieved through stimulating neuron by external control signal, which can be employed to cure some disorder diseases of Alzheimer’s, epilepsy, Parkinson’s, and hand shaking [15–17].
Based on the law of electromagnetic induction theory, Lv et al. have come up with the idea that the memristor can be employed as a connected synapse to describe transmembrane current generated by the membrane potentials’ difference between two coupled neurons [18, 19]. When two coupled neurons own different initial conditions, i.e., different neuron membrane potentials, electromagnetic induction current can be generated to exchange the charged ions across the membrane. In this way, the neuron membrane potentials are altered and synchronization could be achieved . The memristor is a novel circuit device with its memductance really depending on the input and with memory effect , which is regarded as a valid candidate for neuronal synapse . Thus, it is interesting to find the emergence of synchronous behavior for memristor synapse-coupled two neurons having different membrane potentials between them [22–25]. The coexisting firing activities and synchronous behaviors associated to initial condition of the memristor in a memristive synapse-connected Morris–Lecar double neurons’ network are explored . Besides, the coexisting firing activities and initial-associating bifurcation behaviors, as well as the extreme events are disclosed in two adjacent Hindmarsh–Rose neurons connected by flux-controlled memristor . However, the memristor initial condition-associated synchronous behavior still needs further investigation.
Three-dimensional (3D) Chay neuron model is a more physiologically excitable three-variable neuron model with simple mathematical form and rich essential features of electrical activities . In essence, the 3D Chay neuron model has the feature of a fast-slow structure to represent the membrane potential and ionic events in excitable membranes as in . The 3D Chay neuron model can give birth to abundant firing activities of periodic and chaotic bursting/spiking behaviors , as well as the bifurcation scenarios for stochastic resonance are disclosed . Besides, GWN and magnetro-acoustical simulation-induced multiple firing activities are explored by numerical simulations [31–33]. From the viewpoint of ions’ effect mechanisms in biological neuron, the outward current carried by K+ ions and the inward one by Na+ and Ca2+ ions play key role in living biological activities. Thus, beyond all these investigations, by selecting four sets of the maximal conductances for the two ions currents, four representative firing activities are revealed. Besides, the synchronization for these four representative firing activities in coupled Chay neuron models are barely disclosed, which hinders the process of unveiling living biological activities.
The theoretical explorations and numerical simulations are classical methods to investigate neural dynamics, but hardware implementations and experimental measurements have become increasingly promising for diverse neuron-based engineering applications [34–43]. To date, on the benefit of real-time modification, easy software control, and adjustment, field programmable gate array (FPGA) has been employed to verify the dynamical behaviors of Hindmarsh–Rose neuron model [35, 36], Wilson neuron model , Morris–Lecar neuron model , and FitzHugh–Nagumo neuron model  in the hardware level. One of another remarkable benefit is that the FPGA-based experiments can assign the desired initial conditions in software accurately and easily, which is conducive to investigate initial condition-associated electrical activities in the hardware level . To consider the virtue of FPGA-based realization method, there should be important significance to develop various digital electronic neurons for utilizing in hardware level synthesizers for large-scale neuromprphic circuits. Besides, the digitally circuit-implemented neuron network can effectively imitate the synchronous behavior in the network, which can promote the integrated circuit design and diverse neuron-based engineering applications . To our best knowledge, there is no comprehensive exploration about the Chay neuron model in this valuable approach.
The arrangement of this paper is well designed as follows. The representative firing activities in a 3D Chay neuron model are briefly reviewed by employing numerical plots of phase trajectories and time-domain waveforms. Besides, a memristive synapse-connected Chay twin-neuron network is built in Section 2. Section 3 explores synchronous behavior in the memristive Chay twin-neuron network by utilizing time-domain waveforms, STSs, and MSEs. A FPGA-based electronic neuron and the memristive synapse-connected Chay twin-neuron network are realized and the hardware tests are executed to verify the numerically simulated ones in Section 4. Eventually, the conclusion is drawn.
2. Memristive Synapse-Connected Chay Twin-Neuron Network
2.1. Minireview for 3D Chay Neuron Model
The 3D Chay neuron model is an effective candidate in the numerical simulation for electrical activities in single biological neuron , which is described aswhere the three dynamic variables V, n, and C correspond to the membrane potential, open probability of the voltage-sensitive potassium ions channel, and intracellular concentration of calcium ions, respectively. The model parameter in (1) is assigned and shown in Table 1. Besides, y∞ = αy/(αy + βy) is unified to the expressions of m∞, h∞, and n∞, in which y presents the alphabets m, h, and n. Herein, the expression formats for αm, βm, αh, βh, αn, βn, and τn are
On account of the fast-slow effect, the bursting and spiking behaviors are two representative firing activities generated in this neuron model . By using MATLAB ODE45-based method with time step 10−3 s, fixing the initial conditions (0.1 mV, 0.1, 0.1 nmol/L), and employing the model parameters in Table 1, note that “MaxStep” and “RelTol” in MATLAB-based ODE45 algorithm should be assigned as 10−3 s and 10−4 s, respectively.
The firing activities related to the reversal potentials [30, 32], external stimulus [31, 33], and time kinetic constant  have been investigated in numerical survey. Differently, by selecting four sets of model parameters for the maximal conductance of mixed Na+-Ca2+ channel and maximal conductance of potassium ions channel, four representative types of firing activities including periodic and chaotic bursting and chaotic spiking behaviors are revealed by utilizing the trajectories in the C-V plane and the time-domain waveforms of the membrane potential V and intracellular concentration C of calcium ions, as shown in Figure 1. Figures 1(a) and 1(d) exhibit two kinds of periodic bursting behaviors, Figure 1(b) demonstrates chaotic bursting behavior with disordered spikes, and Figure 1(c) illustrates conventional chaotic spiking behavior. The bifurcation mechanisms for the two kinds of periodic bursting behaviors are different. Those are periodic fold/fold bursting in Figure 1(a) and periodic fold/homoclinic bursting in Figure 1(d) [42, 43]. Figure 2(b) shows the chaotic fold/homoclinic bursting behaviors, and Figure 1(c) denotes the chaotic spiking activity. The synchronous behaviors in a memristive synapse-connected Chay twin-neuron network under the four sets of model parameters will be disclosed in the next sections, respectively.
2.2. Modeling for Memristive Synapse-Connected Twin-Neuron Network
Support two identical neurons are bidirectionally coupled by memristor synapse to represent the electromagnetic induction effect induced with the membrane potential differences between them. Herein, the memristor with threshold memductance and the membrane potential difference are employed , so the inducted current and memristor synapse characteristic model can be described aswith two identical Chay neurons coupled by the threshold memristor, and a memristive synapse-connected Chay twin-neuron network can be described aswhere V1 and V2 are the membrane potential, n1 and n2 are probability of the voltage-sensitive K+ channel for the two identical Chay neuron models, C1 and C2 are the intracellular concentration of calcium ions for them, respectively, and stands for the memristor synapse-coupled item with k as positive to feature the coupling strength. In (4), the coupling strength k can control the effect of memristor synapse. Actually, the memristor synapse-connected item just inputs additive current leading to that the membrane potentials which can be regulated. Also, (4) explained the mechanism for memristive feedback control. Besides, yi∞ = αiy/(αiy + βiy) can be unified to the explications of mi∞, hi∞, and ni∞, in which y stands for m, h, and n and i = 1, 2. The explicit expressions for αim, βim, αih, βih, αin, βin, and τin are
Thus, the synchronous behaviors for the memristive synapse-connected Chay twin-neuron network can be disclosed by system (4). Following on this, we mainly focus on exploring the memristor initial condition and coupling strength associated synchronous behaviors in the proposed memristive network.
3. Synchronous Behaviors for the Chay Twin-Neuron Network
The exploration of synchronous behaviors for the Chay twin-neuron network is performed by MATLAB numerical simulations. Herein, we mainly focus on the two coupled neurons with only difference initial membrane potentials between them. Thus, the Chay twin-neuron network is triggered by initial conditions (0.1 mV, 0, 0.1 nmol/L, 1 mV, 0, 0.1 nmol/L, φ0) without loss of the generality, within which the memristor initial condition φ0 is tunable.
The electrical activity is chaotic spiking under the model parameters in Table 1, for each neuron in the memristive synapse-connected Chay twin-neuron network. The synchronized transition states (STSs) are plotted at the right in Figures 2(a)–2(d). There exist no errors between the two membrane potentials with a line in the V1-V2 plane, which means that the two neurons are in sync. Otherwise, the relatively large errors between the two membrane potentials indicate the two neurons out of synchronization. When φ0 = –2 mWb, the difference between the two membrane potentials become smaller with k = 1 and 3 increasingly and disappear with k = 4, as shown in Figures 2(a)–2(c). This manifests that the two coupled neurons are asymptotically synchronized with increasing k. However, when k = 4 with increasing φ0 as –2 mWb and 1 mWb, the difference between the two membrane potentials become larger, as shown in Figures 2(c) and 2(d). It is indicated that the two coupled neurons are loose their synchronization. Summarily, by increasing the coupling strength k or decreasing memristor initial condition φ0, the synchronization can be realized and the difference between the two membrane potentials is becoming smaller in the memristive synapse-connected Chay twin-neuron network. The mechanism for this process is that the coupling memristor exchanges the magnetic flux. Thus, the induced current is the carrier to drive the two Chay neurons in sync. Otherwise, the two connected Chay neurons are loss synchronization under tiny electromagnetic induction outputs.
To fully explore the synchronous behavior associated to the coupling strength k and initial condition φ0 of the memristor synapse simultaneously, mean synchronization error (MSE) E is employed and defined aswhere Vi (j), ni (j), and Ci (j) (i = 1, 2) are the jth sampling values and N is the number of total samples. The normalized MSE of the Chay twin-neuron network is becoming zero for synchronous state and nonzero for out of synchronization.
Herein, the time sequence interval (600 s and 700 s) and the time step 0.01 s are selected. Thus, the number of total samples is N = 10000. The normalized MSEs for different coupling strength k and initial condition φ0, as well as different and are given in the φ0 − k plane, as plotted in Figure 3. The regions padded by red indicate the two connected Chay neurons in sync with E = 0, whereas the regions padded by other colors denote the two connected Chay neurons loss synchronization with E > 0. In general, as coupling strength k becoming larger and more negative initial condition φ0, the normalized MSEs E drops near zero. Thus, the two connected Chay neurons become sync. Contrarily, the two connected Chay neurons are in asynchronous state with k becoming smaller and small negative or positive φ0.
The normalized MSEs is given in Figure 3. The results show that the synchronous behaviors for the memristive synapse-connected Chay twin-neuron network are really associated with the memristor synapse coupling strength and the initial condition. Such an initial condition related synchronous behavior has been rarely reported in previous literature .
4. FPGA-Based Hardware Implementation
It is more complex to physically realize the memristive synapse-connected Chay twin-neuron network than a single 3D Chay neuron model by FPGA. Thus, only the memristive synapse-connected Chay twin-neuron model by the digital electronic platform is demonstrated with representativeness. For this aim, fourth-order Runge–Kutta algorithm is utilized to obtain the discrete-time form for model (4) and given aswhere i is the sampling interval, N is the total number of iterations, and Dq (q = 1, 2, 3, 4) denotes the coefficient of variation. To achieve the unique expression of intermediate vector , and , the assumption of is applied. Then, one yieldsin which q = 1, 2, 3, 4, and
To achieve the discrete-time memristive synapse-connected Chay twin-neuron model (7), we employ a low-cost yet powerful XC7Z020 FPGA to execute the model for the first time. The FPGA software program using Verilog language is coded, within which the number of iteration N = 150000, the sampled interval i = 0.001, and the coefficients of variation D1 = D4 = 1 and D2 = D4 = 2 are set up. The parameters , , k, and φ0, which impact the firing activities and synchronous behaviors, are changed by the software program to capture the four typical firing activities, time-domain waveforms, and STSs corresponding to the numerical simulations.
The hierarchical structure of the Verilog HDL program is illustrated in Figure 4. A main controller is set to reset the electro-neuron and to start the iteration form of initial conditions for Vi, ni, Ci, and φ while the power is on. The floating-type operation IPs are contained in the lowest inherent IP layer, which can be instanced to construct our own customized IP. In the customized IP layer, add-, subtract-, multiply-, divide-, and exponent-operators are instanced to construct each function of the right side of continuous-time model (4) (expressed as fV1, fn1, fC1 fV2, fn2, fC2, and fφ). The intermediate variables m1∞, h1∞, n1∞, m2∞, h2∞, and n2∞ have to be calculated before the calculations of fV, fn, and fC; thus, a sublayer for intermediate variables is hired in this layer. In the iteration layer, the functions fV1, fn1, fC1 fV2, fn2, fC2, and fφ are transmitted by time multiplex way to compute the intermediate vectors , and (marked as K1, K2, K3, and K4) in (8), and then the , and are updated. Finally, an output layer is employed to adjust the output signal for visualizing expediently. The RTL schematic for the digitally electronic twin-neuron network is generated, as shown in Figure 5.
Since the outputs of a FPGA are digital, they are fed to a two-channel 14 bit D/A converter (AD9767) combined with the peripheral circuit to convert the digital outputs into analog ones. Herein, an oscilloscope Agilent DSO-X 3012A is employed to display the output analog signals. Note that, all variables are in the single-precision floating-type during the computation process, so they must be converted into integers and enlarged to the range of [−8192, 8191] to take full use of 14 bits of the DAC digital input ports. The time-domain waveforms of V1 and V2 and synchronous transition states in the V1 − V2 plane for different coupling strength k and initial condition φ0 in the Chay bi-neuron network are captured and displayed in Figure 6. The amplitudes of V1 and V2 on the oscilloscope are differed from that of MATLAB simulations in Figure 2, but they are proportional with each other due to the same enlargement. It is clearly shown that the proposed FPGA-based digital hardware can verify the synchronous behavior for the memristive synapse-connected Chay twin-neuron network. Note that the initial states in our digital circuit experiment are accurately assigned in the software . This is very different from the randomly sensed way of acquiring initial states by repeatedly switching on and off the power supply in an analog circuit experiment . Hence, the initial states are determined in the digital circuits but undetermined in the analog ones.
Besides, a FPGA-based digital hardware electronic neuron is simply realized to confirm the four representative firing activities in the 3D Chay neuron model. The trajectories in the V1 − V2 phase plane and time sequences of V1 and V2 are captured and displayed in Figure 7. The model parameters are selected the same as these utilized in Figure 1.
Four kinds of representative firing activities classified on the dependence of two maximal conductances in a 3D Chay neuron model are briefly reviewed. Then, a memristive synapse-connected Chay twin-neuron network is built, upon which synchronous behaviors are explored by utilizing time-domain waveforms, STSs, and MSEs. The numerical simulations demonstrated the success and effectiveness of employing the memristor synapse to achieve synchronization. It is found that, associating with the large coupling strength and more negative initial condition of the memristor, synchronous behaviors are achieved. An effective approach to implement the electronic neuron and the Chay twin-neuron network via FPGA are employed, from which the four kinds of representative firing activities of chaotic and periodic bursting/spiking behaviors, as well as the STSs are experimentally captured to confirm the correctness of the numerical ones. Synchronous behavior disclosed in neuronal network can well reveal the benefit for understanding the dynamical intricacy in the biological neurons and reflect the feasibility of diverse neuron-based applications.
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
This work was supported by the National Natural Science Foundation of China under Grant nos. 61801054 and 51777016, Natural Science Foundations of Jiangsu Province, China, under Grant nos. BK20160282 and BK20191451, and Postgraduate Research and Practice Innovation Program of Jiangsu Province, China, under Grant nos. KYCX19_1768 and KYCX20_2550.
F. Parastesh, K. Rajagopal, F. E. Alsaadi, T. Hayat, V.-T. Pham, and I. Hussain, “Birth and death of spiral waves in a network of hindmarsh-rose neurons with exponential magnetic flux and excitable media,” Applied Mathematics and Computation, vol. 354, pp. 377–384, 2019.View at: Publisher Site | Google Scholar
Z. T. Njitache, I. S. Doubla, J. Kengne, and A. Cheukem, “Coexistence of firing patterns and its control in two neurons coupled through an asymmetric electrical synapse,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 30, no. 2, Article ID 023101, 2020.View at: Publisher Site | Google Scholar
Y. Yuan, N. Pang, Y. D. Chen, Y. Wang, and X. L. Li, “Theoretical analysis of the effects of transcranial magnetro-acoustical simulation on neuronal firing rhythm and Ca2+ concentration with Chay neuron model,” Biomedical Physics & Engineering Express, vol. 3, Article ID 055006, 2017.View at: Publisher Site | Google Scholar
M. Hayati, M. Nouri, S. Haghiri, and D. Abbott, “Digital multiplierless realization of two coupled biological Morris-Lecar neuron model,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 62, no. 7, pp. 1805–1814, 2015.View at: Google Scholar
H. G. Gu and W. W. Xiao, “Different between intermittent chaotic bursting and spiking of nural firing patterns,” International Journal of Bifurcation and Chaos, vol. 24, no. 6, Article ID 1450082, 2014.View at: Google Scholar