A Note on Some Numerical Approaches to Solve a Neuron Networks Model
Space time integration plays an important role in analyzing scientific and engineering models. In this paper, we consider an integrodifferential equation that comes from modeling neuron networks. Here, we investigate various schemes for time discretization of a theta-neuron model. We use collocation and midpoint quadrature formula for space integration and then apply various time integration schemes to get a full discrete system. We present some computational results to demonstrate the schemes.
Modeling real life problems using differential and integral operators and search for numerical schemes of such models are of ongoing interest [1–9]. We consider such a nonlinear model of transmission line in neural networks with “-synapses” during bursting activity [8, 10, 11]: with initial function , where , , the angle function represents the phase of the signal associated with a neuron at , is a smooth function that represents potential effects and external inputs, is a kernel function, and is the parameter of the model. When the model (1) represents inhibitory neurons and when the model is an excitatory one. For this paper, we consider and which is a nonnegative normalized kernel function. Now if we consider a normalized kernel and , then (1) can be written as where . In most articles has been considered as a nonlinearity. Here as for all which stabilizes the output, and when which oscillates the output . One may observe a saddle node bifurcation when increases or decreases through the value . In this study we consider It is well understood from the studies [10, 11] that can be an excitatory parameter and the Gaussian kernels are associated with its bidirectional influence. So we find an intense interest in using a normalized Gaussian kernel function: where , , and . Now the problem, with a kernel of type and , corresponds to unidirectional connectivity. Thus (2) describes a one-dimensional chain of single neurons interacting with each other where the interaction depends on the choices of the kernel function . From the detailed study in  that the integral operator is positive semidefinite, bounded and invertible operator if which has been well discussed in the next section.
Our study is motivated by . In , the authors study numerical approximation of a nonlocal, partly nonlinear, phase transitions model. They analyze and approximate the problem using various schemes, being a finite difference method, finite element methods with collocation and the Galerkin approach (using piecewise Lagrange polynomials to form finite element basis functions), and the Legendre and Tchebychef spectral methods in space followed by implicit schemes for the time integration. The authors demonstrate some numerical solutions as well as the computational error. They also estimate the theoretical errors of finite difference approximations and finite element approximations.
In [8, 11], Jackiewicz et al. consider the model (1). They use the forward Euler method for time integration to form the resulting model as an integral of Fredholm type. Then the authors approximate the resulting problem using various spectral collocation methods. They present some numerical results to demonstrate their schemes. The motivation was to use global polynomials to approximate . Solutions converge fast in such approximations if one considers smooth initial condition as well as smooth boundaries.
In [8, 11], the authors consider forward Euler scheme for time integration only. Thus we find an interest to approximate the problem using piecewise basis functions for spatial approximation and then investigate various time integration schemes.
Now if we consider a spatially one-periodic initial function , then for all and , that is, . Then (2) can be written as where with We are interested to consider the periodic domain for spatial approximations of the model.
However, it is well understood from  that an integrodifferential equation of type (2) defined in the infinite domain can be defined in a truncated finite domain , where and depend on the decay of the kernel function . A closed form formula to find suitable and is well presented in . Thus the analysis and the approximation we present here in a periodic spatial interval can also be applied to any bounded interval .
In this study, we consider the integrodifferential equation (6) with a Gaussian kernel defined by (8) and . The rest of the paper is organized in the following way. In Section 2, we discuss some preliminary results. We present the approximation of the problem using collocation and quadrature for space integration in Section 3. We present some time integration schemes in Section 4. We conclude this study in Section 5 presenting some numerical results and discussions.
In this section we discuss some properties of the model operator which shows the boundedness and inevitability of the integral operator. Here and thus . This shows the positive semidefiniteness of the operator when . To investigate the boundedness property of the operator let us introduce a proposition. For more details see .
Theorem 1 (see ). Assume that and the following conditions hold:(H1)is ;(H2)is normalized such that ;(H3)is symmetric; that is, , for all ;(H4)is decreasing on ;(H5)is .
Then (H1)–(H4) give the DFT results and for all and the CFT results . Further, if (H5) holds, then for all , .
The following theorem concludes with the boundedness of the operator.
Theorem 2 (see ). If for all , , and , then is bounded and .
The invertibility of the operator can be obtained by the following theorem.
Theorem 3 (see ). If the kernel function satisfies (H1)–(H5), then, for any , there exist constants such that .
3. Numerical Approximation
We consider the periodic domain . We subdivide into subintervals so that , where , , . Let be the midpoint of for all , , . Now we collocate (6) at to get Now using midpoint quadrature formula in the above equation for spatial integration, one gets and we write Thus we get where Now considering , (6) can be written as and so Using (6) we get The above mentioned equations can be presented in the matrix form as where The above system of (18) can be arranged as , which yields Substituting , we get a first-order time dependent system of equations:
4. Time Integration to Solve the System of Differential Equations
Here in this section we investigate various one- and multistep schemes to approximate the system of first-order nonlinear differential equation (21).
4.1. Euler’s Methods
Let be the time at the th time-step, let be the computed solution at the nth time-step, let , let be the step size, and let be constant here. Now from (21) which can be written as , , which is known as forward Euler scheme for initial value problems. The explicit forward/Euler method is based on a truncated Taylor series expansion. Expanding in the neighborhood of , one gets Here the local truncation error of the forward Euler method is . That is to say, the forward Euler method is a first-order technique. A simple Taylor expansion can be used to show that which shows that there is an error of in a single step of the explicit Euler method; that is, we get second-order local truncation error.
In this subsection, our goal is to find finite difference schemes which are more accurate than the simple Euler method; that is, the global error of the sought methods should be or better. We first want to develop an intuitive understanding of how this can be done and then actually do it. An alternative to the above scheme can be to consider the midpoint of the interval to approximate Equation (25) is referred to as the midpoint method, which is also known as a modified Euler scheme. Similar to the explicit Euler’s scheme expanding one can easily show that (25) is determined from the requirement that the corresponding finite difference scheme has the global error or, equivalently, the local truncation error .
4.2. Runge-Kutta Method
We start with the following Taylor expansion: The first derivative can be replaced by the right hand side if the differential equation (21) and the second derivatives is obtained by differentiating (21) with Jacobian . We will from now neglect the dependence of on when it appears as an argument to ; therefore the Taylor expansion and the multivariate Taylor expansion which is the classical second-order Runge-Kutta method. It is also known as Heun’s method or the improved Euler method.
As of the similar fashion the fourth-order Runge-Kutta method can be presented as with Here is the Runge-Kutta approximation of and next value is determined by the value plus the weighted average of four increments, where each increment is the product of the size of the interval, , and an estimated slope specified by function on the right hand side of the differential equation.
4.3. An Explicit Two-Step Scheme
Let be the time at the th time-step, let be the computed solution at the nth time-step, let , let be the step size, and let be constant here. Now from (21) and so . By computer implementation we notice that the above mentioned scheme does not work well. So we modify the scheme by , which converges numerically as of the other schemes discussed previously.
4.4. A Linear Two-Step Adams-Bashforth Scheme
Keeping the notations as above using a simple two-step scheme (21) can be approximated by which needs two values and to compute the value of .
In Table 1 we present some one-order and higher order schemes with local truncation errors for the system of (21).
4.5. Implicit Schemes
Let be the time at the th time-step, let be the computed solution at the th time-step, let , let be the step size, and let be constant here. Now using backward substitution (21) can be approximated by , which can be written as , , which is popularly known as implicit/backward Euler scheme. As of the explicit Euler scheme, expanding at one can easily show that this scheme is determined from the requirement that the corresponding finite difference scheme have the global error or equivalently, the local truncation error .
Another popular alternative to the forward Euler is which is an implicit scheme. The scheme (32) is known as the Trapezoidal method. As of the explicit Euler scheme, expanding at , one can easily show that (32) is determined from the requirement that the corresponding finite difference scheme has the global error or, equivalently, the local truncation error . It is to note that both the implicit solvers give us system of nonlinear equations in terms of which needs to be solved by using Newton or some Newton type solvers. We keep ourselves restricted with the schemes discussed above. However there are many other one-order and higher order schemes that are also available for time integration.
5. Numerical Experiments and Discussions
In this section we discuss computer implementation of the schemes. For all the computations we consider subintervals , , for the spatial domain , and consider the midpoints of the interval for collocation to derive the semidiscrete time dependent system of differential equation (21). Then depending on the choice of the solver for the system (21) we choose different time stepping as required. For all the computations we consider the Gaussian kernel defined in (8) with , and .
In Figure 1 we present solutions for (21) for different choices of the parameter . In all cases we consider , if , and , if . Here we observe different patterns for different choices of the parameter values. The bifurcation of the solutions at are also visible from all the computational results. The other explicit one and multistep solvers also produce same results.
In Figure 2 we present solutions for different choices time schemes for (21). In both cases we consider that , and , if , and , if . From this computations we notice a bifurcation of solutions at the transition point of the nonlinearity . Here from the computations we observe that the implicit solvers work well for large , and as a result they need less computational time, though the explicit solvers are easy to implement. In terms of computational costs and stability issues we recommend the implicit and multistep schemes for this type of nonlinear integrodifferential equations.
Here we restrict ourselves with piecewise constant approximations for space integrations, and we study one space dimensional model only. Thus the multidimensional version of the model with higher order quadratures and higher order schemes for time integration leaves as future studies.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
P. W. Bates, P. C. Fife, X. Ren, and X. Wang, “Traveling waves in a convolution model for phase transitions,” Archive for Rational Mechanics and Analysis, vol. 138, no. 2, pp. 105–136, 1997.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Numerical computation of a nonlocal double obstacle problem,” International Journal of Open Problems in Computer Science and Mathematics, vol. 2, no. 1, pp. 19–36, 2009.View at: Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Stability and convergence analysis of a one step approximation of a linear partial integro-differential equation,” Numerical Methods for Partial Differential Equations, vol. 27, no. 5, pp. 1179–1200, 2011.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Numerical convergence of a one step approximation of an integro-differential equation,” Applied Numerical Mathematics, vol. 62, no. 12, pp. 1880–1892, 2012.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Stable numerical schemes for a partly convolutional partial integro-differential equation,” Applied Mathematics and Computation, vol. 217, no. 8, pp. 4217–4226, 2010.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Piecewise polynomial approximation of a nonlinear partial integro-differential equation,” Tech. Rep., Department of Mathematics, Heriot-Watt University, 2009.View at: Google Scholar
S. K. Bhowmik, D. B. Duncan, M. Grinfeld, and G. J. Lord, “Finite to infinite steady state solutions, bifurcations of an integro-differential equation,” Discrete and Continuous Dynamical Systems B, vol. 16, no. 1, pp. 57–71, 2011.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Z. Jackiewicz, M. Rahman, and B. D. Welfert, “Numerical solution of a Fredholm integro-differential equation modelling neural networks,” Applied Numerical Mathematics, vol. 56, no. 3-4, pp. 423–432, 2006.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
C. Xu and P. Li, “Dynamics in a delayed neural network model of two neurons with inertial coupling,” Abstract and Applied Analysis, vol. 2012, Article ID 689319, 17 pages, 2012.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. K. Bhowmik, “Numerical approximation of a convolution model of neuron networks,” Applied Numerical Mathematics, vol. 61, no. 4, pp. 581–592, 2011.View at: Publisher Site | Google Scholar | Zentralblatt MATH
Z. Jackiewicz, M. Rahman, and B. D. Welfert, “Numerical solution of a Fredholm integro-differential equation modelling over neural networks,” Applied Mathematics and Computation, vol. 195, no. 2, pp. 523–536, 2008.View at: Publisher Site | Google Scholar
F. C. Hoppensteadt, An Introduction to the Mathematics of Neurons, vol. 14 of Cambridge Studies in Mathematical Biology, Cambridge University Press, New York, NY, USA, 2nd edition, 1997.View at: MathSciNet
D. J. Duffy, Finite Difference Methods in Financial Engineering, Wiley Finance Series, John Wiley & Sons, New York, NY, USA, 2006.View at: MathSciNet