Research Article  Open Access
Samir Kumar Bhowmik, Feras M. Al Faqih, Md. Nazmul Islam, "A Note on Some Numerical Approaches to Solve a Neuron Networks Model", Abstract and Applied Analysis, vol. 2014, Article ID 863842, 7 pages, 2014. https://doi.org/10.1155/2014/863842
A Note on Some Numerical Approaches to Solve a Neuron Networks Model
Abstract
Space time integration plays an important role in analyzing scientific and engineering models. In this paper, we consider an integrodifferential equation that comes from modeling neuron networks. Here, we investigate various schemes for time discretization of a thetaneuron model. We use collocation and midpoint quadrature formula for space integration and then apply various time integration schemes to get a full discrete system. We present some computational results to demonstrate the schemes.
1. Introduction
Modeling real life problems using differential and integral operators and search for numerical schemes of such models are of ongoing interest [1–9]. We consider such a nonlinear model of transmission line in neural networks with “synapses” during bursting activity [8, 10, 11]: with initial function , where , , the angle function represents the phase of the signal associated with a neuron at , is a smooth function that represents potential effects and external inputs, is a kernel function, and is the parameter of the model. When the model (1) represents inhibitory neurons and when the model is an excitatory one. For this paper, we consider and which is a nonnegative normalized kernel function. Now if we consider a normalized kernel and , then (1) can be written as where . In most articles has been considered as a nonlinearity. Here as for all which stabilizes the output, and when which oscillates the output [12]. One may observe a saddle node bifurcation when increases or decreases through the value . In this study we consider It is well understood from the studies [10, 11] that can be an excitatory parameter and the Gaussian kernels are associated with its bidirectional influence. So we find an intense interest in using a normalized Gaussian kernel function: where , , and . Now the problem, with a kernel of type and , corresponds to unidirectional connectivity. Thus (2) describes a onedimensional chain of single neurons interacting with each other where the interaction depends on the choices of the kernel function . From the detailed study in [10] that the integral operator is positive semidefinite, bounded and invertible operator if which has been well discussed in the next section.
Our study is motivated by [6]. In [6], the authors study numerical approximation of a nonlocal, partly nonlinear, phase transitions model. They analyze and approximate the problem using various schemes, being a finite difference method, finite element methods with collocation and the Galerkin approach (using piecewise Lagrange polynomials to form finite element basis functions), and the Legendre and Tchebychef spectral methods in space followed by implicit schemes for the time integration. The authors demonstrate some numerical solutions as well as the computational error. They also estimate the theoretical errors of finite difference approximations and finite element approximations.
In [8, 11], Jackiewicz et al. consider the model (1). They use the forward Euler method for time integration to form the resulting model as an integral of Fredholm type. Then the authors approximate the resulting problem using various spectral collocation methods. They present some numerical results to demonstrate their schemes. The motivation was to use global polynomials to approximate . Solutions converge fast in such approximations if one considers smooth initial condition as well as smooth boundaries.
In [8, 11], the authors consider forward Euler scheme for time integration only. Thus we find an interest to approximate the problem using piecewise basis functions for spatial approximation and then investigate various time integration schemes.
Now if we consider a spatially oneperiodic initial function , then for all and , that is, . Then (2) can be written as where with We are interested to consider the periodic domain for spatial approximations of the model.
However, it is well understood from [13] that an integrodifferential equation of type (2) defined in the infinite domain can be defined in a truncated finite domain , where and depend on the decay of the kernel function . A closed form formula to find suitable and is well presented in [13]. Thus the analysis and the approximation we present here in a periodic spatial interval can also be applied to any bounded interval .
In this study, we consider the integrodifferential equation (6) with a Gaussian kernel defined by (8) and . The rest of the paper is organized in the following way. In Section 2, we discuss some preliminary results. We present the approximation of the problem using collocation and quadrature for space integration in Section 3. We present some time integration schemes in Section 4. We conclude this study in Section 5 presenting some numerical results and discussions.
2. Preliminaries
In this section we discuss some properties of the model operator which shows the boundedness and inevitability of the integral operator. Here and thus . This shows the positive semidefiniteness of the operator when . To investigate the boundedness property of the operator let us introduce a proposition. For more details see [3].
Theorem 1 (see [3]). Assume that and the following conditions hold:(H1)is ;(H2)is normalized such that ;(H3)is symmetric; that is, , for all ;(H4)is decreasing on ;(H5)is .
Then (H1)–(H4) give the DFT results and for all and the CFT results . Further, if (H5) holds, then for all , .
The following theorem concludes with the boundedness of the operator.
Theorem 2 (see [10]). If for all , , and , then is bounded and .
The invertibility of the operator can be obtained by the following theorem.
Theorem 3 (see [10]). If the kernel function satisfies (H1)–(H5), then, for any , there exist constants such that .
3. Numerical Approximation
We consider the periodic domain . We subdivide into subintervals so that , where , , . Let be the midpoint of for all , , . Now we collocate (6) at to get Now using midpoint quadrature formula in the above equation for spatial integration, one gets and we write Thus we get where Now considering , (6) can be written as and so Using (6) we get The above mentioned equations can be presented in the matrix form as where The above system of (18) can be arranged as , which yields Substituting , we get a firstorder time dependent system of equations:
4. Time Integration to Solve the System of Differential Equations
Here in this section we investigate various one and multistep schemes to approximate the system of firstorder nonlinear differential equation (21).
4.1. Euler’s Methods
Let be the time at the th timestep, let be the computed solution at the nth timestep, let , let be the step size, and let be constant here. Now from (21) which can be written as , , which is known as forward Euler scheme for initial value problems. The explicit forward/Euler method is based on a truncated Taylor series expansion. Expanding in the neighborhood of , one gets Here the local truncation error of the forward Euler method is . That is to say, the forward Euler method is a firstorder technique. A simple Taylor expansion can be used to show that which shows that there is an error of in a single step of the explicit Euler method; that is, we get secondorder local truncation error.
In this subsection, our goal is to find finite difference schemes which are more accurate than the simple Euler method; that is, the global error of the sought methods should be or better. We first want to develop an intuitive understanding of how this can be done and then actually do it. An alternative to the above scheme can be to consider the midpoint of the interval to approximate Equation (25) is referred to as the midpoint method, which is also known as a modified Euler scheme. Similar to the explicit Euler’s scheme expanding one can easily show that (25) is determined from the requirement that the corresponding finite difference scheme has the global error or, equivalently, the local truncation error .
4.2. RungeKutta Method
We start with the following Taylor expansion: The first derivative can be replaced by the right hand side if the differential equation (21) and the second derivatives is obtained by differentiating (21) with Jacobian . We will from now neglect the dependence of on when it appears as an argument to ; therefore the Taylor expansion and the multivariate Taylor expansion which is the classical secondorder RungeKutta method. It is also known as Heun’s method or the improved Euler method.
As of the similar fashion the fourthorder RungeKutta method can be presented as with Here is the RungeKutta approximation of and next value is determined by the value plus the weighted average of four increments, where each increment is the product of the size of the interval, , and an estimated slope specified by function on the right hand side of the differential equation.
4.3. An Explicit TwoStep Scheme
Let be the time at the th timestep, let be the computed solution at the nth timestep, let , let be the step size, and let be constant here. Now from (21) and so . By computer implementation we notice that the above mentioned scheme does not work well. So we modify the scheme by , which converges numerically as of the other schemes discussed previously.
4.4. A Linear TwoStep AdamsBashforth Scheme
Keeping the notations as above using a simple twostep scheme (21) can be approximated by which needs two values and to compute the value of .
In Table 1 we present some oneorder and higher order schemes with local truncation errors for the system of (21).

4.5. Implicit Schemes
Let be the time at the th timestep, let be the computed solution at the th timestep, let , let be the step size, and let be constant here. Now using backward substitution (21) can be approximated by , which can be written as , , which is popularly known as implicit/backward Euler scheme. As of the explicit Euler scheme, expanding at one can easily show that this scheme is determined from the requirement that the corresponding finite difference scheme have the global error or equivalently, the local truncation error .
Another popular alternative to the forward Euler is which is an implicit scheme. The scheme (32) is known as the Trapezoidal method. As of the explicit Euler scheme, expanding at , one can easily show that (32) is determined from the requirement that the corresponding finite difference scheme has the global error or, equivalently, the local truncation error . It is to note that both the implicit solvers give us system of nonlinear equations in terms of which needs to be solved by using Newton or some Newton type solvers. We keep ourselves restricted with the schemes discussed above. However there are many other oneorder and higher order schemes that are also available for time integration.
5. Numerical Experiments and Discussions
In this section we discuss computer implementation of the schemes. For all the computations we consider subintervals , , for the spatial domain , and consider the midpoints of the interval for collocation to derive the semidiscrete time dependent system of differential equation (21). Then depending on the choice of the solver for the system (21) we choose different time stepping as required. For all the computations we consider the Gaussian kernel defined in (8) with , and .
In Figure 1 we present solutions for (21) for different choices of the parameter . In all cases we consider , if , and , if . Here we observe different patterns for different choices of the parameter values. The bifurcation of the solutions at are also visible from all the computational results. The other explicit one and multistep solvers also produce same results.
In Figure 2 we present solutions for different choices time schemes for (21). In both cases we consider that , and , if , and , if . From this computations we notice a bifurcation of solutions at the transition point of the nonlinearity . Here from the computations we observe that the implicit solvers work well for large , and as a result they need less computational time, though the explicit solvers are easy to implement. In terms of computational costs and stability issues we recommend the implicit and multistep schemes for this type of nonlinear integrodifferential equations.
(a)
(b)
Here we restrict ourselves with piecewise constant approximations for space integrations, and we study one space dimensional model only. Thus the multidimensional version of the model with higher order quadratures and higher order schemes for time integration leaves as future studies.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
References
 P. W. Bates, P. C. Fife, X. Ren, and X. Wang, “Traveling waves in a convolution model for phase transitions,” Archive for Rational Mechanics and Analysis, vol. 138, no. 2, pp. 105–136, 1997. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Numerical computation of a nonlocal double obstacle problem,” International Journal of Open Problems in Computer Science and Mathematics, vol. 2, no. 1, pp. 19–36, 2009. View at: Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Stability and convergence analysis of a one step approximation of a linear partial integrodifferential equation,” Numerical Methods for Partial Differential Equations, vol. 27, no. 5, pp. 1179–1200, 2011. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Numerical convergence of a one step approximation of an integrodifferential equation,” Applied Numerical Mathematics, vol. 62, no. 12, pp. 1880–1892, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Stable numerical schemes for a partly convolutional partial integrodifferential equation,” Applied Mathematics and Computation, vol. 217, no. 8, pp. 4217–4226, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Piecewise polynomial approximation of a nonlinear partial integrodifferential equation,” Tech. Rep., Department of Mathematics, HeriotWatt University, 2009. View at: Google Scholar
 S. K. Bhowmik, D. B. Duncan, M. Grinfeld, and G. J. Lord, “Finite to infinite steady state solutions, bifurcations of an integrodifferential equation,” Discrete and Continuous Dynamical Systems B, vol. 16, no. 1, pp. 57–71, 2011. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Z. Jackiewicz, M. Rahman, and B. D. Welfert, “Numerical solution of a Fredholm integrodifferential equation modelling neural networks,” Applied Numerical Mathematics, vol. 56, no. 34, pp. 423–432, 2006. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 C. Xu and P. Li, “Dynamics in a delayed neural network model of two neurons with inertial coupling,” Abstract and Applied Analysis, vol. 2012, Article ID 689319, 17 pages, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. K. Bhowmik, “Numerical approximation of a convolution model of $\dot{\theta}$ neuron networks,” Applied Numerical Mathematics, vol. 61, no. 4, pp. 581–592, 2011. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 Z. Jackiewicz, M. Rahman, and B. D. Welfert, “Numerical solution of a Fredholm integrodifferential equation modelling over $\dot{\theta}$ neural networks,” Applied Mathematics and Computation, vol. 195, no. 2, pp. 523–536, 2008. View at: Publisher Site  Google Scholar
 F. C. Hoppensteadt, An Introduction to the Mathematics of Neurons, vol. 14 of Cambridge Studies in Mathematical Biology, Cambridge University Press, New York, NY, USA, 2nd edition, 1997. View at: MathSciNet
 D. J. Duffy, Finite Difference Methods in Financial Engineering, Wiley Finance Series, John Wiley & Sons, New York, NY, USA, 2006. View at: MathSciNet
Copyright
Copyright © 2014 Samir Kumar Bhowmik et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.