Research Article  Open Access
Solution of HigherOrder ODEs Using Backward Difference Method
Abstract
The current numerical technique for solving a system of higherorder ordinary differential equations (ODEs) is to reduce it to a system of firstorder equations then solving it using firstorder ODE methods. Here, we propose a method to solve higherorder ODEs directly. The formulae will be derived in terms of backward difference in a constant stepsize formulation. The method developed will be validated by solving some higherorder ODEs directly with constant stepsize. To simplify the evaluations of the integration coefficients, we find the relationship between various orders. The result presented confirmed our hypothesis.
1. Introduction
Differential equations constantly arise in various branches of science and engineering. Many of these problems are in the form of higherorder ordinary differential equations (ODEs). A few examples where these problems can be found are, in the motion of projectiles, the bending of a thin clamped beam and population growth.
The popular practice for solving a system of higherorder ODEs is by reducing it to a system of firstorder equations and then solving with firstorder methods. These methods worked, so that methods for solving higherorder ODEs have been disregarded as robust codes. However, the work by Krogh [1], Suleiman [2], Majid and Suleiman [3], and Omar and Suleiman [4] has revived the interest in solving higherorder ODEs directly and the theoretical development of the methods.
Related works for solving higherorder ODEs can be found in Collatz [5], Gear [6], Krogh [1, 7], and Suleiman [2]. Krogh [7] proposed the direct integration (DI) method for nonstiff problems using modified divided difference while Suleiman [2] proposed the DI method using the standard divided difference. In this paper, we will derive the constant stepsize backward difference formulae of solving higherorder ODEs up to third order. The main reason for developing the constant stepsize formulae is that, in developing the theory on convergence and stability, the approach is through constant stepsize formulation. Another reason is that it is possible to use this formula in conjunction with other similar formulae as in Majid and Suleiman [3] to develop a code for variable stepsize and order.
The advantage of such a code is that the integration or differentiation constants are calculated only once at the start of the first step of integration, whereas other formulations calculate the constants at every step.
In this paper, we will focus only on nonstiff ODEs of the form where in the interval and is the order of the ODE.
Without loss of generality, we will be considering the scalar equation in (1.1).
This paper will be organized as follows. First, the integration coefficients of the explicit constant stepsize backward difference formulation of the DI method will be derived. Then, the coefficients of the implicit method are formulated and their relationship with the explicit coefficients is shown. We start the derivation with the coefficients of the firstorder system, which is given in Henrici [8]. Next, the secondorder coefficients are derived and their relationship with the corresponding firstorder coefficients is given, likewise the relationship of the coefficients for the second and thirdorder systems. Finally, the method developed using backward difference will be validated numerically.
2. The Formulation of the PredictEvaluateCorrectEvaluate (PECE) Multistep Method in Its Backward Difference Form (MSBD) for Nonstiff HigherOrder ODEs
The code developed will be using the PECE mode. The predictor and corrector will have the following form:
predictor: corrector: The corrector will be reformulated, so that it will be in terms of the predictor. The reformulated corrector can be written as where indicates evaluated using predicted values. The integration coefficient and will be derived using the method of generating function. Finally, the constant stepsize algorithm will be constructed and validated with some test problems and examples from physical situations.
3. Derivation up to ThirdOrder Explicit Integration Coefficients
Integrating (1.1) once yields Let be the interpolating polynomial which interpolates the values , then Next, approximating in (3.1) with and letting gives us or where The generating function for the coefficients is defined as follows: Substituting in (3.6) in gives which leads to Equation (3.9) can be written asor Hence, the coefficients of are given by
4. SecondOrder ODE Formulae
Integrate (1.1) twice for secondorder ODEs where . Integrating once leads to the same coefficients as given in (3.6). Integrating twice yields Substituting with gives The generating function of the coefficients is defined as follows Substituting (4.2) into above gives Substituting into (4.4) yields Equation (4.5) can be written asor Hence the coefficients of in relation to coefficients of the previous order are given by
5. ThirdOrder Formulae
Next, the case of the thirdorder ODE where will be considered. In the case of , the corresponding coefficients are as in (3.6) and (4.2). For the solution , integrating three times yields or in the backward difference formulation, given by where The generating function of the coefficients is defined as follows:Substituting (5.3) into above yields As in (4.4), we now substitute in (5.5) which gives Equation (5.6) can be written as
or Hence, the coefficients of in relation to coefficients of the previous order are given by
6. Derivation up to the ThirdOrder Implicit Integration Coefficients
Integrating (1.1) once yields Let be the interpolating polynomial which interpolates the values : As in the previous derivation, we choose Replacing by yields Simplify where The generating function of the coefficients is defined as follows:
or which leads to For the case , the approximate solution of has the form The coefficients are given by where are the coefficients of the backward difference formulation of (6.11) which can be represented by The generating function for the coefficients is defined as follows: Substituting (6.11) into above, Solving (6.14) with the substitution of (3.8) produces the relationship Integrating (1.1) thrice yields The coefficients are given by where are the coefficients of the backward difference formulation of (6.17) which can be represented by
The generating function of the coefficients is defined as follows:
Substituting (6.17) into above yields Solving (6.11) with the substitution of (6.20) produces the relationship
7. The Relationship between the Explicit and Implicit Integration Coefficients
Calculating the integration coefficients directly is time consuming when large numbers of integration are involved. A more efficient way of computing the coefficients is by obtaining a recursive relationship between the coefficients. With this recursive relationship, we are able to obtain the implicit integration coefficient with minimal time consumption. The relationship between the explicit and implicit coefficients is expressed below.
For firstorder coefficients,
It can be written as By substituting into (7.2), we have Expanding the equation yields This gives the recursive relationship For secondorder coefficient, It can be written as Substituting (7.4) into the equation above givesor Substituting (4.5) into (7.10) gives Expanding the equation, we have The above gives the relationship For thirdorder coefficient, we have It can be written as Substituting (7.10) into (7.15) gives
or Substituting into (6.15) leads to Expanding the equation into,
which leads to a recursive relationship
Tables 1 and 2 are a few examples of the explicit and implicit integration coefficients.


8. Numerical Results
For error calculations, we will be using the three error tests, namely, absolute error, relative error, and mixed error tests. The error formula is given by, where , gives the absolute error test, , gives the relative error test, and , gives the mixed error test.
In (8.1), is the exact solution for the problem considered and the computed solution. In a general code when the exact solution is not available for the relative error, is replaced by the computed value.
When is small, the error in (8.1) will approximate the absolute error. However, when it is large, the mixed error test will approximate the relative error. The numerical results give the three errors.
The following notations hold MAX ABS: maximum error when using absolute error test, MAX MIX: maximum error when using mixed error test, MAX REL: maximum error when using relative error test, : step size selected.
For the choice of problems to be tested, we choose four linear problems consisting of a second and a thirdorder problem. The third problem is a mix system of second and firstorder equations and the fourth problem is a system of three secondorder equations. Our reason for choosing the linear problems is that if the formulae are correct, then they should solve linear problems. The choice of system of equations is to raise the degree of difficulty of solving the problems. The rest of the problems are nonlinear, which occur in physical situations. The choices of the physical problems are those with exact solutions known. We give our comments on the numerical results right after the numerical Tables 3, 4, 5, 6, 7, 8, and 9.







Problem 1.
Solution 1.
Source: Krogh [7].
This is a linear equation used by Krogh [7] to test his code. The solution increases exponentially to a maximum value of which is considered large and therefore not suitable for absolute error test and hence the large values of the error.
Problem 2.
Solution 2.
Source: Omar and Suleiman [4].
This is a thirdorder problem with an exponential solution. The difference between Problems 1 and 2 is that one is third order and the other is second order. Again, absolute error test does not work for the same reason given above.
Problem 3.
Solution 3.
Source: Bronson [9].
For this problem, all error tests worked well.
Problem 4.
Solution 4.
Source: Bronson [9].
This problem does not work for relative error test because of the small value of the solution for certain values of .
Problem 5.
Solution 5.
Source: Russel and Shampine [10].
This problem is the symmetrical bending of a laterally loaded circular plate.
The numerical results of this problem show the failure to control the error using relative error test. This is because the solution is zero when .
Problem 6.
Solution 6.
Source: Shampine and Gordon [11].
This problem is Newton’s equations of motion for the twobody problem.
Again, relative error test does not work too well for this problem because is very small at certain points .
Problem 7.
Solution 7.
Source: Robert Jr. [12].
For this problem, all error tests worked well.
All the numerical results show that the errors in the mixed error mode give a reliable error estimate for all the problems given. The absolute error mode failed to give meaningful error results for Problems 1 and 2. This is because the value of increases as increases and this becomes large. Similarly, for Problems 4, 5, and 6, the relative error failed to give an acceptable result because is small.
The research work done shows that the method developed for solving higherorder ODEs directly using the backward difference is successful. We recommend that, for multistep method, the error control procedure should use the mixed error test. This research suggests the potential of this work developing a robust code for solving higherorder ODEs directly.
Acknowledgments
This paper has been supported by the UPM Graduate Research Fellowship (GRF) and Science Fund.
References
 F. T. Krogh, “Algorithms for changing the step size,” SIAM Journal on Numerical Analysis, vol. 10, pp. 949–965, 1973. View at: Publisher Site  Google Scholar
 M. B. Suleiman, “Solving nonstiff higher order ODEs directly by the direct integration method,” Applied Mathematics and Computation, vol. 33, no. 3, pp. 197–219, 1989. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 Z. A. Majid and M. B. Suleiman, “Direct integration implicit variable steps method for solving higher order systems of ordinary differential equations directly,” Sains Malaysiana, vol. 35, no. 2, pp. 63–68, 2006. View at: Google Scholar  Zentralblatt MATH
 Z. B. Omar and M. B. Suleiman, “Parallel 2point explicit block method for solving higher order ordinary differential equations directly,” International Journal of Simulation and Process Modelling, vol. 2, no. 3, pp. 227–231, 2006. View at: Publisher Site  Google Scholar
 L. Collatz, The Numerical Treatment of Differential Equations, Springler, New York, NY, USA, 1966. View at: Zentralblatt MATH
 C. W. Gear, “The numerical integration of ordinary differential equations,” Mathematics of Computation, vol. 21, pp. 146–156, 1967. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 F. T. Krogh, “A variable step, variable order multistep method for the numerical solution of ordinary differential equations,” in Proceedings of the IFIP Congress in Information Processing, vol. 68, pp. 194–199, 1968. View at: Google Scholar
 P. Henrici, Discrete Variable Methods in Ordinary Differential Equations, Wiley, New York, NY, USA, 1962.
 R. Bronson, Modern Introductory Differential Equation: Schaum’s Outline Series, McGrawHill, USA, 1973. View at: Zentralblatt MATH
 R. D. Russell and L. F. Shampine, “A collocation method for boundary value problems,” Numerische Mathematik, vol. 19, pp. 1–28, 1972. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 L. F. Shampine and M. K. Gordon, Computer Solution of Ordinary Differential Equations, W. H. Freeman and Co., San Francisco, Calif, USA, 1975.
 C. E. Roberts Jr., Ordinary Differential Equations. A Computational Approach, PrenticeHall, Englewood Cliffs, NJ, USA, 1979.
Copyright
Copyright © 2011 Mohamed Bin Suleiman et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.