Abstract

This study develops the novel fourth-order iterative alternating decomposition explicit (IADE) method of Mitchell and Fairweather (IADEMF4) algorithm for the solution of the one-dimensional linear heat equation with Dirichlet boundary conditions. The higher-order finite difference scheme is developed by representing the spatial derivative in the heat equation with the fourth-order finite difference Crank-Nicolson approximation. This leads to the formation of pentadiagonal matrices in the systems of linear equations. The algorithm also employs the higher accuracy of the Mitchell and Fairweather variant. Despite the scheme’s higher computational complexity, experimental results show that it is not only capable of enhancing the accuracy of the original corresponding method of second-order (IADEMF2), but its solutions are also in very much agreement with the exact solutions. Besides, it is unconditionally stable and has proven to be convergent. The IADEMF4 is also found to be more accurate, more efficient, and has better rate of convergence than the benchmarked fourth-order classical iterative methods, namely, the Jacobi (JAC4), the Gauss-Seidel (GS4), and the successive over-relaxation (SOR4) methods.

1. Introduction

Numerical methods with accuracy of the order, , , are referred to as higher-order methods ( = mesh size). Recent developments seem to desire methods of higher-order for achieving higher accuracy numerical solutions for problems involving partial differential equations. When higher-order methods are evaluated, factors such as rate of convergence, stability, and boundary conditions have to be considered too. There are mainly two categories of finite difference higher-order schemes.

The first category is the noncompact stencils that utilize any grid point surrounding the grid points of interest where the difference schemes are implemented. The method involves larger matrix bandwidth, but in many cases, the increase is not large [1]. There will be a probable increase in execution time as more grid points are used. However, increasing the number of grid points provides advantages in terms of enhancement in accuracy and improvement in resolution [2]. To enhance accuracy, the approach should consider proper treatment of boundary conditions of comparable accuracy.

The second category is the compact stencils that use Lax-Wendroff’s idea [3] proposed by MacKinnon and Carey [4]. The method uses smaller number of stencils, making it computationally efficient and highly accurate. However, it requires inversion of matrix to obtain spatial derivative at each point. Also, the boundary stencil has a large effect on the stability and accuracy of the scheme [5]. Usually, compact schemes of order higher than four require formation of auxiliary equations due to boundary conditions. This results in large bandwidth matrices which are not symmetric [6]. Furthermore, the schemes can get fairly complicated for more complex equations.

Some of the current findings on higher-order methods include the work by Sulaiman et al. [7] who suggested a fourth-order quarter sweep modified successive over-relaxation (QSMSOR) iterative method for solving a one-dimensional parabolic equation. It is found to be superior in terms of rate of convergence and execution time as compared to other SOR methods. Jha [8] formulated the six-order accurate quarter sweep alternating group explicit (QSAGE) iterative finite difference method for solving nonlinear singular two-point boundary value problems. The method can be implemented in parallel and is found to be superior to the corresponding full sweep alternating group explicit (AGE) and SOR methods. Jin et al. [9] proposed an AGE iteration method of the fourth-order accuracy by integrating the grouping explicit method with numerical boundary conditions. The method was used to solve initial-boundary value problem of convection equations. Fu and Tan [10] showed that an unconditionally stable split-step FDTD method with higher-order spatial accuracy is more accurate than the lower-order methods. The dispersion error of the proposed method is comparable with the higher-order ADI-FDTD method.

Higher-order methods are also studied by Mohebbi and Deghan [11] who applied a compact finite difference approximation of fourth-order and the cubic C1 spline collocation method to some one-dimensional heat and advection-diffusion equations. The scheme has fourth-order accuracy in both space and time and unconditionally stable. Liao [12] proposed an efficient and high-order accuracy of the fourth-order compact finite difference method to solve one-dimensional Burgers’ equation. Tian and Ge [13] studied a stable fourth-order compact ADI method for solving two-dimensional unsteady convection diffusion problems. The method is temporally second-order and spatially fourth-order accurate, which requires only a regular five-point 2D stencil similar to that in the standard second-order methods. Chun [14] solved some nonlinear equations by applying the fourth-order iterative methods containing the King’s fourth-order family. It was observed that the proposed method has at least equal performance compared to other methods of the same order. Zhu et al. [15] presented a high-order parallel finite difference algorithm based on the domain decomposition strategy. The study used the classical explicit scheme to calculate the interface values between subdomains and the fourth-order compact schemes for the interior values. The method has high accuracy and is convergent and stable. Gao and Xie [16] devised a fourth-order alternating direction implicit compact finite difference schemes for the solution of two-dimensional Schrödinger equations. The method is highly competitive as compared to other existing methods, and it achieves the expected convergence rate.

This study develops a higher-order finite difference algorithm, with noncompact stencils, that is capable of delivering highly accurate solutions for a one-dimensional heat equation with Dirichlet boundary conditions. The study focuses on modifying the unconditionally stable and convergent second-order iterative alternating decomposition explicit (IADE) method of Mitchell and Fairweather (IADEMF2). The IADEMF2, which was originally proposed by Sahimi et al. [17], employs the fractional splitting of the Mitchell and Fairweather (MF) variant that has an accuracy of the order . The scheme executes a two-stage process involving the solution of sets of tridiagonal equations along lines parallel to the first and second time steps, respectively. It is found to be unconditionally stable, convergent, and more accurate than the classical AGE class of methods, namely, the AGE method based on the Peaceman and Rachford variant (AGE-PR), whose spatial accuracy is of second order, and the AGE method based on the Douglas and Rachford variant (AGE-DR), whose temporal accuracy is only of first order. The detailed derivation of the IADEMF2 can be obtained from [17].

In this paper, a fourth-order Crank-Nicolson (CN) difference approximation is applied to the spatial derivative in the heat equation, and the MF variant is employed, leading to the formation of the fourth-order IADEMF (IADEMF4) numerical algorithm. The convergence of the IADEMF4 is analyzed and proven. Numerical experiments verify the potential of the IADEMF4 in enhancing the accuracy of the IADEMF2. The results of the proposed higher-order scheme are also compared with the benchmarked fourth-order classical iterative methods, such as the fourth-order Gauss-Seidel (GS4), the fourth-order Jacobi (JAC4), and the fourth-order successive over-relaxation (SOR4) methods.

This paper is organized as follows. Section 2 discusses the implementation and stability of the fourth-order CN approximation on the heat equation. In Section 3, the IADEMF4 algorithm is formulated. Section 4 analyses the convergence of the IADEMF4. Section 5 provides the equations for the benchmarked fourth-order classical iterative methods. The computational complexity of the methods considered in this paper is given in Section 6, while the pseudocode for the IADEMF4 sequential algorithm is presented in Section 7. The experiments conducted are given in Section 8. Sections 9 and 10 provide some discussion and conclusion based on the obtained numerical results.

2. Fourth-Order Crank-Nicolson Approximation to the Spatial Derivative in the Heat Equation

Consider the following one-dimensional parabolic heat equation (1) that has been suitably assumed to be nondimensionalised. It models the flow of heat in a homogeneous unchanging medium of finite extent in the absence of heat source

subject to given initial and Dirichlet boundary conditions

For the problem in (1), the finite difference approach discretizes the time-space domain by placing a rectangular grid over the domain, with grid spacing of and in the - and -directions, respectively. The grid consists of the set of lines parallel to the-axis given by , and a set of lines parallel to the -axis given by , . For simplicity, the grid spacing is taken to be uniform, so that , and . At a grid-point in the solution domain, the dependent variable which represents the nondimensional temperature at time and at position is approximated by .

At the grid-point, the IADEMF4 scheme replaces the spatial derivative in the heat equation with a higher-order, particularly the fourth-order Crank-Nicolson (CN) difference approximation [18]. This is shown in the expression given in (3), with the central difference operators defined as and . The approach gives the fourth-order scheme a spatial truncation error of the order . It enhances the accuracy of its second-order counterpart, which has a larger error of the order

To determine the stability of (3), the von Neumann stability analysis can be applied. Let , and since , the discretization of (3) becomes

The discretized equation in (4) is assumed to have a solution in the form of a Fourier harmonic function; that is, , where is referred to as the amplification factor, is an arbitrary constant, and . The amplification factor represents the time dependence of the solution. If the Fourier function is substituted into (4) and then solve for , the result will be

Since , then the fourth-order CN approximation is unconditionally stable for any choice of , , and .

3. The Formulation of the IADEMF4

The IADEMF4 is firstly developed based on the execution of the unconditionally stable fourth-order CN approximation (3) on the heat equation.

Equation (4) can also be expressed as in (6), using the definitions of the constants given in (7) The approximation in (6) can be displayed in a matrix form such as (8), where is a sparse pentadiagonal coefficient matrix and is the column vector containing the unknown values of at the time level . The column vector consists of boundary values and known values at the previous time level . The definitions for every entry in are given in (9)

The evaluations of , , , and require the values of at the boundaries and . However, these values cannot be obtained numerically because their computations involve nodes at  and , which are exterior to the considered solution domain. If the exact solutions of are available at and , then it is appropriate to consider them as the required boundary values. Otherwise, the boundary conditions have to be formulated, bearing in mind that they should be of comparable accuracy [1].

The IADEMF4 scheme secondly employs the higher-order accuracy formula of MF [19]. The variant, whose accuracy is of the order , is as given in (10) and (11) where , , and represent an acceleration parameter, the iteration index, and an identity matrix, respectively. and are two constituent matrices. The vectors and represent the required solution at the iteration level and at some intermediate level , respectively. The relation of and is given by , .

Substitute the following expression obtained from (10) into (11) and then simplify to obtain Asin (13) becomes sufficiently large, the temperature solution reaches a steady state that is, as , then and . Simplify the equation, and then multiply by . After some algebraic manipulations, the following expression is obtained: Multiply (14) by , and use the definition of to finally obtain the following form:

The comparison between the expression in (8) and the form given in (15) suggests that the coefficient matrixfor the IADEMF4 can be decomposed into The IADEMF4 requires the constituent matrices and in (16) to be in the form of lower and upper tridiagonal matrices, respectively, in order to retain the pentadiagonal structure of . Thus,

By substituting and in (17) into the formula for the decomposition of , the entries of the resultant matrix are compared with the entries of in (8), yielding the following definitions: And for ,

Since and are three banded matrices, then and can be inverted easily. The equations in (10) and (11) are rearranged as in (20) and (21), respectively, The above two equations are computed and simplified, leading to the computational formulae at each of the half iteration levels as given in (22) and (23). (i)At the iteration level, (ii)At the iteration level,

with

The IADEMF4 algorithm is regarded as a two-stage process involving two iteration levels, and . It is completed explicitly by using the required equations at the two levels in alternate sweeps along all the grid points in the interval until convergence is reached. In (22), the calculation to determine the unknown begins at the left boundary and then moves to the right. In a similar manner, in (23) is calculated by proceeding from the right boundary towards the left (Figure 1).

The computational molecules are depicted in Figures 2 and 3.

At each level of iteration, the computational molecules involve two known grid points at the new level and another three known ones at the old level. Clearly, the method is explicit.

4. Convergence Analysis of the IADEMF4

This section proves the convergence of the IADEMF4. Since will not guarantee an accurate approximation for [18], the values of that are considered appropriate for the proof are .

From the definitions in ((18) and (19)), the following results are obtained: Simple computation shows that . Clearly, .

Lemma 1. in ((18) and (19)) is such that, , for all .

Proof. The results in (25) show that . Assume it is true that for all . Since the assumption implies that , then . Therefore, .
It has also been shown that . Assume it is true that for all . The assumption implies that . Thus,
Since it is true that, for , , then, by induction, the assumption is true for all . An equivalent to the preceding statement would be for all . It follows that
Since it is true that, for , , then, by induction, is also true for all .
Suppose there is a such that . Then,
This is a contradiction since . This verifies that , . Let , and then . Therefore, . Lemma 1 is proved.

Lemma 2. If and , then .

Proof. Let for some.
Assume . Since and , then .
If , then , which implies that . This contradicts the fact that .
If , then , which implies that . This contradicts Lemma 1.
So, the assumption that is false. Hence, .

Proposition 3. .

Proof. Let ; that is, is a lower triangular matrix, with all the diagonal entries (whence the eigenvalues of ) equal to , where . Denote all the eigenvalues of by . If is defined as the spectral radius of , then But, by definition of 2-norm, Since all the eigenvalues of are equal, then Thus, from (30) and (32), . By Lemma 2 with replaced by 1, is obtained, leading to the result of Proposition 3, which is .

Proposition 4. .

Proof. Let; that is, is an upper triangular matrix, with all the diagonal entries equal to , where . Since all the eigenvalues of are distinct, then is similar to a diagonal matrix .
By the Schur triangularization theorem [20], there is an orthogonal matrix such that . The diagonal entries of are the eigenvalues of By Lemma 2, for some . Hence, this proves Proposition 4.

From (20) and (21),

Let And let

Then, .

Theorem 5. The IADEMF4 is convergent if , for .

Proof. Define ; then Thus, by similarity, and have the same set of eigenvalues. Therefore, The last inequality is due to Propositions 3 and 4. The proven Theorem 5 assures the convergence of the IADEMF4.

5. The Fourth-Order Classical Iterative Methods

The system of linear equations in (8) may also be solved by using the classical iterative methods of the fourth order. They include the JAC4, the GS4, and the SOR4 methods. These iterative methods are capable of exploiting the sparse structure of the pentadiagonal matrix.

The JAC4 algorithm can be represented by

The approximation of at the iteration level is computed using the relevant values in the iteration.

The GS4 method uses the most recent values of and to update the approximation value of . The algorithm for the GS4 is as expressed in (42)

The SOR4 iterative method accelerates the convergence rate of the GS4. Ifis a relaxation parameter, then for any , (42) can be rewritten as

The SOR4 algorithm reduces to the GS4 if . Except for very special cases, it is difficult to obtain the analytic expression for . According to Young [21], the precise determination of the optimal in the SOR is only known for a small class of matrices. The value of generally lies in the range of .

The computational molecules for the JAC4 and the GS4 are as illustrated in Figures 4 and 5, respectively. The SOR4 has the same form as the GS4.

6. Computational Complexity

The cost of implementing an algorithm can be assessed by examining its computational complexity. The number of arithmetic operations such as additions (including subtractions) and multiplications (including divisions) that is needed to perform by the algorithm can be straightforwardly counted. Table 1 gives the number of sequential arithmetic operations per iteration that is required to evaluate the algorithms.

For the higher-order schemes, trade-off between accuracy and speed usually happens. The computational complexity has an effect on the efficiency of a particular scheme. Thus, this factor will be taken into account when discussing the results of the numerical experiments conducted in this study.

7. The Pseudocode of the IADEMF4 Sequential Algorithm

Algorithm 1 illustrates the pseudocode of the IADEMF4 sequential algorithm. This algorithm can also be generalized and applied to other methods discussed in this paper.

begin
  determine the parameters
  determine initial conditions
  determine exact solutions at time level
  while (time level < )
     determine boundary conditions
     for to
        compute (refer to (9))
     end-for
        set iteration = 0
        while (convergence conditions are not satisfied)
         for to
        compute (refer to (22))
         end-for
         for to
        compute (refer to (23))
         end-for
         test for convergence:
         compute
         if (max )
         then
         add 1 to iteration (if necessary)
        end-while
  end-while
  for to
     determine average absolute error, root mean
     square error and maximum error
  end-for
end

8. Numerical Experiments

Two experiments were conducted to test the sequential numerical performance of the proposed IADEMF4 method against those of the benchmarked classical iterative methods, namely, the JAC4, the GS4, and the SOR4. Comparison is also made with the corresponding IADE method of the second order.

Experiment 1. This problem was taken from Saulev [22] subject to the initial condition and the boundary conditions The exact solution to the given problem is given by

Experiment 2. This problem was taken from Johnson and Reiss [23], subject to the initial condition and the boundary conditions The exact solution to the given problem is given by

9. Results and Discussion

In each experiment, the exact solutions at and were taken as boundary values for the IADEMF4 and the other fourth-order classical iterative methods. The convergence criterion used in the testing of each method was taken as , whereis the convergence tolerance. The selections of the optimum or were determined by experiments. As for the IADEMF2, the CN scheme with was employed.

Figures 6, 7, 8, and 9 visualize the behavior of the one-dimensional parabolic heat solutions for both experiments. By using and a tolerance requirement of , two different mesh sizes, and , were considered in each experiment. The exact solutions are compared with the IADEMF4 and the IADEMF2 numerical solutions. The optimum value ofchosen for each method, as well as their corresponding outcome of the number of iterations, , is stated in the legend of each figure. Every figure reveals that the IADEMF4 is more accurate than the IADEMF2 and the former converges with fewer numbers of iterations in comparison to the latter. The numerical solutions of the IADEMF4 seem to be in very good agreement with the exact solutions. For example, in Figure 7, at , the difference between the exact solution and the numerical solution using the IADEMF2 and using the IADEMF4 is about 3.6% and 0%, respectively. These results imply that the accuracy and convergence rate of the second-order IADE method are enhanced by the implementation of the fourth-order CN approximation that leads to the formation of the corresponding fourth-order IADE scheme.

Figure 10 displays the graph of log (RMSE) versus for decreasing values of implemented on Experiment 2. By considering and fixing , the value of was initially taken as . It was then successively halved into , , and .

The figure shows that amongst the tested methods, the root mean square error (RMSE) of the IADEMF4 and the IADEMF2 decreases linearly as the values of decreases. The slope of the IADEMF4 is approximately equal to 4, which corresponds to its fourth-order spatial accuracy. The IADEMF2 with a second-order spatial accuracy has a slope that is approximately equal to 2. It is clear that the IADEMF4 is always more accurate than the IADEMF2, for the different considered mesh sizes. The graphs of the SOR4 , the GS4, and the JAC4 show that their accuracies of fourth order tend to lack as decreases, largely due to the effect of increasing round-off errors as the value of increases.

Tables 2, 3, 4, 5, 6, 7, 8, and 9 provide numerical results in terms of the average absolute error (AAE), root mean square error (RMSE), maximum error (ME), number of iterations , and execution time (ET) measured in seconds (s). The results are obtained from both experiments for two different values of and mesh size, . It is generally observed that when , , and , the IADEMF4 has the least average absolute error, root mean square error, and maximum error in comparison with the other methods under consideration (Tables 25). When the size of was ten times bigger and a more stringent tolerance criterion was set , the accuracy of the IADEMF4 clearly outperforms the other methods for a mesh size of (Tables 6 and 8). However, the difference in the errors amongst the tested methods is not so obvious for the case of (Tables 7 and 9). The achievement of the fourth-order IADE method in Experiments 1 and 2 can be clearly seen from the results in Tables 2 and 8, respectively, where it has caused a huge 94% reduction of RMSE from its corresponding second-order IADE method.

The IADEMF4 has the advantage of featuring higher accuracy due to the execution of the fourth-order CN approximation coupled with the fourth-order accurate MF variant. The IADEMF2 is only derived from the second-order CN approximation, but its combination with its corresponding fourth-order MF variant managed to produce errors which are better than the GS4, JAC4, and the SOR4. Even though the classical iterative methods are also derived from the fourth-order accurate CN type approximation, they are lacking in accuracy due to the round-off errors that have been accumulated from the time the execution starts till it ends.

With regards to the rate of convergence, the results from each table demonstrate that the number of iterations produced by the IADEMF2 and the fourth-order classical iterative methods is greater than or at least equal to that of the IADEMF4. The convergence rate of the latter surpasses the others in the case of and (Tables 68). Even though the operational count of the IADEMF4 is relatively quite large (Table 1), due to its higher level of accuracy, its increasing number of correct digits at each iteration causes it to converge at a faster rate. The IADEMF2 has the advantage of having less mathematical operations; thus, it is competitive in terms of convergence rate but at the expense of accuracy. The application of the fourth-order CN approximation on the heat equation proves that the three classical iterative methods also converge, with JAC4 appearing to be the slowest and the least accurate amongst all.

It is found that the convergence rate of the fourth-order and second-order methods improves with the application of larger mesh size, that is, from to . The coarser meshes cause a reduction in the computational operations, thus giving better rate of convergence. However, a more accurate solution is obtained by using finer mesh. For example, Table 6 shows that, for , the IADEMF4 has and , whereas Table 7 shows that, for , its and . In general, amongst all the tested methods, the IADEMF4 still maintains its greater accuracy characteristic, even with coarser meshes.

In terms of execution time, the results from every table display shorter execution time for the IADEMF2 in comparison to the IADEMF4. This is expected, since the IADEMF2 has lower computational complexity (Table 1). Despite the achievement in accuracy, the IADEMF4 has to perform more computational work than the IADEMF2 since the former has to utilize values of at two grid points on either side of the point along the th time level. Thus, if accuracy is desired, then the preferred sequential numerical algorithm would be the IADEMF4. On the other hand, if execution time matters, then the choice would be the IADEMF2.

Amongst the fourth-order methods, the IADEMF4 executes in the least amount of time. Even though its computational complexity is relatively large, it operates with the least number of iterations, thus enabling it to be the most efficient.

10. Conclusion

This paper proposes the development of the novel fourth-order IADEMF4 finite difference scheme. The higher-order scheme is developed by representing the spatial derivative in the heat equation with the fourth-order finite difference CN approximation. This leads to the formation of pentadiagonal matrices in the systems of linear equations with larger computational stencils. The algorithm also employs the higher accuracy of the Mitchell and Fairweather variant. Despite the fourth-order IADE scheme’s higher computational complexity, this technique is proved to be valuable because it enhances the accuracy of its second-order counterpart, namely, the IADEMF2. In addition, the higher accuracy of IADEMF4 is verified as a convergent and unconditionally stable scheme and is superior in terms of rate of convergence. It has also been proven to execute more efficiently in comparison to the other benchmarked fourth-order classical iterative methods, such as the GS4, the SOR4, and the JAC4. The increasing number of correct digits at each iteration serves as an advantage for the IADEMF4, thus yielding faster rate of convergence with higher level of accuracy.

In conclusion, the proposed IADEMF4 scheme affords users many advantages with respect to higher accuracy, stability, and rate of convergence, and it serves as an alternative, efficient technique for the solution of a one-dimensional heat equation with Dirichlet boundary conditions.

The proposed fourth-order scheme can be modified and adapted to more general multidimensional linear and nonlinear parabolic, elliptic, and hyperbolic partial differential equations, using different types of boundary conditions. Besides, it can also be considered for applications in problems that require higher-order accuracy with high resolution, such as problems in nanocomputing that require the solution of very large sparse systems of equation.

The explicit and high accuracy feature of the IADEMF4 can be exploited in two- and three-dimensional heat problems, by applying the scheme as pentadiagonal solvers for the system of linear equations arising in the sweeps of a higher-order alternating direction implicit (ADI) scheme. The lower-order ADI scheme was initially proposed by Peaceman and Rachford [24]. The higher space dimensions are expected not to cause unsatisfactory performance for the ADI-IADEMF4, as long as the proposed scheme is stable, convergent, and efficient as the process of its implementation continues to advance from one-time step to another. Pathirana et al. [25] implemented the ADI in developing a two-dimensional model for incorporating flood damage in urban drainage planning. The proposed model is found to be stable, numerically accurate, and computationally efficient. Mirzavand et al. [26] proposed the ADI-FDTD method for the physical modeling of high-frequency semiconductor devices. The approach is able to reduce significantly the full-wave simulation time.

It is possible to parallelize the IADEMF4 algorithm since the calculation of the new iteration only depends on the known values from the last iteration (Figures 2 and 3). Future work is to exploit the explicit computational properties and efficiency of the IADEMF4 for parallelization and execution on distributed parallel computing systems. The idea is to speed up the execution time without compromising its accuracy, especially on problems involving very large linear systems of equations.