Research Article | Open Access
S. A. Edalatpanah, M. M. Rashidi, "On the Application of Homotopy Perturbation Method for Solving Systems of Linear Equations", International Scholarly Research Notices, vol. 2014, Article ID 143512, 5 pages, 2014. https://doi.org/10.1155/2014/143512
On the Application of Homotopy Perturbation Method for Solving Systems of Linear Equations
The application of homotopy perturbation method (HPM) for solving systems of linear equations is further discussed and focused on a method for choosing an auxiliary matrix to improve the rate of convergence. Moreover, solving of convection-diffusion equations has been developed by HPM and the convergence properties of the proposed method have been analyzed in detail; the obtained results are compared with some other methods in the frame of HPM. Numerical experiment shows a good improvement on the convergence rate and the efficiency of this method.
Consider the following convection-diffusion equation: On the unit square domain , with constant coefficients , , subject to Dirichlet boundary conditions. Discretization by a five-point finite difference operator leads to the following linear system: where denotes a vector in a finite-dimensional space and . With discretization on a uniform grid, using standard second-order differences for the Laplacian and either centered or upwind differences for the first derivatives, the coefficient matrix has the form Or with Kronecker product () we obtain where ; are Reynolds numbers. Also, the equidistant step-size is used in the discretization and the natural lexicographic ordering is employed to the unknowns and the right hand side satisfies . For details, we refer to [1, 2] and the references therein. Convection-diffusion equations appear in many fields of science and engineering and there are some reliable methods for solving this class of problems ([1, 2] and the references therein). Here, we use alternative approach to solve (2) based on homotopy perturbation method (HPM). The HPM was first proposed by the Chinese mathematician He in 1999  and was further developed and improved by him [4–6]. He presented a homotopy perturbation technique based on the introduction of homotopy in topology coupled with the traditional perturbation method for the solution of algebraic equations and ODEs. This technique provides a summation of an infinite series with easily computable terms, which converges to the solution of the problem. In the literature, various authors have successfully applied this method for many kinds of different problems such as nonlinear partial differential equations [7, 8], nonlinear wave equations , nonlinear integral and integrodifferential equations , fractional IVPs , and optimization . Nevertheless, to our knowledge, a few papers have considered this analytical method for system of linear equations. Keramati  presented an efficient method for solving system of linear equations based on HPM. Liu  by using HPM and splitting methods proposed a new method for linear systems. Saberi Najafi et al.  based on HPM proposed a new algorithm for fuzzy linear systems and compared it with Adomian’s decomposition method. They also in  show that solving linear systems by using a new method called modified HPM, presented by Noor et al. , is impractical.
In this paper, by combination of HPM and preconditioning technique, we will present a new model for solving linear systems and apply this method to the above convection-diffusion equation.
2. Homotopy Perturbation Method for Linear Systems
Consider linear system (2). HPM procedure for solving of this system is a continuous map from the interval to a function space where it is as follows: and is an embedding parameter.
Keramati  applied a HPM to solve linear systems by the following definitions.
Let and , where is a known vector. Then homotopy is Obviously, we will have According to the HPM, we can first use the embedding parameter as a small parameter and assume that the solution of (2) can be written as a power series in : and the exact solution is obtained as follows: Putting (8) into (5) and comparing the coefficients of identical degrees of on both sides, we find And in general Taking yields Therefore, the solution can be of the form This method is efficient for solving system of linear equations but, however, does not converge for some systems when the spectral radius is greater than one. To make the method useful, Liu in  added the auxiliary parameter and the auxiliary matrix to the HPM. This method is as follows: where Here, is an auxiliary parameter, is the auxiliary matrix, and the operator is decided by the splitting matrix . Then his iterative scheme for is Therefore, And finally by setting , he obtained the solution as follows: This author has adapted the Richardson, Jacobi, and the Gauss-Seidel methods to choose the splitting matrix and obtained that the homotopy series converged rapidly for a large sparse system with a small spectral radius. But to improve the rate of convergence, he does not present on a method for choosing (see , conclusion). The main goal on this paper is studying this problem and doing some modifications for having very effective and straightforward results.
Our idea for choosing is preconditioning technique. Preconditioning methods are the most authoritative techniques to improve poor properties of the basic iterative methods. The main aim of preconditioning method for is to substitute the original matrix with an equivalent one which has better properties concerning the computation of a solution (generally by a certain iterative method). The two matrices are equivalent in the sense that they have the same solution. Simple preconditioners of this type are the left matrix preconditioners. The left preconditioned matrix is a nonsingular matrix and the preconditioned matrix is defined by , where .
In this paper, we consider as a preconditioner and if the auxiliary matrix is properly chosen, we can be able to achieve the best results. To improve the convergence rate of the basic iterative method, various models of preconditioning systems have been proposed [17–19]. In the literature, various authors have suggested different models of -Type preconditioned [20–28], where all of these models are left preconditioners. We can consider all of the models in [17–28] for .
Here we consider Usui et al.  model of )-Type preconditioners for , where Let , where is the diagonal matrix and , are strictly lower and strictly upper triangular matrices of , respectively. Then the preconditioned matrix is as follows: We know that , where Then we have Thus, where , , and are, respectively, the diagonal, strictly lower, and strictly upper triangular parts of .
Therefore, we have Furthermore, for more convergence speed in Jacobi-HPM and Gauss-Seidel-HPM we choose as follows.
In Jacobi-HPM, In Gauss-Seidel-HPM, Now, we will show that by this choice of , these methods are faster than of the basic methods form point of view of the convergence speed.
Lemma 3 (see ). Let A be a -matrix. Then is -matrix if and only if there is a positive vector such that .
Lemma 4 (see ). Let , be -matrix and an -matrix; if , then is an -matrix too.
Lemma 5 (see ). Let be a regular splitting. Then if and only if is nonsingular and is nonnegative.
Proof. Since is an -matrix, by Lemma 3 it is easy to see that also is -matrix, and thus by Lemma 4 is -matrix and is nonnegative. Then by Lemmas 5 and 6 we can obtain .
Therefore by [13, Theorem 2.1] the proof is completed.
3. Numerical Experiments
In this section, we give an example to illustrate the obtained results in the previous sections.
We test convection-diffusion equation (1) when , .
Then, we solved the -matrix yielded by Jacobi-HPM and Gauss-Seidel-HPM.
In this experiment, we choose the right hand side vector, such that is solution of . The stopping criterion with tolerance is .
From the tables, we can see that if is (19), then the mentioned methods are superior to the basic methods.
In this paper, we have applied a new method for solving convection-diffusion equations based on the HPM. We can see that how HPM method is influenced for solving system of linear equation, if combined by preconditioning technique. Finally, from theoretical speaking and numerical experiment, it may be concluded that the convergence behaviors of this method is superior to some other methods in the frame of HPM.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
- H. C. Elman and G. H. Golub, “Iterative methods for cyclically reduced non-self-adjoint linear systems,” Mathematics of Computation, vol. 54, no. 190, pp. 671–700, 1990.
- H. C. Elman and G. H. Golub, “Iterative methods for cyclically reduced nonselfadjoint linear systems. II,” Mathematics of Computation, vol. 56, no. 193, pp. 215–242, 1991.
- J.-H. He, “Homotopy perturbation technique,” Computer Methods in Applied Mechanics and Engineering, vol. 178, no. 3-4, pp. 257–262, 1999.
- J.-H. He, “Homotopy perturbation method: a new nonlinear analytical technique,” Applied Mathematics and Computation, vol. 135, no. 1, pp. 73–79, 2003.
- J.-H. He, “Application of homotopy perturbation method to non-linear wave equations,” Chaos, Solitons & Fractals, vol. 26, no. 3, pp. 695–700, 2005.
- J.-H. He, “Homotopy perturbation method for solving boundary value problems,” Physics Letters A, vol. 350, no. 1-2, pp. 87–88, 2006.
- L. Cveticanin, “Application of homotopy-perturbation to non-linear partial differential equations,” Chaos, Solitons & Fractals, vol. 40, no. 1, pp. 221–228, 2009.
- M. Dehghan and F. Shakeri, “The numerical solution of the second Painleve equation,” Numerical Methods for Partial Differential Equations, vol. 25, no. 5, pp. 1238–1259, 2009.
- J. Saberi-Nadjafi and A. Ghorbani, “He's homotopy perturbation method: an effective tool for solving nonlinear integral and integro-differential equations,” Computers & Mathematics with Applications, vol. 58, no. 11-12, pp. 2379–2390, 2009.
- O. Abdulaziz, I. Hashim, and S. Momani, “Application of homotopy-perturbation method to fractional IVPs,” Journal of Computational and Applied Mathematics, vol. 216, no. 2, pp. 574–584, 2008.
- H. Saberi Najafi and S. A. Edalatpanah, “Homotopy perturbation method for linear programming problems,” Applied Mathematical Modelling, vol. 38, no. 5-6, pp. 1607–1611, 2014.
- B. Keramati, “An approach to the solution of linear system of equations by He's homotopy perturbation method,” Chaos, Solitons & Fractals, vol. 41, no. 1, pp. 152–156, 2009.
- H.-K. Liu, “Application of homotopy perturbation methods for solving systems of linear equations,” Applied Mathematics and Computation, vol. 217, no. 12, pp. 5259–5264, 2011.
- H. Saberi Najafi, S. A. Edalatpanah, and A. H. Refahi Sheikhani, “Application of homotopy perturbation method for fuzzy linear systems and comparison with Adomian’s decomposition method,” Chinese Journal of Mathematics, vol. 2013, Article ID 584240, 7 pages, 2013.
- H. S. Najafi, S. A. Edalatpanah, and N. Vosoughi, “A discussion on the practicability of an analytical method for solving system of linear equations,” American Journal of Numerical Analysis, vol. 2, no. 3, pp. 76–78, 2014.
- M. A. Noor, K. I. Noor, S. Khan, and M. Waseem, “Modified homotopy perturbation method for solving system of linear equations,” Journal of the Association of Arab Universities for Basic and Applied Sciences, vol. 13, no. 1, pp. 35–37, 2013.
- D. J. Evans, Preconditioned Iterative Methods, vol. 4 of Topics in Computer Mathematics, Gordon and Breach Science, Lausanne, Switzerland, 1994.
- M. Benzi, “Preconditioning techniques for large linear systems: a survey,” Journal of Computational Physics, vol. 182, no. 2, pp. 418–477, 2002.
- O. Axelsson, “A survey of preconditioned iterative methods for linear systems of algebraic equations,” BIT Numerical Mathematics, vol. 25, no. 1, pp. 166–187, 1985.
- J. P. Milaszewicz, “Improving Jacobi and Gauss-Seidel iterations,” Linear Algebra and Its Applications, vol. 93, pp. 161–170, 1987.
- A. D. Gunawardena, S. K. Jain, and L. Snyder, “Modified iterative methods for consistent linear systems,” Linear Algebra and Its Applications, vol. 154–156, pp. 123–143, 1991.
- M. Usui, H. Niki, and T. Kohno, “Adaptive Gauss Seidel method for linear systems,” International Journal of Computer Mathematics, vol. 51, no. 1, pp. 119–125, 1994.
- L.-Y. Sun, “Some extensions of the improved modified Gauss-Seidel iterative method for H-matrices,” Numerical Linear Algebra with Applications, vol. 13, no. 10, pp. 869–876, 2006.
- L. Wang and Y. Song, “Preconditioned AOR iterative methods for M-matrices,” Journal of Computational and Applied Mathematics, vol. 226, no. 1, pp. 114–124, 2009.
- H. S. Najafi and S. A. Edalatpanah, “Iterative methods with analytical preconditioning technique to linear complementarity problems: application to obstacle problems,” RAIRO—Operations Research, vol. 47, no. 1, pp. 59–71, 2013.
- H. S. Najafi and S. A. Edalatpanah, “Modification of iterative methods for solving linear complementarity problems,” Engineering Computations, vol. 30, no. 7, pp. 910–923, 2013.
- H. Saberi Najafi and S. A. Edalatpanah, “A collection of new preconditioners for solving linear systems,” Scientific Research and Essays, vol. 8, no. 31, pp. 1522–1531, 2013.
- H. SaberiNajafi and S. A. Edalatpanah, “A new family of (I+S)-type preconditioner with some applications,” Computational and Applied Mathematics, 2014.
- R. S. Varga, Matrix Iterative Analysis, Springer, Berlin, Germany, 2nd edition, 2000.
- A. Berman and R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, Academic Press, New York, NY, USA, 1994.
- A. Frommer and D. B. Szyld, “H-splittings and two-stage iterative methods,” Numerische Mathematik, vol. 63, no. 3, pp. 345–356, 1992.
- Y. Saad, Iterative Methods for Sparse Linear Systems, SIAM, Philadelphia, Pa, USA, 2nd edition, 2003.
Copyright © 2014 S. A. Edalatpanah and M. M. Rashidi. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.