Applications of Fixed Point and Approximate AlgorithmsView this Special Issue
A Class of Three-Step Derivative-Free Root Solvers with Optimal Convergence Order
A class of three-step eighth-order root solvers is constructed in this study. Our aim is fulfilled by using an interpolatory rational function in the third step of a three-step cycle. Each method of the class reaches the optimal efficiency index according to the Kung-Traub conjecture concerning multipoint iterative methods without memory. Moreover, the class is free from derivative calculation per full iteration, which is important in engineering problems. One method of the class is established analytically. To test the derived methods from the class, we apply them to a lot of nonlinear scalar equations. Numerical examples suggest that the novel class of derivative-free methods is better than the existing methods of the same type in the literature.
One of the common problems encountered in engineering problems is that given a single variable function , find the values of for which . The solutions (values of ) are known as the roots of the equation , or the zeros of the function . The root of such nonlinear equations may be real or complex. In general, an equation may have any number of (real) roots or no roots at all. There are two general types of methods available to find the roots of algebraic and transcendental equations. First, direct methods, which are not always applicable to find the roots, and second, iterative methods based on the concept of successive approximations. In this case, the general procedure is to start with one or more initial approximation(s) to the root and attain a sequence of iterates, which in the limit converges to the true solution .
Here, we focus on the simple roots of nonlinear scalar equations by iterative methods. The prominent one-point (or one-step) Newton’s method of order two, which is a basic tool in numerical analysis and numerous applications, has widely been applied and discussed in the literature; see, for example, [2–7]. Newton’s iteration and any of its variants, include derivative calculation per full cycle to proceed, which is not useful in engineering problems. Since the calculation of more derivatives often takes up an eye-catching time.
To remedy this, first Steffensen coined the following quadratical scheme: . Inspired by this method, so many techniques with better orders of convergence have been provided through two- or three-step cycles; see  and the bibliographies therein. In between, the concept of optimality, which was mooted by Kung-Traub , also plays a crucial role; a multipoint method for solving nonlinear scalar equations without memory has the optimal order , where is the total number of evaluations per full cycle. In what follows, we review some of the significant derivative-free iterations.
Peng et al. in  investigated an optimal two-step derivative-free technique as comes next where and is adaptively determined.
Ren et al. in  furnished an optimal quartical scheme using divided differences as follows: where and .
Taking into account the divided differences,  contributed the following two-step optimal method: where . Note that the notation of divided differences will be used throughout this paper. Therefore, we have , .
In 2011, Khattri and Argyros  formulated a sixth-order method as follows:
Very recently, Thukral in  gave the following optimal eighth-order derivative-free iterations without memory: and also
Unfortunately, by error analysis, we have found that (1.6) (relation (2.32) in ) does not possess the convergence order eight. Thus, it is not optimal in the sense of Kung-Traub’s conjecture. Hence, (1.6) is excluded from our list of optimal eighth-order derivative-free methods. Note that (2.27) of  has also an eye-catching typo in its structure, which does not produce optimal order.
Derivative-free methods [15–17] have so many applications in contrast to the derivative-involved methods. Anyhow, there are some other factors, except being free from derivative or high order of convergence in choosing a method for root finding; for example, we refer the readers to , to see the importance of initial guesses in this subject matter. For further reading, one may refer to [19–26].
This research contributes a general class of three-step methods without memory using four points (we mean the evaluations of the function need to be computed four times per step) and four evaluations per full cycle for solving single-variable nonlinear equations. The contributed class has some important features in what follows. First, it reaches the optimal efficiency index 1.682. Second, it is free from derivative calculation per full cycle, which is so much fruitful for engineering and optimization problems. Third, using any optimal quartically convergent derivative-free two-step method in its first two steps will yield a new optimal eighth-order derivative-free iteration without memory in the sense of Kung-Traub’s conjecture . Finally, we will find that the new eighth-order derivative-free methods are fast and convergent.
2. Main Contribution
Consider the nonlinear scalar function that is sufficiently smooth in the neighborhood , of a simple zero . To construct derivative-free methods of optimal order eight, we consider a three-step cycle in which the first two steps are any of the optimal two-step derivative-free schemes without memory as follows:
Please note that or , where is specified by the user. The value of completely relies on the two-point method allocated in the first two steps of (2.1). The purpose of this paper is to establish new derivative-free methods with optimal order; hence, we reduce the number of evaluations from five to four by using a suitable approximation of the new-appeared derivative. Now to attain a class of optimal eighth-order techniques free from derivative, we should approximate using the known values, that is, , , , and . We do this procedure by applying the nonlinear rational fraction inspired by Padé approximant as follows: where .
The general setup in approximation theory is that a function is given and next a user wants to estimate it with a simpler function but in such a way that the difference between and is small. The advantage is that the simpler function can be handled without too many difficulties. Polynomials are not always a good class of functions if one desires to estimate scalar functions with singularities, because polynomials are entire functions without singularities. They are only useful up to the first singularity of near the singularity point. Rational functions (the concept of the Padé approximant) are the simplest functions with singularities. The idea is that the poles of the rational functions will move to the singularities of the function , and hence the domain of convergence can be enlarged. The Padé approximant of is the rational function , where is a polynomial of degree and is a polynomial of degree , in which the interpolation condition is satisfied. As a matter of fact, (2.2) is an interpolatory rational function, which is inspired by the Padé approximant.
Hence, by substituting the known values in (2.2), that is , , , and , we have the following system of three linear equations with three unknowns ( is obvious): which has the follow-up solution after simplifying
To obtain the solution of any nonlinear scalar equation by the new derivative-free methods, we must set a particular initial approximation , ideally close to the simple root. In numerical analysis, it is very useful and essential to know the behavior of an approximate method. Therefore, we are about to prove the convergence order of (2.6).
Theorem 2.1. Let be a simple root of the sufficiently differentiable function in an open interval . If is sufficiently close to , then (2.6) is of eighth order and satisfies the error equation below where , and , .
Proof. We provide the Taylor series expansion of any term involved in (2.6). By Taylor expanding around the simple root in the th iterate, we have . Furthermore, it is easy to find By considering this relation and the first step of (2.6), we obtain At this time, we should expand around the root by taking into consideration (2.9). Accordingly, we have Using (2.9) and (2.10) in the second step of (2.6) results in On the other hand, we have We also have the following Taylor series expansion for the approximation of in the third step using (2.11): Now by applying (2.12) and (2.13), we attain At this time, by applying (2.14) in (2.6), we obtain This ends the proof and shows that (2.6) is an optimal eighth-order derivative-free scheme without memory.
As a consequence using (1.2), we attain the following biparametric eighth-order family which satisfies the following error equation: with and . In what follows, we give other methods that can simply be constructed using the approach given above and just by varying the first two steps and using optimal derivative-free quartical iterations. Therefore, as other examples, we have which satisfies the following error equation: By considering , in , we can have with the follow-up error relation We can also present by considering , , , where and is its error equation.
In Table 1, a comparison of efficiency indices for different derivative-free methods of various orders is given. Equations (2.6), (2.16) or any optimal eighth-order scheme resulting from our class reaches the efficiency index , which is optimal according to the Kung-Traub hypothesis for multipoint iterative methods without memory for solving nonlinear scalar equations.
Remark 2.2. The introduced approximation for in the third step of (2.5) always doubles the convergence rate of the two-step method without memory given in its first two steps. That is, using any optimal fourth-order derivative-free method in its first two steps yields a novel three-step optimal eighth-order method without memory free from derivative. This makes our class interesting and accurate. Note that using any cubical derivative-free method without memory using three evaluations in the first two steps of (2.5) ends in a sixth-order derivative-free technique. This also shows that the introduced approximation for doubles the convergence rate.
The free nonzero parameter plays a crucial rule for obtaining new numerical and theoretical results. In fact, if the user approximate per cycle with another iteration using only the available data at the first step, the convergence behavior of the refined method(s) will be improved. That is to say, a more efficient refined version of the attained optimal eighth-order derivative-free methods can be constructed by accepting an iteration for inside the real iterative scheme, as well as more computational burden. This way of obtaining new methods is called “with memory” iterations. Such developments can be considered as future improvements in this field. We here mention that according to the experimental results, choosing very small value for , such as , will mostly decrease the error equation, and thus the numerical output results will be more accurate and reliable without much more computational load.
In what follows, the findings are generalized by illustrating the effectiveness of the eighth-order methods for determining the simple root of a nonlinear equation.
3. Numerical Testing
The results given in Section 2 are supported through the numerical works. We here also mention a well-known derivative-involved method for comparisons to show the reliability of our derivative-free methods.
Wang and Liu  suggested an optimal derivative-involved eighth-order method as follows:
Iteration (3.1) consists of derivative evaluation per full cycle, which is not good in engineering problems. Three methods of our class, (2.6), (2.16) with , (2.16) with , , are compared with the quartically schemes of Liu et al. (1.3) and Ren et al. (1.2) with , the sixth-order scheme of Khattri and Argyros (1.4), the optimal eighth-order methods of Thukral (1.5). The comparison was also made by the derivative-involved method (3.1).
All the computations reported here were done using MATLAB 7.6 using VPA command, where for convergence we have selected the distance of two consecutive approximations to be less than . That is, or . Scientific computations in many branches of science and technology demand very high precision degree of numerical precision. The test nonlinear scalar functions are listed in Table 2.
The results of comparisons for the test functions are provided in Table 3. It can be seen that the resulting methods from our class are accurate and efficient in terms of number of accurate decimal places to find the roots after some iterations. In terms of computational cost, our class is much better than the compared methods. The class includes four evaluations of the function per full iteration to reach the efficiency index 1.682.
An important problem that appears in practical application of multipoint methods is that a quick convergence, one of the merits of multipoint methods, can be attained only if initial approximations are sufficiently close to the sought roots; otherwise, it is not possible to realize the expected convergence speed in practice. For this reason, in applying multipoint root-finding methods, a special attention should be paid to find good initial approximations. Yun in  outlined a noniterative way for this purpose as comes next where is a simple root (an approximation of it) of on the interval with , and is a positive number in the set of natural numbers.
If the cost of derivatives is greater than that of function evaluation, then (3.1) or any optimal eighth-order derivative-involved method is not effective. To compare (2.5) with optimal eighth-order derivative-involved methods, we can use the (original) computational efficiency definition due to Traub : where is the cost of evaluating . If we take , we have (2.5) and (3.1), so that (3.1)(2.5) if .
4. Concluding Notes
The design of iterative formulas for solving nonlinear scalar equations is an interesting task in mathematics. On the other hand, the analytic methods for solving such equations are almost nonexistent, and therefore, it is only possible to obtain approximate solutions by relying on numerical methods based upon iterative procedures. In this work, we have contributed a simple yet powerful class of iterative methods for the solution of nonlinear scalar equations. The class was obtained by using the concept of Padé approximation (an interpolatory rational function) in the third step of a three-step cycle, in which the first two steps are available by any of the existing optimal fourth-order derivative-free methods without memory. We have seen that the introduced approximation of the first derivative of the function in the third step doubles the convergence rate. The analytical proof for one method of our novel class was written. Per full cycle, our class consists of four evaluations of the function and reaches the optimal order 8. Hence, the efficiency index of the class is 1.682, that is, the optimal efficiency index. The effectiveness of the developed methods from the class was illustrated by solving some test functions and comparing to the well-known derivative-free and derivative-involved methods. The results of comparisons were fully given in Table 3. Finally, it could be concluded that the novel class is accurate and efficient in contrast to the existing methods in the literature.
The authors would like to record their cordial thanks to the reviewer for his/her constructive remarks, which have considerably contributed to the readability of this paper.
A. Iliev and N. Kyurkchiev, Nontrivial Methods in Numerical Analysis: Selected Topics in Numerical Analysis, LAP LAMBERT Academic Publishing, 2010.View at: Zentralblatt MATH
F. Soleymani and M. Sharifi, “On a general efficient class of four-step root-finding methods,” International Journal of Mathematics and Computers in Simulation, vol. 5, pp. 181–189, 2011.View at: Google Scholar
F. Soleymani, “New optimal iterative methods in solving nonlinear equations,” International Journal of Pure and Applied Mathematics, vol. 72, no. 2, pp. 195–202, 2011.View at: Google Scholar
F. Soleymani, “A novel and precise sixth-order method for solving nonlinear equations,” International Journal of Mathematical Models and Methods in Applied Sciences, vol. 5, pp. 730–737, 2011.View at: Google Scholar
F. Soleymani, “On a bi-parametric class of optimal eighth-order derivative-free methods,” International Journal of Pure and Applied Mathematics, vol. 72, pp. 27–37, 2011.View at: Google Scholar
D. K. R. Babajee, Analysis of higher order variants of Newton's method and their applications to differential and integral equations and in ocean acidification, Ph.D. thesis, University of Mauritius, 2010.
F. Soleymani, “On a novel optimal quartically class of methods,” Far East Journal of Mathematical Sciences (FJMS), vol. 58, no. 2, pp. 199–206, 2011.View at: Google Scholar
F. Soleymani and B. S. Mousavi, “A novel computational technique for finding simple roots of nonlinear equations,” International Journal of Mathematical Analysis, vol. 5, pp. 1813–1819, 2011.View at: Google Scholar
F. Soleymani and M. Sharifi, “On a class of fifteenth-order iterative formulas for simple roots,” International Electronic Journal of Pure and Applied Mathematics, vol. 3, pp. 245–252, 2011.View at: Google Scholar
J. F. Traub, Iterative Methods for the Solution of Equations, Chelsea Publishing Company, New York, NY, USA, 1982.