Research Article  Open Access
Newton Type Iteration for Tikhonov Regularization of Nonlinear IllPosed Problems in Hilbert Scales
Abstract
Recently, Vasin and George (2013) considered an iterative scheme for approximately solving an illposed operator equation . In order to improve the error estimate available by Vasin and George (2013), in the present paper we extend the iterative method considered by Vasin and George (2013), in the setting of Hilbert scales. The error estimates obtained under a general source condition on ( is the initial guess and is the actual solution), using the adaptive scheme proposed by Pereverzev and Schock (2005), are of optimal order. The algorithm is applied to numerical solution of an integral equation in Numerical Example section.
1. Introduction
In this study, we are interested in approximately solving a nonlinear illposed operator equation: where is a nonlinear operator. Here is the domain of , and is the inner product with corresponding norm on the Hilbert spaces and . Throughout this paper we denote by the ball of radius centered at denotes the Fréchet derivative of at , and denotes the adjoint of . We assume that are the available noisy data satisfying where is the noise level. Equation (1) is, in general, illposed, in the sense that a unique solution that depends continuously on the data does not exist. Since the available data is , one has to solve (approximately) the perturbed equation instead of (1).
To solve the illposed operator equations, various regularization methods are used, for example, Tikhonov regularization, Landweber iterative regularization, LevenbergMarquardt method, Lavrentiev regularization, Newton type iterative method, and so forth (see, e.g., [1–16]).
In [16], Vasin and George considered the iteration (which is a modified form of the method considered in [8]) where , is the initial guess, is the regularization parameter, and . Iteration (4) was used to obtain an approximation for the zero of and proved that is an approximate solution of (1). The regularization parameter in [16] was chosen appropriately from the finite set depending on the inexact data and the error level satisfying (2) using the adaptive parameter selection procedure suggested by Pereverzev and Schock [17].
In order to improve the rate of convergence many authors have considered the Hilbert scale variant of the regularization methods for solving illposed operator equations, for example, [18–26]. In this study, we present the Hilbert scale variant of (4).
We consider the Hilbert scale (see [14, 18, 23, 26–29]) generated by a strictly positive selfadjoint operator , with the domain dense in satisfying , for all . Recall [19, 28] that the space is the completion of with respect to the norm , induced by the inner product
In this paper, we consider the sequence defined iteratively by where , , is the initial guess, , for obtaining an approximation for zero of (cf. [21, 30])
As in [16], we use the following centertype Lipschitz condition for the convergence of the iterative scheme.
Assumption 1. Let be fixed. There exists a constant such that, for every and , there exists an element satisfying
The error estimates in this work are obtained using the source condition on . In addition to the advantages listed in [16, see page 3], the method considered in this paper gives optimal order for a range of values of smoothness assumptions on . The regularization parameter is chosen from some finite set using the balancing principle considered by Pereverzev and Schock in [17].
The paper is organized as follows. In Section 2, we give the analysis of the method for regularization of (6) in the setting of Hilbert scales. The error analysis and adaptive scheme of parameter are given in Section 3. In Section 4, implementation of the method along with a numerical example is presented to validate the efficiency of the proposed method and we conclude the paper in Section 5.
2. The Method
First we will prove that the sequence defined by (6) converges to the zero of (7) and then we show that is an approximation to the solution of (1).
Let . We make use of the relation which follows from the spectral properties of the positive selfadjoint operator , . Usually, for the analysis of regularization methods in Hilbert scales, an assumption of the form (cf. [18, 24]) on the degree of illposedness is used. In this paper instead of (10) we require only a weaker assumption: for some positive reals , , and .
Note that (11) is simpler than that of (10). Now we define and by The following proposition is used for further analysis.
Proposition 2 (cf. see [29, Proposition 2.1]). For and ,
Let us define a few parameters essential for the convergence analysis. Let with Further let , and For , let Then .
Lemma 3. Let Proposition 2 hold. Then for all , the following hold: (a), (b).
Proof. Observe that, by Proposition 2,
This completes the proof of the lemma.
Theorem 4. Let and be as in (14) and (17), respectively; let be as defined in (6) with . Then under Assumption 1 and Lemma 3, the following estimates hold for all :(a);(b).
Proof. If , then by Assumption 1,
where
and , and hence by Assumption 1 and Lemma 3(a), we have
and by Lemma 3(b),
Hence, by (19), (21), and (22), we have
Next we show that , using Assumption 1 and Lemma 3. Observe that
Hence, (a) follows from (23) and (24).
To prove (b), note that . Suppose for some ; then Thus, by induction for all . This proves (b).
Next we go to the main result of this section.
Theorem 5. Let be as in (6), , and assumptions of Theorem 4 hold. Then is a Cauchy sequence in and converges, say, to . Further and where .
Proof. Using relation (a) of Theorem 4, we obtain
Thus, is a Cauchy sequence in and hence it converges, say, to .
Now letting in (6), we obtain
This completes the proof.
The following assumption on source function and source condition is required to obtain the error estimates.
Assumption 6. There exists a continuous, strictly monotonically increasing function such that the following conditions hold:(i),(ii) for all , and(iii)there exists with , such that
Remark 7. If , for example, , for some positive constant and , then, we have , where , , and .
Theorem 8. Let be the solution of (7) and suppose Assumptions 1 and 6 hold; then
Proof. Let . Then
Since , one can see that
where
Note that by Assumption 1 and Lemma 3,
by Proposition 2,
and by Assumption 6,
Hence, by (34)–(36) and (32), we have
This completes the proof of the theorem.
2.1. Error Bounds under Source Conditions
Theorem 9. Let be as in (6). If assumptions in Theorems 5 and 8 hold, then where is as in Theorem 5. Further if , then where .
2.2. A Priori Choice of the Parameter
The error estimate in Theorem 9 attains minimum for the choice which satisfies . Clearly , where
Thus, we have the following theorem.
Theorem 10. Suppose that all assumptions of Theorems 5 and 8 are fulfilled. For , let , and let be as in Theorem 9. Then
2.3. Adaptive Scheme and Stopping Rule
In this subsection, we consider the adaptive scheme suggested by Pereverzev and Schock in [17], modified suitably for choosing the parameter which does not involve even the regularization method in an explicit manner.
Let and , where , , and . Let , and let be as defined in (6) with and . Then, from Theorem 9, we have
Further, let where is as in Theorem 9. The proof of the following theorem is analogous to the proof of Theorem 4.4 in [31], so we omit the details.
Theorem 11. Let be as in (6) with and , and assumptions in Theorem 9 hold. Let and be as defined in (43) and (44), respectively. Then and
3. Implementation of the Method
Finally, the balancing algorithm associated with the choice of the parameter specified in Theorem 11 involves the following steps:(i)choose such that and ;(ii)choose big enough but not too large and , , where ;(iii)choose .
Algorithm 1. (1)set ;(2)choose ;(3)solve by using the iteration (6);(4)if , then take ;(5)else set and return to Step .
4. Numerical Example
Example 1. In this example, we consider a nonlinear integral operator, , defined by
with
The Fréchet derivative of is given by
In our computation, we take and , where is a random vector with and is a constant [26]. Then the exact solution
We take as
as our initial guess, so that the function satisfies the source condition (see [20, Proposition 5.3]). Thus, we expect to have an accuracy of order at least .
As in [26], we use the matrix
as a discrete approximation of the firstorder differential operator (50).
We choose , , , and . The results of the computation are presented in Tables 1 and 2. The plots of the exact and the approximate solution obtained with are given in Figures 1 and 2.
The last column of Tables 1 and 2 shows that the error is of .


5. Conclusion
In this paper, we present an iterative regularization method for obtaining an approximate solution of a nonlinear illposed operator equation in the Hilbert scale setting. Here is a nonlinear operator and we assume that the available data is in place of exact data . The convergence analysis was based on the centertype Lipschitz condition. We considered a Hilbert scale, , generated by , where is a linear, unbounded, selfadjoint, densely defined, and strictly positive operator on . For choosing the regularization parameter , the adaptive scheme considered by Pereverzev and Schock in [17] was used. Finally, a numerical example is presented in support of our method which is found to be efficient.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgment
Ms. Monnanda Erappa Shobha thanks NBHM, DAE, Government of India, for the financial support.
References
 I. K. Argyros and S. Hilout, “A convergence analysis for directional twostep Newton methods,” Numerical Algorithms, vol. 55, no. 4, pp. 503–528, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 I. K. Argyros and S. Hilout, “Weaker conditions for the convergence of Newton's method,” Journal of Complexity, vol. 28, no. 3, pp. 364–387, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 I. K. Argyros, Y. J. Cho, and S. Hilout, Numerical Methods for Equations and its Applications, CRC Press, Taylor and Francis, New York, NY, USA, 2012. View at: MathSciNet
 A. B. Bakushinsky and M. Y. Kokurin, Iterative Methods for Approximate Solution of Inverse Problems, Springer, Dordrecht, The Netherlands, 2004. View at: MathSciNet
 H. W. Engl, K. Kunisch, and A. Neubauer, Regularization of Inverse Problems, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996.
 H. W. Engl, “Regularization methods for the stable solution of inverse problems,” Surveys on Mathematics for Industry, vol. 3, no. 2, pp. 71–143, 1993. View at: Google Scholar  Zentralblatt MATH  MathSciNet
 H. W. Engl, K. Kunisch, and A. Neubauer, “Convergence rates for Tikhonov regularisation of nonlinear illposed problems,” Inverse Problems, vol. 5, no. 4, pp. 523–540, 1989. View at: Publisher Site  Google Scholar  MathSciNet
 S. George, “Newtontype iteration for Tikhonov regularization of nonlinear illposed problems,” Journal of Mathematics, vol. 2013, Article ID 439316, 9 pages, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 M. Hanke, “A regularizing LevenbergMarquardt scheme, with applications to inverse groundwater filtration problems,” Inverse Problems, vol. 13, no. 1, pp. 79–95, 1997. View at: Publisher Site  Google Scholar  MathSciNet
 B. Kaltenbacher, “A note on logarithmic convergence rates for nonlinear Tikhonov regularization,” Journal of Inverse and IllPosed Problems, vol. 16, no. 1, pp. 79–88, 2008. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 B. Kaltenbacher, A. Neubauer, and O. Scherzer, Iterative Regularization Methods for Nonlinear IllPosed Porblems, de Gruyter, Berlin, Germany, 2008.
 C. T. Kelley, Iterative Methods for Linear and Nonlinear Equations, SIAM, Philadelphia, Pa, USA, 1995.
 Q. Jin, “On a regularized LevenbergMarquardt method for solving nonlinear inverse problems,” Numerische Mathematik, vol. 115, no. 2, pp. 229–259, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 U. Tautenhahn, “On the method of Lavrentiev regularization for nonlinear illposed problems,” Inverse Problems, vol. 18, no. 1, pp. 191–207, 2002. View at: Publisher Site  Google Scholar  MathSciNet
 V. Vasin, “Irregular nonlinear operator equations: Tikhonov's regularization and iterative approximation,” Journal of Inverse and IllPosed Problems, vol. 21, no. 1, pp. 109–123, 2013. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 V. Vasin and S. George, “Expanding the applicability of Tikhonov's regularization and iterative approximation for illposed problems,” Journal of Inverse and IllPosed Problems, 2013. View at: Publisher Site  Google Scholar
 S. Pereverzev and E. Schock, “On the adaptive selection of the parameter in regularization of illposed problems,” SIAM Journal on Numerical Analysis, vol. 43, no. 5, pp. 2060–2076, 2005. View at: Publisher Site  Google Scholar  MathSciNet
 H. Egger and A. Neubauer, “Preconditioning Landweber iteration in Hilbert scales,” Numerische Mathematik, vol. 101, no. 4, pp. 643–662, 2005. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Q. Jin, “Error estimates of some Newtontype methods for solving nonlinear inverse problems in Hilbert scales,” Inverse Problems, vol. 16, no. 1, pp. 187–197, 2000. View at: Publisher Site  Google Scholar  MathSciNet
 S. Lu, S. V. Pereverzev, Y. Shao, and U. Tautenhahn, “On the generalized discrepancy principle for Tikhonov regularization in Hilbert scales,” Journal of Integral Equations and Applications, vol. 22, no. 3, pp. 483–517, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 P. Mahale and M. T. Nair, “A simplified generalized GaussNewton method for nonlinear illposed problems,” Mathematics of Computation, vol. 78, no. 265, pp. 171–184, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 P. Mathe and U. Tautenhahn, “Error bounds for regularization methods in Hilbert scales by using operator monotonicity,” Far East Journal of Mathematical Sciences, vol. 24, no. 1, pp. 1–21, 2007. View at: Google Scholar  MathSciNet
 F. Natterer, “Error bounds for Tikhonov regularization in Hilbert scales,” Applicable Analysis, vol. 18, no. 12, pp. 29–37, 1984. View at: Publisher Site  Google Scholar  MathSciNet
 A. Neubauer, “On Landweber iteration for nonlinear illposed problems in Hilbert scales,” Numerische Mathematik, vol. 85, no. 2, pp. 309–328, 2000. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Q. Jin and U. Tautenhahn, “Inexact Newton regularization methods in Hilbert scales,” Numerische Mathematik, vol. 117, no. 3, pp. 555–579, 2011. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Q. Jin and U. Tautenhahn, “Implicit iteration methods in Hilbert scales under general smoothness conditions,” Inverse Problems, vol. 27, no. 4, Article ID 045012, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 S. George and M. T. Nair, “Error bounds and parameter choice strategies for simplified regularization in Hilbert scales,” Integral Equations and Operator Theory, vol. 29, no. 2, pp. 231–242, 1997. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 U. Tautenhahn, “On a general regularization scheme for nonlinear illposed problems: II. Regularization in Hilbert scales,” Inverse Problems, vol. 14, no. 6, pp. 1607–1616, 1998. View at: Publisher Site  Google Scholar  MathSciNet
 U. Tautenhahn, “Error estimates for regularization methods in Hilbert scales,” SIAM Journal on Numerical Analysis, vol. 33, no. 6, pp. 2120–2130, 1996. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Q. Jin, “On a class of frozen regularized GaussNewton methods for nonlinear inverse problems,” Mathematics of Computation, vol. 79, no. 272, pp. 2191–2211, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. George, “On convergence of regularized modified Newton's method for nonlinear illposed problems,” Journal of Inverse and IllPosed Problems, vol. 18, no. 2, pp. 133–146, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
Copyright
Copyright © 2014 Monnanda Erappa Shobha and Santhosh George. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.