- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Abstract and Applied Analysis
Volume 2012 (2012), Article ID 892980, 12 pages
A Proximal Point Method Involving Two Resolvent Operators
Department of Applied Sciences, Botswana International University of Science and Technology, Private Bag 41, Gaborone, Botswana
Received 29 May 2012; Accepted 1 August 2012
Academic Editor: Svatoslav Staněk
Copyright © 2012 Oganeditse A. Boikanyo. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
We construct a sequence of proximal iterates that converges strongly (under minimal assumptions) to a common zero of two maximal monotone operators in a Hilbert space. The algorithm introduced in this paper puts together several proximal point algorithms under one frame work. Therefore, the results presented here generalize and improve many results related to the proximal point algorithm which were announced recently in the literature.
Let and be nonempty, closed, and convex subsets of a real Hilbert space with nonempty intersection and consider the following problem: In his 1933 paper, von Neumann showed that if and are subspaces of , then the method of alternating projections, defined by converges strongly to a point in which is closest to the starting point . The proof of this classical result can be found for example in [1, 2]. Ever since von Neumann announced his result, many researchers have dedicated their time to study the convex feasibility problem (1.1). In his paper, Bregman  showed that if and are two arbitrary nonempty, closed, and convex subsets in with nonempty intersection, then the sequence generated from the method of alternating projections converges weakly to a point in . The work of Hundal  revealed that the method of alternating projections fails in general to converge strongly, see also .
Recall that the projection operator coincides with the resolvent of a normal cone. Thus, the method of alternating projections can be extended in a natural way as follows: Given , define a sequence iteratively by for , and two maximal monotone operators and , where and are sequences of computational errors. Here is the resolvent of . In this case, problem (1.1) can be restated as For and , Bauschke et al.  proved that sequences generated from the method of alternating resolvents (1.3) converges weakly to some point that solves problem (1.4). In fact, they showed that such a sequences converges weakly to a point in provided that the fixed point set of the composition mapping is nonempty. Note that strong convergence of this method fails in general, (the same counter example of Hundal  applies). For convergence analysis of algorithm (1.3) in the case when any of the sequences of real numbers and is not a constant, and when the error sequences and are not zero for all , we refer the reader to .
There are other papers in the literature that address strong convergence of a given iterative process to solutions of (1.4). For example, several authors have discussed strong convergence of an iterative process of the Halpern type to common solutions of a finite family of maximal monotone operators in Hilbert spaces (or even -accretive operators in Banach spaces). Among the most recent works in this direction is due to Hu and Liu . They showed that under appropriate conditions, an iterative process of Halpern type defined by where with for all , are given, with for , and , converges strongly to a point in nearest to .
Suppose that we want to find solutions to problem (1.4) iteratively. Then we observe that when using the iterative process (1.5), one has to calculate two resolvents of maximal monotone operators in order to find the next iterate. On the other hand, for algorithm (1.3), one needs to calculate only one resolvent operator at each step. This clearly shows that theoretically, algorithm (1.5) requires more computational time compared to algorithm (1.3). The only disadvantage with algorithm (1.3) is that it does not always converge strongly and the limit to which it converges to is not characterized. This is not the case with algorithm (1.5). Since weak convergence is not good for an effective algorithm, our purpose in this paper is to modify algorithm (1.3) in such a way that strong convergence is guaranteed. More precisely, for any two maximal monotone operators and , we define an iterative process in the following way: For given, a sequence is generated using the rule where with and . We will also show that algorithm (1.6), (1.7) contains several algorithms such as the prox-Tikhonov method, the Halpern-type proximal point algorithm, and the regularized proximal method as special cases. That is, with our algorithm, we are able to put several algorithms under one frame work. Therefore, our main results improve, generalize, and unify many related results announced recently in the literature.
2. Preliminary Results
In the sequel, will be a real Hilbert space with inner product and induced norm . We recall that a map is called nonexpansive if for every we have . We say that a map is firmly nonexpansive if for every , we have It is clear that firmly nonexpansive mappings are also nonexpansive. The converse need not be true. The excellent book by Goebel and Reich  is recommended to the reader who is interested in studying properties of firmly nonexpansive mappings. An operator is said to be monotone if where is the graph of . In other words, an operator is monotone if its graph is a monotone subset of the product space . An operator is called maximal monotone if in addition to being monotone, its graph is not properly contained in the graph of any other monotone operator. Note that if is maximal monotone, then so is its inverse . For a maximal monotone operator , the resolvent of , defined by , is well defined on the whole space , is single-valued, and is firmly nonexpansive for every . It is known that the Yosida approximation of , an operator defined by (where is the identity operator) is maximal monotone for every . For the properties of maximal monotone operators discussed above, we refer the reader to .
Notations. given a sequence , we will use to mean that converges strongly to whereas will mean that converges weakly to . The weak -limit set of a sequence will be denoted by . That is,
The following lemmas will be useful in proving our main results. The first lemma is a basic property of norms in Hilbert spaces.
Lemma 2.1. For all , one has
The next lemma is well known, it can be found for example in [10, page 20].
Lemma 2.2. Any maximal monotone operator satisfies the demiclosedness principle. In other words, given any two sequences and satisfying and with , then .
Lemma 2.3 (Xu ). For any and , where is a maximal monotone operator.
We end this section with the following key lemmas.
Lemma 2.4 (Boikanyo and Moroşanu ). Let be a sequence of nonnegative real numbers satisfying where , , , , and satisfy the conditions: (i) , with , (ii) , (iii) , and (iv) for all with . Then .
Remark 2.5. Note that if , then if and only if .
Lemma 2.6 (Maingé ). Let be a sequence of real numbers that does not decrease at infinity, in the sense that there exists a subsequence of such that for all . Define an integer sequence as Then as and for all ,
3. Main Results
We first begin by giving a strong convergence result associated with the exact iterative process where with , and are given. The proof of the following theorem makes use of some ideas of the papers [12–15].
Theorem 3.1. Let and be maximal monotone operators with . For arbitrary but fixed vectors , let be the sequence generated by (3.1), (3.2), where with , and . Assume that (i) , for some and , (ii) either or , and (iii) and for some . Then converges strongly to the point of nearest to .
Proof. Let . Then from (3.2) and the fact that the resolvent operator of a maximal monotone operator is nonexpansive, we have
Again using the fact that the resolvent operator is nonexpansive, we have from (3.1)
where the last inequality follows from (3.3). Using a simple induction argument, we get
This shows that the subsequence of is bounded. In view of (3.3), the subsequence is also bounded. Hence the sequence must be bounded.
Now from the firmly nonexpansive property of , we have for any which in turn gives Again by using the firmly nonexpansive property of the resolvent , we see that Now from (3.1) and Lemma 2.1, we have where is such that . On the other hand, we observe that (3.2) is equivalent to Multiplying this inclusion scalarly by and using the monotonicity of , we obtain which implies that Using this inequality in (3.9), we get If we denote , then we have for some positive constant We now show that converges to zero strongly. For this purpose, we consider two possible cases on the sequence .
Case 1. is eventually decreasing (i.e., there exists such that is decreasing for all ). In this case, is convergent. Letting in (3.14), we get Now using the second part of (3.15) and the fact that as , we get as . Also, we have the following from Lemma 2.3 and the first part of (3.15) as . Since , where denotes the Yosida approximation of , is demiclosed, it follows that . On the other hand, from the nonexpansive property of the resolvent operator of , we get where the first inequality follows from Lemma 2.3. Since is demiclosed, passing to the limit in the above inequality yields , showing that . Therefore, there is a subsequence of converging weakly to some such that where the above inequality follows from the characterization of the projection operator. Note that by virtue of (3.16), we have as well. Now, we derive from (3.13) Using Lemma 2.4 we get as . Passing to the limit in (3.12), we also get as . Therefore, we derive as . This proves the result for the case when is eventually decreasing.
Case 2. is not eventually decreasing, that is, there is a subsequence of such that for all . We then define an integer sequence as in Lemma 2.6 so that for all . Then from (3.14), it follows that We also derive from (3.1) as . In a similar way as in Case 1, we derive . Consequently, Note that from (3.21) we have, for some positive constant , Therefore, for all , we have Since for all , we have Letting in the above inequality, we see that . Hence from (2.8) it follows that as . That is, as . Furthermore, for some positive constant , we have from (3.12) which implies that as . Hence, we have as . This completes the proof of the theorem.
Theorem 3.2. Let and be maximal monotone operators with . For arbitrary but fixed vectors , let be the sequence generated by (1.6), (1.7), where with and . Assume that , for some and , either or , and for some . Then converges strongly to the point of nearest to , provided that any of the following conditions is satisfied:(a) and ; (b) and ; (c) and ; (d) and ; (e) and ; (f) and ; (g) and ; (h) and ; (i) and ; (j) and ; (k) and ; (l) and ; (m) and ; (n) and .
Proof. Taking note of Theorem 3.1, it suffices to show that as . Since the resolvent of is nonexpansive, we derive from (1.7) and (3.2) the following: Similarly, from (1.6) and (3.1), we have Substituting (3.29) into (3.30) yields Therefore, if the error sequence satisfy any of the conditions (a)–(i), then it readily follows from Lemma 2.4 that as . Passing to the limit in (3.29), we derive as well. If the error sequence satisfy any of the conditions (j)–(n), then from (3.29) and (3.30), we have Then Lemma 2.4 guarantees that as . Passing to the limit in (3.30), we derive as well. This completes the proof of the theorem.
Note that when where is the subdifferential of the indicator function of and for all , then algorithm (1.6), (1.7) is reduced to the contraction proximal point method which was introduced by Yao and Noor in 2008 . Such a method is given by where we have used the notation . Here is a sequence in and with . For this method, we have the following strong convergence result.
Corollary 3.3. Let be a maximal monotone operator with . For arbitrary but fixed vectors , let be the sequence generated by (3.33) where with and . Assume that with , for some and for some . If either or , then converges strongly to the point of nearest to .
Corollary 3.3 generalizes and unifies many results announced recently in the literature such as [7, Theorem 4], [16, Theorem 3.3], [17, Theorem 2], and [18, Theorem 3.1]. We also recover [15, Theorem 1].
In the case when where is the subdifferential of the indicator function of and for all , then algorithm (1.6), (1.7) reduces to the regularization method where we have used the notation . In this case, we have the following strong convergence result which improves results given in the papers [11, 19–21].
Corollary 3.5. Let be a maximal monotone operator with . For arbitrary but fixed vectors , let be the sequence generated by (3.34) where and . Assume that with and for some . If either or , then converges strongly to the point of nearest to .
It is worth mentioning that the regularization method is a generalization of the prox-Tikhonov method introduced by Lehdili and Moudafi , see . We also mention that for and , the regularization method (3.34) is equivalent to the inexact Halpern type proximal point algorithm, see . Therefore Corollary 3.5 also improves many results given in the papers [15, 19, 22, 24–26] related to the inexact Halpern type proximal point algorithm.
- H. H. Bauschke, E. Matoušková, and S. Reich, “Projection and proximal point methods: convergence results and counterexamples,” Nonlinear Analysis, vol. 56, no. 5, pp. 715–738, 2004.
- E. Kopecká and S. Reich, “A note on the von Neumann alternating projections algorithm,” Journal of Nonlinear and Convex Analysis, vol. 5, no. 3, pp. 379–386, 2004.
- L. M. Bregman, “The method of successive projection for nding a common point of convex sets,” Soviet Mathematics. Doklady, vol. 6, pp. 688–692, 1965.
- H. S. Hundal, “An alternating projection that does not converge in norm,” Nonlinear Analysis, vol. 57, no. 1, pp. 35–61, 2004.
- E. Matoušková and S. Reich, “The Hundal example revisited,” Journal of Nonlinear and Convex Analysis, vol. 4, no. 3, pp. 411–427, 2003.
- H. H. Bauschke, P. L. Combettes, and S. Reich, “The asymptotic behavior of the composition of two resolvents,” Nonlinear Analysis, vol. 60, no. 2, pp. 283–301, 2005.
- O. A. Boikanyo and G. Moroşanu, “Four parameter proximal point algorithms,” Nonlinear Analysis, vol. 74, no. 2, pp. 544–555, 2011.
- L. Hu and L. Liu, “A new iterative algorithm for common solutions of a finite family of accretive operators,” Nonlinear Analysis, vol. 70, no. 6, pp. 2344–2351, 2009.
- K. Goebel and S. Reich, Uniform Convexity, Hyperbolic Geometry, and Nonexpansive Mappings, vol. 83 of Monographs and Textbooks in Pure and Applied Mathematics, Marcel Dekker, New Yorkm, NY, USA, 1984.
- G. Moroşanu, Nonlinear Evolution Equations and Applications, vol. 26 of Mathematics and its Applications, D. Reidel, Dordrecht, The Netherlands, 1988.
- H.-K. Xu, “A regularization method for the proximal point algorithm,” Journal of Global Optimization, vol. 36, no. 1, pp. 115–125, 2006.
- O. A. Boikanyo and G. Moroşanu, “Strong convergence of the method of alternating resolvents,” Journal of Nonlinear and Convex Analysis. In press.
- P.-E. Maingé, “Strong convergence of projected subgradient methods for nonsmooth and nonstrictly convex minimization,” Set-Valued Analysis, vol. 16, no. 7-8, pp. 899–912, 2008.
- O. A. Boikanyo and G. Moros, “A generalization of the regularization proximal point method,” Journal of Nonlinear Analysis and Application, vol. 2012, Article ID jnaa-00129, 6 pages, 2012.
- F. Wang and H. Cui, “On the contraction-proximal point algorithms with multi-parameters,” Journal of Global Optimization. In press.
- Y. Yao and M. A. Noor, “On convergence criteria of generalized proximal point algorithms,” Journal of Computational and Applied Mathematics, vol. 217, no. 1, pp. 46–55, 2008.
- O. A. Boikanyo and G. Moroşanu, “Multi parameter proximal point algorithms,” Journal of Nonlinear and Convex Analysis, vol. 13, no. 2, pp. 221–231, 2012.
- Y. Yao and N. Shahzad, “Strong convergence of a proximal point algorithm with general errors,” Optimization Letters, vol. 6, no. 4, pp. 621–628, 2012.
- O. A. Boikanyo and G. Moroşanu, “Inexact Halpern-type proximal point algorithm,” Journal of Global Optimization, vol. 51, no. 1, pp. 11–26, 2011.
- Y. Song and C. Yang, “A regularization method for the proximal point algorithm,” Journal of Global Optimization, vol. 43, no. 1, pp. 171–174, 2009.
- F. Wang, “A note on the regularized proximal point algorithm,” Journal of Global Optimization, vol. 50, no. 3, pp. 531–535, 2011.
- N. Lehdili and A. Moudafi, “Combining the proximal algorithm and Tikhonov regularization,” Optimization, vol. 37, no. 3, pp. 239–252, 1996.
- O. A. Boikanyo and G. Moroşanu, “A proximal point algorithm converging strongly for general errors,” Optimization Letters, vol. 4, no. 4, pp. 635–641, 2010.
- S. Kamimura and W. Takahashi, “Approximating solutions of maximal monotone operators in Hilbert spaces,” Journal of Approximation Theory, vol. 106, no. 2, pp. 226–240, 2000.
- G. Marino and H.-K. Xu, “Convergence of generalized proximal point algorithms,” Communications on Pure and Applied Analysis, vol. 3, no. 4, pp. 791–808, 2004.
- H.-K. Xu, “Iterative algorithms for nonlinear operators,” Journal of the London Mathematical Society, vol. 66, no. 1, pp. 240–256, 2002.