Abstract and Applied Analysis

Volume 2013 (2013), Article ID 590519, 12 pages

http://dx.doi.org/10.1155/2013/590519

## Bregman Distance and Strong Convergence of Proximal-Type Algorithms

^{1}Department of Applied Mathematics, National Sun Yat-Sen University, Kaohsiung 80424, Taiwan^{2}Department of Mathematics, Banaras Hindu University, Varanasi 221005, India

Received 31 October 2012; Revised 7 March 2013; Accepted 7 March 2013

Academic Editor: Dumitru Motreanu

Copyright © 2013 Li-Wei Kuo and D. R. Sahu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

The purpose of this paper is to discuss some fundamental properties of Bregman distance, generalized projection operators, firmly nonexpansive mappings, and resolvent operators of set-valued monotone operators corresponding to a functional . We further study some proximal point algorithms for finding zeros of monotone operators and solving generalized mixed equilibrium problems in Banach spaces. Our results improve and extend some recent results concerning generalized projection operators corresponding to Bregman distance.

#### 1. Introduction

In this paper, denotes a real Banach space with norm , and denotes the Banach dual of endowed with the dual norm . We write for the value of a functional in at in . As usual, and stand for the norm and weak convergence of a net to in , respectively.

A continuous strictly increasing function is said to be a *gauge* if
The mapping defined by
is called the *duality mapping* with gauge . In the special case where , the duality mapping is the classical *normalized duality mapping*. In the case , , the duality mapping is called *the generalized duality mapping* and it is given by

For a gauge , the function defined by is a continuous convex strictly increasing differentiable function on with and . Therefore, has a continuous inverse function .

We recall the Bregman Distance and function studied in [1]. Let be a real smooth Banach space. The *Bregman distance * between and in is defined by
One can see from Lemma 3 that . In the case , , the distance is called the *-Lyapunov functional* studied in [2] and it is given by
Note that
is the *Lyapunov functional*. It is obvious that
See Brègman [3], Butnariu and Iusem [4], and Censor and Lent [5].

Let be a nonempty closed convex subset of a smooth Banach space . The *generalized projection * is defined by
The metric projection operator defined by
has been employed successfully in optimization, optimal control, approximation theory, and fixed point theory in the framework of Hilbert spaces. In such a framework, metric projections are nonexpansive (i.e., for all in ). However, this is no longer true in the framework of Banach spaces. Instead, the generalized projections are needed. In [6], Alber generalized the metric projection operator to generalized projection operators from Hilbert spaces to uniformly smooth Banach spaces. Many applications of the generalized projections in Banach spaces are discussed in the recent literature (see [7–12]).

Section 2 contains preliminaries. In Section 3, we study the fundamental properties of Bregman distance and -generalized projection operators, where is a proper, convex, lower semicontinuous function. In Section 4, we discuss -firmly nonexpansive mappings and -resolvent operators. In Section 5, we establish strong convergence of the proximal-projection methods for finding fixed points of -firmly nonexpansive mappings, zeros of (not necessarily maximal) monotone operators, and solutions of generalized mixed equilibrium problems in Banach spaces using -generalized projection operators . Here, we do not assume the maximality of monotone operators and the uniform smoothness of Banach spaces.

#### 2. Preliminaries

Let be a set-valued operator. The set is called the *effective domain* of . The *range* of is defined by . The operator is said to be *monotone* if for any in , we have
A monotone operator is said to be *maximal* if the graph of is not a proper subset of the graph of another monotone operator. We know that if is a maximal monotone operator, then the zero set is closed and convex.

In the rest of this paper, by we always mean a gauge and by the corresponding function defined in (4). We list some properties of the duality mapping below (for more details see [13, 14]).

Proposition 1. *Let be a real Banach space.*(i)* is norm-to-weak*** upper semicontinuous;*(ii)*for each ** in **, the set ** is convex and weakly closed in **;*(iii)* and ** for all nonzero ** in **;*(iv)*there holds*(v)* is maximal monotone;*(vi)*if ** is strictly convex, then ** is strictly monotone; that is,*

(vii)*if ** is strictly convex and reflexive, then ** is single-valued monotone and demicontinuous.*

The following result is well known. We include a proof for completeness.

Lemma 2. *If a Banach space has a uniformly Gâteaux differentiable norm, then is uniformly norm-to-weak* continuous on nonempty bounded subsets of to .*

*Proof. *Suppose not, and there exist norm one vectors in and a constant such that , and , for all . For a fixed , define
Observe that
Hence,
Choose . By the uniform Gâteaux differentiability of the norm, if is large enough, both and are less than , and so . We arrive at a contradiction.

Together with Proposition 1, the conclusion in Lemma 2 also holds for .

Let be a Banach space and a function. The function is *proper* if . An element in is said to be a *subgradient* of a proper convex function at a point in if
The set (possibly empty)
of subgradients of at in , is called the *subdifferential* of at .

Lemma 3. *Let be a smooth Banach space and the duality mapping with gauge . Then for ; that is,
*

The proof of the following result is straightforward.

Lemma 4. *Let be a real Banach space and a gauge function.*(a)* is a convex and continuous function on .*(b)* is strictly convex if and only if is strictly convex.*

Lemma 5. *Let be a real Banach space and a gauge function. Then the following assertions are equivalent:*(a)* is uniformly convex;*(b)* is uniformly convex on the closed ball , where is arbitrarily given. That is, there exists a strictly increasing convex function with such that
* *for all in and in .*

*Proof. *First we note that the general case can be reduced to the case . Suppose it holds
We will show that (20) holds for any . Set and for . Then is still a gauge function, and let be the function corresponding to as defined in (4), . Let and and . Then . Applying (21) to , we get
which is exactly (20). A similar argument also shows that the case can be deduced from any other case .

Below, we assume and .

. Given in such that and . Setting in (20), we have
It turns out that
This verifies that is uniformly convex.

. Assume that is uniformly convex, which implies that is strictly convex by Lemma 4(b). Define a function on by setting , and for ,
where is the closed unit ball of .*Claim*. Consider for .

Suppose on the contrary that for some . Then we can find sequences , in such that for all , and
Without loss of generality, we may assume that
It then follows from (26) that
The strict convexity of together with (28) implies that if . Since, on the other hand, by definition, . We therefore must have , which together with (28) implies that . If we set , , then for all ; moreover, from (27), we get
This contradicts the uniform convexity of , and verifies that for all .

It turns out from (25) that
for all in , with .

By the dyadic rational argument used in the proof of [15, Theorem 2.2], we can extend the inequality (30) to the case of a general convex combination of and , namely,
for in and in . Note that is increasing and continuous. By [16], the function can also be assumed to be convex (the convexity of is not needed in our argument throughout the rest of this paper however).

Lemma 6. *Let be a real uniformly convex Banach space. Then there exists a strictly increasing convex function with such that
*

*Proof. *Since is the subdifferential of the functional , we have for in , in that
Let be the function that satisfies (20) with and assume that . Replacing with , , we obtain
Taking limit as , we get

Lemma 7 (see [17, Theorem 3.11, page 952]). *Let be a reflexive Banach space and the duality map with gauge . Suppose that is maximal monotone. Then the operator is surjective.*

#### 3. Bregman Distance and Function

One can easily see that Noticing that for in , the scalar function is coercive (see [18, Lemma 7.3(v)]).

Proposition 8. *Let be a strictly convex smooth Banach space. Let . Then
*

*Proof. *See [18, Lemma 7.3(vi)]

Proposition 9. *Let be a smooth and uniformly convex Banach space. Then there exists a strictly increasing convex function with such that
*

*Proof. *Let . By Lemma 6 we have

As in Butnariu et al. [19], we can prove the following proposition.

Proposition 10. *Let be a smooth and uniformly convex Banach space. Let and be two sequences in such that . If is bounded, then .*

*Proof. *Assume is bounded. From definition (5) we have
It follows that
Since is bounded, and as it follows from (41) that is bounded, too.

We may now assume that and both lie in the closed unit ball (otherwise consider the rescaled sequences and for a sufficiently small ). By Proposition 9, there exists a strictly increasing convex function with such that
Since and is strictly increasing, we immediately conclude that .

Proposition 11 (see [20, Lemma 3.1]). *Let be a smooth Banach space. Let and be a sequence in such that is bounded. Then is bounded.*

The statement in the following proposition is evident from the definition of (cf. [18, Lemma 7.3(ii)]).

Proposition 12. *Let be a smooth Banach space. Then, for any fixed in , the scalar function is continuous, weakly lower semicontinuous, and convex on .*

Let be a proper, convex, lower semicontinuous function. Define

Some of the following basic properties of the Bregman distance and function are known in the literature (see [18–21]).

The following proposition can be deduced from Butnariu and Kassay [21, Lemma 2.1].

Proposition 13. *Let be a nonempty closed convex subset of a reflexive, strictly convex, and smooth Banach space . Let and let be a proper, convex, lower semicontinuous function with . Then there exists a unique element in such that
*

Bregman projections are thoroughly studied and used for iteration schemes such as sequential subspace methods or split feasibility problems successfully (see, [22–24]). The notion of -proximal mappings was introduced and studied in [1]. Recently, the notion of Moreau proximal mapping [25] is generalized by Butnariu and Kassay [21] as the proximal mapping relative to associated with a proper, convex, lower semicontinuous function . Using the idea of [1, 26], Proposition 13 allows us to extend generalized projections as follows.

*Definition 14. *In the setting of Proposition 13, we define the -generalized projection from onto by

In case and , we notice that coincides with . In case that is a Hilbert space and , denote by .

Applying the tools used in [1, 26, 27], we can establish the following results.

Proposition 15. *Let be a nonempty closed convex subset of a reflexive, strictly convex, and smooth Banach space and let be a proper, convex, lower semicontinuous function with .*(i)*Let ** and **. Then the following assertions are equivalent:*(a),(b), .(ii)*Given ** in **, one has*

Proposition 16. *Let be a nonempty closed convex subset of a smooth and uniformly convex Banach space and a proper, convex, lower semicontinuous function with . Let and let be a bounded sequence in such that . If for all in , then .*

*Proof. *Set . Then, by assumption, we have for all in . By the three-point identity (36), we have
Since is a bounded sequence in , there exists a subsequence of such that converges weakly to some element in . Note that
that is, . Using Proposition 15, we have
which implies that . It follows from Proposition 10 that . This implies that converges strongly to .

#### 4. -Firmly Nonexpansive and -Resolvent Operators

Following [1], we study properties of -firmly nonexpansive mappings in Banach spaces.

*Definition 17. *Let be a smooth Banach space, a duality mapping with gauge function , and a nonempty subset of . An operator is called -firmly nonexpansive if

In the case of , inequality (50) reduces to
If satisfies condition (51), we call of *firmly nonexpansive type*. The class of firmly nonexpansive type operators is studied by Kohsaka and Takahashi [28]. When is a Hilbert space, inequality (50) reduces to the following inequality about firmly nonexpansive operators in the classical sense (see Goebel and Kirk [29]):

We now give useful characterizations of -firmly nonexpansive mappings which can be deduced from the Bregman distance (5).

Proposition 18. *Let be a smooth Banach space and a nonempty closed convex subset of . Let be a -firmly nonexpansive mapping. Then
*

The geometry of the fixed point set of -firmly nonexpansive mappings is established in Reich and Sabach [30, Lemma 15.5] as follows.

Proposition 19. *Let be a strictly convex smooth Banach space and a nonempty closed convex subset of . Let be a -firmly nonexpansive mapping. Then the set of fixed points of is closed and convex.*

Let be a nonempty closed convex subset of a smooth Banach space and let be a mapping. A point in is an *asymptotic fixed point* of if contains a sequence such that and ; see [31]. We denote the set of asymptotic fixed points of by . A mapping is *relatively **-nonexpansive* if the following conditions are satisfied:(i) is nonempty; (ii) for all in and in ;(iii).

The class of relatively -nonexpansive mappings is larger than the class of relatively nonexpansive mappings (see [32]).

A mapping is -firmly quasinonexpansive if and for all in and in . From the definition of the Bregman distance (5) and (54), the following proposition follows immediately.

Proposition 20. *Let be a smooth Banach space, a nonempty subset of , and a -firmly quasinonexpansive mapping. Then
**
for all in and in .*

The following supplements Reich and Sabach [30, Lemma 15.6].

Proposition 21. *Let be a strictly convex Banach space with a uniformly Gâteaux differentiable norm. Let be a nonempty closed convex subset of and let be a -firmly nonexpansive mapping. Then .*

*Proof. *It is easy to see that . It remains to prove that . For this, suppose that . Then, there exists a sequence in such that and . We need to prove that . Using (53), we get
It is not hard to find that (56) is reduced to the relation
We note that . Indeed, for any norm one linear functional of , we have
Both terms in the right-hand side approach zero. Consequently,
*Claim*. Consider .

Since and , there is a constant such that all . It follows from the uniform norm to weak* continuity of on bounded subsets (Lemma 2); we have
Observe that
Moreover, . By the uniform continuity of on , we have
The claim is thus verified.

We obtain from (57) and the claim that
This is equivalent to
The strict monotonicity of the duality mapping implies that equality must hold. Namely, or .

The resolvent of an operator relative to a Gâteaux differentiable function is introduced and studied in [1]. We define -resolvent operators following [1, 18].

*Definition 22. *Let be a nonempty closed convex subset of a smooth Banach space and let be the duality mapping with gauge . Suppose that is an operator satisfying the range condition
For each , the -resolvent associated with operator is the operator defined by

For in and in , we have
If is maximal monotone, then, by Lemma 7, we see that condition (65) holds for .

*Remark 23. *For smooth and with , we have and . For , and this kind of resolvent operators is studied in the literature (see [28, 33]).

Let be a nonempty closed convex subset of a reflexive, strictly convex, and smooth Banach space . Let be a monotone operator satisfying the condition , where . Using the smoothness and strict convexity of , we obtain that is single-valued. The conditions ensure that is the single-valued -resolvent operator form into . In other words,

Following [18, 28], we have the following proposition.

Proposition 24. *Let be a nonempty closed convex subset of a reflexive, strictly convex and smooth Banach space and let be the duality mapping with gauge . Let be a monotone operator satisfying the condition , where is a positive real number. Let be a resolvent of , where*(a)* is **-firmly nonexpansive mapping from ** into **,*(b).

#### 5. Convergence Theorems

Let be a nonempty subset of a Banach space and a family of mappings from into with . Let be a family of mappings from into such that . We say the family has *property **with respect to the family * if the following assertion holds:

If and the above condition holds, then we say has *property *.

*Remark 25. *If is a singleton, that is, , or for all , then always has property .

We now give some examples.

*Example 26. *Let be a nonempty closed convex subset of a Banach space and a nonexpansive mapping from into with . Assume in with for all . Define by for all in . Then has property () with respect to the family .

*Proof. *Let be a bounded net in such that as . Note that
and for all . Therefore, as .

The following example shows that the family of resolvent operators of a maximal monotone operator enjoys property .

*Example 27. *Let be a nonempty closed convex subset of a real Hilbert space and let be a monotone operator satisfying the following condition:
Let be a bounded net in such that as . Then as for each .

*Proof. *Let , . By Takahashi [34], we have
Using (72), we have

We now discuss the problem of finding common fixed points of a sequence of -firmly nonexpansive mappings. Our proximal-projection method is based on (a not necessarily Bregman distance) function . The proof is based on the technique in [20].

Theorem 28. *Let be a uniformly convex Banach space with a uniformly Gâteaux differentiable norm. Let be a gauge function, a nonempty closed convex subset of , and a proper, convex, lower semicontinuous function with . Let be a -firmly nonexpansive mapping and a sequence of -firmly nonexpansive self-mappings on such that and has property () with respect to . For in and with , define a sequence in as follows:
**
Then converges strongly to .*

*Proof. *We proceed the proof in the following steps:*Step 1*. is well defined.

Note that all are closed and convex. For in and in , we obtain from (54) that
It follows that and hence . Therefore, is well defined.*Step 2*. is bounded.

Let . It follows from Proposition 15; we have
It follows that is bounded and hence from Proposition 11, we obtain that is bounded.*Step 3*. Consider .

Note that . It follows from Proposition 15 that
This implies that
Therefore, the sequence (see (43)) is increasing. Note that is bounded by (76). It follows that exists. By (78), we obtain
One can see that . Using Proposition 10, we obtain that . Since , we have
Using (79), we obtain that
and hence . Note that is bounded. Then, one can see from Proposition 10 that is bounded and
This implies that
Since the family has property () with respect to , it follows from (83) that .*Step 4*. The sequence converges strongly to .

Since is bounded, there exists a subsequence of such that . Hence . From Proposition 19, is closed and convex. The nonemptiness of implies that the generalized projection is well defined. Note that and is contained in ; we have
Therefore, we conclude from Proposition 16 that converges strongly to .

Theorem 29. *Let be a uniformly convex Banach space with a uniformly Gâteaux differentiable norm. Let be a gauge function, a nonempty closed convex subset of , and a proper, convex, lower semicontinuous function with . Let be a monotone operator with satisfying the following condition:
**
Let be a positive real number; for in and with , define a sequence in as follows:
**
Then converges strongly to .*

*Proof. *Set . Note that is -firmly nonexpansive mapping from into and . Further, every singleton family enjoys property (). Therefore, Theorem 29 follows from Theorem 28.

*Remark 30. *Compared with other convergence theorems concerning proximal point algorithms in the literature (see, e.g., Agarwal et al. [35, Theorem 3.1]; Kamimura and Takahashi [26, Theorem 8]; Matsushita and Takahashi [32, Theorem 4.3]), Theorem 29 establishes a new proximal point algorithm for the problem of finding zeros of (not necessarily maximal) monotone operators in a uniformly convex Banach space with a uniformly Gâteaux differentiable norm.

We now derive an interesting new result.

Corollary 31. *Let be a nonempty closed convex subset of real Hilbert space , and let be a proper, convex, lower semicontinuous function with . Let be a monotone operator satisfying condition (71) such that . Let be a sequence in such that , for in , let with , and define a sequence in as follows:
**
Then converges strongly to .*

*Proof. *Set for and for all in . Note that is a firmly nonexpansive mapping from into and . From (83), we have . Example 27 implies that has property (). It follows that . Therefore, Corollary 31 follows from Theorem 28.

Let be a nonempty, closed, and convex subset of a Banach space . Let be a bi-function, a nonlinear operator, and a real-valued function. We assume the following conditions are all satisfied.(A1) for all in .(A2) is monotone; that is, for all in .(A3) for all in , .(A4) for all in , is convex and lower semicontinuous.

Blum and Oettli [36] studied the following equilibrium problem (EP).

Find in such that The solution set of (88) is denoted by .

Following [37], we have the following lemma.

Lemma 32. *Let be a nonempty closed convex subset of a reflexive, strictly convex, and smooth Banach space , and let be a gauge function. Let be a bi-function satisfying conditions (A1)–(A4), and let and . Then there exists in such that
*

We now consider the following *generalized mixed equilibrium problem* (GMEP): find in such that
The solution set of (90) is denoted by . The following *auxiliary generalized mixed equilibrium problem* is an important tool for finding the solution of GMEP (90).

Let . For a given point in , find in such that The existence of a solution of the auxiliary mixed equilibrium problem (91) is guaranteed by [37].

Let be a nonempty closed convex subset of a reflexive, strictly convex, and smooth Banach space and let be a gauge function. Let be continuous and monotone, a bi-function satisfying conditions (A1)–(A4), and a lower semicontinuous and convex function. For , define the mapping as follows:

Lemma 33 (see [37]). *One has the following.*(1)* is single-valued. *(2)* is a -firmly nonexpansive mapping; that is, for all in ,
*(4)*.*(5)* is closed and convex.*(6)* For all in and in , one has
*

The following theorem establishes the strong convergence of the proximal-projection method for solving generalized mixed equilibrium problems in the framework of uniformly convex Banach spaces.

Theorem 34. *Let be a nonempty closed convex subset of a uniformly convex Banach space with a uniformly Gâteaux differentiable norm. Let be a gauge function and let be a proper, convex, lower semicontinuous function with . Let be continuous and monotone, a bi-function satisfying conditions (A1)–(A4), and a lower semicontinuous and convex function. Assume that GMEP. For in , , and with *