Muhammad Aslam Noor,1Khalida Inayat Noor,1Saira Zainab,1and Eisa Al-Said2
Academic Editor: Yonghong Yao
Received13 Dec 2011
Accepted22 Dec 2011
Published20 Feb 2012
Abstract
We use auxiliary principle technique coupled with iterative regularization method to suggest and analyze some new iterative methods for solving mixed variational-like inequalities. The convergence analysis of these new iterative schemes is considered under some suitable conditions. Some special cases are also discussed. Our method of proofs is very simple as compared with other methods. Our results represent a significant refinement of the previously known results.
1. Introduction
Variational inequalities are being used to study a wide class of diverse unrelated problems arising in various branches of pure and applied sciences in a unified framework. Various generalizations and extensions of variational inequalities have been considered in different directions using a novel and innovative technique. A useful and important generalization of the variational inequalities is called the variational-like inequality, which has been studied and investigated extensively. It has been shown [1β3] that the minimum of the differentiable preinvex (invex) functions on the preinvex sets can be characterized by the variational-like inequalities. Note that the preinvex functions may not be convex functions and the invex sets may not be convex sets. This implies that the concept ofinvxesityplays same roles in the variational-like inequalities as the convexity plays the role in the variational inequalities.We would like to point out that the variational-like inequalities are quite different then variational inequalities in several aspects. For example, one can prove that the variational inequalities are equivalent to the fixed point problems, whereas variational-like inequalities are not equivalent to the fixed point problems. However, if the invex set is equivalent to the convex set, then variational-like inequalities collapse to the variational inequalities. This shows that variational-like inequalities include variational inequalities as a special case. Authors are advised to see the delicate difference between these two different problems. For other kind of variational inequalities involving two and three operators, see Noor [4β7] and Noor et al. [8β13].
There is a substantial number of numerical methods including the projection technique and its variant forms including the Wiener-Hopf equations, auxiliary principle, and resolvent equations methods for solving variational inequalities and related optimization problems. However, it is known that the projection method, Wiener-Hopf equations, and resolvent equations techniques cannot be extended to suggest and analyze similar iterative methods for solving variational-like inequalities due to the presence of the bifunction . This fact motivated us to use the auxiliary principle technique of Glowinski et al. [14]. In this technique, one consider an auxiliary problem associated with the original problem. This way, one defines a mapping and shows that this mapping has a fixed point, which is a solution of the original problem. This fact enables us to suggest and analyze some iterative methods for solving the original problem. This technique has been used to suggest and analyze several iterative methods for solving various classes of variational inequalities and their generalizations, see [1, 2, 4β34] and the references therein.
The principle of iterative regularization is also used for solving variational inequalities. It was introduced by BakuΕ‘inskiΔ [16] in connection with variational inequalities in 1979. An important extension of this approach is presented by Alber and Ryazantseva[15].In this approach, the regularized parameter is changed at each iteration which is in contrast with the common practice for parameter identification of using a fixed regularization parameter throughout the minimization process. One can combine these two different techniques for solving the variational inequalities and related optimization problems. This approach was used by Khan and Rouhani [22] and Noor et al. [9, 10] for solving the mixed variational inequalities.
Motivated and inspired by the these activities, we suggest and analyze some iterative algorithms based on auxiliary principle and principle of iterative regularization for solving a class of mixed variational-like inequalities. For the convergence analysis of the explicit version of this iterative algorithm, we use partially relaxed strongly monotone operator which is a weaker condition than strongly monotonicity used by Khan and Rouhani [22]. We also suggest a new implicit iterative algorithm, the convergence of which requires only the monotonicity, which is weaker condition than strongly monotonicity. Results proved in this paper represent a significant improvement of the previously known results. The comparison of these methods with other methods is an interesting problem for future research.
2. Preliminaries
Let be a real Hilbert space, whose inner product and norm are denoted by and , respectively. Let be a nonempty closed set in . Let and be mappings. First of all, we recall the following well-known results and concepts; see [1β3, 21, 33].
Definition 2.1. Let . Then the set is said to be invex at with respect to , if
is said to be an invex set with respect to , if is invex at each . The invex set is also called -connected set. Clearly, every convex set is an invex set with ,ββfor all , but the converse is not true; see [3, 33].
From now onwards,is a nonempty closed and invex set in with respect to , unless otherwise specified.
Definition 2.2. A function is said to be preinvex with respect to , if
Note that every convex function is a preinvex function, but the converse is not true; see [3, 33].
Definition 2.3. A function is said to be a strongly preinvex function on with respect to the function with modulus , if
Clearly, a differentiable strongly preinvex function is a strongly invex function with constant , that is,
and the converse is also true under certain conditions.
We remark that if , then Definitions 2.2 and 2.3 reduce to
One can easily show that the minimum of the differentiable preinvex function on the invex set is equivalent to finding such that
which is known as the variational-like inequality. This shows that the preinvex functions play the same role in the study of variational-like inequalities as the convex functions play in the theory of variational inequalities. For other properties of preinvex functions, see [3, 30, 33] and the references therein.
Let be a nonempty closed and invex set in . For given nonlinear operator and a continuous function , we consider the problem of finding such that
which is called the mixed variational-like inequality introduced and studied by [1]. It has been shown in [1β3] that a minimum of differentiable preinvex functions on the invex sets in the normed spaces can be characterized by a class of variational-like inequalities (2.7) with where is the differential of a preinvex function . This shows that the concept of variational-like inequalities is closely related to the concept of invexity. For the applications, numerical methods, and other aspects of the mixed variational-like inequalities, see [1, 2, 29] and the references therein.
We note that if , then the invex set becomes the convex set and problem (2.7) is equivalent to finding such that
which is known as a mixed variational inequality. It has been shown [1β14, 17β35] that a wide class of problems arising in elasticity, fluid flow through porous media and optimization can be studied in the general framework of problems (2.7) and (2.8).
If , then problem (2.7) is equivalent to finding such that
which is known as the variational-like inequality and has been studied extensively in recent years. For , the variational-like inequality (2.9) reduces to the original variational inequality, which was introduced and studied by Stampacchi [32] in 1964. For the applications, numerical methods, dynamical system, and other aspects of variational inequalities and related optimization problems, see [1β35] and the references therein.
Definition 2.4. An operator is said to be(i)-Monotone, if and only if, , for allββ.(ii)Partially relaxed strongly -monotone, if there exists a constant such that
Note that for , partially relaxed strong -monotonicity reduces to -monotonicity of the operator . For , the invex set becomes the convex set and consequently Definition 2.4 collapses to the well concept of monotonicity and partial relaxed strongly monotonicity of the operator.
Assumption 2.5. Assume that the bifunction satisfies the condition
In particular, it follows that and
Assumption 2.5 has been used to suggest and analyze some iterative methods for various classes of variational-like inequalities.
3. Auxiliary Principle Technique/Principle of Iterative Regularization
In this section, we will discuss the solution of mixed variational-like inequality (2.7) using its regularized version. We will use auxiliary principle technique [14] coupled with principle of iterative regularization for solving the mixed variational-like inequalities.
For a given satisfying (2.7), we consider the problem of finding such that
Note that, if , then (3.1) reduces to (2.7). Using (3.1), we suggest an iterative scheme for solving (2.7). For a given , consider the problem of finding a solution satisfying the auxiliary variational-like inequality
where be a sequence of positive real, and be a decreasing sequence of positive real such that as . Clearly, if and as , then is a solution of (2.7).
Now, we consider the regularized version of (2.7). For a fixed but arbitrary and for , find such that
Algorithm 3.1. For a given , compute from the iterative scheme
where be a sequence of positive real and be a decreasing sequence of positive reals such that as .
We now study the convergence analysis of Algorithm 3.1.
Theorem 3.2. Let T be a monotone operator.For the approximation of , assume that there exists such that such that
Also for the sequences , , and , one has
Then the approximate solution obtained fromAlgorithm 3.1converges to an exact solution satisfying (2.7).
Proof. Let satisfying the regularized mixed variational-like inequality (3.3). Then replacing by in (3.3), we have
Let be the approximate solution obtained from (3.4). Replacing by , we have
For the sake of simplicity, we have and in (3.7) and (3.8), respectively, and then adding the resultant inequalities, we have
We consider the Bregman function:
Now
Since is a monotone operator, is strongly monotone with constant ββ(say), we have
from which, we have
where
Using Lemmaββ2.1and Lipschitz continuity of operator , we have
Thus
Solving for , where
Using (3.5), we obtain
where we have used the Lipschitz continuity of with constant . Now using Assumption 2.5, we have
From (3.13), (3.16) and (3.19), we have
Using conditions (3.6), we have
If , it is easily shown that is a solution of the variational-like inequality (2.7). Otherwise, the assumption implies that is nonnegative and we must have
From (3.22), it follows that the sequence is bounded. Let be a cluster point of the sequence and let the subsequence of this sequence converges to . Now essentially using the technique of Zhu and Marcotte [35], it can be shown that the entire sequence converges to the cluster point satisfying the variational-like inequality (2.7).
To implement the proximal method, one has to calculate the solution implicitly, which is itself a difficult problem. We again use the auxiliary principle technique to suggest another iterative method, the convergence of which requires only the partially relaxed strongly monotonicity of the operator. For this, we rewrite (3.1) as follows.
For a given , consider the problem of finding such that
Note that if , then (3.23) reduces to (2.7). Using (3.23), we develop an iterative scheme for solving (2.7).
For a given , consider the problem of finding a solution satisfying the auxiliary variational-like inequality
where be a sequence of positive reals, and be a decreasing sequence of positive reals such that as .
Note that if and as , then is a solution of (2.7).
Algorithm 3.3. For a given , compute from the iterative scheme
where be a sequence of positive and be a decreasing sequence of positive such that as .
Using the technique of Theorem 3.2, one can prove the convergence of Algorithm 3.3. We include its proof for the sake of completeness.
Theorem 3.4. Let be a partially relaxed strongly monotone operator with constant . For the approximation of , let (3.5) holds. Also for the sequences , and , (3.6) is satisfied. Then the approximate solution obtained from Algorithm 3.3 converges to an exact solution satisfying (2.7).
Proof. Let satisfying the regularized mixed variational-like inequality (3.3), then replacing by , we have
Let be the approximate solution obtained from (3.25). Replacing by , we have
For the sake of simplicity, we have and in (3.26) and (3.27), respectively, and then adding the resultant inequalities, we have
from which, we have
We consider the Bregman function:
Now, we investigate the difference. Using the strongly preinvexity of , we have
Since is partially relaxed strongly monotone with constant , is partially relaxed strongly monotone with constant ββ(say), we have
From which, we have
where
Using Lipschitz continuity of operator , we have
Put , we have
Solving for , where
Using (3.5), we obtain
where we have used the Lipschitz continuity of with constant . Now using Assumption 2.5, we have, for any ,
Combining all the results above, we have
Taking , we have
Using conditions (3.6), we have
If , then it can easily shown that is a solution of the variational-like inequality (2.7). Otherwise, the assumption implies that is nonnegative and we must have
From (3.43), it follows that the sequence is bounded. Let be a cluster point of the sequence and let the subsequence of this sequence converges to . Now essentially using the technique of Zhu and Marcotte [35], it can be shown that the entire sequence converges to the cluster point satisfying the variational-like inequality (2.7).
4. Conclusion
In this paper, we have suggested and analyzed some new iterative methods for solving the regularized mixed variational-like inequalities. We have also discussed the convergence analysis of the suggested iterative methods under some suitable and weak conditions. Results proved in this are new and original ones. We hope to extend the idea and technique of this paper for solving invex equilibrium problems and this is the subject of another paper.
Acknowledgments
This research is supported by the Visiting Professor Program of King Saud University, Riyadh, Saudi Arabia. The authors are also grateful to Dr. S. M. Junaid Zaidi, Rector, COMSATS Institute of Information Technology, Pakistan for providing the excellent research facilities.
References
M. A. Noor, βVariational-like inequalities,β Optimization, vol. 30, pp. 323β330, 1994.
M. A. Noor, βNonconvex functions and variational inequalities,β Journal of Optimization Theory and Applications, vol. 87, no. 3, pp. 615β630, 1995.
X. Q. Yang and G. Y. Chen, βA class of nonconvex functions and pre-variational inequalities,β Journal of Mathematical Analysis and Applications, vol. 169, no. 2, pp. 359β373, 1992.
M. A. Noor, βSome iterative methods for general nonconvex variational inequalities,β Mathematical and Computer Modelling, vol. 54, pp. 2953β2961, 2011.
M. A. Noor, K. I. Noor, and T. M. Rassias, βSome aspects of variational inequalities,β Journal of Computational and Applied Mathematics, vol. 47, no. 3, pp. 285β312, 1993.
M. A. Noor, K. I. Noor, S. Zainab, and E. Al-Said, βSome iterative algorithms for solving regularized mixed quasi variational inequalities,β International Journal of the Physical Sciences, vol. 6, no. 28, pp. 6505β6512, 2011.
M. A. Noor, K. I. Noor, H. Yaqoob, and S. Zainab, βIterative schemes for regularized mixed quasi-variational inequalities,β International Journal of Modern Physic B. In press.
M. A. Noor, K. I. Noor, and E. Al-Said, βIterative methods for solving nonconvex equilibrium variational inequalities,β Applied Mathematics and Information Science, vol. 6, no. 1, pp. 65β69, 2012.
M. A. Noor, K. I. Noor, and E. Al-Said, βOn new proximal methods for solving the variational inequalities,β Journal on Applied Mathematics, vol. 2012, Article ID 412413, 2012.
M. A. Noor, K. I. Noor, Y. Z. Huang, and E. Al-Said, βImplicit schemes for solving extended general nonconvex variational inequalities,β Journal of Applied Mathematics, vol. 2012, Article ID 646259, 10 pages, 2012.
A. B. BakuΕ‘inskiΔ, βOn the principle of iterative regularization,β Zhurnal Vychislitel'noi Matematiki i Matematicheskoi Fiziki, vol. 19, no. 4, pp. 1040β1043, 1979.
F. H. Clarke, Y. S. Ledyaev, and P. R. Wolenski, Nonsmooth Analysis and Control Theory, vol. 178, Springer, Berlin, Germany, 1998.
N. El Farouq, βPseudomonotone variational inequalities: convergence of proximal methods,β Journal of Optimization Theory and Applications, vol. 109, no. 2, pp. 311β326, 2001.
F. Giannessi and A. Maugeri, Variational Inequalities and Network Equilibrium Problems, Plenum Press, New York, NY, USA, 1995.
F. Giannessi, A. Maugeri, and P. M. Pardalos, Equilibrium Problems: Nonsmooth Optimization and Variational Inequality Methods, vol. 58 of Nonconvex Optimization and its Applications, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2001.
M. A. Hanson, βOn sufficiency of the Kuhn-Tucker conditions,β Journal of Mathematical Analysis and Applications, vol. 80, no. 2, pp. 545β550, 1981.
A. A. Khan and B. D. Rouhani, βIterative regularization for elliptic inverse problems,β Computers and Mathematics with Applications, vol. 54, no. 6, pp. 850β860, 2007.
D. Kinderlehrer and G. Stampacchia, An Introduction to Variational Inequalities and Their Applications, vol. 88 of Pure and Applied Mathematics, Academic Press, New York, NY, USA, 1980.
M. A. Noor, On variational inequalities, Ph.D. thesis, Brunel University, London, UK, 1975.
M. A. Noor, βSome recent advances in variational inequalities, Part I, Basic concepts,β New Zealand Journal of Mathematics, vol. 26, no. 4, pp. 53β80, 1997.
M. A. Noor, βA predictor-corrector algorithm for general variational inequalities,β Applied Mathematics Letters, vol. 14, no. 1, pp. 53β87, 2001.
M. A. Noor, βProximal methods for mixed variational inequalities,β Journal of Optimization Theory and Applications, vol. 115, no. 2, pp. 447β451, 2002.
M. A. Noor, βExtragradient methods for pseudomonotone variational inequalities,β Journal of Optimization Theory and Applications, vol. 117, no. 3, pp. 475β488, 2003.
M. A. Noor, βFundamentals of mixed quasi variational inequalities,β International Journal of Pure and Applied Mathematics, vol. 15, no. 2, pp. 137β258, 2004.
M. A. Noor, βOn generalized preinvex functions and monotonicities,β Journal of Inequalities in Pure and Applied Mathematics, vol. 5, no. 4, pp. 1β9, 2004.
T. Weir and B. Mond, βPre-invex functions in multiple objective optimization,β Journal of Mathematical Analysis and Applications, vol. 136, no. 1, pp. 29β38, 1988.
Y. Yao, M. A. Noor, Y. C. Liou, and S. M. Kang, βIterative algorithms for general multivalued variational inequalities,β Abstract and Applied Analysis, vol. 2012, Article ID 768272, 10 pages, 2012.
D. L. Zhu and P. Marcotte, βCo-coercivity and its role in the convergence of iterative schemes for solving variational inequalities,β SIAM Journal on Optimization, vol. 6, no. 3, pp. 714β726, 1996.