Institute of Mathematics, School of Mathematics and Computer Science, Nanjing Normal University, Nanjing 210097, China
The efficiency of the implicit
method proposed by He (1999) depends on the parameter heavily; while it varies for individual problem, that is, different problem has
different “suitable” parameter, which is difficult to find. In this
paper, we present a modified implicit method, which adjusts the
parameter automatically per iteration, based on the
message from former iterates. To improve the performance of the algorithm,
an inexact version is proposed, where the subproblem is just solved approximately.
Under mild conditions as those for variational inequalities, we prove the
global convergence of both exact and inexact versions of the new method. We
also present several preliminary numerical results, which demonstrate that the self-adaptive
implicit method, especially the inexact version, is efficient and robust.
1. Introduction
Let be a closed convex subset of and let be a mapping from into itself. The so-called finite-dimensional variant variational inequalities, denoted by , is to find a vector , such that
while a classical variational inequality problem, abbreviated by , is to find a vector , such that
where is a mapping from into itself.
Both and serve as very general mathematical models of numerous applications arising in economics, engineering, transportation, and so forth. They include some widely applicable problems as special cases, such as mathematical programming problems, system of nonlinear equations, and nonlinear complementarity problems, and so forth. Thus, they have been extensively investigated. We refer the readers to the excellent monograph of Faccinei and Pang [1, 2] and the references therein for theoretical and algorithmic developments on , for example, [3–10], and [11–16] for .
It is observed that if is invertible, then by setting , the inverse mapping of can be reduced to . Thus, theoretically, all numerical methods for solving can be used to solve . However, in many practical applications, the inverse mapping may not exist. On the other hand, even if it exists, it is not easy to find it. Thus, there is a need to develop numerical methods for and recently, the Goldstein's type method was extended from solving to [12, 17].
In [11], He proposed an implicit method for solving general variational inequality problems. A general variational inequality problem is to find a vector , such that
When is the identity mapping, it reduces to and if is the identity mapping, it reduces to . He's implicit method is as follows.
(S0)Given , and a positive definite matrix .(S1)Find via
where
with being the projection from onto , under the Euclidean norm.He's method is attractive since it solves the general variational inequality problem, which is essentially equivalent to a system of nonsmooth equations
via solving a series of smooth equations (1.4). The mapping in the subproblem is well conditioned and many efficient numerical methods, such as Newton's method, can be applied to solve it. Furthermore, to improve the efficiency of the algorithm, He [11] proposed to solve the subproblem approximately. That is, at Step 1, instead of finding a zero of , it only needs to find a vector satisfying
where is a nonnegative sequence. He proved the global convergence of the algorithm under the condition that the error tolerance sequence satisfies
In the above algorithm, there are two parameters and , which affect the efficiency of the algorithm. It was observed that nearly for all problems, close to is a better choice than smaller , while different problem has different optimal . A suitable parameter is thus difficult to find for an individual problem. For solving variational inequality problems, He et al. [18] proposed to choose a sequence of parameters , instead of a fixed parameter , to improve the efficiency of the algorithm. Under the same conditions as those in [11], they proved the global convergence of the algorithm. The numerical results reported there indicated that for any given initial parameter , the algorithm can find a suitable parameter self-adaptively. This improves the efficiency of the algorithm greatly and makes the algorithm easy and robust to implement in practice.
In this paper, in a similar theme as [18], we suggest a general rule for choosing suitable parameter in the implicit method for solving . By replacing the constant factor in (1.4) and (1.5) with a self-adaptive variable positive sequence , the efficiency of the algorithm can be improved greatly. Moreover, it is also robust to the initial choice of the parameter . Thus, for any given problems, we can choose a parameter arbitrarily, for example, or . The algorithm chooses a suitable parameter self-adaptively, based on the information from the former iteration, which makes it able to add a little additional computational cost against the original algorithm with fixed parameter . To further improve the efficiency of the algorithm, we also admit approximate computation in solving the subproblem per iteration. That is, per iteration, we just need to find a vector that satisfies (1.8).
Throughout this paper, we make the following assumptions.
Assumption A. The solution set of , denoted by , is nonempty.
Assumption B. The operator is monotone, that is, for any ,
The rest of this paper is organized as follows. In Section 2, we summarize some basic properties which are useful in the convergence analysis of our method. In Sections 3 and 4, we describe the exact version and inexact version of the method and prove their global convergence, respectively. We report our preliminary computational results in Section 5 and give some final conclusions in the last section.
2. Preliminaries
For a vector and a symmetric positive definite matrix , we denote as the Euclidean-norm and as the matrix-induced norm, that is, .
Let be a nonempty closed convex subset of , and let denote the projection mapping from onto , under the matrix-induced norm. That is,
It is known [12, 19] that the variant variational inequality problem (1.1) is equivalent to the projection equation
where is an arbitrary positive constant. Then, we have the following lemma.
Lemma 2.1. is a solution of if and only if for any fixed constant , where
is the residual function of the projection equation (2.2).
Proof. See [11, Theorem 1].
The following lemma summarizes some basic properties of the projection operator, which will be used in the subsequent analysis.
Lemma 2.2. Let be a closed convex set in and let denote the projection operator onto under the matrix-induced norm, then one has
The following lemma plays an important role in convergence analysis of our algorithm.
Lemma 2.3. For a given , let Then it holds that
Proof. See [20] for a simple proof.
Lemma 2.4. Let , then for all and , one has
Proof. It follows from the definition of (see (1.1) that
By setting and in (2.4), we obtain
Adding (2.8) and (2.9), and using the definition of in (2.3), we get
that is,
where the last inequality follows from the monotonicity of (Assumption B). This completes the proof.
3. Exact Implicit Method and Convergence Analysis
We are now in the position to describe our algorithm formally.
3.1. Self-Adaptive Exact Implicit Method
(S0)Given , , and a positive definite matrix .(S1)Compute such that
(S2)If the given stopping criterion is satisfied, then stop; otherwise choose a new parameter , where satisfies
Set and go to Step 1.From (3.1), we know that is the (exact) unique zero of
We refer to the above method as the self-adaptive exact implicit method.
Remark 3.1. According to the assumption and , we have . Denote
Hence, the sequence is bounded. Then, let and .
Now, we analyze the convergence of the algorithm, beginning with the following lemma.
Lemma 3.2. Let be the sequence generated by the proposed self-adaptive exact implicit method. Then for any and , one has
Proof. Using (3.1), we get
where the inequality follows from (2.7). This completes the proof.
Since and is monotone, it follows that
where the inequality follows from the monotonicity of the mapping . Combining (3.5) and (3.7), we have
Now, we give the self-adaptive rule in choosing the parameter . For the sake of balance, we hope that
That is, for given constant , if
we should increase in the next iteration; on the other hand, we should decrease when
Let
Then we give
Such a self-adaptive strategy was adopted in [18, 21–24] for solving variational inequality problems, where the numerical results indicated its efficiency and robustness to the choice of the initial parameter . Here we adopted it for solving variant variational inequality problems.
We are now in the position to give the convergence result of the algorithm, the main result of this section.
Theorem 3.3. The sequence generated by the proposed self-adaptive exact implicit method converges to a solution of .
Proof. Let . Then from the assumption that , we have that , which means that . Denote
From (3.8), for any , that is, an arbitrary solution of , we have
This, together with the monotonicity of the mapping , means that the generated sequence is bounded.
Also from (3.8), we have
Adding both sides of the above inequality, we obtain
where the second inequality follows from (3.15). Thus, we have
which, from Lemma 2.3, means that
Since is bounded, it has at least one cluster point. Let be a cluster point of and let be the subsequence converging to . Since is continuous, taking limit in (3.20) along the subsequence, we get
Thus, from Lemma 2.1, is a solution of .
In the following we prove that the sequence has exactly one cluster point. Assume that is another cluster point of , which is different from . Because is a cluster point of the sequence and is monotone, there is a such that
where
On the other hand, since and is an arbitrary solution, by setting in (3.15), we have for all ,
that is,
Then,
Using the monotonicity of and the choosing rule of , we have
Combing (3.25)–(3.27), we have that for any ,
which means that cannot be a cluster point of . Thus, has just one cluster point.
4. Inexact Implicit Method and Convergence Analysis
The main task at each iteration of the implicit exact algorithm in the last section is to solve a system of nonlinear equations. To solve it exactly per iteration is time consuming, and there is little justification to solve it exactly, especially when the iterative point is far away from the solution set. Thus, in this section, we propose to solve the subproblem approximately. That is, for a given , instead of finding the exact solution of (3.1), we would accept as the new iterate if it satisfies
where is a nonnegative sequence with . If (3.1) is replaced by (4.1), the modified method is called inexact implicit method.
We now analyze the convergence of the inexact implicit method.
Lemma 4.1. Let be the sequence generated by the inexact implicit method. Then there exists a such that for any and ,
Proof. Denote
Then (4.1) can be rewritten as
According to (4.3) and (2.7),