![MathJax Logo](/templates/jsp/_style2/_tandf/pb2/images/math-jax.gif)
Abstract
In this paper, we propose a new hybrid extragradient-viscosity algorithm for solving variational inequality problems, where the constraint set is the common elements of the set of solutions of a pseudomonotone equilibrium problem and the set of fixed points of a demicontractive mapping. Using the hybrid extragradient-viscosity method and combining with hybrid plane cutting techniques, we obtain the algorithm for this problem. Under certain conditions on parameters, the convergence of the iteration sequences generated by the algorithms is obtained.
Public Interest Statement
Variational inequality and equilibrium problems as well as fixed point problems are very useful and efficient tools in mathematics. They provided a unified framework for studying many problems arising in engineering, economics, and other fields. In this paper, we propose a new algorithm for solving variational inequality problems where the constraint set is the common elements of the set of solutions of a pseudomonotone equilibrium problem and the set of fixed points of a demicontractive mapping. One difficulty of this problem is that the constraint set is not given explicitly. The proposed method allows us to solve this problem by solving a sequence of convex programs in which they are much easier to solve.
1. Introduction
Let be a n-dimentional Euclidean space with the inner product
and associated norm
. Let C be a nonempty closed convex subset in
and
,
be operators, and
be a bifunction satisfying
for every
. We consider the following variational inequality problem over the set is the common elements of the set of a pseudomonotone equilibrium problem and the set of fixed points of a demicontractive mapping (shortly VIEFP(
):
(1)
(1)
where ,
, i.e.
is the solution set of the following equilibrium problem (EP(
) for short)
(2)
(2)
and is the fixed points of the mapping
, i.e.
.
We call problem (1) the upper problem and (2) the lower one. Problem (1) is a special case of mathematical programs with equilibrium constraints. Sources for such problems can be found in Luo, Pang, and Ralph (Citation1996), Migdalas, Pardalos, and Varbrand (Citation1988), Muu and Oettli (Citation1992). Bilevel variational inequalities were considered in Anh, Kim, and Muu (Citation2012), Moudafi (Citation2010) and Yao, Liou, and Kang (Citation2010) suggested the use of the proximal point method for monotone bilevel equilibrium problems, which contain monotone variational inequalites as a special case. Recently, Ding (Citation2010) used the auxiliary problem principle to monotone bilevel equilibrium problems. In those papers, the lower problem is required to be monotone. In this case, the subproblems to be solved are monotone.
It should be noticed that the solution set of the lower problem (2) is convex whenever f is pseudomonotone on C. However, the main difficulty is that, even the constrained set
is convex, it is not given explicitly as in a standard mathematical programming problem, and therefore the available methods of convex optimization and variational inequality cannot be applied directly to problem (1).
In this paper, we extend the hybrid extragradient-viscosity methods introduced by Maingé (Citation2008b) for solving bilevel problem (1) when the lower problem is pseudomonotone with respect to its solution set equilibrium problems rather than monotone variational inequalities as in Maingé (Citation2008b), the later pseudomonotonicity is somewhat more general than pseudomonotone. We show that the sequence of iterates generated by the proposed algorithm converges to the unique solution of the bilevel problem (1).
The paper is organized as follows. Section 2 contains some preliminaries on the Euclidean projection and equilibrium problems. Section 3 is devoted to presentation of the algorithm and its convergence. In Section 4, we describe a special case of variational inequalities with variational inequalities and fixed points constraints, where the lower variational inequality is pseudomonotone with respect to its solution set.
2. Preliminaries
In the rest of the paper, by we denote as the projection operator on C, that is
The following well-known results on the projection operator onto a closed convex set will be used in the sequel.
Lemma 2.1
Suppose that C is a nonempty closed convex set in . Then,
(1) |
| ||||
(2) |
| ||||
(3) |
|
We recall some well-known definitions which will be useful in the sequel (see e.g. Blum & Oettli, Citation1994; Facchinei & Pang, Citation2003; Konnov, Citation2001; Muu & Oettli, Citation1992; Solodov & Svaiter, Citation1999).
Definition 2.1
A mapping is called
(1) | nonexpansive if | ||||
(2) | quasi-nonexpansive if | ||||
(3) |
| ||||
(4) |
|
Definition 2.2
A bifunction is said to be
(1) | strongly monotone on C with modulus | ||||
(2) | monotone on C if | ||||
(3) | pseudomonotone on C if | ||||
(4) | pseudomonotone on C with respect to |
From Definition 2.2, it follows that (1) (2)
(3)
(4)
.
When , where
is an operator, then the definition (1) becomes:
that is is
-strongly monotone on C. Similarly, if
satisfies (2) ((3), (4) resp.) on C, then
becomes monotone, (pseudomonotone, pseudomonotone with respect to
resp.) on C.
In the sequel, we need the following blanket assumptions
(A1) |
| ||||
(A2) |
| ||||
(A3) | f is pseudomonotone on C with respect to the solution set | ||||
(A4) | T is | ||||
(A5) | G is | ||||
(B1) |
| ||||
(B2) |
| ||||
(B3) |
|
Lemma 2.2
Suppose Problem EP() has a solution. Then, under assumptions (A1), (A2), and (A3), the solution set
is closed, convex, and
The following lemmas are well known from the auxiliary problem principle for equilibrium problems.
Lemma 2.3
(Mastroeni, Citation2003) Suppose that h is a continuously differentiable and strongly convex function on C with modulus . Then, under assumptions (A1) and (A2), a point
is a solution of EP(
) if and only if it is a solution to the equilibrium problem:
The function
is called Bregman function. Such a function was used to define a generalized projection, called d-projection, which was used to develop algorithms for particular problems (see e.g. Censor & Lent, Citation1981). An important case is . In this case, d-projection becomes the Euclidean one.
Lemma 2.4
(Mastroeni, Citation2003) Under assumptions (A1) and (A2), a point is a solution of problem (AEP) if and only if
Note that since is convex and h is strongly convex, Problem (CP) is a strongly convex program.
For each , by
, we denote the subgradient of the convex function
at z, i.e.
and each we define the halfspace
as
(3)
(3)
Note that when , where
, this halfspace becomes the one introduced in Solodov and Svaiter (Citation1999). The following lemma says that the hyperplane does not cut off any solution of problem EP(
).
Lemma 2.5
(Dinh & Muu, Citation2015) Under assumptions (A2) and (A3), one has for every
.
Lemma 2.6
(Dinh & Muu, Citation2015) Under assumptions (A1) and (A2), if is a sequence, such that
converges to
and the sequence
, with
converges to
, then
.
Lemma 2.7
Suppose the bifunction f satisfies the assumptions (A1) and (A2), the function h satisfies the assumption (B1). If is bounded and
is a sequence, such that
then is bounded.
Proof
Firstly, we show that if converges to
, then
is bounded. Indeed,
and
therefore
In addition, is strongly convex on C with modulus
; hence, for all
we get
This implies , so that
Because converges to
and
, by Theorem 24.5 in Rockafellar (Citation1970), the sequence
is bounded; combining with the boundedness of
, we have
also bounded.
Now, we prove the Lemma 2.7. Suppose contradict that is unbounded, i.e. there exists an subsequence
, such that
. By the boundedness of
, it implies
is also bounded; without loss of gerarality, we may assume that
. By the same argument as above, we have
is bounded, which we contradict. Therefore,
is bounded.
The following lemma is in Solodov and Svaiter (Citation1999) (see also Dinh & Muu, Citation2015).
Lemma 2.8
(Dinh & Muu, Citation2015; Solodov & Svaiter, Citation1999) Suppose that and
. Then,
Lemma 2.9
(Maingé, Citation2008b) Let be an
demicontractive mapping, such that Fix(
) is nonempty. Then,
is a quasi-nonexpansive mapping over C for every
. Furthermore,
Lemma 2.10
(Lemma 3.1 Maingé, Citation2008a) Let be a sequence of real numbers that does not decrease at infinity, in the sense that there exists a subsequence
of
such that
Also, consider the sequence of integers defined by
Then, is a nondecreasing sequence verifying
and, for all , the following two inequalities hold:
(4)
(4)
(5)
(5)
3. A hybrid extragradient-viscosity algorithm for VIEFP (C, f, T, G)
Remark 3.1
(1) | If | ||||
(2) |
|
Now, we are going to analyze the validity and convergence of the algorithm. Some parts in our proofs are based on the proof scheme in Maingé (Citation2008b).
Lemma 3.1
Under Assumptions (A1) and (A2), the linesearch rule (6) is well defined in the sense that at each iteration k, there exists an integer number , satisfying the inequality in (6) for every
, and if, in addition assumptions (A3) and (A4) are satisfied, then for every
, one has
(6)
(6)
where .
Proof
First, we prove that there exists a positive integer such that
Indeed, suppose by contradiction that for every positive integer m and , there exists
, such that
Since as
, by Theorem 24.5 in Rockafellar (Citation1970), the sequence
is bounded. Thus, we may assume that
for some
. Taking the limit as
, from
and
, by Lemma 2.6, it follows that
and
(7)
(7)
Since , we have
Combining with (9) yields
which contradicts to the fact that
Thus, the linesearch is well defined.
Now, we prove (8). For simplicity of notation, let ,
.
Since and
, by Lemma 2.5,
, we have
which together with
implies(8)
(8)
Replacing
into (10), we obtain
Substituting into the last inequality, we get
In addition, by the Armijo linesearch rule, using the -strong convexity of h, we have
Note that can be written as:
(9)
(9)
From Lemma 2.9, we have(10)
(10)
Replacing into (12), we get
(11)
(11)
where the last inequality follows from . We have
which together with (11) implies(12)
(12)
as desired.
Lemma 3.2
The sequences , and
generated by the Algorithm 1 are bounded under assumptions (A1), (A2), (A3), (A4), and (A5).
Proof
From (13), we get(13)
(13)
In addition,(14)
(14)
where .
Since is
-Lipschitz and
-strongly monotone, we have
Hence, . Then, combining with (16), we get
where, ,
, and the last inequality deduced from (11). Combining with (15), we obtain
(15)
(15)
By induction, it implies . Hence,
is bounded, which, from (11), implies that
is also bounded. Since
, and by the boundedness of
, we can conclude that
is bounded.
Lemma 3.3
If the subsequence converges to some
and
(16)
(16)
then .
Proof
By definition of in Algorithm 1, we have
. Therefore,
. Taking the limit as
and by the closedness of mapping
, we get
, i.e.
.
Now, we prove . Indeed, from Lemma 3.2,
is bounded. Without loss of generality, we may assume that
. We will consider two distinct cases:
Case 1. . Then, from (18), one has
, thus
and
.
According to the definition of , we have
by the continuity of , we get in the limit as
that
this fact shows that .
Case 2. . By the linesearch rule and
-strong convexity of h, we have
Thus, .
From the boundedness of and (18), it follows
, so that
as
Without loss of generality, we suppose that
and
as
.
We have
letting , we obtain in the limit that
On the other hand, by the linesearch rule (6), for , there exists
, such that
(17)
(17)
Letting and combining with
we obtain in the limit from (19) that
Note that ; it follows from the last inequality that
Hence,
which shows that .
In addition, combining with (11), it implies
(18)
(18)
taking the limit both sides of (20), we get . Hence,
. Therefore,
.
Now, we are in a position to prove the convergence of the proposed algorithm.
Theorem 3.4
Suppose that the set is nonempty and that the function
, the sequence
,
satisfies the conditions (
), (
), and (
), respectively. Then, under Assumptions (A1), (A2), (A3), (A4), and (A5), the sequence
generated by Algorithm 1 converges to the unique solution
of VIEFP(
).
Proof
By Lemma 3.1, we have(19)
(19)
From the boundedness of and
, it implies that there exist positive numbers
, such that
By setting , and combining with the last inequalities, (21) becomes
(20)
(20)
We will consider two distinct cases:
Case 1. There exists , such that
is decreasing when
.
Then, there exists , taking the limit on both sides of (22), we get
(21)
(21)
This implies . In addition,
(22)
(22)
Thus, . From the boundedness of
, it implies that there exists
and
, such that
.
Combining this fact with (23) and (24), we obtain
By Lemma 3.3, we get . Thus,
Since is
-strongly monotone, one has
Taking the limit as and remembering that
, we get
(23)
(23)
If , then by choosing
, from (25), it implies that there exists
, such that
From (21), we get
and thus summing up from to k, we have
combining this fact with , we obtain
, which is a contradiction.
Thus, we must have , i.e.
.
Case 2. There exists a subsequence , such that
for all
. In this situation, we consider the sequence of indices
defined as in Lemma 2.10. It follows that
, which by (22) amounts to
Therefore,
From the boundedness of , without loss of generality, we may assume that
. By Lemma 3.3, we get
.
In addition,
Therefore, .
By (21), we get
which implies(24)
(24)
Since is
-strongly monotone, we have
which combining with (26), we get
so that
which amounts to(25)
(25)
In addition,
which together with (27), one has , which means that
.
By (5) in Lemma 2.10, we have
Thus, converges to
4. Application to variational inequalities with variational inequality and fixed point constraints
In this section, we consider the following variational inequality problem over the set that is the common elements of the solution set of a pseudomonotone variational inequality problem and the set of fixed points of a demicontractive mapping (shortly VIFP():
(26)
(26)
where ,
,
i.e. is the solution set of the following variational inequality problems VIP(
) for short)
(27)
(27)
and as before, is the fixed point of the mapping
. This problem was considered by Maingé (Citation2008b).
In the sequel, we always suppose that Assumptions (A1), (A2), (A3), (A4), and (A5) are satisfied. The algorithm for this case takes the form:
Similar to Theorem 3.1, we have the following theorem
Theorem 4.1
Under assumptions (A1), (A2), (A3), (A4), and (A5) and (B1), (B2), and (B3), the sequence generated by Algorithm 2 converges to the unique solution
of VIFP(
).
5. Conclusion
We have proposed a hybrid extragradient-viscosity algorithm for solving strongly monotone variational inequality problems over the set that is common points of the set of solutions of a pseudomonotone equilibrium problem and the set of fixed points of a demicontractive mapping. The convergence of the proposed algorithm is obtained, and a special case of this problem is also considered.
Additional information
Funding
Notes on contributors
Bui Van Dinh
Dr Bui Van Dinh is a lecturer at the Department of Mathematics, Faculty of Information Technology, Le Quy Don Technical University, Hanoi, Vietnam. His interest includes solution methods for optimization problems, fixed point problems, variational inequality, and equilibrium problems.
References
- Anh, P. N., Kim, J. K., & Muu, L. D. (2012). An extragradient algorithm for solving bilevel variational inequalities. Journal of Global Optimization, 52, 627–39.
- Blum, E., & Oettli, W. (1994). From optimization and variational inequalities to equilibrium problems. The Mathematics Student, 63, 127–149.
- Censor, Y., & Lent, A. (1981). An iterative row-action method for interval convex programming. Journal of Optimization Theory and Applications, 34, 321–353.
- Ding, X. P. (2010). Auxiliary principle and algorithm for mixed equilibrium problems and bilevel equilibrium problems in Banach spaces. Journal of Optimization Theory and Applications, 146, 347–357.
- Dinh, B. V., & Muu, L. D. (2015). Projection algorithm for solving pseudomonotone equilibrium problems and it’s application to a class of bilevel equilibria. Optimization, 64, 559–575.
- Facchinei, F., & Pang, J. S. (2003). Finite-dimensional variational inequalities and complementarity problems. New York, NY: Springer.
- Konnov, I. V. (2001). Combined relaxation methods for variational inequalities (Lecture notes in economics and mathematical systems). Berlin: Springer.
- Luo, J. Q., Pang, J. S., & Ralph, D. (1996). Mathematical programs with equilibrium constraints. Cambridge: Cambridge University Press.
- Maingé, P. E. (2008a). Strong convergence of projected subgradient methods for nonsmooth and nonstrictly convex minimization. Set-Valued Analysis, 16, 899–912.
- Maingé, P. E. (2008b). A hybrid extragradient viscosity methods for monotone operators and fixed point problems. SIAM Journal on Control and Optimization, 47, 1499–1515.
- Mastroeni, G. (2003). On auxiliary principle for equilibrium problems. Journal of Global Optimization, 27, 411–426.
- Migdalas, M. A., Pardalos, P., & Varbrand, P. (Eds.). (1988). Multilevel optimization: Algorithms and applications. Dordrecht: Kluwer.
- Moudafi, A. (2010). Proximal methods for a class of bilevel monotone equilibrium problems. Journal of Global Optimization, 47, 287–292.
- Muu, L. D., & Oettli, W. (1992). Convergence of an adaptive penalty scheme for finding constrained equilibria. Nonlinear Analysis, Theory, Methods & Applications, 18, 1159–1166.
- Rockafellar, R. T. (1970). Convex analysis. Princeton, NJ: Princeton University Press.
- Solodov, M. V., & Svaiter, B. F. (1999). A new projection method for variational inequality problems. SIAM Journal on Control and Optimization, 37, 765–776.
- Yao, Y., Liou, Y. C., & Kang, S. M. (2010). Minimization of equilibrium problems, variational inequality problems and fixed point problems. Journal of Global Optimization, 48, 643–656.