Research Article  Open Access
Xuewen Mu, Yaling Zhang, "An Alternating Direction Method for Convex Quadratic SecondOrder Cone Programming with Bounded Constraints", Mathematical Problems in Engineering, vol. 2015, Article ID 379734, 10 pages, 2015. https://doi.org/10.1155/2015/379734
An Alternating Direction Method for Convex Quadratic SecondOrder Cone Programming with Bounded Constraints
Abstract
An alternating direction method is proposed for convex quadratic secondorder cone programming problems with bounded constraints. In the algorithm, the primal problem is equivalent to a separate structure convex quadratic programming over secondorder cones and a bounded set. At each iteration, we only need to compute the metric projection onto the secondorder cones and the projection onto the bound set. The result of convergence is given. Numerical results demonstrate that our method is efficient for the convex quadratic secondorder cone programming problems with bounded constraints.
1. Introduction
In this paper, we consider a convex quadratic secondorder cone programming (CQSOCP) problem with bounded constraints which is defined by minimizing a convex quadratic function over the intersection of an affine set, a bounded set, and the product of secondorder cones. The primal convex quadratic secondorder cone programming problem is defined aswhere is a bounded set, is an symmetric positive semidefinite matrix, , , , and is viewed as a column vector in with . In addition, and , where is the dimensional secondorder cone given bywhere is the standard Euclidean norm.
Convex quadratic secondorder cone programming problem with bounded constraints is a nonlinear programming problem, which can be seen as a trust region subproblem in the trust region method for the nonlinear secondorder cone programming [1, 2]. Since is symmetric positive semidefinite, we can compute its positive semidefinite square root by the Cholesky method. Then problem (1) can be equivalently transformed as the following mix linear and secondorder cone programming (MLSOCP) [3]:In paper [1, 2], the authors use those well developed and publicly available softwares, based on interiorpoint methods, such as SeDuMi [4] and SDPT3 [5] to solve the equivalent MLSOCP (3).
Interiorpoint methods have been well developed for linear symmetric cone programming [6–8]. However, at each iteration these solvers require to formulate and solve a dense Schur complement matrix, which for the CQSOCP problem with bounded constraints amounts to a linear system of dimension . In addition, the transformed method needs to compute the square root of semidefinite matrix . When is large, because of the very large size and illconditioning of the linear system of equations, interiorpoint methods are difficult to solve the transformed MLSOCP problem efficiently [3].
The alternating direction method (ADM) has been an effective firstorder approach for solving large optimization problems, such as linear programming [9], linear semidefinite programming (LSDP) [10, 11], nonlinear convex optimization [12], and nonsmooth minimization arising from compressive sensing [13, 14]. A modified alternating direction method is proposed for convex quadratically constrained quadratic semidefinite programs in paper [15]. In the thesis [3], a semismooth NewtonCG augmented Lagrangian method is proposed for large scale convex quadratic symmetric cone programming. In paper [16], an alternating direction dual augmented Lagrangian method for solving linear semidefinite programming problems in standard form is presented and extended to the SDP with inequality constraints and positivity constraints.
In the paper, an alternating direction method for the CQSOCP problem with bounded constraints is proposed. Firstly, the primal problem is equivalent to a separate structure convex quadratic programming over secondorder cones and a bounded set. Then the alternating direction method is proposed to solve the separate structure convex quadratic programming. In the alternating direction method, we only need to compute the metric projection onto the secondorder cones and projection onto the bounded set at each iteration. We also give the convergence results and the numerical results.
2. The Projection on the SecondOrder Cone and the Bounded Set
In this section, we will give the projection results on the secondorder cones and the bounded set.
Let for ; then the spectral decomposition of associate with secondorder cone can be described as [17–19]wherewith if and any vector in satisfying if .
Next we introduce the projection lemma over the secondorder cone [17–19].
Lemma 1 (see [17–19]). For any , let be the projection of onto the secondorder cone ; then we havewhere for .
Let ; then the projection of over the cone is described as
Let ; then the projection on the bounded set is easy to carry out, namely, through an element by element method:
3. An Alternating Direction Method for CQSOCP Problems with Bounded Constraints
In this section, we give an alternating direction method for convex quadratic secondorder cone programming problems with bounded constraints.
Firstly, we give an equivalent separate structure convex quadratic programming over secondorder cone and bounded set as follows:
The Lagrangian function for the separate structure convex quadratic programming problem is written aswhere .
Under mild constraint qualifications (e.g., Slater condition), strong duality holds for problem (9), and hence, is an optimal solution of (9) if and only if there exists satisfying the following KKT system in variational inequality form:
The augmented Lagrangian function for the the separate structure convex quadratic programming problem is defined aswhere .
The variational inequality form of alternating direction method for (12) is as follows.
3.1. The Original Alternating Direction Method
Given , and . For , then consider the following.
Step 1. Consider ; we compute , which satisfies
Step 2. Consider ; we compute , which satisfies
Step 3. Consider ; update the Lagrange multiplier by
Step 4. Consider ; update the Lagrange multiplier by
In Steps 1 and 2, we should solve variational inequalities. In the following analysis, we will convert them to simple projection operations.
Lemma 2 (see [20]). Let be a closed convex set in a Hilbert space and let be the projection of onto . Then
Taking and in (17), we see that (13) is equivalent to the following nonlinear equation:where can be any positive number.
Taking and in (17), we see that (14) is equivalent to the following nonlinear equation:where can be any positive number.
Due to the existence of the terms and in (18), we can not compute directly. We therefore use the following approximate approach which is similar to the one in paper [15]. For certain constants and , letbe the residual between and their linearization at , respectively.
Instead of computing (18), we computeWe choose so that , where and are the largest eigenvalues of and , respectively.
Settingin (21), we have which will be used as an approximation to the solution of variational inequality (13).
Let in (19); we have
In summary, the modified alternating direction method is given as follows.
3.2. The Modified Alternating Direction Method
Given , and . For , then consider the following.
Step 1. Consider ; we compute , which satisfies
Step 2. Consider ; we compute , which satisfies
Step 3. Consider ; update the Lagrange multiplier by
Step 4. Consider ; update the Lagrange multiplier by
From Steps 1 and 2, the modified alternating direction method only needs to compute the metric projection of vectors onto and . From Steps 3 and 4, we could interpret and as the dual stepsizes. Therefore, the iteration of our method is simple and fast.
4. The Convergence Result
In this section, we extended and modified the convergence results of the alternating direction methods for convex quadratically constrained quadratic semidefinite programs in paper [15] and then give the convergence analysis of the alternating direction method for CQSOCP problems with bounded constraints.
Lemma 3. The sequence generated by the modified alternating direction method satisfieswhere is a KKT point of system (11).
Proof. Let in the second inequality in system (11); we haveLet in (14), and coupled with (16), we haveAdding (30) and (31) together, we haveIn addition, from (14) and (16), we haveAdding the two inequality above, we haveNote that (21) can be written equivalently asSetting , we have Let in the first inequality in system (11); we have Adding (36) and (37) together, we haveFrom first part at the left side of (38) and the third equation in system (11), we haveFrom (16), (36), the last equation in system (11), and the second part at the left side of (38), we haveIn addition, from the third part at the left side of (38), we haveIt follows from (32)(34) and (38)–(41) that
Now, we give the convergent conclusion.
Theorem 4. The sequence generated by the modified alternating direction method converges to a solution point of problem (9).
Proof. We denotewhere denotes the dimensional unit matrix and is positive definite. Here, we define the inner product of and asand the associated norm aswhere .
Observe that, by Lemma 2, solving the optimal condition (11) for problem (9) is equivalent to finding a zero point of the residual function:From (15), (16), and the first equation in (21), we have thatFrom (19) and (16), we have Based on (47)(48), (15)(16), and the nonexpansion property of the projection operator, we havewhere is a positive constant depending on parameters , and the largest eigenvalue of and , for example, settingFrom Lemma 3, we can write (29) aswhich implies that Thus From the above inequality, we have That is, the sequence is bounded. Thus there exists at least one cluster point of .
It also follows from (53) thatand thusLet be a cluster point of and the subsequence converges to . We haveso satisfies system (11). Setting , we haveThe sequence satisfies
5. Simulation Experiments
In this section we present computational results by comparing the modified alternating direction method with the interiorpoint method. The interiorpoint method is used to solve the transformed mix linear and secondorder cone programming problems (3). All the algorithms are run in the MATLAB 7.0 environment on an Inter Core processor 1.80 GHz personal computer with 2.00 GB of Ram.
The test problems are formulated by random method as follows:(1)Given the values of , with .(2)Generate a random matrix , and set . At the same time, generate a random matrix with full row rank.(3)Set , where is a vector whose components are all ones.(4)Given , then generate the random vector and make it an interior point of secondorder cone for .(5)We obtain by computing .
The first set of test problems includes 16 small scale CQSOCP problems with bounded constraints, which is shown in Table 1. In Tables 1 and 3, an entry of the form “” in the “SOC” column means that there are 20 5dimensional secondorder cones, and the “ratio” denotes the ratio between the number of the secondorder cones and the value of .

As is known to all, the interiorpoint methods have proved to be one of the most efficient class of methods for SOCP. Here the Matlab program codes for the interiorpoint method are designed from the software package by SeDuMi [4]. In the SeDuMi software, we set the desired accuracy parameter .
Let , where . In the alternating direction method, we stop our algorithm whenfor . Here we set and . We choose the initial point , and , where is the dimensional vector of ones.
For the first set of test problems, the iteration number and average CPU time are used to evaluate the performances of the modified alternating direction method and the interiorpoint method by SeDuMi. The test results are shown in Table 2. In the Tables 2 and 4, “Time” represents the average CPU time (in seconds), and “Iter.” denotes the average number of iteration. In addition, “MADM” represents the modified alternating direction method. In Table 4, “/” denotes that the method does not work in our personal computer because the method is “out of memory.”



Table 2 shows that the modified alternating direction method costs less CPU time than the interiorpoint method by SeDuMi. But, the iteration number of the interiorpoint method is less than that of the modified alternating direction method.
In addition, Table 1 gives different kinds of test problem, including the problems with only one large secondorder cone, such as P01, P05, P09, and P13, the problems with many small secondorder cones, such as P04, P08, P12, and P16, and the problems with one large secondorder cone and some small secondorder cones, such as P02, P06, P10, and P14. The test results in Table 2 show that the modified alternating direction method can solve different kinds of convex quadratic secondorder cone programming problems within appropriate CPU time and accuracy.
The second set of test problems includes 15 medium scale problems, which is shown in Table 3. For the second set of test problems, the test results are shown in Table 4.
The results in Table 4 show the interior point method by SeDuMi does not work for the transformed problem (3) because of being “out of memory” in our personal computer when , but the modified alternating direction method is still efficient because the modified alternating direction method needs less memory space than the interiorpoint method.
In addition, we add test results of P04 and P12 in smaller criteria and with random initial points. The smaller criteria of our method is . In addition, we do one hundred experiments with the random initial point. The test results are shown in Table 5. In the SeDuMi software, we set the desired accuracy parameter .

Table 5 shows that the performances of MADM with random initial points are a bit better than that of MADM with fixed initial points in two different stop criteria. In addition, the number of iteration of MADM with is more than that of MADM with , and the CPU time of MADM with is longer than that of MADM with .
6. Conclusion
In the paper, a modified alternating direction method is proposed for solving convex quadratic secondorder cone programming problems with bounded constraints. The proposed method does not require solving subvariational inequality problems over the second cones and the bounded set. At each iteration, we only need to compute the metric projection onto the secondorder cones and a projection onto the bounded set. The proposed modified method does not require secondorder information and it is easy to implement. The random simulation results show that our method can efficiently solve some convex quadratic secondorder cone programming problems of vector size up to 5000 within reasonable time and accuracy by using a desktop computer.
Disclosure
This work was conducted while Xuewen Mu has been visiting Ohio University, Department of Mathematics.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
The work is supported by China Scholarship Council (CSC). This work was also supported by the National Science Foundations for Young Scientists of China (11101320, 61201297) and the Fundamental Research Funds for the Central Universities (JB150713).
References
 X. Zhang, Z. Liu, and S. Liu, “A trust region SQPfilter method for nonlinear secondorder cone programming,” Computers & Mathematics with Applications, vol. 63, no. 12, pp. 1569–1576, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 H. Kato and M. Fukushima, “An SQPtype algorithm for nonlinear secondorder cone programs,” Optimization Letters, vol. 1, no. 2, pp. 129–144, 2007. View at: Publisher Site  Google Scholar  MathSciNet
 X. Y. Zhao, A semismooth NewtonCG augmented Lagrangian method for large scale linear and convex quadratic SDPs [Ph.D. thesis], National University of Singapore, 2009.
 J. F. Sturm, “Using SeDuMi 1.02, a MATLAB toolbox for optimization over symmetric cones,” Optimization Methods and Software, vol. 11, no. 1–4, pp. 625–653, 1999. View at: Publisher Site  Google Scholar
 R. H. Tütüncü, K. C. Toh, and M. J. Todd, “Solving semidefinitequadraticlinear programs using SDPT3,” Mathematical Programming, vol. 95, pp. 189–217, 2003. View at: Google Scholar
 S. H. Schmieta and F. Alizadeh, “Associative and Jordan algebras, and polynomial time interiorpoint algorithms for symmetric cones,” Mathematics of Operations Research, vol. 26, no. 3, pp. 543–564, 2001. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. H. Schmieta and F. Alizadeh, “Extension of primaldual interior point algorithms to symmetric cones,” Mathematical Programming, vol. 96, no. 3, pp. 409–438, 2003. View at: Publisher Site  Google Scholar
 R. D. Monteiro and T. Tsuchiya, “Polynomial convergence of primaldual algorithms for the secondorder cone program based on the MZfamily of directions,” Mathematical Programming, vol. 88, no. 1, pp. 61–83, 2000. View at: Publisher Site  Google Scholar  MathSciNet
 J. Eckstein and D. P. Bertsekas, An Alternating Direction Method for Linear Programming, LIDSP, Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, Mass, USA, 1967.
 Z. Yu, “Solving semidefinite programming problems via alternating direction methods,” Journal of Computational and Applied Mathematics, vol. 193, no. 2, pp. 437–445, 2006. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 J. Malick, J. Povh, F. Rendl, and A. Wiegele, “Regularization methods for semidefinite programming,” SIAM Journal on Optimization, vol. 20, no. 1, pp. 336–356, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 P. Tseng, “Alternating projectionproximal methods for convex programming and variational inequalities,” SIAM Journal on Optimization, vol. 7, no. 4, pp. 951–965, 1997. View at: Publisher Site  Google Scholar  MathSciNet
 Y. Wang, J. Yang, W. Yin, and Y. Zhang, “A new alternating minimization algorithm for total variation image reconstruction,” SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 248–272, 2008. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 J. Yang, Y. Zhang, and W. Yin, “An efficient TVL1 algorithm for deblurring multichannel images corrupted by impulsive noise,” SIAM Journal on Scientific Computing, vol. 31, no. 4, pp. 2842–2865, 2009. View at: Publisher Site  Google Scholar  MathSciNet
 J. Sun and S. Zhang, “A modified alternating direction method for convex quadratically constrained quadratic semidefinite programs,” European Journal of Operational Research, vol. 207, no. 3, pp. 1210–1220, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 Z. Wen, D. Goldfarb, and W. Yin, “Alternating direction augmented Lagrangian methods for semidefinite programming,” Mathematical Programming Computation, vol. 2, no. 34, pp. 203–230, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 U. Faraut and A. Koranyi, Analysis on Symmetric Cone, Oxford University Press, New York, NY, USA, 1994.
 J. V. Outrata and D. Sun, “On the coderivative of the projection operator onto the secondorder cone,” SetValued Analysis, vol. 16, no. 78, pp. 999–1014, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 L. C. Kong, L. Tuncel, and N. H. Xiu, “Clarke generalized jacobian of the projection onto symmetric cones,” SetValued and Variational Analysis, vol. 17, pp. 135–151, 2009. View at: Google Scholar
 D. Kinderlehrer and G. Stampacchia, An Introduction to Variational Inequalities and their Applications, Academic Press, New York, NY, USA, 1980. View at: MathSciNet
Copyright
Copyright © 2015 Xuewen Mu and Yaling Zhang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.