About this Journal Submit a Manuscript Table of Contents
Abstract and Applied Analysis
Volume 2013 (2013), Article ID 532041, 5 pages
http://dx.doi.org/10.1155/2013/532041
Research Article

Scaled Diagonal Gradient-Type Method with Extra Update for Large-Scale Unconstrained Optimization

1Department of Mathematics, University Putra Malaysia, 43400 Serdang, Selangor, Malaysia
2Department of Mathematics, Islamic Azad University, South Tehran Branch, Tehran 1418765663, Iran
3Department of Mathematics, Faculty of Science and Technology, University Malaysia Terengganu, 21030 Kuala Terengganu, Malaysia

Received 18 December 2012; Revised 26 February 2013; Accepted 26 February 2013

Academic Editor: Guanglu Zhou

Copyright © 2013 Mahboubeh Farid et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. Barzilai and J. M. Borwein, “Two-point step size gradient methods,” IMA Journal of Numerical Analysis, vol. 8, no. 1, pp. 141–148, 1988. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  2. E. G. Birgin, J. M. Martínez, and M. Raydan, “Nonmonotone spectral projected gradient methods on convex sets,” SIAM Journal on Optimization, vol. 10, no. 4, pp. 1196–1211, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  3. Y.-H. Dai and R. Fletcher, “Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming,” Numerische Mathematik, vol. 100, no. 1, pp. 21–47, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  4. Y.-H. Dai and L.-Z. Liao, “R-linear convergence of the Barzilai and Borwein gradient method,” IMA Journal of Numerical Analysis, vol. 22, no. 1, pp. 1–10, 2002. View at Publisher · View at Google Scholar · View at MathSciNet
  5. Y.-H. Dai, W. W. Hager, K. Schittkowski, and H. Zhang, “The cyclic Barzilai-Borwein method for unconstrained optimization,” IMA Journal of Numerical Analysis, vol. 26, no. 3, pp. 604–627, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  6. G. Frassoldati, G. Zanghirati, and L. Zanni, “New adaptive stepsize selections in gradient methods,” Journal of Industrial and Management Optimization, vol. 4, no. 2, pp. 299–312, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  7. M. Raydan, “On the Barzilai and Borwein choice of steplength for the gradient method,” IMA Journal of Numerical Analysis, vol. 13, no. 3, pp. 321–326, 1993. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  8. M. Raydan, “The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem,” SIAM Journal on Optimization, vol. 7, no. 1, pp. 26–33, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  9. B. Zhou, L. Gao, and Y. Dai, “Monotone projected gradient methods for large-scale box-constrained quadratic programming,” Science in China. Series A, vol. 49, no. 5, pp. 688–702, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  10. B. Zhou, L. Gao, and Y.-H. Dai, “Gradient methods with adaptive step-sizes,” Computational Optimization and Applications, vol. 35, no. 1, pp. 69–86, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  11. R. Fletcher, “On the Barzilai-Borwein method,” Tech. Rep. NA/207, Department of Mathematics, University of Dundee, Scotland, UK, 2001.
  12. M. Farid, W. J. Leong, and M. A. Hassan, “A new two-step gradient-type method for large-scale unconstrained optimization,” Computers & Mathematics with Applications, vol. 59, no. 10, pp. 3301–3307, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  13. M. Farid and W. J. Leong, “An improved multi-step gradient-type method for large scale optimization,” Computers & Mathematics with Applications, vol. 61, no. 11, pp. 3312–3318, 2011. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  14. M. Farid, W. J. Leong, and L. Zheng, “Accumulative approach in multistep diagonal gradient-type method for large-scale unconstrained optimization,” Journal of Applied Mathematics, vol. 2012, Article ID 875494, 11 pages, 2012. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  15. M. A. Hassan, W. J. Leong, and M. Farid, “A new gradient method via quasi-Cauchy relation which guarantees descent,” Journal of Computational and Applied Mathematics, vol. 230, no. 1, pp. 300–305, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  16. W. J. Leong, M. A. Hassan, and M. Farid, “A monotone gradient method via weak secant equation for unconstrained optimization,” Taiwanese Journal of Mathematics, vol. 14, no. 2, pp. 413–423, 2010. View at Zentralblatt MATH · View at MathSciNet
  17. M. Al-Baali, “Extra updates for the BFGS method,” Optimization Methods and Software, vol. 13, no. 3, pp. 159–179, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  18. M. Al-Baali, “Numerical experience with a class of self-scaling quasi-Newton algorithms,” Journal of Optimization Theory and Applications, vol. 96, no. 3, pp. 533–553, 1998. View at Publisher · View at Google Scholar · View at MathSciNet
  19. E. G. Birgin, J. M. Martínez, and M. Raydan, “Inexact spectral projected gradient methods on convex sets,” IMA Journal of Numerical Analysis, vol. 23, no. 4, pp. 539–559, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  20. E. G. Birgin, J. M. Martinez, and M. Raydan, “Nonmonotone spectral projected gradient methods on convex,” Encyclopedia of Optimization, pp. 3652–3659, 2009.
  21. L. Grippo, F. Lampariello, and S. Lucidi, “A nonmonotone line search technique for Newton's method,” SIAM Journal on Numerical Analysis, vol. 23, no. 4, pp. 707–716, 1986. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  22. W. J. Leong, M. Farid, and M. A. Hassan, “Scaling on diagonal quasi-Newton update for large-scale unconstrained optimization,” Bulletin of the Malaysian Mathematical Sciences Society, vol. 35, no. 2, pp. 247–256, 2012. View at Zentralblatt MATH · View at MathSciNet
  23. N. Andrei, “An unconstrained optimization test functions collection,” Advanced Modeling and Optimization, vol. 10, no. 1, pp. 147–161, 2008. View at Zentralblatt MATH · View at MathSciNet
  24. J. J. Moré, B. S. Garbow, and K. E. Hillstrom, “Testing unconstrained optimization software,” ACM Transactions on Mathematical Software, vol. 7, no. 1, pp. 17–41, 1981. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet