Journal of Applied Mathematics
Volume 2014 (2014), Article ID 324181, 14 pages
http://dx.doi.org/10.1155/2014/324181
Research Article
Optimal Algorithms and the BFGS Updating Techniques for Solving Unconstrained Nonlinear Minimization Problems
Department of Civil Engineering, National Taiwan University, Taipei 106-17, Taiwan
Received 5 November 2013; Revised 21 January 2014; Accepted 29 January 2014; Published 12 March 2014
Academic Editor: Jung-Fa Tsai
Copyright © 2014 Chein-Shan Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Linked References
- J. Barzilai and J. M. Borwein, “Two-point step size gradient methods,” IMA Journal of Numerical Analysis, vol. 8, no. 1, pp. 141–148, 1988. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- M. Raydan, “On the Barzilai and Borwein choice of steplength for the gradient method,” IMA Journal of Numerical Analysis, vol. 13, no. 3, pp. 321–326, 1993. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- M. Raydan, “The Barzilaiai and Borwein gradient method for the large scale unconstrained minimization problem,” SIAM Journal on Optimization, vol. 7, no. 1, pp. 26–33, 1997. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- A. Friedlander, J. M. Martinez, B. Molina, and M. Raydan, “Gradient method with retards and generalizations,” SIAM Journal on Numerical Analysis, vol. 36, no. 1, pp. 275–289, 1999. View at Google Scholar · View at MathSciNet · View at Scopus
- M. Raydan and B. F. Svaiter, “Relaxed steepest descent and Cauchy-Barzilai-Borwein method,” Computational Optimization and Applications, vol. 21, no. 2, pp. 155–167, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- Y. H. Dai, J. Y. Yuan, and Y. Yuan, “Modified two-point stepsize gradient methods for unconstrained optimization,” Computational Optimization and Applications, vol. 22, no. 1, pp. 103–109, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- Y. H. Dai and L.-H. Liao, “R-linear convergence of the Barzilai and Borwein gradient method,” IMA Journal of Numerical Analysis, vol. 22, no. 1, pp. 1–10, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- Y. H. Dai and Y. Yuan, “Alternate minimization gradient method,” IMA Journal of Numerical Analysis, vol. 23, no. 3, pp. 377–393, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- R. Fletcher, “On the Barzilai-Borwein gradient method,” in Optimization and Control with Applications, L. Qi, K. Teo, and X. Yang, Eds., vol. 96 of Applied Optimization, pp. 235–256, Springer, New York, NY, USA, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
- Y.-X. Yuan, “A new stepsize for the steepest descent method,” Journal of Computational Mathematics, vol. 24, no. 2, pp. 149–156, 2006. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- E. G. Birgin and J. M. Martinez, “A spectral conjugate gradient method for unconstrained optimization,” Applied Mathematics and Optimization, vol. 43, no. 2, pp. 117–128, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- N. Andrei, “Scaled conjugate gradient algorithms for unconstrained optimization,” Computational Optimization and Applications, vol. 38, no. 3, pp. 401–416, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- N. Andrei, “A Dai-Yuan conjugate gradient algorithm with sufficient descent and conjugacy conditions for unconstrained optimization,” Applied Mathematics Letters, vol. 21, no. 2, pp. 165–171, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- N. Andrei, “New accelerated conjugate gradient algorithms as a modification of Dai-Yuan's computational scheme for unconstrained optimization,” Journal of Computational and Applied Mathematics, vol. 234, no. 12, pp. 3397–3410, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- L. Zhang, “A new Liu-Storey type nonlinear conjugate gradient method for unconstrained optimization problems,” Journal of Computational and Applied Mathematics, vol. 225, no. 1, pp. 146–157, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- S. Babaie-Kafaki, R. Ghanbari, and N. Mahdavi-Amiri, “Two new conjugate gradient methods based on modified secant equations,” Journal of Computational and Applied Mathematics, vol. 234, no. 5, pp. 1374–1386, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- Z.-J. Shi and J. Guo, “A new family of conjugate gradient methods,” Journal of Computational and Applied Mathematics, vol. 224, no. 1, pp. 444–457, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- W. C. Davidon, “Variable metric method for minimization,” AEC Research Development Report ANL-5990, 1959. View at Google Scholar
- R. Fletcher and M. Powell, “A rapidly convergent descent method for minimization,” The Computer Journal, vol. 6, pp. 163–168, 1963. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
- C.-S. Liu, “A Jordan algebra and dynamic system with associator as vector field,” International Journal of Non-Linear Mechanics, vol. 35, no. 3, pp. 421–429, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- C. G. Broyden, “The convergence of a class of double-rank minimization algorithms: 2. The new algorithm,” Journal of the Institute of Mathematics and its Applications, vol. 6, no. 3, pp. 222–231, 1970. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- R. Fletcher, “A new approach to variable metric algorithms,” The Computer Journal, vol. 13, no. 3, pp. 317–322, 1970. View at Google Scholar · View at Scopus
- D. Goldfarb, “A family of variable-metric methods derived by variational means,” Mathematics of Computation, vol. 24, pp. 23–26, 1970. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
- D. F. Shanno, “Conditioning of quasi-Newton methods for function minimization,” Mathematics of Computation, vol. 24, pp. 647–656, 1970. View at Publisher · View at Google Scholar · View at MathSciNet
- Y.-H. Dai, “Convergence properties of the BFGS algoritm,” SIAM Journal on Optimization, vol. 13, no. 3, pp. 693–701, 2003. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
- Y.-H. Dai, “A perfect example for the BFGS method,” Mathematical Programming A, vol. 138, no. 1-2, pp. 501–530, 2013. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
- P. E. Gill, W. Murray, and P. A. Pitfield, “The implementation of two revised quasi-Newton algorithms for unconstrained optimization,” Tech. Rep. NAC-11, National Physical Laboratory, Teddington, UK, 1972. View at Google Scholar
- H. H. Rosenbrock, “An automatic method for finding the greatest or least value of a function,” The Computer Journal, vol. 3, no. 3, pp. 175–184, 1960. View at Publisher · View at Google Scholar · View at MathSciNet
- H.-C. Kuo, J.-R. Chang, and C.-H. Liu, “Particle swarm optimization for global optimization problems,” Journal of Marine Science and Technology, vol. 14, no. 3, pp. 170–181, 2006. View at Google Scholar · View at Scopus
- C.-S. Liu and S. N. Atluri, “A fictitious time integration method (FTIM) for solving mixed complementarity problems with applications to non-linear optimization,” Computer Modeling in Engineering & Sciences, vol. 34, no. 2, pp. 155–178, 2008. View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
- P. Bouvry, F. Arbab, and F. Seredynski, “Distributed evolutionary optimization, in Manifold: Rosenbrock's function case study,” Information Sciences, vol. 122, no. 2–4, pp. 141–159, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
- S. Kok and C. Sandrock, “Locating and characterizing the stationary points of the extended Rosenbrock function,” Evolutionary Computation, vol. 17, no. 3, pp. 437–453, 2009. View at Publisher · View at Google Scholar · View at Scopus
- M. J. D. Powell, “An iterative method for finding stationary values of a function of several variables,” The Computer Journal, vol. 5, no. 2, pp. 147–151, 1962. View at Publisher · View at Google Scholar · View at Zentralblatt MATH