Publication Cover
Optimization
A Journal of Mathematical Programming and Operations Research
Volume 66, 2017 - Issue 5
238
Views
17
CrossRef citations to date
0
Altmetric
Articles

Some new three-term Hestenes–Stiefel conjugate gradient methods with affine combination

, , , &
Pages 759-776 | Received 05 Jun 2016, Accepted 05 Feb 2017, Published online: 23 Feb 2017

References

  • Fletcher R, Reeves C. Function minimization by conjugate gradients. Comput J. 1964;7(2):149–154.
  • Hestenes MR, Stiefel E. Methods of conjugate gradients for solving linear systems. J Res Natl Bur Stand. 1952;49(6):409–436.
  • Gilbert JC, Nocedal J. Global convergence properties of conjugate gradient methods for optimization. SIAM J Optim. 1992;2(1):21–42.
  • Dai Y, Yuan Y. A nonlinear conjugate gradient method with a strong global convergence property. SIAM J Optim. 1999;10(1):177–182.
  • Dai Y, Yuan Y. New conjugacy conditions and related nonlinear conjugate gradient methods. Appl Math Optim. 2001;43(1):87–101.
  • Hager WW, Zhang H. A survey of nonlinear conjugate gradient methods. Pac J Optim. 2006;2(1):35–58.
  • Gilbert JC, Nocedal J. Global convergence properties of conjugate gradient methods for optimization. SIAM J Optim. 1992;2(1):21–42.
  • Babaie-Kafaki S, Reza G. A descent family of Dai--Liao conjugate gradient methods. Optim Methods Softw. 2014;29(3):583–591.
  • Babaie-Kafaki S, Reza G. The Dai-Liao nonlinear conjugate gradient method with optimal parameter choices. Eur J Oper Res. 2014;234(3):625–630.
  • Babaie-Kafaki S. On optimality of two adaptive choices for the parameter of Dai-Liao method. Optim Lett. 2016;10(8):1789–1797.
  • Fatemi M. An optimal parameter for Dai-Liao family of conjugate gradient methods[J]. J Optim Theory Appl. 2016;169(2):1–19.
  • Fatemi M. A new efficient conjugate gradient method for unconstrained optimization. J Comput Appl Math. 2016;300:207–216.
  • Dong X, Liu H, He Y. A self-adjusting conjugate gradient method with sufficient descent condition and conjugacy condition. J Optim Theory Appl. 2015;165(1):225–241.
  • Dong X, Liu H, Xu Y, et al. A modified Hestenes-Stiefel conjugate gradient method with sufficient descent condition and conjugacy condition. J Comp Appl Math. 2015;281:239–249.
  • Hager WW, Zhang H. A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM J Optim. 2016;16(1):170–192.
  • Dai Y, Kou C. A nonlinear conjugate gradient algorithm with an optimal property and an improved Wolfe line search. SIAM J Optim. 2013;23(1):296–320.
  • Zhang L, Zhou W, Li D. A descent modified Polak-Ribiére-Polyak conjugate gradient method and its global convergence. IMA J Numer Anal. 2006;26(4):629–640.
  • Narushima Y, Yabe H, Ford JA. A three-term conjugate gradient method with sufficient descent property for unconstrained optimization. SIAM J Optim. 2011;21(1):212–230.
  • Al-Baali M, Narushima Y, Yabe H. A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization. Comput Optim Appl. 2015;194(2):469–474.
  • Andrei N. Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization. Optim Methods Softw. 2007;22(4):561–571.
  • Andrei N. A simple three-term conjugate gradient algorithm for unconstrained optimization. J Comp Appl Math. 2013;241:19–29.
  • Andrei N. On three-term conjugate gradient algorithms for unconstrained optimization. Appl Math Comput. 2013;219(11):6316–6327.
  • Zhang L, Zhou W, Li D. Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search. Numer Math. 2006;104(4):561–572.
  • Li X, Zhang W, Dong X. A class of modified FR conjugate gradient method and applications to non-negative matrix factorization[J]. Comput Math Appl. 2016;73(2):270–276.
  • Livieris IE, Pintelas P. A limited memory descent Perry conjugate gradient method. Optim Lett. 2015;10(8):1–18.
  • Kou C. An improved nonlinear conjugate gradient method with an optimal property. Sci China Math. 2014;57(3):35–648.
  • Kou C, Dai Y. A Barzilai--Borwein conjugate gradient method. Sci China Math. 2016;59(8):1511–1524.
  • Dai Z, Chen X, Wen F. A modified Perrys conjugate gradient methodbased derivative-free method for solving large-scale nonlinear monotone equations. Appl Math Comput. 2015;270(7):378–C386.
  • Dai Z, Li D, Wen F. Worse-case conditional value-at-risk for asymmetrically distributed asset scenarios returns. J Comput Anal Appl. 2016;20(2):237–251.
  • Wen F, He Z, Dai Z. Characteristics of investors risk preference for stock markets. Econ Comput Econ Cyb. 2014;48(3):235–254.
  • Dong X, Liu H, He Y. New version of the three-term conjugate gradient method based on spectral scaling conjugacy condition that generates descent search direction. Appl Math Comput. 2015;269:606–617.
  • Dong X, Liu H, Xu Y, et al. Some nonlinear conjugate gradient methods with sufficient descent condition and global convergence. Optim Lett. 2015;9(7):1421–1432.
  • Dong X. Comment on ‘A new three-term conjugate gradient method for unconstrained problem’. Appl Math Comput. 2016;72(1):173–179.
  • Dong X, Liu H, Li X, et al. A modified nonmonotone Hestenes-Stiefel type conjugate gradient methods for large-scale unconstrained problem. Numer Func Anal Oot. 2017;38(1):39–50.
  • Cheng W, Li D. An active set modified Polak-Ribiére-Polyak method for large-scale nonlinear bound constrained optimization. J Optim Theory Appl. 2012;155(3):1084–1094.
  • Yu G, Guan L, Chen W. Spectral conjugate gradient methods with sufficient descent property for large-scale unconstrained optimization. Optim. Methods Softw. 2008;23(2):275–293.
  • Zhang L, Zhou W, Li D. Some descent three-term conjugate gradient methods and their global convergence. Optim Methods Softw. 2007;22(4):697–711.
  • Zhang L, Zhou W. A note on the convergence properties of the original three-term Hestenes-Stiefel method. Adv Model Optim. 2012;14(1):159–163.
  • Shanno DF. On the convergence of a new conjugate gradient algorithm. SIAM J Numer Anal. 1978;15(6):1247–1257.
  • Sun W, Yuan Y. Optimization theory and methods: nonlinear programming. New York (NY): Springer; 2006.
  • Wolfe P. Convergence conditions for ascent methods. SIAM Rev. 1969;11(2):226–235.
  • Zhang J, Xu C. Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations. J Comput Appl Math. 2001;137(2):269–278.
  • Zhang J, Xu C. New quasi-Newton equation and related methods for unconstrained optimization. J Comput Appl Math. 1999;102(1):147–167.
  • Babaie-Kafaki S, Ghanbari R, Mahdavi-Amiri N. Two new conjugate gradient methods based on modified secant equations. J Comput Appl Math. 2010;234(5):1374–1386.
  • Li D, Fukushima M. On the global convergence of BFGS method for unconstrained optimization problems. SIAM J Optim. 2001;11:1054–1064.
  • Dolan ED, Mor\’{e} JJ. Benchmarking optimization software with performance profiles. Math Program. 2002;91(2):201–213.
  • Bongartz I, Conn AR, Gould NIM, et al. Cute: constrained and unconstrained testing environment. ACM Trans Math Softw. 1995;21(1, Ser. A):123–160.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.