A modified Polak–Ribière–Polyak conjugate gradient algorithm for large-scale optimization problems

References

• Ahmed , T. and Storey , D. 1990 . Efficient hybrid conjugate gradient techniques . Journal of Optimization Theory and Applications , 64 : 379 – 394 .
   Web of Science ®Google Scholar
• Al-Baali , A. 1985 . Descent property and global convergence of the Fletcher–Reeves method with inexact line search . IMA Journal of Numerical Analysis , 5 : 121 – 124 .
   Web of Science ®Google Scholar
• Andrei , N. 2008 . A hybrid conjugate gradient algorithm for unconstrained optimization as a convex combination of Hestenes–Stiefel and Dai–Yuan . Studies in Informatics and Control , 17 : 55 – 70 .
   Web of Science ®Google Scholar
• Birgin , E. G. , Martinez , J. M. and Raydan , M. 2000 . Nonmonotone spectral projected gradient methods on convex sets . SIAM Journal on Optimization , 10 : 1196 – 1121 .
   Web of Science ®Google Scholar
• Bongartz , I. , Conn , A. R. , Gould , N. I. and Toint , P. L. 1995 . CUTE: constrained and unconstrained testing environment . ACM Transactions on Mathmatical Software , 21 : 123 – 160 .
   Web of Science ®Google Scholar
• Broyden , C. G. 1970 . The convergence of a class of double-rank minimization algorithms: 2. The new algorithm . Journal of the Institute of Mathematics and Its Applications , 6 : 222 – 231 .
   Google Scholar
• Broyden , C. G. , Dennis , J. E. and Moré , J. J. 1973 . On the local and superlinear convergence of quasi-Newton methods. . Journal of the Institute of Mathematics and Its Applications , 12 : 223 – 246 .
   Google Scholar
• Byrd , R. and Nocedal , J. 1989 . A tool for the analysis of quasi-Newton methods with application to unconstrained minimization . SIAM Journal on Numerical Analysis , 26 : 727 – 739 .
   Web of Science ®Google Scholar
• Byrd , R. , Nocedal , J. and Yuan , Y. 1987 . Global convergence of a class of quasi-Newton methods on convex problems . SIAM Journal on Numerical Analysis , 24 : 1171 – 1189 .
   Web of Science ®Google Scholar
• Dai , Y. 1997 . Analysis of conjugate gradient methods . Ph.D. Thesis, Institute of Computational Mathematics and Scientific/Engineering Computing, Chinese Academy of Sciences
   Google Scholar
• Dai , Y. 2002 . A nonmonotone conjugate gradient algorithm for unconstrained optimization . Journal of Systems Science and Complexity , 15 : 139 – 145 .
   Google Scholar
• Dai , Y. 2003 . Convergence properties of the BFGS algorithm . SIAM Journal on Optimization , 13 : 693 – 701 .
   Web of Science ®Google Scholar
• Dai , Y. , Han , J. , Sun , D. , Yin , H. and Yuan , Y. 1999 . Convergence properties of nonlinear conjugate gradient methods . SIAM Journal on Optimization , 10 : 345 – 358 .
   Web of Science ®Google Scholar
• Dai , Y. and Liao , L. Z. 2001 . New conjugacy conditions and related nonlinear conjugate methods . Applied Mathematics and Optimization , 43 : 87 – 101 .
   Web of Science ®Google Scholar
• Dai , Y. and Yuan , Y. 1998 . Nonlinear Conjugate Gradient Methods , Shanghai , , People’s Republic of China : Shanghai Scientific and Technical Publishers .
   Google Scholar
• Dai , Y. and Yuan , Y. 2000 . A nonlinear conjugate gradient with a strong global convergence properties . SIAM Journal on Optimization , 10 : 177 – 182 .
   Web of Science ®Google Scholar
• Dai , Y. and Yuan , Y. 2001 . An efficient hybrid conjugate gradient method for unconstrained optimization . Annals of Operations Research , 103 : 33 – 47 .
   Web of Science ®Google Scholar
• Dennis , J. E. and Moré , J. J. 1974 . A characterization of superlinear convergence and its application to quasi-Newton methods . Mathematics of Computation , 28 : 549 – 560 .
   Web of Science ®Google Scholar
• Dolan , E. D. and Moré , J. J. 2002 . Benchmarking optimization software with performance profiles . Mathematical Programming , 91 : 201 – 213 .
   Web of Science ®Google Scholar
• Fletcher , R. 1970 . A new approach to variable metric algorithms . Computer Journal , 13 : 317 – 322 .
   Web of Science ®Google Scholar
• Fletcher , R. 1997 . Practical Methods of Optimization. Vol. I: Unconstrained Optimization, second edition , New York , NY : Wiley .
   Google Scholar
• Fletcher , R. and Reeves , C. 1964 . Function minimization by conjugate gradients . The Computer Journal , 7 : 149 – 154 .
   Web of Science ®Google Scholar
• Gilbert , J. C. and Nocedal , J. 1992 . Global convergence properties of conjugate gradient methods for optimization . SIAM Journal on Optimization , 2 : 21 – 42 .
   Web of Science ®Google Scholar
• Goldfarb , D. 1970 . A family of variable metric updates derived by variational means . Mathematics of Computation , 24 : 23 – 26 .
   Web of Science ®Google Scholar
• Gould , N. I. , Orban , D. and Toint , P. L. 2003 . CUTEr and SifDec: a constrained and unconstrained testing environment, revised . ACM Transcations on Mathmatical Software , 29 : 373 – 394 .
   Web of Science ®Google Scholar
• Grippo , L. , Lampariello , F. and Lucidi , S. 1986 . A nonmonotone line search technique for Newton’s method. . SIAM Journal on Numerical Analysis , 23 : 707 – 716 .
   Web of Science ®Google Scholar
• Grippo , L. and Lucidi , S. 1997 . A globally convergent version of the Polak–Ribière gradient method . Mathematical Programming , 78 : 375 – 391 .
   Web of Science ®Google Scholar
• Hager , W. W. 1989 . A derivate-based bracketing scheme for univariate minimization and the conjugate gradient method . Computers and Mathematics with Applications , 18 : 779 – 795 .
   Web of Science ®Google Scholar
• Hager , W. W. and Zhang , H. 2005 . A new conjugate gradient method with guaranteed descent and an efficient line search . SIAM Journal on Optimization , 16 : 170 – 192 .
   Web of Science ®Google Scholar
• Hager , W. W. and Zhang , H. 2006a . Algorithm 851: CG − DESCENT, a conjugate gradient method with guaranteed descent . ACM Transactions on Mathematical Software , 32 : 113 – 137 .
   Web of Science ®Google Scholar
• Hager , W. W. and Zhang , H. 2006b . A survey of nonlinear conjugate gradient methods . Pacific Journal of Optimization , 2 : 35 – 58 .
   Google Scholar
• Han , J. Y. and Liu , G. H. 1997 . Global convergence analysis of a new nonmonotone BFGS algorithm on convex objective functions . Computational Optimization and Applications , 7 : 277 – 289 .
   Web of Science ®Google Scholar
• Hestenes , M. R. and Stiefel , E. 1952 . Method of conjugate gradient for solving linear equations . Journal of Research of the National Bureau of Standards , 49 : 409 – 436 .
   Google Scholar
• Hu , Y. F. and Storey , C. 1991 . Global convergence result for conjugate method . Journal Optimization Theory and Applications , 71 : 399 – 405 .
   Web of Science ®Google Scholar
• Li , D. and Fukushima , M. 2001a . A modified BFGS method and its global convergence in nonconvex minimization . Journal of Computational and Applied Mathematics , 129 : 15 – 35 .
   Web of Science ®Google Scholar
• Li , D. and Fukushima , M. 2001b . On the global convergence of the BFGS method for nonconvex unconstrained optimization problems . SIAM Journal on Optimization , 11 : 1054 – 1064 .
   Web of Science ®Google Scholar
• Li , G. , Tang , C. and Wei , Z. 2007 . New conjugacy condition and related new conjugate gradient methods for unconstrained optimization problems . Journal of Computational and Applied Mathematics , 202 : 532 – 539 .
   Web of Science ®Google Scholar
• Liu , G. H. , Han , J. Y. and Sun , D. F. 1995 . Global convergence analysis of the BFGS algorithm with nonmonotone linesearch . Optimization , 34 : 147 – 159 .
   Google Scholar
• Liu , G. H. and Peng , J. M. 1992 . The convergence properties of a nonmonotonic algorithm . Journal of Computational Mathematics , 1 : 65 – 71 .
   Google Scholar
• Liu , Y. and Storey , C. 1992 . Effcient generalized conjugate gradient algorithms part 1: theory . Journal of Applied Mathematics and Computing , 69 : 17 – 41 .
   Google Scholar
• Polak , E. 1969 . The conjugate gradient method in extreme problems . Computational Mathematics and Mathematical Physics , 9 : 94 – 112 .
   Google Scholar
• Polak , E. and Ribière , G. 1969 . Note sur la convergence de directions conjugees . Rev. Francaise informat Recherche Opératinelle , 3 : 35 – 43 .
   Google Scholar
• Powell , M.J.D . 1984 . Nonconvex minimization calculations and the conjugate gradient method . Lecture Notes in Mathematics , 1066 : 122 – 141 .
   Web of Science ®Google Scholar
• Powell , M.J.D . 1986 . Convergence properties of algorithm for nonlinear optimization . SIAM Review , 28 : 487 – 500 .
   Web of Science ®Google Scholar
• Shanno , D. F. 1970 . Conditioning of quazi-Newton methods for function minimization . Mathematics of Computation , 24 : 647 – 656 .
   Web of Science ®Google Scholar
• Toint , P. L. 1996 . An assessment of non-monotone line search techniques for unconstrained minimization problem . SIAM Journal on Scientific Computing , 17 : 725 – 739 .
   Web of Science ®Google Scholar
• Wei , Z. , Li , G. and Qi , L. 2006a . New nonlinear conjugate gradient formulas for large-scale unconstrained optimization problems . Applied Mathematics and Computation , 179 : 407 – 430 .
   Web of Science ®Google Scholar
• Wei , Z. , Li , G. and Qi , L. 2006b . New quasi-Newton methods for unconstrained optimization problems . Applied Mathematics and Computation , 175 : 1156 – 1188 .
   Web of Science ®Google Scholar
• Wei , Z. , Li , G. and Qi , L. 2008 . Global convergence of the PRP conjugate gradient methods with inexact line search for nonconvex unconstrained optimization problems . Mathematics of Computation , 77 : 2173 – 2193 .
   Web of Science ®Google Scholar
• Wei , Z. , Yao , S. and Liu , L. 2006 . The convergence properties of some new conjugate gradient methods . Applied Mathematics and Computation , 183 : 1341 – 1350 .
   Web of Science ®Google Scholar
• Wei , Z. , Yu , G. Yuan G. and Lian , Z. 2004 . The superlinear convergence of a modified BFGS-type method for unconstrained optimization . Computational Optimization and Applications , 29 : 315 – 332 .
   Web of Science ®Google Scholar
• Yu , G.H. 2007 . Nonlinear self-scaling conjugate gradient methods for large-scale optimization problems . Doctoral dissertations, Sun Yat-Sen University, China
   Google Scholar
• Yuan , G. L. 2009 . Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems . Optimization Letters , 3 : 11 – 21 .
   Web of Science ®Google Scholar
• Yuan , G. L. and Lu , X. W. 2009 . A modified PRP conjugate gradient method . Annals of Operations Research , 166 : 73 – 90 .
   Web of Science ®Google Scholar
• Yuan , G. L. , Lu , X. W. and Wei , Z. X. 2009 . A conjugate gradient method with descent direction for unconstrained optimization . Journal of Computational and Applied Mathematics , 233 : 519 – 530 .
   Web of Science ®Google Scholar
• Yuan , G. L. and Wei , Z. X. 2008 . The superlinear convergence analysis of a nonmonotone BFGS algorithm on convex objective functions . Acta Mathematica Sinica, English Series , 24 : 35 – 42 .
   Web of Science ®Google Scholar
• Yuan , G. L. and Wei , Z. X. 2009 . New line search methods for unconstrained optimization . Journal of the Korean Statistical Society , 38 : 29 – 39 .
   Web of Science ®Google Scholar
• Yuan , G. L. and Wei , Z. X. 2010 . Convergence analysis of a modified BFGS method on convex minimizations . Computational Optimization and Applications , 47 : 237 – 255 .
   Web of Science ®Google Scholar
• Yuan , Y. X. 1993 . Analysis on the conjugate gradient method . Optimization methods and Software , 2 : 19 – 29 .
   Google Scholar
• Zhang , H. C. and Hager , W. W. 2004 . A nonmonotone line search technique and its application to unconstrained optimization . SIAM Journal on Optimization , 14 : 1043 – 1056 .
   Web of Science ®Google Scholar
• Zhang , L. , Zhou , W. and Li , D. 2006 . A descent modified Polak-Ribière-Polyak conjugate method and its global convergence . IMA Journal on Numerical Analysis , 26 : 629 – 649 .
   Web of Science ®Google Scholar
• Zhou , J. L. and Tits , A. L. 1993 . Nonmonotone line search for minimax problem . Journal Optimization Theory and Applications , 76 : 455 – 476 .
   Web of Science ®Google Scholar