Nonlinear stepsize control, trust regions and regularizations for unconstrained optimization

References

• Bastin , F. , Malmedy , V. , Mouffe , M. , Toint , Ph. L. and Tomanos , D. 2010 . A retrospective trust-region method for unconstrained optimization . Math. Program. Ser. A , 123 ( 2 ) : 395 – 418 .
   Web of Science ®Google Scholar
• Bellavia , S. , Cartis , C. , Gould , N. I.M. , Morini , B. and Toint , Ph. L. 2010 . Convergence of a regularized Euclidean residual algorithm for nonlinear least-squares . SIAM J. Numer. Anal. , 48 ( 1 ) : 1 – 29 .
   Web of Science ®Google Scholar
• Burke , J. V. , Moré , J. J. and Toraldo , G. 1990 . Convergence properties of trust region methods for linear and convex constraints . Math. Program. Ser. A , 47 ( 3 ) : 305 – 336 .
   Web of Science ®Google Scholar
• Cartis , C. , Gould , N. I.M. and Toint , Ph. L. 2009 . Trust-region and other regularisation of linear least-squares problems . BIT , 49 ( 1 ) : 21 – 53 .
   Web of Science ®Google Scholar
• Cartis , C. , Gould , N. I.M. and Toint , Ph. L. 2011 . Adaptive cubic overestimation methods for unconstrained optimization. Part II: Worst-case function–evaluation complexity . Math. Program. Ser. A , doi:10.1007/s10107-009-0337-y
   Web of Science ®Google Scholar
• Cartis , C. , Gould , N. I.M. and Toint , Ph. L. 2010 . On the complexity of steepest descent, Newton's and regularized Newton's methods for nonconvex unconstrained optimization . SIAM J. Optim. , 20 ( 6 ) : 2833 – 2852 .
   Web of Science ®Google Scholar
• Cartis , C. , Gould , N. I.M. and Toint , Ph. L. 2011 . Adaptive cubic overestimation methods for unconstrained optimization. Part I: Motivation, convergence and numerical results . Math. Program. Ser. A , 127 ( 2 ) : 245 – 295 .
   Web of Science ®Google Scholar
• Conn , A. R. , Gould , N. I.M. and Toint , Ph. L. 1988 . Global convergence of a class of trust region algorithms for optimization with simple bounds . SIAM J. Numer. Anal. , 25 ( 182 ) : 433 – 460 . 26 (1989), pp. 764–767
   Google Scholar
• Conn , A. R. , Gould , N. I.M. and Toint , Ph. L. 1989 . Global convergence of a class of trust region algorithms for optimization with simple bounds . SIAM J. Numer. Anal. , 26 : 764 – 767 .
   Web of Science ®Google Scholar
• Conn , A. R. , Gould , N. I.M. , Sartenaer , A. and Toint , Ph. L. 1993 . Global convergence of a class of trust region algorithms for optimization using inexact projections on convex constraints . SIAM J. Optim. , 3 ( 1 ) : 164 – 221 .
   Google Scholar
• Conn , A. R. , Gould , N. I.M. and Toint , Ph. L. 2000 . “ Trust-Region Methods ” . In Number 01 in MPS-SIAM Series on Optimization , Philadelphia , PA : SIAM .
   Google Scholar
• Fan , J. 2006 . Convergence rate of the trust region method for nonlinear equations under local error bound condition . Comput. Optim. Appl. , 2 ( 34 ) : 215 – 227 .
   Google Scholar
• Fan , J. and Pan , J. 2008 . An improved trust region algorithm for nonlinear equations . Comput. Optim. Appl. , 48 ( 1 ) : 59 – 70 .
   Google Scholar
• Fan , J. and Pan , J. 2008 . A modified trust region algorithm for nonlinear equations with new updating rule of trust region radius . Int. J. Comput. Math. , 87 ( 14 ) : 3186 – 3195 .
   Web of Science ®Google Scholar
• Fan , J. and Yuan , Y. A new trust region algorithm with trust region radius converging to zero . Proceedings of the 5th International Conference on Optimization: Techniques and Applications (ICOTA 2001, Hong Kong) . Edited by: Li , D. pp. 786 – 794 .
   Google Scholar
• Gratton , S. , Sartenaer , A. and Toint , Ph. L. 2008 . Recursive trust-region methods for multiscale nonlinear optimization . SIAM J. Optim. , 19 ( 1 ) : 414 – 444 .
   Web of Science ®Google Scholar
• Griewank , A. 1981 . “ The modification of Newton's method for unconstrained optimization by bounding cubic terms ” . Cambridge , , UK : Department of Applied Mathematics and Theoretical Physics, University of Cambridge . Tech. Rep. NA/12
   Google Scholar
• Nesterov , Yu. 2007 . Modified Gauss–Newton scheme with worst-case guarantees for global performance . Optim. Methods Softw. , 22 ( 3 ) : 469 – 483 .
   Web of Science ®Google Scholar
• Nesterov , Yu. and Polyak , B. T. 2006 . Cubic regularization of Newton method and its global performance . Math. Program. Ser. A , 108 ( 1 ) : 177 – 205 .
   Web of Science ®Google Scholar
• Nocedal , J. and Wright , S. J. 1999 . “ Numerical Optimization ” . In Series in Operations Research , Heidelberg, Berlin : Springer Verlag . New York
   Google Scholar
• Powell , M. J.D. 1970 . “ A new algorithm for unconstrained optimization ” . In Nonlinear Programming , Edited by: Rosen , J. B. , Mangasarian , O. L. and Ritter , K. 31 – 65 . London : Academic Press .
   Google Scholar
• Shultz , G. A. , Schnabel , R. B. and Byrd , R. H. 1985 . A family of trust-region-based algorithms for unconstrained minimization with strong global convergence properties . SIAM J. Numer. Anal. , 22 ( 1 ) : 47 – 67 .
   Web of Science ®Google Scholar
• Toint , Ph. L. 1988 . Global convergence of a class of trust region methods for nonconvex minimization in Hilbert space . IMA J. Numer. Anal. , 8 ( 2 ) : 231 – 252 .
   Web of Science ®Google Scholar
• Weiser , M. , Deuflhard , P. and Erdmann , B. 2007 . Affine conjugate adaptive Newton methods for nonlinear elastomechanics . Optim. Methods Softw. , 22 ( 3 ) : 413 – 431 .
   Web of Science ®Google Scholar
• Zhang , J. and Wang , Y. 2003 . A new trust region method for nonlinear equations . Math. Methods Oper. Res. , 58 : 283 – 298 .
   Web of Science ®Google Scholar