Advanced search
Publication Cover
Optimization Methods and Software Volume 24, 2009 - Issue 1
Submit an article Journal homepage
219
Views
11
CrossRef citations to date
0
Altmetric
Original Articles

Duality in quasi-Newton methods and new variational characterizations of the DFP and BFGS updates

Osman Güler Department of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, MD, USACorrespondence[email protected]
,
Filiz Gürtuna Department of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, MD, USA
&
Olena Shevchenko Department of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, MD, USA
Pages 45-62 | Received 19 Sep 2007, Published online: 04 Mar 2011

References

  • Broyden , C. G. 1971 . The convergence of an algorithm for solving sparse nonlinear systems . Math. Comp. , 25 : 285 – 294 .
  • Byrd , R. H. and Nocedal , J. 1989 . A tool for the analysis of quasi-Newton methods with application to unconstrained minimization . SIAM J. Numer. Anal. , 26 : 727 – 739 .
  • Courant , R. and Hilbert , D. 1953 . Methods of Mathematical Physics , Vol. I , New York, NY : Interscience Publishers, Inc .
  • Davidon , W. C. 1991 . Variable metric method for minimization . SIAM J. Optim. , 1 : 1 – 17 .
  • Dennis , J. E. Jr. and Moré , J. J. 1977 . Quasi-Newton methods, motivation and theory . SIAM Rev. , 19 : 46 – 89 .
  • Dennis , J. E. Jr. and Schnabel , R. B. 1979 . Least change secant updates for quasi-Newton methods . SIAM Rev. , 21 : 443 – 459 .
  • Dunford , N. and Schwartz , J. T. 1988 . Linear Operators, Part II , New York : Wiley Classics Library, John Wiley & Sons Inc . Spectral Theory. Selfadjoint Operators in Hilbert Space, with the assistance of William G. Bade, and Robert G. Bartle, reprint of the 1963 original. A Wiley-Interscience Publication
  • Fletcher , R. 1970 . A new approach to variable metric methods . Comput. J. , 13 : 317 – 322 .
  • Fletcher , R. 1991 . A new variational result for quasi-Newton formulae . SIAM J. Optim. , 1 : 18 – 21 .
  • Fletcher , R. 1995 . An optimal positive definite update for sparse Hessian matrices . SIAM J. Optim. , 5 : 192 – 218 .
  • Fletcher , R. and Powell , M. J.D. 1963/1964 . A rapidly convergent descent method for minimization . Comput. J. , 6 : 163 – 168 .
  • Goldfarb , D. 1970 . A family of variable-metric methods derived by variational means . Math. Comp. , 24 : 23 – 26 .
  • Greenstadt , J. 1970 . Variations on variable-metric methods (with discussion) . Math. Comp. , 24 : 1 – 22 .
  • Griewank , A. 1982 . A short proof of the Dennis–Schnabel theorem . BIT , 22 : 252 – 256 .
  • Griewank , A. 1987 . The local convergence of Broyden-like methods on Lipschitzian problems in Hilbert spaces . SIAM J. Numer. Anal. , 24 : 684 – 705 .
  • Kato , T. 1995 . Perturbation theory for linear operators, Classics in Mathematics , Berlin : Springer-Verlag . reprint of the 1980 edition
  • Kelley , C. T. and Sachs , E. W. 1987 . Quasi-Newton methods and unconstrained optimal control problems . SIAM J. Control Optim. , 25 : 1503 – 1516 .
  • Nocedal , J. 1992 . Theory of algorithms for unconstrained optimization, Acta numerica, 1992 , 199 – 242 . Cambridge : Cambridge University Press .
  • Oi , K. , Sayama , H. and Takamatsu , T. 1973 . Computational schemes of the Davidon–Fletcher–Powell method in infinite-dimensional space . J. Optim. Theor. Appl. , 12 : 447 – 458 .
  • Sachs , E. W. 1986 . Broyden's method in Hilbert space . Math. Program. , 35 : 71 – 82 .
  • Shanno , D. F. 1970 . Conditioning of quasi-Newton methods for function minimization . Math. Comp. , 24 : 647 – 656 .
  • Toint , P. L. 1977 . On sparse and symmetric matrix updating subject to a linear equation . Math. Comp. , 31 : 954 – 961 .

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.