References
- L. Armijo, Minimization of functions having Lipschitz continuous first partial derivatives, Pacific J. Math. 16 (1966), pp. 1–3. Available at http://projecteuclid.org/euclid.pjm/1102995080. MR 0191071. doi: 10.2140/pjm.1966.16.1
- A. Asl and M.L. Overton, Analysis of limited-memory BFGS on a class of nonsmooth convex functions, IMA J. Numer. Anal. (2019). Available at arXiv:1810.00292.
- D. Bertsekas, Nonlinear Programming, 2nd ed., Athena Scientific, Nashua, NH, 1999.
- J.V. Burke, A.S. Lewis, and M.L. Overton, A robust gradient sampling algorithm for nonsmooth, nonconvex optimization, SIAM J. Optim. 15 (2005), pp. 751–779. Available at http://dx.doi.org/10.1137/030601296. MR 2142859.
- J.V. Burke, F.E. Curtis, A.S. Lewis, M.L. Overton, and L.E.A. Simões, Gradient sampling methods for nonsmooth optimization, Submitted to Special methods for nonsmooth optimization, A. Bagirov, M. Gaudioso, N. Karmitsa and M. Mäkelä, eds., Springer, 2018. Available at arXiv:1804.11003v1.
- A. Cauchy, Méthode générale pour la résolution des systèmes d'équations simultanées, Comp. Rend. Sci. Paris. 25 (1847), pp. 135–163.
- F.E. Curtis, T. Mitchell, and M.L. Overton, A BFGS-SQP method for nonsmooth, nonconvex, constrained optimization and its evaluation using relative minimization profiles, Optim. Methods Softw. 32 (2017), pp. 148–181. Available at http://dx.doi.org/10.1080/10556788.2016.1208749.
- V.F. Dem'janov and V.N. Malozemov, The theory of nonlinear minimax problems, Uspehi Mat. Nauk 26 (1971), pp. 53–104. MR 0297378.
- R. Fletcher, Practical Methods of Optimization, 2nd ed., A Wiley-Interscience Publication, John Wiley & Sons, Ltd., Chichester, 1987. MR 955799.
- A. Greenbaum, A.S. Lewis, and M.L. Overton, Variational analysis of the Crouzeix ratio, Math. Program. 164 (2017), pp. 229–243. Available at http://dx.doi.org/10.1007/s10107-016-1083-6. MR 3661030.
- J. Guo and A. Lewis, Nonsmooth variants of Powell's BFGS convergence theorem, SIAM J. Optim. 28 (2018), pp. 1301–1311. Available at https://doi.org/10.1137/17M1121883.
- J.B. Hiriart-Urruty and C. Lemaréchal, Convex Analysis and Minimization Algorithms. I, Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences] Vol. 305, Springer-Verlag, Berlin, 1993. MR 1261420.
- K.C. Kiwiel, Methods of Descent for Nondifferentiable Optimization, Lecture Notes in Mathematics, Vol. 1133, Springer-Verlag, Berlin, 1985, Available at http://dx.doi.org/10.1007/BFb0074500. MR 797754.
- K.C. Kiwiel, C onvergence of the gradient sampling algorithm for nonsmooth nonconvex optimization, SIAM J. Optim. 18 (2007), pp. 379–388. Available at https://doi.org/10.1137/050639673.
- C. Lemaréchal, An extension of Davidon methods to non differentiable problems, Math. Programming Stud., 1975, pp. 95–109. MR 0436586.
- A.S. Lewis and M.L. Overton, Nonsmooth optimization via quasi-Newton methods, Math. Program. 141 (2013), pp. 135–163. Available at http://dx.doi.org/10.1007/s10107-012-0514-2. MR 3097282.
- D.C. Liu and J. Nocedal, On the limited memory BFGS method for large scale optimization, Math. Program. 45 (1989), pp. 503–528. Available at https://doi.org/10.1007/BF01589116. MR 1038245.
- A. Nedić and D.P. Bertsekas, Incremental subgradient methods for nondifferentiable optimization, SIAM J. Optim. 12 (2001), pp. 109–138. Available at https://doi.org/10.1137/S1052623499362111. MR 1870588.
- Y. Nesterov, Smooth minimization of non-smooth functions, Math. Program. 103 (2005), pp. 127–152. Available at http://dx.doi.org/10.1007/s10107-004-0552-5. MR 2166537.
- Y. Nesterov, Private communication (2016). Les Houches, France.
- J. Nocedal and S.J. Wright, Numerical Optimization, 2nd ed., Springer, New York, 2006.
- M.J.D. Powell, A view of unconstrained optimization, in Optimization in Action (Proc. Conf., Univ. Bristol, Bristol, 1975). Academic Press, London, 1976, pp. 117–152.
- M.J.D. Powell, Some global convergence properties of a variable metric algorithm for minimization without exact line searches, in Nonlinear Programming, SIAM-AMS Proc. Vol. IX, Amer. Math. Soc., Providence, 1976, pp. 53–72.
- N.Z. Shor, Minimization Methods for Non-differentiable Functions, Springer Series in Computational Mathematics, Springer, Berlin, 1985.
- A.B. Taylor, J.M. Hendrickx, and F. Glineur, Exact worst-case performance of first-order methods for composite convex optimization, SIAM J. Optim. 27 (2017), pp. 1283–1313. Available at https://doi.org/10.1137/16M108104X.
- P. Wolfe, Convergence conditions for ascent methods, SIAM Rev. 11 (1969), pp. 226–235. Available at http://dx.doi.org/10.1137/1011036. MR 0250453.
- P. Wolfe, A method of conjugate subgradients for minimizing nondifferentiable functions, Math. Programming Stud., 1975, pp. 145–173. MR 0448896.