Publication Cover
Optimization
A Journal of Mathematical Programming and Operations Research
Volume 73, 2024 - Issue 7
157
Views
1
CrossRef citations to date
0
Altmetric
Research Article

On the Arrow–Hurwicz differential system for linearly constrained convex minimization

ORCID Icon
Pages 2313-2345 | Received 12 Aug 2021, Accepted 27 Mar 2023, Published online: 24 May 2023

References

  • Ekeland I, Témam R. Convex analysis and variational problems. Philadelphia: Society for Industrial and Applied Mathematics; 1999. (Classics in applied mathematics).
  • Bauschke HH, Combettes PL. Convex analysis and monotone operator theory in Hilbert spaces. New York: Springer; 2017. (CMS books in mathematics).
  • Arrow KJ, Hurwicz L. A gradient method for approximating saddle points and constrained maxima. Santa Monica (CA): RAND Corp; 1951. p. 223.
  • Kose T. Solutions of saddle value problems by differential equations. Econometrica. 1956;24:59–70.
  • Arrow KJ, Hurwicz L, Uzawa H. Studies in linear and non-linear programming. Stanford (CA): Stanford University Press; 1958.
  • Minty GJ. Monotone (nonlinear) operators in Hilbert space. Duke Math J. 1962;29:341–346.
  • Rockafellar RT. Monotone operators associated with saddle-functions and minimax problems. In: Nonlinear functional analysis. Amer Math Soc; 1969. p. 241–250. (Providence (RI): Proceedings of symposia in pure math).
  • Rockafellar RT. Saddle-points and convex analysis. In: Differential games and related topics. Amsterdam: North-Holland; 1971. p. 109–127.
  • Crandall MG, Pazy A. Semi-groups of nonlinear contractions and dissipative sets. J Funct Anal. 1969;3:376–418.
  • Brézis H. Opérateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert. Amsterdam: North-Holland; 1973. (Mathematics Studies 5).
  • Kato T. Nonlinear semigroups and evolution equations. J Math Soc Japan. 1967;19:508–520.
  • Kōmura Y. Nonlinear semi-groups in Hilbert space. J Math Soc Japan. 1967;19:493–507.
  • Browder FE. Nonlinear operators and nonlinear equations of evolution in Banach spaces. In: Nonlinear functional analysis. Amer Math Soc; 1976. (Providence (RI): Proceedings of symposia in pure math).
  • Baillon JB, Brézis H. Une remarque sur le comportement asymptotique des semigroupes non linéaires. Houston J Math. 1976;2:5–7.
  • Venets VI. Continuous algorithms for solution of convex optimization problems and finding saddle points of convex-concave functions with the use of projection operators. Optimization. 1985;16:519–533.
  • Flåm SD, Ben-Israel A. Approximating saddle points as equilibria of differential inclusions. J Math Anal Appl. 1989;141:264–277.
  • Aubin JP, Cellina A. Differential inclusions. New York: Springer; 1984. (Grundlehren der mathematischen Wissenschaften 264).
  • Polyak BT. Iterative methods using Lagrange multipliers for solving extremal problems with constraints of the equation type. USSR Comput Math Math Phys. 1970;10:42–52.
  • Nemirovski AS, Yudin DB. Cesari convergence of the gradient method of approximating saddle points of convex-concave functions. Dokl Akad Nauk SSSR. 1978;239:1056–1059.
  • Bregman LM. The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Comput Math Math Phys. 1967;7:200–217.
  • Haraux A. Systèmes dynamiques dissipatifs et applications. Paris: Masson; 1991. (Recherches en Mathématiques Appliquées 17).
  • Pazy A. Semi-groups of nonlinear contractions and their asymptotic behavior. In: Nonlinear analysis and mechanics: Heriot-Watt symposium III. London: Pitman; 1979.p. 36–134.
  • Peypouquet J, Sorin S. Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time. J Convex Anal. 2010;17:1113–1163.
  • Passty GB. Ergodic convergence to a zero of the sum of monotone operators in Hilbert space. J Math Anal Appl. 1979;72:383–390.
  • Brézis H. Asymptotic behavior of some evolution systems. In: Nonlinear evolution equations, Madison, 1977. New York: Acad Press; 1978. p. 141–154.
  • Opial Z. Weak convergence of the sequence of successive approximations for nonexpansive mappings. Bull Amer Math Soc. 1967;73:591–597.
  • Bruck RE. Asymptotic convergence of nonlinear contraction semi-groups in Hilbert spaces. J Funct Anal. 1975;18:15–26.
  • Chbani Z, Riahi H. Existence and asymptotic behaviour for solutions of dynamical equilibrium systems. Evol Equ Control Theory. 2014;3:1–14.
  • Benzi M, Golub GH, Liesen J. Numerical solution of saddle point problems. Acta Numer. 2005;14:1–137.
  • Polyak BT. Some methods of speeding up the convergence of iteration methods. USSR Comput Math Math Phys. 1964;4:1–17.
  • Álvarez F. On the minimizing property of a second order dissipative system in Hilbert spaces. SIAM J Control Optim. 2000;38:1102–1119.
  • Attouch H, Goudou X, Redont P. The heavy ball with friction method, I. The continuous dynamical system: global exploration of the local minima of a real-valued function by asymptotic analysis of a dissipative dynamical system. Commun Contemp Math. 2000;2:1–34.
  • Attouch H, Chbani Z, Fadili J, et al. Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics. J Optim Theory Appl. 2022;193:704–736.
  • Boţ RI, Nguyen DK. Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping. J Differ Equ. 2021;303:369–406.
  • Nesterov Y. A method of solving a convex programming problem with convergence rate O(1/k2). Sov Math Dokl. 1983;27:372–376.
  • Su W, Boyd S, Candès E. A differential equation for modeling Nesterov's accelerated gradient method: theory and insights. J Mach Learn Res. 2016;17:1–43.
  • Hiriart-Urruty JB, Lemaréchal C. Convex analysis and minimization algorithms I. New York: Springer; 1993. (Grundlehren der mathematischen Wissenschaften 305).
  • Brézis H. Functional analysis, Sobolev spaces and partial differential equations. New York: Springer; 2011.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.