A closed-measure approach to stochastic approximation

References

• C.D. Aliprantis and K.C. Border, Infinite Dimensional Analysis: A Hitchhiker's Guide, Springer, Berlin, 2013.
   Google Scholar
• L. Ambrosio, N. Gigli, and G. Savaré, Gradient Flows in Metric Spaces and in the Space of Probability Measures, 2nd ed., Lectures in Mathematics ETH Zürich, Birkhäuser, Basel, 2008.
   Google Scholar
• J.-P. Aubin and A. Cellina, Differential Inclusions: Set-Valued Maps and Viability Theory, Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], Vol. 264, Springer, Berlin, 1984.
   Google Scholar
• A. Barakat, P. Bianchi, W. Hachem, and S. Schechtman, Stochastic optimization with momentum: Convergence, fluctuations, and traps avoidance, Electron. J. Stat. 15(2) (2021),pp. 3892–3947.
   Web of Science ®Google Scholar
• M. Benaïm, Dynamics of stochastic approximation algorithms, in Séminaire de Probabilités, XXXIII, Lecture Notes in Math., Vol. 1709, Springer, Berlin, 1999, pp. 1–68.
   Google Scholar
• M. Benaïm and M.W. Hirsch, Asymptotic pseudotrajectories and chain recurrent flows, with applications, J. Dynam. Differ. Equ. 8(1) (1996), pp. 141–176.
   Google Scholar
• M. Benaïm and S.J. Schreiber, Ergodic properties of weak asymptotic pseudotrajectories for semiflows, J. Dynam. Differ. Equ. 12(3) (2000), pp. 579–598.
   Google Scholar
• M. Benaïm, J. Hofbauer, and S. Sorin, Stochastic approximations and differential inclusions, SIAM J. Control Optim. 44(1) (2005), pp. 328–348. (electronic).
   Web of Science ®Google Scholar
• M. Benaïm, J. Hofbauer, and S. Sorin, Stochastic approximations and differential inclusions. II. Applications, Math. Oper. Res. 31(4) (2006), pp. 673–695.
   Web of Science ®Google Scholar
• P. Bernard, Young measures, superposition and transport, Indiana Univ. Math. J. 57(1) (2008), pp. 247–275.
   Web of Science ®Google Scholar
• J. Bolte and E. Pauwels, Conservative set valued fields, automatic differentiation, stochastic gradient methods and deep learning, Math. Program. 188 (2020), pp. 19–51.
   Web of Science ®Google Scholar
• J. Bolte, E. Pauwels, and R. Rios-Zertuche, Long term dynamics of the subgradient method for Lipschitz path differentiable functions, preprint, 2020; Available at arXiv:2006.00098.
   Google Scholar
• V.S. Borkar, Stochastic Approximation: A Dynamical Systems Viewpoint, Cambridge, Cambridge University Press, 2008.
   Google Scholar
• C. Castaing and M. Valadier, Convex Analysis and Measurable Multifunctions, Lecture Notes in Mathematics, Vol. 580, Springer, Berlin, 1977.
   Google Scholar
• F.H. Clarke. Optimization and nonsmooth analysis. Canadian Mathematical Society Series of Monographs and Advanced Texts. John Wiley & Sons, Inc., New York, 1983. A Wiley-Interscience Publication.
   Google Scholar
• M. Duflo, Algorithmes Stochastiques, Berlin, Heidelberg, Springer, 1996.
   Google Scholar
• M. Faure and G. Roth, Stochastic approximations of set-valued dynamical systems: Convergence with positive probability to an attractor, Math. Oper. Res. 35(3) (2010), pp. 624–640.
   Web of Science ®Google Scholar
• M. Faure and G. Roth, Ergodic properties of weak asymptotic pseudotrajectories for set-valued dynamical systems, Stoch. Dyn. 13(1) (2013), Article ID 1250011, 23 pp.
   Web of Science ®Google Scholar
• S. Gadat, F. Panloup, and S. Saadane, Stochastic heavy ball, Electron. J. Stat. 12(1) (2018),pp. 461–529.
   Web of Science ®Google Scholar
• A. Gaunersdorfer and J. Hofbauer, Fictitious play, shapley polygons, and the replicator equation, Games Econ. Behav. 11(2) (1995), pp. 279–303.
   Web of Science ®Google Scholar
• P. Hall and C. Heyde, Martingale Limit Theory and Its Application, Academic Press, 2014.
   Google Scholar
• J. Hofbauer, Deterministic evolutionary game dynamics, in Evolutionary Game Dynamics, Vol. 69, American Mathematical Society Providence, RI, 2011, pp. 61–79.
   Google Scholar
• J. Hofbauer and S. Sorin, Best response dynamics for continuous zero–sum games, Discrete Contin. Dyn. Syst. B 6(1) (2006), p. 215.
   Web of Science ®Google Scholar
• H.J. Kushner and G.G. Yin, Stochastic Approximation and Recursive Algorithms and Applications, 2nd ed., Applications of Mathematics (New York), Stochastic Modelling and Applied Probability, Vol. 35, Springer, New York, 2003.
   Google Scholar
• L. Ljung, Analysis of recursive stochastic algorithms, IEEE Trans. Automat. Contr. 22(4) (1977), pp. 551–575.
   Web of Science ®Google Scholar
• W. Miller and E. Akin, Invariant measures for set-valued dynamical systems, Trans. Amer. Math. Soc.351(3) (1999), pp. 1203–1225.
   Web of Science ®Google Scholar
• H. Robbins and S. Monro, A stochastic approximation method, in Herbert Robbins Selected Papers, Springer, 1985, pp. 102–109.
   Google Scholar