The Compact Law of the Iterated Logarithm for Multivariate Stochastic Approximation Algorithms

Abstract

We consider a sequence (Z _n ) _n≥1 defined by a general multivariate stochastic approximation algorithm and assume that (Z _n ) converges to a solution z* almost surely. We establish the compact law of the iterated logarithm for Z _n by proving that, with probability one, the limit set of the sequence (Z _n  − z*) suitably normalized is an ellipsoid. We also give the law of the iterated logarithm for the l ^p norms, p ∈ [1, ∞], of (Z _n  − z*).

Key Words:

• Law of the iterated logarithm
• Stochastic algorithm

Mathematics Subject Classification:

• 62L20
• 60F15
• 60F25

ACKNOWLEDGMENT

We thank the anonymous referee for his constructive comments.